Upload 3 files
Browse files- JCLS_model_card.md +39 -39
- README.md +39 -39
- final_model.pkl +2 -2
JCLS_model_card.md
CHANGED
|
@@ -31,9 +31,9 @@ The predicted entities are:
|
|
| 31 |
## MODEL PERFORMANCES (LOOCV):
|
| 32 |
| NER_tag | precision | recall | f1_score | support | support % |
|
| 33 |
|-----------|-------------|----------|------------|-----------|-------------|
|
| 34 |
-
| PER |
|
| 35 |
-
| micro_avg |
|
| 36 |
-
| macro_avg |
|
| 37 |
|
| 38 |
## TRAINING PARAMETERS:
|
| 39 |
- Entities types: ['PER']
|
|
@@ -70,46 +70,46 @@ Model Output: BIOES labels sequence
|
|
| 70 |
*** IN CONSTRUCTION ***
|
| 71 |
|
| 72 |
## TRAINING CORPUS:
|
| 73 |
-
| | Document
|
| 74 |
-
|----|----------------------------------------------------------------|----------------|-----------------------------------|
|
| 75 |
-
| 0 | 1731_Prévost-Antoine-François_Manon-Lescaut_PER-ONLY
|
| 76 |
-
| 1 |
|
| 77 |
-
| 2 |
|
| 78 |
-
| 3 |
|
| 79 |
-
| 4 |
|
| 80 |
-
| 5 |
|
| 81 |
-
| 6 |
|
| 82 |
-
| 7 | 1856_Cousin-Victor_Madame-de-Hautefort
|
| 83 |
-
| 8 | 1863_Gautier-
|
| 84 |
-
| 9 | 1873_Zola-
|
| 85 |
-
| 10 | 1881_Flaubert-Gustave_Bouvard-et-
|
| 86 |
-
| 11 |
|
| 87 |
-
| 12 |
|
| 88 |
-
| 13 |
|
| 89 |
-
| 14 |
|
| 90 |
-
| 15 |
|
| 91 |
-
| 16 |
|
| 92 |
-
| 17 |
|
| 93 |
-
| 18 |
|
| 94 |
-
| 19 |
|
| 95 |
-
| 20 |
|
| 96 |
-
| 21 |
|
| 97 |
-
| 22 |
|
| 98 |
-
| 23 | 1903_Conan-
|
| 99 |
-
| 24 |
|
| 100 |
-
| 25 |
|
| 101 |
-
| 26 |
|
| 102 |
-
| 27 | 1923_Delly_Dans-les-ruines
|
| 103 |
-
| 28 | 1923_Radiguet-Raymond_Le-diable-au-corps
|
| 104 |
-
| 29 | 1926_Audoux-Marguerite_De-la-ville-au-moulin
|
| 105 |
-
| 30 | 1937_Audoux-Marguerite_Douce-
|
| 106 |
-
| 31 | TOTAL
|
| 107 |
|
| 108 |
## PREDICTIONS CONFUSION MATRIX:
|
| 109 |
| Gold Labels | PER | O | support |
|
| 110 |
|---------------|-------|-----|-----------|
|
| 111 |
-
| PER | 3,
|
| 112 |
-
| O |
|
| 113 |
|
| 114 |
## CONTACT:
|
| 115 |
mail: antoine [dot] bourgois [at] protonmail [dot] com
|
|
|
|
| 31 |
## MODEL PERFORMANCES (LOOCV):
|
| 32 |
| NER_tag | precision | recall | f1_score | support | support % |
|
| 33 |
|-----------|-------------|----------|------------|-----------|-------------|
|
| 34 |
+
| PER | 94.02% | 95.99% | 94.99% | 4,162 | 100.00% |
|
| 35 |
+
| micro_avg | 94.02% | 95.99% | 94.99% | 4,162 | 100.00% |
|
| 36 |
+
| macro_avg | 94.02% | 95.99% | 94.99% | 4,162 | 100.00% |
|
| 37 |
|
| 38 |
## TRAINING PARAMETERS:
|
| 39 |
- Entities types: ['PER']
|
|
|
|
| 70 |
*** IN CONSTRUCTION ***
|
| 71 |
|
| 72 |
## TRAINING CORPUS:
|
| 73 |
+
| | Document | Tokens Count | Is included in model eval |
|
| 74 |
+
|----|---------------------------------------------------------------------------------|----------------|-----------------------------------|
|
| 75 |
+
| 0 | 1731_Prévost-Antoine-François_Manon-Lescaut_PER-ONLY | 71,219 tokens | False |
|
| 76 |
+
| 1 | 1830_Balzac-Honoré-de_La-maison-du-chat-qui-pelote | 24,776 tokens | False |
|
| 77 |
+
| 2 | 1830_Balzac-Honoré-de_Sarrasine | 15,408 tokens | False |
|
| 78 |
+
| 3 | 1832_Sand-George_Indiana_PER-ONLY | 112,221 tokens | False |
|
| 79 |
+
| 4 | 1836_Gautier-Théophile_La-morte-amoureuse | 14,293 tokens | False |
|
| 80 |
+
| 5 | 1837_Balzac-Honoré-de_La-maison-Nucingen | 30,030 tokens | False |
|
| 81 |
+
| 6 | 1841_Sand-George_Pauline | 12,398 tokens | False |
|
| 82 |
+
| 7 | 1856_Cousin-Victor_Madame-de-Hautefort | 11,768 tokens | False |
|
| 83 |
+
| 8 | 1863_Gautier-Théophile_Le-capitaine-Fracasse | 11,848 tokens | False |
|
| 84 |
+
| 9 | 1873_Zola-Émile_Le-ventre-de-Paris | 12,613 tokens | False |
|
| 85 |
+
| 10 | 1881_Flaubert-Gustave_Bouvard-et-Pécuchet | 12,308 tokens | False |
|
| 86 |
+
| 11 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-buche | 2,267 tokens | False |
|
| 87 |
+
| 12 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-relique | 2,041 tokens | False |
|
| 88 |
+
| 13 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-rouille | 2,949 tokens | True |
|
| 89 |
+
| 14 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Madame-Baptiste | 2,578 tokens | True |
|
| 90 |
+
| 15 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Marocca | 4,078 tokens | False |
|
| 91 |
+
| 16 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-A-cheval | 2,878 tokens | False |
|
| 92 |
+
| 17 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Fou | 1,905 tokens | False |
|
| 93 |
+
| 18 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Mademoiselle-Fifi | 5,439 tokens | True |
|
| 94 |
+
| 19 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Reveil | 2,159 tokens | False |
|
| 95 |
+
| 20 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Un-reveillon | 2,364 tokens | False |
|
| 96 |
+
| 21 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Une-ruse | 2,469 tokens | False |
|
| 97 |
+
| 22 | 1901_Achard-Lucie_Rosalie-de-Constant-sa-famille-et-ses-amis | 12,775 tokens | False |
|
| 98 |
+
| 23 | 1903_Conan-Laure_Élisabeth-Seton | 13,046 tokens | False |
|
| 99 |
+
| 24 | 1904-1912_Rolland-Romain_Jean-Christophe(1) | 10,982 tokens | True |
|
| 100 |
+
| 25 | 1904-1912_Rolland-Romain_Jean-Christophe(2) | 10,305 tokens | False |
|
| 101 |
+
| 26 | 1917_Bourgeois-Adèle_Némoville | 12,468 tokens | False |
|
| 102 |
+
| 27 | 1923_Delly_Dans-les-ruines | 95,617 tokens | False |
|
| 103 |
+
| 28 | 1923_Radiguet-Raymond_Le-diable-au-corps | 14,850 tokens | False |
|
| 104 |
+
| 29 | 1926_Audoux-Marguerite_De-la-ville-au-moulin | 12,144 tokens | True |
|
| 105 |
+
| 30 | 1937_Audoux-Marguerite_Douce-Lumière | 12,346 tokens | False |
|
| 106 |
+
| 31 | TOTAL | 554,542 tokens | 5 files used for cross-validation |
|
| 107 |
|
| 108 |
## PREDICTIONS CONFUSION MATRIX:
|
| 109 |
| Gold Labels | PER | O | support |
|
| 110 |
|---------------|-------|-----|-----------|
|
| 111 |
+
| PER | 3,995 | 167 | 4,162 |
|
| 112 |
+
| O | 254 | 0 | 254 |
|
| 113 |
|
| 114 |
## CONTACT:
|
| 115 |
mail: antoine [dot] bourgois [at] protonmail [dot] com
|
README.md
CHANGED
|
@@ -31,9 +31,9 @@ The predicted entities are:
|
|
| 31 |
## MODEL PERFORMANCES (LOOCV):
|
| 32 |
| NER_tag | precision | recall | f1_score | support | support % |
|
| 33 |
|-----------|-------------|----------|------------|-----------|-------------|
|
| 34 |
-
| PER |
|
| 35 |
-
| micro_avg |
|
| 36 |
-
| macro_avg |
|
| 37 |
|
| 38 |
## TRAINING PARAMETERS:
|
| 39 |
- Entities types: ['PER']
|
|
@@ -70,46 +70,46 @@ Model Output: BIOES labels sequence
|
|
| 70 |
*** IN CONSTRUCTION ***
|
| 71 |
|
| 72 |
## TRAINING CORPUS:
|
| 73 |
-
| | Document
|
| 74 |
-
|----|----------------------------------------------------------------|----------------|------------------------------------|
|
| 75 |
-
| 0 | 1731_Prévost-Antoine-François_Manon-Lescaut_PER-ONLY
|
| 76 |
-
| 1 |
|
| 77 |
-
| 2 |
|
| 78 |
-
| 3 |
|
| 79 |
-
| 4 |
|
| 80 |
-
| 5 |
|
| 81 |
-
| 6 |
|
| 82 |
-
| 7 | 1856_Cousin-Victor_Madame-de-Hautefort
|
| 83 |
-
| 8 | 1863_Gautier-
|
| 84 |
-
| 9 | 1873_Zola-
|
| 85 |
-
| 10 | 1881_Flaubert-Gustave_Bouvard-et-
|
| 86 |
-
| 11 |
|
| 87 |
-
| 12 |
|
| 88 |
-
| 13 |
|
| 89 |
-
| 14 |
|
| 90 |
-
| 15 |
|
| 91 |
-
| 16 |
|
| 92 |
-
| 17 |
|
| 93 |
-
| 18 |
|
| 94 |
-
| 19 |
|
| 95 |
-
| 20 |
|
| 96 |
-
| 21 |
|
| 97 |
-
| 22 |
|
| 98 |
-
| 23 | 1903_Conan-
|
| 99 |
-
| 24 |
|
| 100 |
-
| 25 |
|
| 101 |
-
| 26 |
|
| 102 |
-
| 27 | 1923_Delly_Dans-les-ruines
|
| 103 |
-
| 28 | 1923_Radiguet-Raymond_Le-diable-au-corps
|
| 104 |
-
| 29 | 1926_Audoux-Marguerite_De-la-ville-au-moulin
|
| 105 |
-
| 30 | 1937_Audoux-Marguerite_Douce-
|
| 106 |
-
| 31 | TOTAL
|
| 107 |
|
| 108 |
## PREDICTIONS CONFUSION MATRIX:
|
| 109 |
| Gold Labels | PER | O | support |
|
| 110 |
|---------------|--------|-------|-----------|
|
| 111 |
-
| PER |
|
| 112 |
-
| O |
|
| 113 |
|
| 114 |
## CONTACT:
|
| 115 |
mail: antoine [dot] bourgois [at] protonmail [dot] com
|
|
|
|
| 31 |
## MODEL PERFORMANCES (LOOCV):
|
| 32 |
| NER_tag | precision | recall | f1_score | support | support % |
|
| 33 |
|-----------|-------------|----------|------------|-----------|-------------|
|
| 34 |
+
| PER | 94.58% | 95.16% | 94.87% | 71,738 | 100.00% |
|
| 35 |
+
| micro_avg | 94.58% | 95.16% | 94.87% | 71,738 | 100.00% |
|
| 36 |
+
| macro_avg | 94.58% | 95.16% | 94.87% | 71,738 | 100.00% |
|
| 37 |
|
| 38 |
## TRAINING PARAMETERS:
|
| 39 |
- Entities types: ['PER']
|
|
|
|
| 70 |
*** IN CONSTRUCTION ***
|
| 71 |
|
| 72 |
## TRAINING CORPUS:
|
| 73 |
+
| | Document | Tokens Count | Is included in model eval |
|
| 74 |
+
|----|---------------------------------------------------------------------------------|----------------|------------------------------------|
|
| 75 |
+
| 0 | 1731_Prévost-Antoine-François_Manon-Lescaut_PER-ONLY | 71,219 tokens | True |
|
| 76 |
+
| 1 | 1830_Balzac-Honoré-de_La-maison-du-chat-qui-pelote | 24,776 tokens | True |
|
| 77 |
+
| 2 | 1830_Balzac-Honoré-de_Sarrasine | 15,408 tokens | True |
|
| 78 |
+
| 3 | 1832_Sand-George_Indiana_PER-ONLY | 112,221 tokens | True |
|
| 79 |
+
| 4 | 1836_Gautier-Théophile_La-morte-amoureuse | 14,293 tokens | True |
|
| 80 |
+
| 5 | 1837_Balzac-Honoré-de_La-maison-Nucingen | 30,030 tokens | True |
|
| 81 |
+
| 6 | 1841_Sand-George_Pauline | 12,398 tokens | True |
|
| 82 |
+
| 7 | 1856_Cousin-Victor_Madame-de-Hautefort | 11,768 tokens | True |
|
| 83 |
+
| 8 | 1863_Gautier-Théophile_Le-capitaine-Fracasse | 11,848 tokens | True |
|
| 84 |
+
| 9 | 1873_Zola-Émile_Le-ventre-de-Paris | 12,613 tokens | True |
|
| 85 |
+
| 10 | 1881_Flaubert-Gustave_Bouvard-et-Pécuchet | 12,308 tokens | True |
|
| 86 |
+
| 11 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-buche | 2,267 tokens | True |
|
| 87 |
+
| 12 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-relique | 2,041 tokens | True |
|
| 88 |
+
| 13 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-rouille | 2,949 tokens | True |
|
| 89 |
+
| 14 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Madame-Baptiste | 2,578 tokens | True |
|
| 90 |
+
| 15 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Marocca | 4,078 tokens | True |
|
| 91 |
+
| 16 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-A-cheval | 2,878 tokens | True |
|
| 92 |
+
| 17 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Fou | 1,905 tokens | True |
|
| 93 |
+
| 18 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Mademoiselle-Fifi | 5,439 tokens | True |
|
| 94 |
+
| 19 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Reveil | 2,159 tokens | True |
|
| 95 |
+
| 20 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Un-reveillon | 2,364 tokens | True |
|
| 96 |
+
| 21 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Une-ruse | 2,469 tokens | True |
|
| 97 |
+
| 22 | 1901_Achard-Lucie_Rosalie-de-Constant-sa-famille-et-ses-amis | 12,775 tokens | True |
|
| 98 |
+
| 23 | 1903_Conan-Laure_Élisabeth-Seton | 13,046 tokens | True |
|
| 99 |
+
| 24 | 1904-1912_Rolland-Romain_Jean-Christophe(1) | 10,982 tokens | True |
|
| 100 |
+
| 25 | 1904-1912_Rolland-Romain_Jean-Christophe(2) | 10,305 tokens | True |
|
| 101 |
+
| 26 | 1917_Bourgeois-Adèle_Némoville | 12,468 tokens | True |
|
| 102 |
+
| 27 | 1923_Delly_Dans-les-ruines | 95,617 tokens | True |
|
| 103 |
+
| 28 | 1923_Radiguet-Raymond_Le-diable-au-corps | 14,850 tokens | True |
|
| 104 |
+
| 29 | 1926_Audoux-Marguerite_De-la-ville-au-moulin | 12,144 tokens | True |
|
| 105 |
+
| 30 | 1937_Audoux-Marguerite_Douce-Lumière | 12,346 tokens | True |
|
| 106 |
+
| 31 | TOTAL | 554,542 tokens | 31 files used for cross-validation |
|
| 107 |
|
| 108 |
## PREDICTIONS CONFUSION MATRIX:
|
| 109 |
| Gold Labels | PER | O | support |
|
| 110 |
|---------------|--------|-------|-----------|
|
| 111 |
+
| PER | 68,267 | 3,471 | 71,738 |
|
| 112 |
+
| O | 3,910 | 0 | 3,910 |
|
| 113 |
|
| 114 |
## CONTACT:
|
| 115 |
mail: antoine [dot] bourgois [at] protonmail [dot] com
|
final_model.pkl
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:116f5605f0bcd856a65a56123c76d67156460ad3532d03c04506f5627800de52
|
| 3 |
+
size 386227630
|