AntoineBourgois commited on
Commit
6064a11
·
verified ·
1 Parent(s): 57f35df

Upload 3 files

Browse files
Files changed (3) hide show
  1. JCLS_model_card.md +39 -39
  2. README.md +39 -39
  3. final_model.pkl +2 -2
JCLS_model_card.md CHANGED
@@ -31,9 +31,9 @@ The predicted entities are:
31
  ## MODEL PERFORMANCES (LOOCV):
32
  | NER_tag | precision | recall | f1_score | support | support % |
33
  |-----------|-------------|----------|------------|-----------|-------------|
34
- | PER | 92.54% | 95.54% | 94.02% | 4,061 | 100.00% |
35
- | micro_avg | 92.54% | 95.54% | 94.02% | 4,061 | 100.00% |
36
- | macro_avg | 92.54% | 95.54% | 94.02% | 4,061 | 100.00% |
37
 
38
  ## TRAINING PARAMETERS:
39
  - Entities types: ['PER']
@@ -70,46 +70,46 @@ Model Output: BIOES labels sequence
70
  *** IN CONSTRUCTION ***
71
 
72
  ## TRAINING CORPUS:
73
- | | Document | Tokens Count | Is included in model eval |
74
- |----|----------------------------------------------------------------|----------------|-----------------------------------|
75
- | 0 | 1731_Prévost-Antoine-François_Manon-Lescaut_PER-ONLY | 71,219 tokens | False |
76
- | 1 | 1832_Sand-George_Indiana_PER-ONLY | 112,221 tokens | False |
77
- | 2 | 1836_Gautier-Theophile_La-morte-amoureuse | 14,293 tokens | False |
78
- | 3 | 1840_Sand-George_Pauline | 12,398 tokens | False |
79
- | 4 | 1842_Balzac-Honore-de_La-Maison-du-chat-qui-pelote | 24,776 tokens | False |
80
- | 5 | 1844_Balzac-Honore-de_La-Maison-Nucingen | 30,034 tokens | False |
81
- | 6 | 1844_Balzac-Honore-de_Sarrasine | 15,408 tokens | False |
82
- | 7 | 1856_Cousin-Victor_Madame-de-Hautefort | 11,768 tokens | False |
83
- | 8 | 1863_Gautier-Theophile_Le-capitaine-Fracasse | 11,848 tokens | False |
84
- | 9 | 1873_Zola-Emile_Le-ventre-de-Paris | 12,613 tokens | False |
85
- | 10 | 1881_Flaubert-Gustave_Bouvard-et-Pecuchet | 12,308 tokens | False |
86
- | 11 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-1_1-MADEMOISELLE-FIFI | 5,439 tokens | True |
87
- | 12 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-1_2-MADAME-BAPTISTE | 2,578 tokens | True |
88
- | 13 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-1_3-LA-ROUILLE | 2,949 tokens | True |
89
- | 14 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-2_1-MARROCA | 4,078 tokens | False |
90
- | 15 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-2_2-LA-BUCHE | 2,267 tokens | False |
91
- | 16 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-2_3-LA-RELIQUE | 2,041 tokens | False |
92
- | 17 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-3_1-FOU | 1,905 tokens | False |
93
- | 18 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-3_2-REVEIL | 2,159 tokens | False |
94
- | 19 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-3_3-UNE-RUSE | 2,469 tokens | False |
95
- | 20 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-3_4-A-CHEVAL | 2,878 tokens | False |
96
- | 21 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-3_5-UN-REVEILLON | 2,358 tokens | False |
97
- | 22 | 1901_Lucie-Achard_Rosalie-de-Constant-sa-famille-et-ses-amis | 12,776 tokens | False |
98
- | 23 | 1903_Conan-Laure_Elisabeth_Seton | 13,046 tokens | False |
99
- | 24 | 1904_Rolland-Romain_Jean-Christophe_Tome-I-L-aube | 10,982 tokens | True |
100
- | 25 | 1904_Rolland-Romain_Jean-Christophe_Tome-II-Le-matin | 10,305 tokens | False |
101
- | 26 | 1917_Adèle-Bourgeois_Némoville | 12,468 tokens | False |
102
- | 27 | 1923_Delly_Dans-les-ruines | 95,617 tokens | False |
103
- | 28 | 1923_Radiguet-Raymond_Le-diable-au-corps | 14,850 tokens | False |
104
- | 29 | 1926_Audoux-Marguerite_De-la-ville-au-moulin | 12,083 tokens | True |
105
- | 30 | 1937_Audoux-Marguerite_Douce-Lumiere | 12,346 tokens | False |
106
- | 31 | TOTAL | 554,480 tokens | 5 files used for cross-validation |
107
 
108
  ## PREDICTIONS CONFUSION MATRIX:
109
  | Gold Labels | PER | O | support |
110
  |---------------|-------|-----|-----------|
111
- | PER | 3,880 | 181 | 4,061 |
112
- | O | 303 | 0 | 303 |
113
 
114
  ## CONTACT:
115
  mail: antoine [dot] bourgois [at] protonmail [dot] com
 
31
  ## MODEL PERFORMANCES (LOOCV):
32
  | NER_tag | precision | recall | f1_score | support | support % |
33
  |-----------|-------------|----------|------------|-----------|-------------|
34
+ | PER | 94.02% | 95.99% | 94.99% | 4,162 | 100.00% |
35
+ | micro_avg | 94.02% | 95.99% | 94.99% | 4,162 | 100.00% |
36
+ | macro_avg | 94.02% | 95.99% | 94.99% | 4,162 | 100.00% |
37
 
38
  ## TRAINING PARAMETERS:
39
  - Entities types: ['PER']
 
70
  *** IN CONSTRUCTION ***
71
 
72
  ## TRAINING CORPUS:
73
+ | | Document | Tokens Count | Is included in model eval |
74
+ |----|---------------------------------------------------------------------------------|----------------|-----------------------------------|
75
+ | 0 | 1731_Prévost-Antoine-François_Manon-Lescaut_PER-ONLY | 71,219 tokens | False |
76
+ | 1 | 1830_Balzac-Honoré-de_La-maison-du-chat-qui-pelote | 24,776 tokens | False |
77
+ | 2 | 1830_Balzac-Honoré-de_Sarrasine | 15,408 tokens | False |
78
+ | 3 | 1832_Sand-George_Indiana_PER-ONLY | 112,221 tokens | False |
79
+ | 4 | 1836_Gautier-Théophile_La-morte-amoureuse | 14,293 tokens | False |
80
+ | 5 | 1837_Balzac-Honoré-de_La-maison-Nucingen | 30,030 tokens | False |
81
+ | 6 | 1841_Sand-George_Pauline | 12,398 tokens | False |
82
+ | 7 | 1856_Cousin-Victor_Madame-de-Hautefort | 11,768 tokens | False |
83
+ | 8 | 1863_Gautier-Théophile_Le-capitaine-Fracasse | 11,848 tokens | False |
84
+ | 9 | 1873_Zola-Émile_Le-ventre-de-Paris | 12,613 tokens | False |
85
+ | 10 | 1881_Flaubert-Gustave_Bouvard-et-Pécuchet | 12,308 tokens | False |
86
+ | 11 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-buche | 2,267 tokens | False |
87
+ | 12 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-relique | 2,041 tokens | False |
88
+ | 13 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-rouille | 2,949 tokens | True |
89
+ | 14 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Madame-Baptiste | 2,578 tokens | True |
90
+ | 15 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Marocca | 4,078 tokens | False |
91
+ | 16 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-A-cheval | 2,878 tokens | False |
92
+ | 17 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Fou | 1,905 tokens | False |
93
+ | 18 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Mademoiselle-Fifi | 5,439 tokens | True |
94
+ | 19 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Reveil | 2,159 tokens | False |
95
+ | 20 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Un-reveillon | 2,364 tokens | False |
96
+ | 21 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Une-ruse | 2,469 tokens | False |
97
+ | 22 | 1901_Achard-Lucie_Rosalie-de-Constant-sa-famille-et-ses-amis | 12,775 tokens | False |
98
+ | 23 | 1903_Conan-Laure_Élisabeth-Seton | 13,046 tokens | False |
99
+ | 24 | 1904-1912_Rolland-Romain_Jean-Christophe(1) | 10,982 tokens | True |
100
+ | 25 | 1904-1912_Rolland-Romain_Jean-Christophe(2) | 10,305 tokens | False |
101
+ | 26 | 1917_Bourgeois-Adèle_Némoville | 12,468 tokens | False |
102
+ | 27 | 1923_Delly_Dans-les-ruines | 95,617 tokens | False |
103
+ | 28 | 1923_Radiguet-Raymond_Le-diable-au-corps | 14,850 tokens | False |
104
+ | 29 | 1926_Audoux-Marguerite_De-la-ville-au-moulin | 12,144 tokens | True |
105
+ | 30 | 1937_Audoux-Marguerite_Douce-Lumière | 12,346 tokens | False |
106
+ | 31 | TOTAL | 554,542 tokens | 5 files used for cross-validation |
107
 
108
  ## PREDICTIONS CONFUSION MATRIX:
109
  | Gold Labels | PER | O | support |
110
  |---------------|-------|-----|-----------|
111
+ | PER | 3,995 | 167 | 4,162 |
112
+ | O | 254 | 0 | 254 |
113
 
114
  ## CONTACT:
115
  mail: antoine [dot] bourgois [at] protonmail [dot] com
README.md CHANGED
@@ -31,9 +31,9 @@ The predicted entities are:
31
  ## MODEL PERFORMANCES (LOOCV):
32
  | NER_tag | precision | recall | f1_score | support | support % |
33
  |-----------|-------------|----------|------------|-----------|-------------|
34
- | PER | 93.92% | 94.71% | 94.31% | 71,106 | 100.00% |
35
- | micro_avg | 93.92% | 94.71% | 94.31% | 71,106 | 100.00% |
36
- | macro_avg | 93.92% | 94.71% | 94.31% | 71,106 | 100.00% |
37
 
38
  ## TRAINING PARAMETERS:
39
  - Entities types: ['PER']
@@ -70,46 +70,46 @@ Model Output: BIOES labels sequence
70
  *** IN CONSTRUCTION ***
71
 
72
  ## TRAINING CORPUS:
73
- | | Document | Tokens Count | Is included in model eval |
74
- |----|----------------------------------------------------------------|----------------|------------------------------------|
75
- | 0 | 1731_Prévost-Antoine-François_Manon-Lescaut_PER-ONLY | 71,219 tokens | True |
76
- | 1 | 1832_Sand-George_Indiana_PER-ONLY | 112,221 tokens | True |
77
- | 2 | 1836_Gautier-Theophile_La-morte-amoureuse | 14,293 tokens | True |
78
- | 3 | 1840_Sand-George_Pauline | 12,398 tokens | True |
79
- | 4 | 1842_Balzac-Honore-de_La-Maison-du-chat-qui-pelote | 24,776 tokens | True |
80
- | 5 | 1844_Balzac-Honore-de_La-Maison-Nucingen | 30,034 tokens | True |
81
- | 6 | 1844_Balzac-Honore-de_Sarrasine | 15,408 tokens | True |
82
- | 7 | 1856_Cousin-Victor_Madame-de-Hautefort | 11,768 tokens | True |
83
- | 8 | 1863_Gautier-Theophile_Le-capitaine-Fracasse | 11,848 tokens | True |
84
- | 9 | 1873_Zola-Emile_Le-ventre-de-Paris | 12,613 tokens | True |
85
- | 10 | 1881_Flaubert-Gustave_Bouvard-et-Pecuchet | 12,308 tokens | True |
86
- | 11 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-1_1-MADEMOISELLE-FIFI | 5,439 tokens | True |
87
- | 12 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-1_2-MADAME-BAPTISTE | 2,578 tokens | True |
88
- | 13 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-1_3-LA-ROUILLE | 2,949 tokens | True |
89
- | 14 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-2_1-MARROCA | 4,078 tokens | True |
90
- | 15 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-2_2-LA-BUCHE | 2,267 tokens | True |
91
- | 16 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-2_3-LA-RELIQUE | 2,041 tokens | True |
92
- | 17 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-3_1-FOU | 1,905 tokens | True |
93
- | 18 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-3_2-REVEIL | 2,159 tokens | True |
94
- | 19 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-3_3-UNE-RUSE | 2,469 tokens | True |
95
- | 20 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-3_4-A-CHEVAL | 2,878 tokens | True |
96
- | 21 | 1882_Guy-de-Maupassant_Mademoiselle-Fifi-3_5-UN-REVEILLON | 2,358 tokens | True |
97
- | 22 | 1901_Lucie-Achard_Rosalie-de-Constant-sa-famille-et-ses-amis | 12,776 tokens | True |
98
- | 23 | 1903_Conan-Laure_Elisabeth_Seton | 13,046 tokens | True |
99
- | 24 | 1904_Rolland-Romain_Jean-Christophe_Tome-I-L-aube | 10,982 tokens | True |
100
- | 25 | 1904_Rolland-Romain_Jean-Christophe_Tome-II-Le-matin | 10,305 tokens | True |
101
- | 26 | 1917_Adèle-Bourgeois_Némoville | 12,468 tokens | True |
102
- | 27 | 1923_Delly_Dans-les-ruines | 95,617 tokens | True |
103
- | 28 | 1923_Radiguet-Raymond_Le-diable-au-corps | 14,850 tokens | True |
104
- | 29 | 1926_Audoux-Marguerite_De-la-ville-au-moulin | 12,083 tokens | True |
105
- | 30 | 1937_Audoux-Marguerite_Douce-Lumiere | 12,346 tokens | True |
106
- | 31 | TOTAL | 554,480 tokens | 31 files used for cross-validation |
107
 
108
  ## PREDICTIONS CONFUSION MATRIX:
109
  | Gold Labels | PER | O | support |
110
  |---------------|--------|-------|-----------|
111
- | PER | 67,347 | 3,759 | 71,106 |
112
- | O | 4,234 | 0 | 4,234 |
113
 
114
  ## CONTACT:
115
  mail: antoine [dot] bourgois [at] protonmail [dot] com
 
31
  ## MODEL PERFORMANCES (LOOCV):
32
  | NER_tag | precision | recall | f1_score | support | support % |
33
  |-----------|-------------|----------|------------|-----------|-------------|
34
+ | PER | 94.58% | 95.16% | 94.87% | 71,738 | 100.00% |
35
+ | micro_avg | 94.58% | 95.16% | 94.87% | 71,738 | 100.00% |
36
+ | macro_avg | 94.58% | 95.16% | 94.87% | 71,738 | 100.00% |
37
 
38
  ## TRAINING PARAMETERS:
39
  - Entities types: ['PER']
 
70
  *** IN CONSTRUCTION ***
71
 
72
  ## TRAINING CORPUS:
73
+ | | Document | Tokens Count | Is included in model eval |
74
+ |----|---------------------------------------------------------------------------------|----------------|------------------------------------|
75
+ | 0 | 1731_Prévost-Antoine-François_Manon-Lescaut_PER-ONLY | 71,219 tokens | True |
76
+ | 1 | 1830_Balzac-Honoré-de_La-maison-du-chat-qui-pelote | 24,776 tokens | True |
77
+ | 2 | 1830_Balzac-Honoré-de_Sarrasine | 15,408 tokens | True |
78
+ | 3 | 1832_Sand-George_Indiana_PER-ONLY | 112,221 tokens | True |
79
+ | 4 | 1836_Gautier-Théophile_La-morte-amoureuse | 14,293 tokens | True |
80
+ | 5 | 1837_Balzac-Honoré-de_La-maison-Nucingen | 30,030 tokens | True |
81
+ | 6 | 1841_Sand-George_Pauline | 12,398 tokens | True |
82
+ | 7 | 1856_Cousin-Victor_Madame-de-Hautefort | 11,768 tokens | True |
83
+ | 8 | 1863_Gautier-Théophile_Le-capitaine-Fracasse | 11,848 tokens | True |
84
+ | 9 | 1873_Zola-Émile_Le-ventre-de-Paris | 12,613 tokens | True |
85
+ | 10 | 1881_Flaubert-Gustave_Bouvard-et-Pécuchet | 12,308 tokens | True |
86
+ | 11 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-buche | 2,267 tokens | True |
87
+ | 12 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-relique | 2,041 tokens | True |
88
+ | 13 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-La-rouille | 2,949 tokens | True |
89
+ | 14 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Madame-Baptiste | 2,578 tokens | True |
90
+ | 15 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Marocca | 4,078 tokens | True |
91
+ | 16 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-A-cheval | 2,878 tokens | True |
92
+ | 17 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Fou | 1,905 tokens | True |
93
+ | 18 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Mademoiselle-Fifi | 5,439 tokens | True |
94
+ | 19 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Reveil | 2,159 tokens | True |
95
+ | 20 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Un-reveillon | 2,364 tokens | True |
96
+ | 21 | 1882-1883_Maupassant-Guy-de_Mademoiselle-Fifi-Nouveaux-contes-Une-ruse | 2,469 tokens | True |
97
+ | 22 | 1901_Achard-Lucie_Rosalie-de-Constant-sa-famille-et-ses-amis | 12,775 tokens | True |
98
+ | 23 | 1903_Conan-Laure_Élisabeth-Seton | 13,046 tokens | True |
99
+ | 24 | 1904-1912_Rolland-Romain_Jean-Christophe(1) | 10,982 tokens | True |
100
+ | 25 | 1904-1912_Rolland-Romain_Jean-Christophe(2) | 10,305 tokens | True |
101
+ | 26 | 1917_Bourgeois-Adèle_Némoville | 12,468 tokens | True |
102
+ | 27 | 1923_Delly_Dans-les-ruines | 95,617 tokens | True |
103
+ | 28 | 1923_Radiguet-Raymond_Le-diable-au-corps | 14,850 tokens | True |
104
+ | 29 | 1926_Audoux-Marguerite_De-la-ville-au-moulin | 12,144 tokens | True |
105
+ | 30 | 1937_Audoux-Marguerite_Douce-Lumière | 12,346 tokens | True |
106
+ | 31 | TOTAL | 554,542 tokens | 31 files used for cross-validation |
107
 
108
  ## PREDICTIONS CONFUSION MATRIX:
109
  | Gold Labels | PER | O | support |
110
  |---------------|--------|-------|-----------|
111
+ | PER | 68,267 | 3,471 | 71,738 |
112
+ | O | 3,910 | 0 | 3,910 |
113
 
114
  ## CONTACT:
115
  mail: antoine [dot] bourgois [at] protonmail [dot] com
final_model.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8567e0cd0c44a63fb780202521e009610d951b2319251c4af1257e43dcc33abf
3
- size 121757607
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:116f5605f0bcd856a65a56123c76d67156460ad3532d03c04506f5627800de52
3
+ size 386227630