Token Classification
Transformers
Safetensors
Korean
English
openai_privacy_filter
ner
pii
privacy
pii-masking
korean
english
finance
customer-service
security
infrastructure
bioes
viterbi
mixture-of-experts
Instructions to use BCCard/MoAI-Privacy-Filter with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use BCCard/MoAI-Privacy-Filter with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="BCCard/MoAI-Privacy-Filter")# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("BCCard/MoAI-Privacy-Filter") model = AutoModelForTokenClassification.from_pretrained("BCCard/MoAI-Privacy-Filter", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update model card
Browse files
README.md
CHANGED
|
@@ -163,7 +163,7 @@ The dataset combines relabeled rows from [`ai4privacy/pii-masking-openpii-1.5m`]
|
|
| 163 |
### 4.2. Procedure
|
| 164 |
|
| 165 |
<div align="center">
|
| 166 |
-
<img src="figures/
|
| 167 |
</div>
|
| 168 |
|
| 169 |
| Item | Value |
|
|
@@ -204,7 +204,7 @@ The headline metrics are language-slice strict micro Precision, Recall, and F1.
|
|
| 204 |
### 5.2. Results
|
| 205 |
|
| 206 |
<div align="center">
|
| 207 |
-
<img src="figures/
|
| 208 |
</div>
|
| 209 |
|
| 210 |
| Language | Validation P | Validation R | Validation F1 | Golden P | Golden R | Golden F1 | F1 Difference |
|
|
|
|
| 163 |
### 4.2. Procedure
|
| 164 |
|
| 165 |
<div align="center">
|
| 166 |
+
<img src="figures/evaluation-train-1-1.png" alt="Training loss, learning rate, and gradient norm by training step">
|
| 167 |
</div>
|
| 168 |
|
| 169 |
| Item | Value |
|
|
|
|
| 204 |
### 5.2. Results
|
| 205 |
|
| 206 |
<div align="center">
|
| 207 |
+
<img src="figures/evaluation-test-1-1.png" alt="Validation precision, recall, micro F1, and macro F1 by training step">
|
| 208 |
</div>
|
| 209 |
|
| 210 |
| Language | Validation P | Validation R | Validation F1 | Golden P | Golden R | Golden F1 | F1 Difference |
|