cedricbonhomme commited on
Commit
b663955
·
verified ·
1 Parent(s): 1f4c42f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -24
README.md CHANGED
@@ -1,37 +1,29 @@
1
  ---
 
 
 
2
  library_name: transformers
3
- base_model: ai-forever/ruRoberta-large
4
  tags:
 
 
 
 
 
5
  - generated_from_trainer
6
- metrics:
7
- - accuracy
8
- model-index:
9
- - name: vulnerability-severity-classification-russian-ruRoberta-large
10
- results: []
11
  ---
12
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
  should probably proofread and complete it, then remove this comment. -->
15
 
16
- # vulnerability-severity-classification-russian-ruRoberta-large
17
 
18
- This model is a fine-tuned version of [ai-forever/ruRoberta-large](https://huggingface.co/ai-forever/ruRoberta-large) on an unknown dataset.
19
- It achieves the following results on the evaluation set:
20
- - Loss: 2.6495
21
- - Accuracy: 0.7417
22
- - F1 Macro: 0.6650
23
- - Low Precision: 0.6154
24
- - Low Recall: 0.3380
25
- - Low F1: 0.4364
26
- - Medium Precision: 0.7619
27
- - Medium Recall: 0.8312
28
- - Medium F1: 0.7951
29
- - High Precision: 0.6869
30
- - High Recall: 0.6080
31
- - High F1: 0.6450
32
- - Critical Precision: 0.7678
33
- - Critical Recall: 0.7996
34
- - Critical F1: 0.7834
35
 
36
  ## Model description
37
 
@@ -58,6 +50,24 @@ The following hyperparameters were used during training:
58
  - lr_scheduler_type: linear
59
  - num_epochs: 5
60
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
61
  ### Training results
62
 
63
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Macro | Low Precision | Low Recall | Low F1 | Medium Precision | Medium Recall | Medium F1 | High Precision | High Recall | High F1 | Critical Precision | Critical Recall | Critical F1 |
 
1
  ---
2
+ language:
3
+ - ru
4
+ license: apache-2.0
5
  library_name: transformers
 
6
  tags:
7
+ - text-classification
8
+ - vulnerability
9
+ - severity
10
+ - cybersecurity
11
+ - fstec
12
  - generated_from_trainer
13
+ datasets:
14
+ - CIRCL/Vulnerability-FSTEC
15
+ base_model: ai-forever/ruRoberta-large
16
+ pipeline_tag: text-classification
 
17
  ---
18
 
19
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
20
  should probably proofread and complete it, then remove this comment. -->
21
 
22
+ # VLAI: Automated Vulnerability Severity Classification (Chinese Text)
23
 
24
+ A fine-tuned [ai-forever/ruRoberta-large](https://huggingface.co/ai-forever/ruRoberta-large) model for classifying Russian vulnerability descriptions from the [FSTEC](https://vulnerability.circl.lu/recent#fstec).
25
+
26
+ Trained on the [CIRCL/Vulnerability-FSTEC](https://huggingface.co/datasets/CIRCL/Vulnerability-FSTEC) dataset as part of the [VulnTrain](https://github.com/vulnerability-lookup/VulnTrain) project.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
 
28
  ## Model description
29
 
 
50
  - lr_scheduler_type: linear
51
  - num_epochs: 5
52
 
53
+ It achieves the following results on the evaluation set:
54
+ - Loss: 2.6495
55
+ - Accuracy: 0.7417
56
+ - F1 Macro: 0.6650
57
+ - Low Precision: 0.6154
58
+ - Low Recall: 0.3380
59
+ - Low F1: 0.4364
60
+ - Medium Precision: 0.7619
61
+ - Medium Recall: 0.8312
62
+ - Medium F1: 0.7951
63
+ - High Precision: 0.6869
64
+ - High Recall: 0.6080
65
+ - High F1: 0.6450
66
+ - Critical Precision: 0.7678
67
+ - Critical Recall: 0.7996
68
+ - Critical F1: 0.7834
69
+
70
+
71
  ### Training results
72
 
73
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Macro | Low Precision | Low Recall | Low F1 | Medium Precision | Medium Recall | Medium F1 | High Precision | High Recall | High F1 | Critical Precision | Critical Recall | Critical F1 |