Instructions to use kamel-usp/jbcs2025_Llama-3.1-8B-llama31_classification_lora-C2-essay_only-r16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use kamel-usp/jbcs2025_Llama-3.1-8B-llama31_classification_lora-C2-essay_only-r16 with PEFT:
from peft import PeftModel from transformers import AutoModelForSequenceClassification base_model = AutoModelForSequenceClassification.from_pretrained("meta-llama/Llama-3.1-8B") model = PeftModel.from_pretrained(base_model, "kamel-usp/jbcs2025_Llama-3.1-8B-llama31_classification_lora-C2-essay_only-r16") - Notebooks
- Google Colab
- Kaggle
File size: 1,189 Bytes
edb6a4f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 |
---
language:
- pt
- en
tags:
- aes
datasets:
- kamel-usp/aes_enem_dataset
base_model: meta-llama/Llama-3.1-8B
metrics:
- accuracy
- qwk
library_name: peft
model-index:
- name: Llama-3.1-8B-llama31_classification_lora-C2-essay_only-r16
results:
- task:
type: text-classification
name: Automated Essay Score
dataset:
name: Automated Essay Score ENEM Dataset
type: kamel-usp/aes_enem_dataset
config: JBCS2025
split: test
metrics:
- name: Macro F1
type: f1
value: 0.2581516901023498
- name: QWK
type: qwk
value: 0.3419510513615995
- name: Weighted Macro F1
type: f1
value: 0.3584808341162131
---
# Model ID: Llama-3.1-8B-llama31_classification_lora-C2-essay_only-r16
## Results
| | test_data |
|:-----------------|------------:|
| eval_accuracy | 0.326087 |
| eval_RMSE | 62.0425 |
| eval_QWK | 0.341951 |
| eval_Macro_F1 | 0.258152 |
| eval_Weighted_F1 | 0.358481 |
| eval_Micro_F1 | 0.326087 |
| eval_HDIV | 0.101449 |
|