kamel-usp
/

jbcs2025_albertina-1b5-portuguese-ptbr-encoder-encoder_classification-C5-essay_only

Text Classification

Eval Results (legacy)

text-embeddings-inference

Model card Files Files and versions

jbcs2025_albertina-1b5-portuguese-ptbr-encoder-encoder_classification-C5-essay_only / README.md

abarbosa's picture

Pushing fine-tuned model to Hugging Face Hub

46296a2 verified about 1 year ago

|

History Blame Contribute Delete

1.25 kB


	---
	language:
	- pt
	- en
	tags:
	- aes
	datasets:
	- kamel-usp/aes_enem_dataset
	base_model: PORTULAN/albertina-1b5-portuguese-ptbr-encoder
	metrics:
	- accuracy
	- qwk
	library_name: transformers
	model-index:
	- name: albertina-1b5-portuguese-ptbr-encoder-encoder_classification-C5-essay_only
	results:
	- task:
	type: text-classification
	name: Automated Essay Score
	dataset:
	name: Automated Essay Score ENEM Dataset
	type: kamel-usp/aes_enem_dataset
	config: JBCS2025
	split: test
	metrics:
	- name: Macro F1
	type: f1
	value: 0.1530071129978623
	- name: QWK
	type: qwk
	value: 0.0289766746080115
	- name: Weighted Macro F1
	type: f1
	value: 0.1712828232958547
	---
	# Model ID: albertina-1b5-portuguese-ptbr-encoder-encoder_classification-C5-essay_only
	## Results
	\| \| test_data \|
	\|:-----------------\|------------:\|
	\| eval_accuracy \| 0.195652 \|
	\| eval_RMSE \| 76.7454 \|
	\| eval_QWK \| 0.0289767 \|
	\| eval_Macro_F1 \| 0.153007 \|
	\| eval_Weighted_F1 \| 0.171283 \|
	\| eval_Micro_F1 \| 0.195652 \|
	\| eval_HDIV \| 0.166667 \|