File size: 1,028 Bytes
e7b7a5e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 | ---
language: en
library_name: transformers
base_model: roberta-base
tags:
- text-classification
- rte
- parameter-efficient-fine-tuning
---
# RoBERTa-base fine-tuned on GLUE RTE (lora)
This checkpoint is one learning experiment comparing Full Fine-Tuning,
BitFit, adapters, and LoRA on GLUE Recognizing Textual Entailment (RTE).
It uses seed 42 and selects the highest validation epoch.
| Metric | Value |
| --- | ---: |
| Best validation accuracy | 0.7148 |
| Best epoch | 6 |
| Trainable parameters | 887,042 |
| Total parameters | 125,534,212 |
## Method
`lora`. See the project README for the exact shared training configuration.
This is an educational experiment, not a benchmark-level performance claim.
## Load
```python
from peft import PeftModel
from transformers import AutoModelForSequenceClassification
base = AutoModelForSequenceClassification.from_pretrained("roberta-base", num_labels=2)
model = PeftModel.from_pretrained(base, "Anirudh7003/roberta-base-rte-lora")
```
|