| ### t5-base finetuned on xsum dataset |
|
|
| #### train args<br> |
| max_input_length: 512<br> |
| max_tgt_length: 128<br> |
| epoch: 3<br> |
| optimizer: AdamW<br> |
| lr: 2e-5<br> |
| weight_decay: 1e-3<br> |
| fp16: False<br> |
| prefix: "summarize: "<br> |
| |
| #### performance<br> |
| train_loss 0.5976<br> |
| eval_loss: 0.5340<br> |
| eval_rouge1: 34.6791<br> |
| eval_rouge2: 12.8236<br> |
| eval_rougeL: 28.1201<br> |
| eval_rougeLsum: 28.1241<br> |
| |
| |
| #### usage<br> |
| from transformers import AutoTokenizer, AutoModelForSeq2SeqLM<br> |
| |
| #### dependency<br> |
| trained with transformers==4.24<br> |
| compatible with transformers==3.0.2<br> |
