Instructions to use hattran/gpt2-vn-PROMPT_TUNING_CAUSAL_LM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use hattran/gpt2-vn-PROMPT_TUNING_CAUSAL_LM with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("NlpHUST/gpt2-vietnamese") model = PeftModel.from_pretrained(base_model, "hattran/gpt2-vn-PROMPT_TUNING_CAUSAL_LM") - Notebooks
- Google Colab
- Kaggle
| { | |
| "auto_mapping": null, | |
| "base_model_name_or_path": "NlpHUST/gpt2-vietnamese", | |
| "inference_mode": true, | |
| "num_attention_heads": 12, | |
| "num_layers": 12, | |
| "num_transformer_submodules": 1, | |
| "num_virtual_tokens": 30, | |
| "peft_type": "PROMPT_TUNING", | |
| "prompt_tuning_init": "TEXT", | |
| "prompt_tuning_init_text": "B\u1ea1n l\u00e0 chuy\u00ean gia v\u1ec1 Lu\u1eadt, tr\u1ea3 l\u1eddi t\u1ea5t c\u1ea3 c\u00e2u h\u1ecfi d\u1ef1a tr\u00ean n\u1ed9i dung t\u1eeb \"START CONTEXT\" t\u1edbi \"END CONTEXT\".", | |
| "revision": null, | |
| "task_type": "CAUSAL_LM", | |
| "token_dim": 768, | |
| "tokenizer_name_or_path": "NlpHUST/gpt2-vietnamese" | |
| } |