Instructions to use alsokit/Phi-3-medium-128K-LoRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use alsokit/Phi-3-medium-128K-LoRA with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-3-medium-128k-instruct") model = PeftModel.from_pretrained(base_model, "alsokit/Phi-3-medium-128K-LoRA") - Notebooks
- Google Colab
- Kaggle
| { | |
| "epoch": 2.9902912621359223, | |
| "num_input_tokens_seen": 61072080, | |
| "total_flos": 5.065534456681464e+18, | |
| "train_loss": 0.1973544524990635, | |
| "train_runtime": 23852.8939, | |
| "train_samples_per_second": 0.622, | |
| "train_steps_per_second": 0.019 | |
| } |