Instructions to use Incomple/Llama-3.1-8B-Instruct_sft_sg_values_p005_OA_silver with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Incomple/Llama-3.1-8B-Instruct_sft_sg_values_p005_OA_silver with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.1-8B-Instruct") model = PeftModel.from_pretrained(base_model, "Incomple/Llama-3.1-8B-Instruct_sft_sg_values_p005_OA_silver") - Notebooks
- Google Colab
- Kaggle
| {"current_steps": 71, "total_steps": 1404, "loss": 0.436, "lr": 5.0354609929078e-07, "epoch": 0.05055179779280883, "percentage": 5.06, "elapsed_time": "0:01:54", "remaining_time": "0:35:54"} | |
| {"current_steps": 142, "total_steps": 1404, "loss": 0.4702, "lr": 9.992082343626285e-07, "epoch": 0.10110359558561766, "percentage": 10.11, "elapsed_time": "0:03:52", "remaining_time": "0:34:26"} | |
| {"current_steps": 213, "total_steps": 1404, "loss": 0.3861, "lr": 9.429928741092636e-07, "epoch": 0.15165539337842648, "percentage": 15.17, "elapsed_time": "0:05:47", "remaining_time": "0:32:24"} | |
| {"current_steps": 250, "total_steps": 1404, "eval_loss": 0.33530548214912415, "epoch": 0.17799928800284798, "percentage": 17.81, "elapsed_time": "0:07:19", "remaining_time": "0:33:50"} | |
| {"current_steps": 284, "total_steps": 1404, "loss": 0.3824, "lr": 8.867775138558986e-07, "epoch": 0.2022071911712353, "percentage": 20.23, "elapsed_time": "0:08:13", "remaining_time": "0:32:26"} | |
| {"current_steps": 355, "total_steps": 1404, "loss": 0.3494, "lr": 8.305621536025336e-07, "epoch": 0.25275898896404414, "percentage": 25.28, "elapsed_time": "0:10:10", "remaining_time": "0:30:04"} | |
| {"current_steps": 426, "total_steps": 1404, "loss": 0.3172, "lr": 7.743467933491686e-07, "epoch": 0.30331078675685297, "percentage": 30.34, "elapsed_time": "0:12:09", "remaining_time": "0:27:54"} | |
| {"current_steps": 497, "total_steps": 1404, "loss": 0.3075, "lr": 7.181314330958036e-07, "epoch": 0.3538625845496618, "percentage": 35.4, "elapsed_time": "0:14:07", "remaining_time": "0:25:45"} | |
| {"current_steps": 500, "total_steps": 1404, "eval_loss": 0.21360304951667786, "epoch": 0.35599857600569595, "percentage": 35.61, "elapsed_time": "0:14:40", "remaining_time": "0:26:31"} | |
| {"current_steps": 568, "total_steps": 1404, "loss": 0.2562, "lr": 6.619160728424386e-07, "epoch": 0.4044143823424706, "percentage": 40.46, "elapsed_time": "0:16:31", "remaining_time": "0:24:18"} | |
| {"current_steps": 639, "total_steps": 1404, "loss": 0.2832, "lr": 6.057007125890736e-07, "epoch": 0.45496618013527945, "percentage": 45.51, "elapsed_time": "0:18:31", "remaining_time": "0:22:10"} | |
| {"current_steps": 710, "total_steps": 1404, "loss": 0.2606, "lr": 5.494853523357086e-07, "epoch": 0.5055179779280883, "percentage": 50.57, "elapsed_time": "0:20:29", "remaining_time": "0:20:01"} | |
| {"current_steps": 750, "total_steps": 1404, "eval_loss": 0.1820104718208313, "epoch": 0.533997864008544, "percentage": 53.42, "elapsed_time": "0:22:02", "remaining_time": "0:19:13"} | |
| {"current_steps": 781, "total_steps": 1404, "loss": 0.2443, "lr": 4.932699920823436e-07, "epoch": 0.5560697757208971, "percentage": 55.63, "elapsed_time": "0:22:53", "remaining_time": "0:18:15"} | |
| {"current_steps": 852, "total_steps": 1404, "loss": 0.2421, "lr": 4.3705463182897863e-07, "epoch": 0.6066215735137059, "percentage": 60.68, "elapsed_time": "0:24:46", "remaining_time": "0:16:03"} | |
| {"current_steps": 923, "total_steps": 1404, "loss": 0.2301, "lr": 3.808392715756136e-07, "epoch": 0.6571733713065148, "percentage": 65.74, "elapsed_time": "0:26:45", "remaining_time": "0:13:56"} | |
| {"current_steps": 994, "total_steps": 1404, "loss": 0.2404, "lr": 3.246239113222486e-07, "epoch": 0.7077251690993236, "percentage": 70.8, "elapsed_time": "0:28:41", "remaining_time": "0:11:50"} | |
| {"current_steps": 1000, "total_steps": 1404, "eval_loss": 0.16689015924930573, "epoch": 0.7119971520113919, "percentage": 71.23, "elapsed_time": "0:29:21", "remaining_time": "0:11:51"} | |
| {"current_steps": 1065, "total_steps": 1404, "loss": 0.2535, "lr": 2.684085510688836e-07, "epoch": 0.7582769668921324, "percentage": 75.85, "elapsed_time": "0:31:09", "remaining_time": "0:09:55"} | |
| {"current_steps": 1136, "total_steps": 1404, "loss": 0.2323, "lr": 2.1219319081551858e-07, "epoch": 0.8088287646849412, "percentage": 80.91, "elapsed_time": "0:33:09", "remaining_time": "0:07:49"} | |
| {"current_steps": 1207, "total_steps": 1404, "loss": 0.257, "lr": 1.559778305621536e-07, "epoch": 0.8593805624777501, "percentage": 85.97, "elapsed_time": "0:35:14", "remaining_time": "0:05:45"} | |
| {"current_steps": 1250, "total_steps": 1404, "eval_loss": 0.16124244034290314, "epoch": 0.8899964400142399, "percentage": 89.03, "elapsed_time": "0:36:51", "remaining_time": "0:04:32"} | |
| {"current_steps": 1278, "total_steps": 1404, "loss": 0.2368, "lr": 9.976247030878859e-08, "epoch": 0.9099323602705589, "percentage": 91.03, "elapsed_time": "0:37:38", "remaining_time": "0:03:42"} | |
| {"current_steps": 1349, "total_steps": 1404, "loss": 0.217, "lr": 4.35471100554236e-08, "epoch": 0.9604841580633677, "percentage": 96.08, "elapsed_time": "0:39:37", "remaining_time": "0:01:36"} | |
| {"current_steps": 1404, "total_steps": 1404, "epoch": 0.9996440014239943, "percentage": 100.0, "elapsed_time": "0:41:12", "remaining_time": "0:00:00"} | |