Instructions to use acl-srw-2024/llama-3-8b-instruct-4bit-SCB-checkpoints with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use acl-srw-2024/llama-3-8b-instruct-4bit-SCB-checkpoints with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/llama-3-8b-Instruct-bnb-4bit") model = PeftModel.from_pretrained(base_model, "acl-srw-2024/llama-3-8b-instruct-4bit-SCB-checkpoints") - Notebooks
- Google Colab
- Kaggle
Download checkpoint-1197/optimizer.pt from acl-srw-2024/llama-3-8b-instruct-4bit-SCB-checkpoints: direct link, hf CLI and curl.
- Browser
- Download file 84.6 MB
-
https://huggingface.co/acl-srw-2024/llama-3-8b-instruct-4bit-SCB-checkpoints/resolve/6aaa36c429d3cc35152fc532ff27e51197808571/checkpoint-1197/optimizer.pt
- Command line
-
hf download hf://acl-srw-2024/llama-3-8b-instruct-4bit-SCB-checkpoints@6aaa36c429d3cc35152fc532ff27e51197808571/checkpoint-1197/optimizer.pt
-
curl -L -o optimizer.pt https://huggingface.co/acl-srw-2024/llama-3-8b-instruct-4bit-SCB-checkpoints/resolve/6aaa36c429d3cc35152fc532ff27e51197808571/checkpoint-1197/optimizer.pt
84.6 MB
- Xet hash:
- eb064727de4495493903283fc452caae4b53d0727a5a802ca7074d23afdb4f5e
- Size of remote file:
- 84.6 MB
- SHA256:
- cca3c460530b51b7e0dee8ac9072c7ba15e52cf6cbd895100da5322c08ab48a1
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.