How to use redcathode/fabricator with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.1-8B-Instruct") model = PeftModel.from_pretrained(base_model, "redcathode/fabricator")
https://huggingface.co/redcathode/fabricator/resolve/main/__pycache__/convert_hf_to_gguf.cpython-311.pyc
hf download hf://redcathode/fabricator/__pycache__/convert_hf_to_gguf.cpython-311.pyc
curl -L -o convert_hf_to_gguf.cpython-311.pyc https://huggingface.co/redcathode/fabricator/resolve/main/__pycache__/convert_hf_to_gguf.cpython-311.pyc
