LoRA-3MPER0RR-Abliterated-Q8_0-GGUF
Collection
2 items • Updated
How to use 3MPER0RR/phi-4-mini-LoRA-adapter-3MPER0RR-abliterated-Q8_0-GGUF with PEFT:
Task type is invalid.
How to use 3MPER0RR/phi-4-mini-LoRA-adapter-3MPER0RR-abliterated-Q8_0-GGUF with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("3MPER0RR/phi-4-mini-LoRA-adapter-3MPER0RR-abliterated-Q8_0-GGUF", device_map="auto")8-bit
Base model
microsoft/Phi-4-mini-instruct