How to use 3MPER0RR/GLM-4.6V-Flash-Lora-adapter-3MPER0RR-abliterated with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("./testllm") model = PeftModel.from_pretrained(base_model, "3MPER0RR/GLM-4.6V-Flash-Lora-adapter-3MPER0RR-abliterated")
How to use 3MPER0RR/GLM-4.6V-Flash-Lora-adapter-3MPER0RR-abliterated with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("3MPER0RR/GLM-4.6V-Flash-Lora-adapter-3MPER0RR-abliterated", device_map="auto")
The community tab is the place to discuss and collaborate with the HF community!
