How to use alicekyting/Qwen2-Audio-7B-Instruct-4bit with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("alicekyting/Qwen2-Audio-7B-Instruct-4bit") model = AutoModelForMultimodalLM.from_pretrained("alicekyting/Qwen2-Audio-7B-Instruct-4bit", device_map="auto")
ckolozsy