Duplicated from marianbasti/Llama-3.2-3B-Orpheus-Rioplatense-1795
How to use surus-ai/Llama-3.2-3B-Orpheus-Rioplatense-1795 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-to-speech", model="surus-ai/Llama-3.2-3B-Orpheus-Rioplatense-1795")
# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("surus-ai/Llama-3.2-3B-Orpheus-Rioplatense-1795") model = AutoModelForCausalLM.from_pretrained("surus-ai/Llama-3.2-3B-Orpheus-Rioplatense-1795", device_map="auto")
