How to use theunlikely/t5-v1_1-xxl-fp16 with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("theunlikely/t5-v1_1-xxl-fp16") model = AutoModel.from_pretrained("theunlikely/t5-v1_1-xxl-fp16", device_map="auto")
No model card
Files info
# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("theunlikely/t5-v1_1-xxl-fp16") model = AutoModel.from_pretrained("theunlikely/t5-v1_1-xxl-fp16", device_map="auto")