[Experimental] flan-t5-xxl (text encoder) (Pre-compiled for Snapdragon X Series(X/X2) NPU)
This repository provides a pre-compiled, optimized version of flan-t5-xxl running in fp16 precision, specifically designed to run 100% locally on the Snapdragon X Series NPU via ONNX Runtime with the QNN Execution Provider (QNN EP).
🛠️ How to Use
👉 GitHub: buuta-buta-butaata/SD35-with-Snapdragon-X-Elite-NPU
👥 Credits & Disclaimer
- Base Model: Huge thanks to Google for the amazing flan-t5-xxl.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for Buuta/flan-t5-xxl-for-Snapdragon-X-Series
Base model
google/flan-t5-xxl