Instructions to use amd/Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Lemonade
How to use amd/Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull amd/Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid
Run and chat with the model (requires XDNA 2 NPU)
lemonade run user.Exaone-3.5-2.4B-Instruct-onnx-ryzenai-hybrid
List all available models
lemonade list
metadata
license: mit
base_model:
- deepseek-ai/DeepSeek-R1-Distill-Llama-8B
tags:
- ryzenai-hybrid
amd/Exaone-3.5-2.4B-instruct-onnx-ryzenai-hybrid
Introduction
This model was prepared using the AMD Quark Quantization tool, followed by necessary post-processing. Model generated using Ryzen AI 1.6.0. Compiled ops for 3K context length support located indd_plugins. Thedd_pluginsdirectory must be one level above the root model directory to be properly found.