Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

151

Base only

Active filters: rk3588

Pelochus/deepseek-R1-distill-qwen-1.5B

Updated May 28, 2025 • 22

Prince-1/SmolVLM-Instruct-GGUF-RKllm

Image-Text-to-Text • Updated Jun 17, 2025 • 5

Prince-1/Veena-RKllm

Text-to-Speech • Updated Jun 26, 2025 • 15 • 1

Prince-1/Mellum-RKllm

Updated Jun 28, 2025 • 16

Prince-1/DeepHermes-3-RKllm

Updated Jun 28, 2025 • 1

Prince-1/Osmosis-Structure-0.6-RKllm

Updated Jun 28, 2025 • 12

Prince-1/Osmosis-Mcp-Rkllm

Updated Jun 28, 2025 • 2

Prince-1/Gabliterated-Qwen3-RKllm

Updated Jun 28, 2025 • 18

Prince-1/TinyLlama-1.1B-Chat-v1.0-RKLLM

Updated Jun 30, 2025 • 2 • 1

Prince-1/medgemma-4b-pt

Image-Text-to-Text • Updated Jul 4, 2025 • 14

Prince-1/Chatglm3-6b

Updated Jul 4, 2025 • 10

Prince-1/Qwen3-1.7B-RKllm

Updated Jul 4, 2025 • 18 • 1

Prince-1/Gemma-3-12b-pt-RKLlm

Updated Jul 4, 2025 • 7 • 1

Prince-1/Seed-Coder-8B-Instruct-RKllm

Text Generation • Updated Jul 4, 2025 • 10

Prince-1/Llama-OuteTTS-1.0-1B-RKllm

Text-to-Speech • Updated Jul 4, 2025 • 9 • 1

jamescallander/deepseek-llm-7b-chat_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 15

jamescallander/txgemma-9b-chat_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 12

jamescallander/NextCoder-7B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 27, 2025 • 6 • 1

jamescallander/Qwen2.5-Math-1.5B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 12

jamescallander/MediPhi-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 6, 2025 • 1

jamescallander/Qwen2.5-Coder-3B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 62 • 2

jamescallander/Llama-3.1-8B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 9, 2025 • 32

jamescallander/MiniCPM4-0.5B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 31

jamescallander/TinyLlama-1.1B-Chat-v1.0_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 18 • 2

jamescallander/MediPhi-PubMed_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 21 • 1

jamescallander/medgemma-4b-it_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 6, 2025 • 3 • 1

jamescallander/Qwen2.5-Math-7B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 6, 2025 • 11

jamescallander/deepseek-coder-1.3b-instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 19, 2025 • 22

jamescallander/MiniCPM3-4B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 8, 2025 • 14 • 1

jamescallander/Llama-3.2-3B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 9, 2025 • 29