Quantized Open Models - a Sohailhosseini Collection

Sohailhosseini 's Collections

Quantized Open Models

Quantized Open Models

updated 12 days ago

Quantized open-weight models, reproducible recipes.

Sohailhosseini/OpenThinker3-7B-FP8

Text Generation • 8B • Updated 12 days ago • 857

Note FP8 of open-thoughts/OpenThinker3-7B
Sohailhosseini/OpenThinker3-7B-AWQ-W4A16

Text Generation • 8B • Updated 12 days ago • 62

Note AWQ-W4A16 of open-thoughts/OpenThinker3-7B
Sohailhosseini/Qwen3-4B-NVFP4

Text Generation • 4B • Updated 12 days ago • 453

Note NVFP4 of Qwen/Qwen3-4B
Sohailhosseini/Nanbeige4.1-3B-W8A8-INT8

Text Generation • 4B • Updated 12 days ago • 68

Note W8A8-INT8 of Nanbeige/Nanbeige4.1-3B
Sohailhosseini/Qwen3-4B-Base-FP8

Text Generation • 4B • Updated 12 days ago • 27

Note serve-verified
Sohailhosseini/Qwen3.8-9B-Distill-AWQ-W4A16

Image-Text-to-Text • 9B • Updated 12 days ago • 1.85k

Note serve-verified
Sohailhosseini/Ornith-1.5-9B-AWQ-W4A16

Image-Text-to-Text • 9B • Updated 12 days ago • 1.89k

Note serve-verified
Sohailhosseini/Qwen3.8-9B-Distill-FP8

Image-Text-to-Text • 9B • Updated 12 days ago • 17.4k

Note serve-verified
Sohailhosseini/Ornith-1.5-9B-FP8

Image-Text-to-Text • 9B • Updated 12 days ago • 340 • 1

Note serve-verified
Sohailhosseini/Carnice-9b-AWQ-W4A16

Text Generation • 9B • Updated 12 days ago • 58

Note serve-verified
Sohailhosseini/Carnice-9b-FP8

Text Generation • 9B • Updated 12 days ago • 40

Note serve-verified
Sohailhosseini/UI-Mate-27B-AWQ-W4A16

Image-Text-to-Text • 27B • Updated 12 days ago • 56 • 1

Note serve-verified
Sohailhosseini/UI-Mate-27B-FP8

Image-Text-to-Text • 27B • Updated 12 days ago • 35

Note serve-verified
Sohailhosseini/UI-Mate-9B-AWQ-W4A16

Image-Text-to-Text • 3B • Updated 12 days ago • 32

Note serve-verified
Sohailhosseini/UI-Mate-9B-FP8

Image-Text-to-Text • 9B • Updated 12 days ago • 35

Note serve-verified
Sohailhosseini/Ornith-1.0-9B-FP8

Image-Text-to-Text • 9B • Updated 12 days ago • 31

Note serve-verified
Sohailhosseini/Qwopus3.5-9B-Coder-FP8

Image-Text-to-Text • 9B • Updated 12 days ago • 31

Note serve-verified
Sohailhosseini/Qwen3.5-9B-GLM5.1-Distill-v1-FP8

Image-Text-to-Text • 9B • Updated 12 days ago • 46

Note serve-verified
Sohailhosseini/Qwopus3.5-9B-v3-FP8

Image-Text-to-Text • 9B • Updated 12 days ago • 29

Note serve-verified
Sohailhosseini/chandra-ocr-2-AWQ-W4A16

Image-Text-to-Text • 5B • Updated 12 days ago • 108 • 1

Note serve-verified
Sohailhosseini/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-FP8

Image-Text-to-Text • 9B • Updated 12 days ago • 28

Note serve-verified
Sohailhosseini/NuExtract3-AWQ-W4A16

Image-Text-to-Text • 5B • Updated 12 days ago • 48

Note serve-verified
Sohailhosseini/DeepSeek-V4-Pro-Qwen3.5-9B-AWQ-W4A16

Image-Text-to-Text • 3B • Updated 12 days ago • 29

Note serve-verified
Sohailhosseini/Fara1.5-27B-AWQ-W4A16

Image-Text-to-Text • 6B • Updated 12 days ago • 37

Note serve-verified
Sohailhosseini/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-AWQ-W4A16

Image-Text-to-Text • 3B • Updated 12 days ago • 7.3k

Note serve-verified
Sohailhosseini/Qwopus3.6-27B-Coder-AWQ-W4A16

Image-Text-to-Text • 6B • Updated 12 days ago • 32

Note serve-verified
Sohailhosseini/NuExtract3-FP8

Image-Text-to-Text • 5B • Updated 12 days ago • 44

Note serve-verified
Sohailhosseini/Qwopus3.5-9B-Coder-AWQ-W4A16

Image-Text-to-Text • 3B • Updated 12 days ago • 30

Note serve-verified
Sohailhosseini/DeepSeek-V4-Pro-Qwen3.5-9B-FP8

Image-Text-to-Text • 9B • Updated 12 days ago • 31

Note serve-verified
Sohailhosseini/Qwen3.5-9B-DeepSeek-V4-Flash-FP8

9B • Updated 13 days ago • 20

Note serve-verified
Sohailhosseini/Qwen3.5-9B-DeepSeek-V4-Flash-AWQ-W4A16

Image-Text-to-Text • 3B • Updated 12 days ago • 29

Note serve-verified