Quantised from Jackrong/Qwopus3.6-35B-A3B-v1

Has been converted using OMLX Version 0.4 MTP Headers have been retained

This is the FP16 version which is optimal for Apple Silicon M1 and M2 Mac devices. I have also incorporated the "Fixed" Chat Template from froggeric/Qwen-Fixed-Chat-Templates

All thanks goes to the creators of all of the above, I merely just converted the model for those that cannot

Downloads last month
5
Safetensors
Model size
36B params
Tensor type
U32
·
F16
·
MLX
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for wezzel98765/Qwopus3.6-35B-A3B-v1-oQ8-fp16-mtp

Quantized
(26)
this model