Quantised from Jackrong/Qwopus3.6-27B-v2

Has been converted using OMLX Version 0.4.0rc2 (1395) MTP Headers have been retained

This is the FP16 version which is optimal for Apple Silicon M1 and M2 Mac devices. I have also incorporated the "Fixed" Chat Template from froggeric/Qwen-Fixed-Chat-Templates

All thanks goes to the creators of all of the above, I merely just converted the model for those that cannot

Downloads last month: 10

Safetensors

Model size

28B params

Tensor type

U32

F16

MLX

Hardware compatibility

5-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for wezzel98765/Qwopus3.6-27B-v2-oQ5-fp16-mtp

Base model

Jackrong/Qwopus3.6-27B-v2

Quantized

(59)

this model