Ornith-1.5-35B-A3B oQe MTP
Collection
6 items • Updated • 2
How to use scottlowry/Ornith-1.5-35B-A3B-oQ8e-fp16-mtp with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download scottlowry/Ornith-1.5-35B-A3B-oQ8e-fp16-mtp --local-dir Ornith-1.5-35B-A3B-oQ8e-fp16-mtp
This model was quantized using oQ (oMLX v0.6.2) mixed-precision quantization.
8-bit
Base model
ornith-ai/Ornith-1.5-35B-A3B