Ornith-1.5-35B-A3B oQe MTP
Collection
6 items • Updated • 2
How to use scottlowry/Ornith-1.5-35B-A3B-oQ6e-fp16-mtp with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Ornith-1.5-35B-A3B-oQ6e-fp16-mtp scottlowry/Ornith-1.5-35B-A3B-oQ6e-fp16-mtp
This model was quantized using oQ (oMLX v0.6.2) mixed-precision quantization.
6-bit
Base model
ornith-ai/Ornith-1.5-35B-A3B