EXL3 quants of ReadyArt/gemma-4-31B-it-scotoma-2
- Model Commit: d4dd79f9ea20fbfa4823277057d16eaf53332090
- ExLlamaV3: 1.5.0
- Command:
python -m exllamav3.conversion.convert_model --in_dir "./ReadyArt__gemma-4-31B-it-scotoma-2/" --out_dir "./6.0bpw" --work_dir "./workdir/" --bits 6 --devices 0,1 - MTP model is not included (not supported by ExLlamaV3)
Weights:
- 4.0 bits per weight (H6,V6)
- 5.0 bits per weight (H6,V6)
- 6.0 bits per weight (H6,V6)
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for jirka642/gemma-4-31B-it-scotoma-2-exl3
Base model
ReadyArt/gemma-4-31B-it-scotoma-2