Original Model: https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2
Quantized with AutoGPTQ 128g wikitext2, using the script from https://aphrodite.pygmalion.chat/pages/quantization/quantization-methods.html#gptq
- Downloads last month
- 13
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for mikudev/L3-8B-Stheno-v3.2-GPTQ
Base model
Sao10K/L3-8B-Stheno-v3.2