Model highly unstable, use only for basic information!
Bielik V3.0 11B Instruct, a language model made by SpeakLeash (aka Spichlerz), but heavily quantized. The model's raw weights were taken and compressed to IQ2_XXS, an aggresive form of quantization meant for GGUF models. It achieves ~10tok/s while using 3.1GB of RAM with a context window of 8 thousand on the MacBook Pro (base M1, 8GB of unified memory, 256GB of internal storage).
Bielik at this level of compression tends to hallucinate frequently and generate context in languages different than intended. (Polish and english are the intended languages.)
- Downloads last month
- 30
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for piskle/Bielik-V3.0-Instruct-11B-IQ2_XXS_GGUF
Base model
speakleash/Bielik-11B-v3-Base-20250730 Finetuned
speakleash/Bielik-PL-11B-v3.0-Instruct