Update README.md

f235809 verified about 1 year ago

1.73 kB

language:
  - pl
license: apache-2.0
library_name: mlx
tags:
  - finetuned
  - mlx
inference: false
pipeline_tag: text-generation
base_model: speakleash/Bielik-11B-v2.6-Instruct

Bielik-11B-v2.6-Instruct-MLX-8bit

This model was converted to MLX format from SpeakLeash's Bielik-11B-v2.6-Instruct.

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Use with mlx

pip install mlx-lm

from mlx_lm import load, generate

model, tokenizer = load("speakleash/Bielik-11B-v2.6-Instruct-MLX-4bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)

Model description:

Developed by: SpeakLeash & ACK Cyfronet AGH
Language: Polish
Model type: causal decoder-only
Quant from: Bielik-11B-v2.6-Instruct
Finetuned from: Bielik-11B-v2
License: Apache 2.0 and Terms of Use

Responsible for model quantization

Remigiusz Kinas^SpeakLeash - team leadership, conceptualizing, calibration data preparation, process creation and quantized model delivery.

Contact Us

If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.