These are quantizations of the model Pixtral-12B-Captioner-Relaxed

Original model: https://huggingface.co/unalignment/Pixtral-12B-Captioner-Relaxed

It is a very capable image classifier model, that you could use for example with a program like ImageIndexer to bulk tag and describe images.
Try to use the best quality you can run.
For the mmproj, try to use the F32 version as it will produce the best results. F32 > BF16 > F16

Downloads last month
149
GGUF
Model size
12B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for noctrex/Pixtral-12B-Captioner-Relaxed-GGUF