Hugging Face's logo

SvalTek
/
MN-CharThink-12B-Base-GGUF

GGUF
mistral
llama.cpp
llama-cpp
unsloth
conversational
Model card Files
xet
 Community

MN-CharThink-12B-Base-GGUF : GGUF

This model was converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: llama-cli -hf SvalTek/MN-CharThink-12B-Base-GGUF --jinja
  • For multimodal models: llama-mtmd-cli -hf SvalTek/MN-CharThink-12B-Base-GGUF --jinja

Available model files:

  • MN-CharThink-12B-Base.Q4_K_M.gguf
  • MN-CharThink-12B-Base.Q6_K.gguf
Downloads last month
113
GGUF
Model size
12B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

6-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SvalTek/MN-CharThink-12B-Base-GGUF

Base model

SvalTek/MN-CharThink-12B-Base
Quantized
(3)
this model