Instructions to use AesSedai/MiMo-V2.5-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use AesSedai/MiMo-V2.5-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf AesSedai/MiMo-V2.5-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf AesSedai/MiMo-V2.5-GGUF:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf AesSedai/MiMo-V2.5-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf AesSedai/MiMo-V2.5-GGUF:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf AesSedai/MiMo-V2.5-GGUF:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf AesSedai/MiMo-V2.5-GGUF:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf AesSedai/MiMo-V2.5-GGUF:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf AesSedai/MiMo-V2.5-GGUF:Q4_K_M

Use Docker

docker model run hf.co/AesSedai/MiMo-V2.5-GGUF:Q4_K_M

LM Studio
Jan
Ollama
How to use AesSedai/MiMo-V2.5-GGUF with Ollama:
```
ollama run hf.co/AesSedai/MiMo-V2.5-GGUF:Q4_K_M
```
Unsloth Desktop

How to use AesSedai/MiMo-V2.5-GGUF with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf AesSedai/MiMo-V2.5-GGUF:Q4_K_M

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "AesSedai/MiMo-V2.5-GGUF:Q4_K_M"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use AesSedai/MiMo-V2.5-GGUF with Docker Model Runner:
```
docker model run hf.co/AesSedai/MiMo-V2.5-GGUF:Q4_K_M
```

Lemonade

How to use AesSedai/MiMo-V2.5-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull AesSedai/MiMo-V2.5-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.MiMo-V2.5-GGUF-Q4_K_M

List all available models

lemonade list

Hermes Agent

How to use AesSedai/MiMo-V2.5-GGUF with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf AesSedai/MiMo-V2.5-GGUF:Q4_K_M

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default AesSedai/MiMo-V2.5-GGUF:Q4_K_M

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use AesSedai/MiMo-V2.5-GGUF with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf AesSedai/MiMo-V2.5-GGUF:Q4_K_M

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "AesSedai/MiMo-V2.5-GGUF:Q4_K_M" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

MiMo-V2.5-GGUF / kld_data /kld_ctx_cache_data.csv

AesSedai

Super-squash branch 'main' using huggingface_hub

eed9c5e 4 months ago

Raw

History Blame Contribute Delete

16.1 kB

	model_name,quant_type,file_path,ctx_size,cache_k,cache_v,kld_value,kld_error,ppl_value,ppl_error,file_size_gib,filename
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx1024-kf16-vf16.md,1024,f16,f16,0.058814,0.000697,5.155054,0.028021,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx1024-kf16-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx1024-kf16-vq4_0.md,1024,f16,q4_0,0.061869,0.000712,5.159461,0.028013,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx1024-kf16-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx1024-kf16-vq8_0.md,1024,f16,q8_0,0.058696,0.000701,5.158973,0.028062,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx1024-kf16-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq4_0-vf16.md,1024,q4_0,f16,0.061522,0.00071,5.162931,0.028069,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq4_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq4_0-vq4_0.md,1024,q4_0,q4_0,0.064503,0.000722,5.168699,0.028065,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq4_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq4_0-vq8_0.md,1024,q4_0,q8_0,0.061507,0.000707,5.168826,0.028109,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq4_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq8_0-vf16.md,1024,q8_0,f16,0.05898,0.000697,5.157834,0.028042,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq8_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq8_0-vq4_0.md,1024,q8_0,q4_0,0.062168,0.000731,5.160217,0.028018,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq8_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq8_0-vq8_0.md,1024,q8_0,q8_0,0.058871,0.000699,5.162468,0.028082,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx1024-kq8_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx16384-kf16-vf16.md,16384,f16,f16,0.111023,0.001527,6.575903,0.041263,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx16384-kf16-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx16384-kf16-vq4_0.md,16384,f16,q4_0,0.11702,0.001575,6.568354,0.041151,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx16384-kf16-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx16384-kf16-vq8_0.md,16384,f16,q8_0,0.112567,0.001565,6.585205,0.041409,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx16384-kf16-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq4_0-vf16.md,16384,q4_0,f16,0.119184,0.001581,6.599128,0.041365,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq4_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq4_0-vq4_0.md,16384,q4_0,q4_0,0.12191,0.001594,6.531153,0.040668,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq4_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq4_0-vq8_0.md,16384,q4_0,q8_0,0.118269,0.001582,6.574292,0.041217,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq4_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq8_0-vf16.md,16384,q8_0,f16,0.113869,0.001559,6.592209,0.041341,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq8_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq8_0-vq4_0.md,16384,q8_0,q4_0,0.116213,0.001559,6.556024,0.040999,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq8_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq8_0-vq8_0.md,16384,q8_0,q8_0,0.111762,0.001539,6.563142,0.041123,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx16384-kq8_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx2048-kf16-vf16.md,2048,f16,f16,0.069366,0.000922,5.348603,0.029893,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx2048-kf16-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx2048-kf16-vq4_0.md,2048,f16,q4_0,0.071958,0.00094,5.343927,0.029813,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx2048-kf16-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx2048-kf16-vq8_0.md,2048,f16,q8_0,0.069299,0.000914,5.348876,0.029905,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx2048-kf16-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq4_0-vf16.md,2048,q4_0,f16,0.073137,0.000967,5.35124,0.029894,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq4_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq4_0-vq4_0.md,2048,q4_0,q4_0,0.075934,0.000973,5.352369,0.029854,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq4_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq4_0-vq8_0.md,2048,q4_0,q8_0,0.072876,0.000956,5.35479,0.029937,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq4_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq8_0-vf16.md,2048,q8_0,f16,0.069442,0.000922,5.346176,0.029882,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq8_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq8_0-vq4_0.md,2048,q8_0,q4_0,0.072883,0.000957,5.34506,0.029819,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq8_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq8_0-vq8_0.md,2048,q8_0,q8_0,0.069558,0.000921,5.34829,0.029906,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx2048-kq8_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx32768-kf16-vf16.md,32768,f16,f16,0.116102,0.001688,6.537501,0.042022,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx32768-kf16-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx32768-kf16-vq4_0.md,32768,f16,q4_0,0.12454,0.001774,6.522697,0.041845,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx32768-kf16-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx32768-kf16-vq8_0.md,32768,f16,q8_0,0.117116,0.001708,6.527866,0.041962,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx32768-kf16-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx32768-kq8_0-vf16.md,32768,q8_0,f16,0.121892,0.001725,6.592058,0.042472,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx32768-kq8_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx32768-kq8_0-vq4_0.md,32768,q8_0,q4_0,0.123043,0.001737,6.528897,0.041907,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx32768-kq8_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx32768-kq8_0-vq8_0.md,32768,q8_0,q8_0,0.117857,0.001726,6.527538,0.041925,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx32768-kq8_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx4096-kf16-vf16.md,4096,f16,f16,0.0831,0.001118,5.620737,0.032325,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx4096-kf16-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx4096-kf16-vq4_0.md,4096,f16,q4_0,0.087182,0.001151,5.609687,0.032148,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx4096-kf16-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx4096-kf16-vq8_0.md,4096,f16,q8_0,0.083645,0.001126,5.624818,0.032384,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx4096-kf16-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq4_0-vf16.md,4096,q4_0,f16,0.089174,0.001176,5.617736,0.03224,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq4_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq4_0-vq4_0.md,4096,q4_0,q4_0,0.091723,0.001185,5.606327,0.03209,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq4_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq4_0-vq8_0.md,4096,q4_0,q8_0,0.088864,0.001176,5.627245,0.032358,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq4_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq8_0-vf16.md,4096,q8_0,f16,0.084177,0.001132,5.625465,0.032345,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq8_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq8_0-vq4_0.md,4096,q8_0,q4_0,0.087539,0.00116,5.610181,0.032169,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq8_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq8_0-vq8_0.md,4096,q8_0,q8_0,0.082624,0.00111,5.61671,0.032294,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx4096-kq8_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx512-kf16-vf16.md,512,f16,f16,0.052844,0.000541,5.028616,0.027064,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx512-kf16-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx512-kf16-vq4_0.md,512,f16,q4_0,0.055227,0.000551,5.037206,0.027111,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx512-kf16-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx512-kf16-vq8_0.md,512,f16,q8_0,0.052717,0.000545,5.030449,0.027087,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx512-kf16-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx512-kq4_0-vf16.md,512,q4_0,f16,0.055667,0.000573,5.040713,0.027143,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx512-kq4_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx512-kq4_0-vq4_0.md,512,q4_0,q4_0,0.058585,0.000582,5.0539,0.02722,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx512-kq4_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx512-kq4_0-vq8_0.md,512,q4_0,q8_0,0.055443,0.000566,5.039932,0.027145,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx512-kq4_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx512-kq8_0-vf16.md,512,q8_0,f16,0.053088,0.000559,5.027533,0.027063,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx512-kq8_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx512-kq8_0-vq4_0.md,512,q8_0,q4_0,0.055267,0.000553,5.036969,0.027108,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx512-kq8_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx512-kq8_0-vq8_0.md,512,q8_0,q8_0,0.052566,0.000542,5.029216,0.027076,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx512-kq8_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx8192-kf16-vf16.md,8192,f16,f16,0.100263,0.001383,5.804322,0.034464,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx8192-kf16-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx8192-kf16-vq4_0.md,8192,f16,q4_0,0.105348,0.001423,5.800119,0.034339,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx8192-kf16-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx8192-kf16-vq8_0.md,8192,f16,q8_0,0.102584,0.001423,5.812887,0.034537,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx8192-kf16-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq4_0-vf16.md,8192,q4_0,f16,0.105886,0.001426,5.784699,0.034191,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq4_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq4_0-vq4_0.md,8192,q4_0,q4_0,0.109715,0.001451,5.773138,0.034046,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq4_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq4_0-vq8_0.md,8192,q4_0,q8_0,0.105584,0.001433,5.7975,0.034357,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq4_0-vq8_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq8_0-vf16.md,8192,q8_0,f16,0.101656,0.001398,5.801148,0.034388,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq8_0-vf16
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq8_0-vq4_0.md,8192,q8_0,q4_0,0.105841,0.001431,5.794716,0.034284,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq8_0-vq4_0
	Qwen3.5-35B-A3B-IQ3_S (aes_sedai),IQ3_S,/home/jarvis/development/llama.cpp/kld-ctx/MiniMax-M2.5/calibration_datav5/aes_sedai/Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq8_0-vq8_0.md,8192,q8_0,q8_0,0.100888,0.0014,5.795717,0.03439,12.64,Qwen3.5-35B-A3B-IQ3_S-ctx8192-kq8_0-vq8_0