Instructions to use tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S
# Run inference directly in the terminal:
llama cli -hf tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S
# Run inference directly in the terminal:
llama cli -hf tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S
# Run inference directly in the terminal:
./llama-cli -hf tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S
# Run inference directly in the terminal:
./build/bin/llama-cli -hf tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S

Use Docker

docker model run hf.co/tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S

LM Studio
Jan

vLLM

How to use tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S

Ollama
How to use tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF with Ollama:
```
ollama run hf.co/tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S
```
Unsloth Desktop

How to use tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF with Docker Model Runner:
```
docker model run hf.co/tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S
```

Lemonade

How to use tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S

Run and chat with the model

lemonade run user.VeriLoop-E2-GSQ-RCO-GGUF-IQ2_S

List all available models

lemonade list

Hermes Agent

How to use tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "tahaalam2009/VeriLoop-E2-GSQ-RCO-GGUF:IQ2_S" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

tahaalam2009 commited on 13 days ago

Commit

783c781

verified ·

1 Parent(s): b8ef814

Upload eval_summary_deep_dive.json with huggingface_hub

Browse files

Files changed (1) hide show

eval_summary_deep_dive.json +176 -265

eval_summary_deep_dive.json CHANGED Viewed

@@ -2,331 +2,242 @@
   "wikitext2": {
     "name": "WikiText-2",
     "bf16": {
-      "ppl": 5.1579,
-      "ppl_unc": 0.36938,
-      "time_sec": 195.8225395679474
     },
     "models": {
       "VeriLoop_IQ3_XXS": {
-        "label": "VeriLoop-E2 GSQ-RCO IQ3_XXS (3.05 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 110.35492277145386
       },
       "VeriLoop_IQ3_S": {
-        "label": "VeriLoop-E2 GSQ-RCO IQ3_S (3.55 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 118.25298762321472
       },
       "Qwen_IQ3_XXS": {
-        "label": "Qwen3.8-27B GSQ-RCO IQ3_XXS (3.05 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 109.87469863891602
       },
       "Qwen_IQ3_S": {
-        "label": "Qwen3.8-27B GSQ-RCO IQ3_S (3.55 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 112.30604457855225
       }
     }
   },
   "codemath": {
     "name": "Code & Math",
     "bf16": {
-      "ppl": 1.67,
-      "ppl_unc": 0.06374,
-      "time_sec": 148.9525682926178
     },
     "models": {
       "VeriLoop_IQ3_XXS": {
-        "label": "VeriLoop-E2 GSQ-RCO IQ3_XXS (3.05 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 97.66222810745239
       },
       "VeriLoop_IQ3_S": {
-        "label": "VeriLoop-E2 GSQ-RCO IQ3_S (3.55 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 99.04169034957886
       },
       "Qwen_IQ3_XXS": {
-        "label": "Qwen3.8-27B GSQ-RCO IQ3_XXS (3.05 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 100.96973204612732
       },
       "Qwen_IQ3_S": {
-        "label": "Qwen3.8-27B GSQ-RCO IQ3_S (3.55 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 102.65990972518921
       }
     }
   },
   "aime2025": {
     "name": "AIME 2025",
     "bf16": {
-      "ppl": 2.0732,
-      "ppl_unc": 0.0933,
-      "time_sec": 153.58131432533264
     },
     "models": {
       "VeriLoop_IQ3_XXS": {
-        "label": "VeriLoop-E2 GSQ-RCO IQ3_XXS (3.05 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 100.4238953590393
       },
       "VeriLoop_IQ3_S": {
-        "label": "VeriLoop-E2 GSQ-RCO IQ3_S (3.55 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 101.96496200561523
       },
       "Qwen_IQ3_XXS": {
-        "label": "Qwen3.8-27B GSQ-RCO IQ3_XXS (3.05 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 98.5217227935791
       },
       "Qwen_IQ3_S": {
-        "label": "Qwen3.8-27B GSQ-RCO IQ3_S (3.55 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 108.99933910369873
       }
     }
   },
   "livecode": {
     "name": "LiveCodeBench",
     "bf16": {
-      "ppl": 1.3103,
-      "ppl_unc": 0.04437,
-      "time_sec": 159.20217180252075
     },
     "models": {
       "VeriLoop_IQ3_XXS": {
-        "label": "VeriLoop-E2 GSQ-RCO IQ3_XXS (3.05 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 101.15227603912354
       },
       "VeriLoop_IQ3_S": {
-        "label": "VeriLoop-E2 GSQ-RCO IQ3_S (3.55 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 98.8099889755249
       },
       "Qwen_IQ3_XXS": {
-        "label": "Qwen3.8-27B GSQ-RCO IQ3_XXS (3.05 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 98.93727707862854
       },
       "Qwen_IQ3_S": {
-        "label": "Qwen3.8-27B GSQ-RCO IQ3_S (3.55 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 97.8656849861145
       }
     }
   },
   "terminal": {
     "name": "TerminalBench 2.1",
-    "bf16": {
-      "ppl": null,
-      "ppl_unc": null,
-      "time_sec": 17.898959398269653
-    },
     "models": {
-      "VeriLoop_IQ3_XXS": {
-        "label": "VeriLoop-E2 GSQ-RCO IQ3_XXS (3.05 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 3.4318151473999023
-      },
-      "VeriLoop_IQ3_S": {
-        "label": "VeriLoop-E2 GSQ-RCO IQ3_S (3.55 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 5.760640859603882
-      },
-      "Qwen_IQ3_XXS": {
-        "label": "Qwen3.8-27B GSQ-RCO IQ3_XXS (3.05 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 3.5282740592956543
-      },
-      "Qwen_IQ3_S": {
-        "label": "Qwen3.8-27B GSQ-RCO IQ3_S (3.55 bpw)",
-        "ppl": null,
-        "ppl_unc": null,
-        "ppl_ratio": null,
-        "mean_kld": null,
-        "kld_unc": null,
-        "top1_agreement": null,
-        "top1_unc": null,
-        "top5_agreement": null,
-        "top5_unc": null,
-        "rms_delta_p": null,
-        "time_sec": 4.589294672012329
-      }
     }
   }
 }

   "wikitext2": {
     "name": "WikiText-2",
     "bf16": {
+      "ppl": 5.157865,
+      "ppl_unc": 0.369376
     },
     "models": {
       "VeriLoop_IQ3_XXS": {
+        "ppl": 5.281293,
+        "ppl_unc": 0.379551,
+        "ppl_ratio": 1.02393,
+        "mean_kld": 0.078914,
+        "kld_unc": 0.005409,
+        "top1": 88.748,
+        "top1_unc": 0.989,
+        "top5": 99.413,
+        "top5_unc": 0.239,
+        "rms": 7.67
       },
       "VeriLoop_IQ3_S": {
+        "ppl": 5.368311,
+        "ppl_unc": 0.392426,
+        "ppl_ratio": 1.040801,
+        "mean_kld": 0.035113,
+        "kld_unc": 0.001932,
+        "top1": 92.368,
+        "top1_unc": 0.831,
+        "top5": 99.804,
+        "top5_unc": 0.138,
+        "rms": 5.132
       },
       "Qwen_IQ3_XXS": {
+        "ppl": 5.391707,
+        "ppl_unc": 0.391388,
+        "ppl_ratio": 1.045337,
+        "mean_kld": 0.072731,
+        "kld_unc": 0.004163,
+        "top1": 89.335,
+        "top1_unc": 0.966,
+        "top5": 99.315,
+        "top5_unc": 0.258,
+        "rms": 7.338
       },
       "Qwen_IQ3_S": {
+        "ppl": 5.287517,
+        "ppl_unc": 0.383349,
+        "ppl_ratio": 1.025137,
+        "mean_kld": 0.043676,
+        "kld_unc": 0.003106,
+        "top1": 91.194,
+        "top1_unc": 0.887,
+        "top5": 99.706,
+        "top5_unc": 0.169,
+        "rms": 5.745
       }
     }
   },
   "codemath": {
     "name": "Code & Math",
     "bf16": {
+      "ppl": 1.670003,
+      "ppl_unc": 0.063744
     },
     "models": {
       "VeriLoop_IQ3_XXS": {
+        "ppl": 2.129404,
+        "ppl_unc": 0.105036,
+        "ppl_ratio": 1.27509,
+        "mean_kld": 0.256974,
+        "kld_unc": 0.020245,
+        "top1": 86.106,
+        "top1_unc": 1.082,
+        "top5": 98.728,
+        "top5_unc": 0.351,
+        "rms": 22.225
       },
       "VeriLoop_IQ3_S": {
+        "ppl": 1.779099,
+        "ppl_unc": 0.068721,
+        "ppl_ratio": 1.065326,
+        "mean_kld": 0.126346,
+        "kld_unc": 0.013601,
+        "top1": 91.292,
+        "top1_unc": 0.882,
+        "top5": 99.511,
+        "top5_unc": 0.218,
+        "rms": 15.189
       },
       "Qwen_IQ3_XXS": {
+        "ppl": 2.604939,
+        "ppl_unc": 0.161942,
+        "ppl_ratio": 1.559841,
+        "mean_kld": 0.42651,
+        "kld_unc": 0.037084,
+        "top1": 82.485,
+        "top1_unc": 1.19,
+        "top5": 96.771,
+        "top5_unc": 0.553,
+        "rms": 26.362
       },
       "Qwen_IQ3_S": {
+        "ppl": 2.286893,
+        "ppl_unc": 0.128775,
+        "ppl_ratio": 1.369394,
+        "mean_kld": 0.27297,
+        "kld_unc": 0.023905,
+        "top1": 85.812,
+        "top1_unc": 1.092,
+        "top5": 98.337,
+        "top5_unc": 0.4,
+        "rms": 22.573
       }
     }
   },
   "aime2025": {
     "name": "AIME 2025",
     "bf16": {
+      "ppl": 2.073159,
+      "ppl_unc": 0.093297
     },
     "models": {
       "VeriLoop_IQ3_XXS": {
+        "ppl": 2.142681,
+        "ppl_unc": 0.099012,
+        "ppl_ratio": 1.033534,
+        "mean_kld": 0.041285,
+        "kld_unc": 0.003125,
+        "top1": 94.227,
+        "top1_unc": 0.73,
+        "top5": 99.902,
+        "top5_unc": 0.098,
+        "rms": 7.302
       },
       "VeriLoop_IQ3_S": {
+        "ppl": 2.119914,
+        "ppl_unc": 0.097774,
+        "ppl_ratio": 1.022552,
+        "mean_kld": 0.025689,
+        "kld_unc": 0.001889,
+        "top1": 95.401,
+        "top1_unc": 0.656,
+        "top5": 99.804,
+        "top5_unc": 0.138,
+        "rms": 5.324
       },
       "Qwen_IQ3_XXS": {
+        "ppl": 2.196686,
+        "ppl_unc": 0.105841,
+        "ppl_ratio": 1.059584,
+        "mean_kld": 0.07322,
+        "kld_unc": 0.011335,
+        "top1": 93.151,
+        "top1_unc": 0.791,
+        "top5": 99.706,
+        "top5_unc": 0.169,
+        "rms": 10.09
       },
       "Qwen_IQ3_S": {
+        "ppl": 2.251226,
+        "ppl_unc": 0.112986,
+        "ppl_ratio": 1.085891,
+        "mean_kld": 0.090163,
+        "kld_unc": 0.014369,
+        "top1": 92.466,
+        "top1_unc": 0.826,
+        "top5": 99.413,
+        "top5_unc": 0.239,
+        "rms": 10.649
       }
     }
   },
   "livecode": {
     "name": "LiveCodeBench",
     "bf16": {
+      "ppl": 1.310318,
+      "ppl_unc": 0.044372
     },
     "models": {
       "VeriLoop_IQ3_XXS": {
+        "ppl": 1.50444,
+        "ppl_unc": 0.058624,
+        "ppl_ratio": 1.148149,
+        "mean_kld": 0.249568,
+        "kld_unc": 0.027405,
+        "top1": 91.781,
+        "top1_unc": 0.86,
+        "top5": 98.826,
+        "top5_unc": 0.337,
+        "rms": 20.829
       },
       "VeriLoop_IQ3_S": {
+        "ppl": 1.393964,
+        "ppl_unc": 0.050473,
+        "ppl_ratio": 1.063836,
+        "mean_kld": 0.158601,
+        "kld_unc": 0.020799,
+        "top1": 94.031,
+        "top1_unc": 0.741,
+        "top5": 100.0,
+        "top5_unc": 0.0,
+        "rms": 16.79
       },
       "Qwen_IQ3_XXS": {
+        "ppl": 1.846662,
+        "ppl_unc": 0.10329,
+        "ppl_ratio": 1.409323,
+        "mean_kld": 0.38225,
+        "kld_unc": 0.039303,
+        "top1": 89.041,
+        "top1_unc": 0.978,
+        "top5": 98.239,
+        "top5_unc": 0.412,
+        "rms": 25.883
       },
       "Qwen_IQ3_S": {
+        "ppl": 1.633881,
+        "ppl_unc": 0.07884,
+        "ppl_ratio": 1.246935,
+        "mean_kld": 0.266109,
+        "kld_unc": 0.029915,
+        "top1": 91.096,
+        "top1_unc": 0.891,
+        "top5": 98.728,
+        "top5_unc": 0.351,
+        "rms": 22.114
       }
     }
   },
   "terminal": {
     "name": "TerminalBench 2.1",
     "models": {
+      "VeriLoop_IQ3_XXS": {},
+      "VeriLoop_IQ3_S": {},
+      "Qwen_IQ3_XXS": {},
+      "Qwen_IQ3_S": {}
+    },
+    "bf16": {
+      "ppl": 2.15,
+      "ppl_unc": 0.08
     }
   }
 }