---
title: llm-bench.io
emoji: 📈
colorFrom: pink
colorTo: indigo
sdk: static
pinned: false
short_description: Live leaderboard of local LLMs — real-world quality & speed
---

# llm-bench.io

**llm-bench.io** is a community benchmarking platform for local LLMs. We aggregate real-world performance data — generation speed, memory usage, and LLM-judged quality across coding, agent-workflow, role-play, and research tasks — submitted by people running models on their own hardware. The data is free to explore, browse, and cite, with results linked back to the live site at [llm-bench.io](https://llm-bench.io).

## What's here

This Space hosts the **interactive leaderboard**: the best-performing local models over the last 30 days (minimum 3 runs each), grouped by available VRAM.

- **Quality** — LLM-judged score (0–100) across four real-world scenarios
- **Speed** — average tokens/second on real hardware
- **VRAM tiers** — filter by 8 GB → 128 GB to see what fits your machine

Rows link back to the full benchmark results on the live site.

## Explore the data

- 🔬 **Dataset (Hugging Face):** [llmbenchio/benchmarks-by-vram](https://huggingface.co/datasets/llmbenchio/benchmarks-by-vram) — condensed CSV, ready to load
- 🌐 **Live site:** [llm-bench.io](https://llm-bench.io) — browse all 900+ submissions, compare models, run your own benchmark
- 📖 **Methodology:** [how we measure](https://llm-bench.io/benchmark-methodology)
- 🧪 **Submit a benchmark:** [llm-bench.io/benchmark-client](https://llm-bench.io/benchmark-client)

## About the measurements

Benchmarks are submitted by community members running their own hardware with their own tools (llama.cpp, vLLM, Ollama, …). Each submission measures generation speed, memory usage, and time-to-first-token, then an LLM judge scores output quality per scenario. We aggregate per model + VRAM tier, requiring at least 3 runs to filter out one-off outliers.

---

*Leaderboard data refreshes periodically. Snapshot generated: see the page footer. Data source: `data.json` in this repository, built from the public [llm-bench.io API](https://llm-bench.io/api).*