Instructions to use distil-labs/distil-qwen3-0.6b-SHELLper with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use distil-labs/distil-qwen3-0.6b-SHELLper with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf distil-labs/distil-qwen3-0.6b-SHELLper
# Run inference directly in the terminal:
llama cli -hf distil-labs/distil-qwen3-0.6b-SHELLper

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf distil-labs/distil-qwen3-0.6b-SHELLper
# Run inference directly in the terminal:
llama cli -hf distil-labs/distil-qwen3-0.6b-SHELLper

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf distil-labs/distil-qwen3-0.6b-SHELLper
# Run inference directly in the terminal:
./llama-cli -hf distil-labs/distil-qwen3-0.6b-SHELLper

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf distil-labs/distil-qwen3-0.6b-SHELLper
# Run inference directly in the terminal:
./build/bin/llama-cli -hf distil-labs/distil-qwen3-0.6b-SHELLper

Use Docker

docker model run hf.co/distil-labs/distil-qwen3-0.6b-SHELLper

LM Studio
Jan
Ollama
How to use distil-labs/distil-qwen3-0.6b-SHELLper with Ollama:
```
ollama run hf.co/distil-labs/distil-qwen3-0.6b-SHELLper
```
Unsloth Desktop

How to use distil-labs/distil-qwen3-0.6b-SHELLper with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf distil-labs/distil-qwen3-0.6b-SHELLper

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "distil-labs/distil-qwen3-0.6b-SHELLper"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use distil-labs/distil-qwen3-0.6b-SHELLper with Docker Model Runner:
```
docker model run hf.co/distil-labs/distil-qwen3-0.6b-SHELLper
```

Lemonade

How to use distil-labs/distil-qwen3-0.6b-SHELLper with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull distil-labs/distil-qwen3-0.6b-SHELLper

Run and chat with the model

lemonade run user.distil-qwen3-0.6b-SHELLper-{{QUANT_TAG}}

List all available models

lemonade list

Hermes Agent

How to use distil-labs/distil-qwen3-0.6b-SHELLper with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf distil-labs/distil-qwen3-0.6b-SHELLper

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default distil-labs/distil-qwen3-0.6b-SHELLper

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use distil-labs/distil-qwen3-0.6b-SHELLper with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf distil-labs/distil-qwen3-0.6b-SHELLper

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "distil-labs/distil-qwen3-0.6b-SHELLper" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

distil-qwen3-0.6b-SHELLper / training-logs.csv

gabikadlecova

Upload folder using huggingface_hub

28da437 verified 9 months ago

Raw History Blame Contribute Delete

5.49 kB

	,eval_loss,eval_rouge,eval_tool_call_equivalence,eval_binary_tool_call,eval_staged_tool_call,eval_runtime,eval_samples_per_second,eval_steps_per_second,epoch,step,loss,grad_norm,learning_rate,train_runtime,train_samples_per_second,train_steps_per_second,total_flos,train_loss
	0,0.8929561972618103,0.937919663982576,0.0,0.0,0.11138613861386139,14.3241,7.051,7.051,0.0,0,,,,,,,,
	1,,,,,,,,,0.07654623392529088,250,0.3482,0.02500811219215393,7.431192660550459e-06,,,,,
	2,,,,,,,,,0.15309246785058175,500,0.0429,0.008739220909774303,1.507645259938838e-05,,,,,
	3,,,,,,,,,0.22963870177587262,750,0.0374,0.004052203614264727,1.9856567284448028e-05,,,,,
	4,,,,,,,,,0.3061849357011635,1000,0.0347,0.0033449186012148857,1.9453666398066078e-05,,,,,
	5,,,,,,,,,0.38273116962645437,1250,0.0415,0.0022903024218976498,1.9050765511684128e-05,,,,,
	6,,,,,,,,,0.45927740355174523,1500,0.031,0.027417173609137535,1.8647864625302178e-05,,,,,
	7,,,,,,,,,0.5358236374770361,1750,0.0226,0.008835730142891407,1.8244963738920228e-05,,,,,
	8,,,,,,,,,0.612369871402327,2000,0.0305,0.005046794191002846,1.7842062852538278e-05,,,,,
	9,,,,,,,,,0.6889161053276179,2250,0.0285,0.20080187916755676,1.7439161966156328e-05,,,,,
	10,,,,,,,,,0.7654623392529087,2500,0.0316,6.839264869689941,1.7036261079774378e-05,,,,,
	11,,,,,,,,,0.8420085731781997,2750,0.026,0.0050949715077877045,1.6633360193392428e-05,,,,,
	12,,,,,,,,,0.9185548071034905,3000,0.0259,0.0008175886468961835,1.6230459307010478e-05,,,,,
	13,,,,,,,,,0.9951010410287814,3250,0.0316,0.004300868138670921,1.5827558420628527e-05,,,,,
	14,0.000406633218517527,1.0,0.0,0.0,0.0,14.1478,7.139,7.139,1.0,3266,,,,,,,,
	15,,,,,,,,,1.0716472749540722,3500,0.021,0.003385871183127165,1.5424657534246577e-05,,,,,
	16,,,,,,,,,1.1481935088793631,3750,0.0192,0.0013272400246933103,1.5021756647864627e-05,,,,,
	17,,,,,,,,,1.224739742804654,4000,0.0126,0.011078927665948868,1.4618855761482676e-05,,,,,
	18,,,,,,,,,1.301285976729945,4250,0.0248,0.0007338496507145464,1.4215954875100726e-05,,,,,
	19,,,,,,,,,1.3778322106552356,4500,0.0188,0.0011558783007785678,1.3813053988718777e-05,,,,,
	20,,,,,,,,,1.4543784445805266,4750,0.0135,0.0014210738008841872,1.3410153102336827e-05,,,,,
	21,,,,,,,,,1.5309246785058175,5000,0.0196,0.0008120909333229065,1.3007252215954875e-05,,,,,
	22,,,,,,,,,1.6074709124311084,5250,0.012,0.0008096823003143072,1.2604351329572925e-05,,,,,
	23,,,,,,,,,1.6840171463563993,5500,0.0161,0.0006479414878413081,1.2201450443190977e-05,,,,,
	24,,,,,,,,,1.76056338028169,5750,0.0054,0.0022624810226261616,1.1798549556809027e-05,,,,,
	25,,,,,,,,,1.8371096142069812,6000,0.0194,0.0005137866828590631,1.1395648670427075e-05,,,,,
	26,,,,,,,,,1.9136558481322719,6250,0.0161,0.0008381849038414657,1.0992747784045125e-05,,,,,
	27,,,,,,,,,1.9902020820575628,6500,0.0172,0.0074251918122172356,1.0589846897663177e-05,,,,,
	28,0.0006000794819556177,1.0,0.0,0.0,0.0,14.3549,7.036,7.036,2.0,6532,,,,,,,,
	29,,,,,,,,,2.0667483159828537,6750,0.0131,0.0007506917463615537,1.0186946011281225e-05,,,,,
	30,,,,,,,,,2.1432945499081444,7000,0.0066,0.0024207313545048237,9.784045124899275e-06,,,,,
	31,,,,,,,,,2.2198407838334355,7250,0.006,2.910186290740967,9.381144238517325e-06,,,,,
	32,,,,,,,,,2.2963870177587262,7500,0.0063,0.005975926760584116,8.978243352135375e-06,,,,,
	33,,,,,,,,,2.3729332516840174,7750,0.0084,0.003063431940972805,8.575342465753425e-06,,,,,
	34,,,,,,,,,2.449479485609308,8000,0.0135,0.0001805390347726643,8.172441579371475e-06,,,,,
	35,,,,,,,,,2.5260257195345988,8250,0.0028,0.00022566839470528066,7.769540692989526e-06,,,,,
	36,,,,,,,,,2.60257195345989,8500,0.0177,0.0006398891564458609,7.366639806607575e-06,,,,,
	37,,,,,,,,,2.6791181873851806,8750,0.0094,0.00088964041788131,6.9637389202256255e-06,,,,,
	38,,,,,,,,,2.7556644213104713,9000,0.0148,4.781706809997559,6.560838033843675e-06,,,,,
	39,,,,,,,,,2.8322106552357624,9250,0.0073,0.15788480639457703,6.1579371474617246e-06,,,,,
	40,,,,,,,,,2.908756889161053,9500,0.0052,0.01699310913681984,5.755036261079775e-06,,,,,
	41,,,,,,,,,2.9853031230863443,9750,0.0105,0.00037287099985405803,5.3521353746978245e-06,,,,,
	42,0.00018237480253446847,1.0,0.0,0.0,0.0,14.2523,7.087,7.087,3.0,9798,,,,,,,,
	43,,,,,,,,,3.061849357011635,10000,0.0049,0.00012844217417296022,4.949234488315875e-06,,,,,
	44,,,,,,,,,3.138395590936926,10250,0.0083,0.0004688242042902857,4.546333601933924e-06,,,,,
	45,,,,,,,,,3.214941824862217,10500,0.0061,0.00019535735191311687,4.143432715551974e-06,,,,,
	46,,,,,,,,,3.2914880587875075,10750,0.0026,0.0005410211160778999,3.7405318291700243e-06,,,,,
	47,,,,,,,,,3.3680342927127986,11000,0.0086,5.1037678718566895,3.337630942788074e-06,,,,,
	48,,,,,,,,,3.4445805266380893,11250,0.0085,1.2916507720947266,2.934730056406124e-06,,,,,
	49,,,,,,,,,3.52112676056338,11500,0.0022,0.0018537973519414663,2.531829170024174e-06,,,,,
	50,,,,,,,,,3.597672994488671,11750,0.0027,0.0240076445043087,2.1289282836422245e-06,,,,,
	51,,,,,,,,,3.674219228413962,12000,0.0061,0.0010780717711895704,1.7260273972602742e-06,,,,,
	52,,,,,,,,,3.750765462339253,12250,0.0025,0.006764480844140053,1.323126510878324e-06,,,,,
	53,,,,,,,,,3.8273116962645437,12500,0.0036,0.017819898203015327,9.202256244963739e-07,,,,,
	54,,,,,,,,,3.903857930189835,12750,0.0057,0.0003714622580446303,5.173247381144239e-07,,,,,
	55,,,,,,,,,3.9804041641151255,13000,0.0023,0.005369406659156084,1.1442385173247381e-07,,,,,
	56,0.00017647647473495454,1.0,0.0,0.0,0.0,14.355,7.036,7.036,4.0,13064,,,,,,,,
	57,,,,,,,,,4.0,13064,,,,3792.3332,3.445,3.445,1.0792453270457549e+17,0.021713328195892077