Text Generation
GGUF
English
code
coder
qwen2.5
qwen2.5-coder
llama-cpp
llama.cpp
ollama
code-generation
tool-calling
conversational
cpu-inference
small-language-model
offline
sakthai
house-of-sak
Eval Results (legacy)
Eval Results
Instructions to use Nanthasit/sakthai-coder-1.5b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Nanthasit/sakthai-coder-1.5b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: llama cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: llama cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Use Docker
docker model run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use Nanthasit/sakthai-coder-1.5b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Nanthasit/sakthai-coder-1.5b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Nanthasit/sakthai-coder-1.5b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- Ollama
How to use Nanthasit/sakthai-coder-1.5b with Ollama:
ollama run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- Unsloth Desktop
- Pi
How to use Nanthasit/sakthai-coder-1.5b with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Nanthasit/sakthai-coder-1.5b:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Nanthasit/sakthai-coder-1.5b with Docker Model Runner:
docker model run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- Lemonade
How to use Nanthasit/sakthai-coder-1.5b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Nanthasit/sakthai-coder-1.5b:Q4_K_M
Run and chat with the model
lemonade run user.sakthai-coder-1.5b-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Nanthasit/sakthai-coder-1.5b with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Nanthasit/sakthai-coder-1.5b:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Nanthasit/sakthai-coder-1.5b with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Nanthasit/sakthai-coder-1.5b:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Commit History
Update model card: refresh download counts, add coding benchmarks and usage examples 638267a verified
Upload README.md with huggingface_hub 354562d verified
Upload README.md with huggingface_hub b5e3f0e verified
Fix model count: 11→12 public (v2 added) 54fbc74 verified
docs: add origin story + CTA section for narrative consistency across House of Sak cards 7f5ee2b verified
Fix coder-1.5b card: remove dead Rising Stars links, add 0.5b-tools cross-link, fix ecosystem count a695334 verified
Upload README.md with huggingface_hub 9184a87 verified
fix: model count 12→11 (actual from HF API) eeaf349 verified
fix: update model family count from 13 to 12 69dae28 verified
fix: correct model count 14→13, remove deprecated English embedding reference 58d1916 verified
fix: align family count to 14 models + add signature tagline deb477a verified
docs: align card to lean standard — live downloads badge, single canonical family table, drop funnel sections and stale counts 55f8f6e verified
docs: align card to lean standard — live downloads badge, single canonical family table, drop funnel sections and stale counts b519591 verified
fix: replace broken shields.io/endpoint badge with working static badge (70 dl) 17b8f79 verified
Remove eval_results derived from small internal spot checks, not benchmarks 0c0e380 verified
Remove unearned model-index claims; state measured results or mark as unbenchmarked 03376c7 verified
Overhaul coder-1.5b card: add growing ecosystem section, expand family table, fix counts 12→13 models, 5→6 datasets a8351cf
SakThai commited on
Upload .eval_results/coding.yaml with huggingface_hub 7787f5f verified
Delete .eval_results/coding-humaneval.yaml with huggingface_hub f9e6bdb verified
Upload .eval_results/coding.yaml with huggingface_hub ff9a08f verified
Upload .eval_results/coding-humaneval.yaml with huggingface_hub 2dc8208 verified
Upload README.md with huggingface_hub 79492ea verified
Lean rewrite: dynamic download badge, single family table, honest evals, story→profile 86e9630 verified
Fix card: remove dead paper link, drop unverified model-index claims, dedupe tables, fix stray markdown 06b2f00 verified
Fix: Replace stale deprecated embedding link → redirect to multilingual (public) 3c24bed verified
docs: show actual 0.5B-Tools downloads (7) in family table — promotes lowest-download model 0d53605 verified
docs: expand Rising Stars section to promote low-download siblings 0be9aae
SakThai Agent commited on
Upload qwen2.5-coder-1.5b-instruct-q4_k_m.gguf with huggingface_hub 9ac706c verified
Delete qwen2.5-coder-1.5b-instruct-q4_k_m.gguf with huggingface_hub 5b0c2d3 verified
Upload README.md with huggingface_hub f5ca649 verified
docs: refresh download counts across all tables, mark deprecated/private models, rename Low-Download Gems -> Rising Stars 76cdab9 verified
Upload qwen2.5-coder-1.5b-instruct-q4_k_m.gguf with huggingface_hub 3ee28c3 verified
Delete gguf/sakthai-coder-q4_k_m.gguf with huggingface_hub d6252a9 verified
Remove accidentally uploaded coder-readme.md (part 5) d342d89 verified
Remove accidentally uploaded coder-readme.md (part 4) 4ae5d94 verified
Remove accidentally uploaded coder-readme.md (part 3) 66e6340 verified
Remove accidentally uploaded coder-readme.md (part 2) 0b1bd98 verified
Remove accidentally uploaded coder-readme.md 6918355 verified
Add Low-Download Gems section, cross-links, and Quick Links to coder-1.5b README 4dfca06 verified
Upload coder-readme.md with huggingface_hub b2cb310 verified
fix: update 17 stale download counts across Pipeline Integration and Family tables 2983635
SakThai commited on