Instructions to use Nanthasit/sakthai-coder-1.5b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Nanthasit/sakthai-coder-1.5b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: llama cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: llama cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Use Docker
docker model run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use Nanthasit/sakthai-coder-1.5b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Nanthasit/sakthai-coder-1.5b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Nanthasit/sakthai-coder-1.5b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- Ollama
How to use Nanthasit/sakthai-coder-1.5b with Ollama:
ollama run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- Unsloth Desktop
- Pi
How to use Nanthasit/sakthai-coder-1.5b with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Nanthasit/sakthai-coder-1.5b:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Nanthasit/sakthai-coder-1.5b with Docker Model Runner:
docker model run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- Lemonade
How to use Nanthasit/sakthai-coder-1.5b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Nanthasit/sakthai-coder-1.5b:Q4_K_M
Run and chat with the model
lemonade run user.sakthai-coder-1.5b-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Nanthasit/sakthai-coder-1.5b with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Nanthasit/sakthai-coder-1.5b:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Nanthasit/sakthai-coder-1.5b with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Nanthasit/sakthai-coder-1.5b:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download .github/copilot-instructions.md from Nanthasit/sakthai-coder-1.5b: direct link, hf CLI and curl.
- Browser
- Download file 5.66 kB
-
https://huggingface.co/Nanthasit/sakthai-coder-1.5b/resolve/15e22e44705543591df52fcc2bf70eb397fa8485/.github/copilot-instructions.md
- Command line
-
hf download hf://Nanthasit/sakthai-coder-1.5b@15e22e44705543591df52fcc2bf70eb397fa8485/.github/copilot-instructions.md
-
curl -L -o copilot-instructions.md https://huggingface.co/Nanthasit/sakthai-coder-1.5b/resolve/15e22e44705543591df52fcc2bf70eb397fa8485/.github/copilot-instructions.md
Copilot instructions for sakthai-agent-v2
Purpose
- Quick, focused guidance for Copilot/CLI assistants working in this repository.
- Consult these files for deeper context: README.md, CLAUDE.md, CONTRIBUTING.md and docs/*.
- Build, test, and lint (commands)
Install (preferred, reproducible):
- uv sync --all-extras
- or: pip install -e ".[dev]" (dev toolchain)
- optional dashboard extras: pip install -e ".[dashboard]"
Full test suite (hermetic):
- python -m pytest tests/ -q
Run a single test file (example):
- python -m pytest tests/test_memory_store.py -q
Exclude integration tests (CI default):
- python -m pytest -m "not integration" -q
Lint / format / types / security (mirror CI):
- ruff check sakthai tests
- ruff format --check sakthai tests
- mypy sakthai
- bandit -c pyproject.toml -r sakthai
Notes:
- CI runs on Python 3.11–3.13 and requires green lint + tests before merging.
- Coverage floor: fail_under = 85 (tool.coverage.report in pyproject.toml).
- High-level architecture (big picture)
- One package, three ways in: CLI (sakthai), Agent loop (sakthai run "task"), MCP stdio server (sakthai mcp).
- Data flow: CLI / MCP -> agent loop -> tool registry (sakthai/agent/tools.py) -> MemoryStore (sakthai/memory/store.py) -> SQLite DB (~/.sakthai/memory.db; override with SAKTHAI_HOME).
- Core subsystems:
- memory/: MemoryStore is the single SQLite seam; provider adapter injects memory into prompts.
- agent/: run_agent orchestration, tool registry, and providers (Anthropic/Gemini/OpenAI/Ollama).
- mcp/: inbound JSON-RPC stdio server and outbound client/manager for external MCP servers.
- cli/: Click commands that surface the tools and runtimes.
- skills/ & library/: SKILL.md-based skills injected into the system prompt.
- Entry points share the same tool registry: add a tool once (agent/tools.BUILTIN_TOOLS) and it appears in both agent loop and MCP.
- Key repository conventions (do not deviate)
- Memory store is the seam: all SQLite access must go through sakthai/memory/store.py (MemoryStore).
- Config centralization: use sakthai/config.py for paths and env-var names; do not hard-code paths.
- Dependency injection: run_agent() and mcp.handle_request()/manager accept injectable client/store arguments — prefer DI for testability; avoid module-level globals for clients/stores.
- Tests are hermetic: no network or GCP credentials. Mark integration tests with @pytest.mark.integration; they self-skip when credentials are absent. Use MemoryStore(":memory:") and tmp_path fixtures.
- Sandbox defaults: read_file limited to cwd + ~/.sakthai + SAKTHAI_READ_ALLOW; run_command is opt-in via SAKTHAI_SHELL_ALLOW. Respect these guards.
- Tool registry is authoritative: add new tools to sakthai/agent/tools.py (BUILTIN_TOOLS) and write tests in tests/test_tools.py using an injected MemoryStore.
- Later tool wins: ToolRegistry.with_tools() allows external plugins/MCP servers to shadow built-ins by name.
- Schema migrations: migrations are additive (ALTER TABLE only), run under BEGIN IMMEDIATE; never drop columns/tables in a migration.
- Lint/type scope: ruff excludes library/ and scripts/; mypy only checks sakthai/ (dashboard/app.py is ignored). Keep new code strict-clean.
- Ollama networking: prefer 127.0.0.1 (not localhost) for Ollama hosts to avoid IPv6 resolution issues.
- Important files to consult
- README.md, CLAUDE.md (project-specific assistant guidance).
- CONTRIBUTING.md (quality bar, CI gates, test examples).
- docs/architecture.md, docs/plugins.md, docs/runtimes.md (detailed diagrams and flows).
- sakthai/agent/tools.py (BUILTIN_TOOLS) and sakthai/memory/store.py (MemoryStore) — the two critical seams.
- Test & dev patterns
- New tests: inject MemoryStore(":memory:") and mock provider clients at the provider boundary; keep tests hermetic.
- Use git worktrees for isolated development if multiple agents/devs share the checkout (see CONTRIBUTING.md).
- AI assistant configs
- This repository contains CLAUDE.md. Copilot sessions should read it before making repository-wide recommendations.
- When editing code
- Make surgical edits only. Validate with ruff, mypy, bandit, pytest locally before suggesting a PR. Update docs (README, docs/, CLAUDE.md) if behavior or conventions change.
Maintainer note
- Created from README.md, CLAUDE.md, CONTRIBUTING.md and pyproject.toml.
MCP servers — example config
Add a JSON file at ~/.sakthai/mcp.json (or under SAKTHAI_HOME) to declare external MCP servers. Example entries below can be dropped into that file or used as a starting point for local development.
Example (Ollama):
{
"servers": [
{
"name": "ollama",
"command": "ollama",
"args": ["mcp", "serve"],
"env": {}
}
]
}
Notes & tips:
- Ollama: when used as a provider prefer
OLLAMA_HOST=http://127.0.0.1:11434(IPv4 literal avoids localhost/IPv6 issues). - GitHub-style npx MCP server example:
{
"servers": [
{
"name": "github",
"command": "npx",
"args": ["-y", "@modelcontextprotocol/server-github"],
"env": { "GITHUB_PERSONAL_ACCESS_TOKEN": "your-token-here" }
}
]
}
How SakThai uses these specs:
- On
sakthai run, SakThai auto-loads ~/.sakthai/mcp.json and attempts to start each server, merging their tools into the registry as<server>__<tool>. - Use
sakthai statusorsakthai status | sakthai toolsto list discovered tools. - Pass
--no-mcptosakthai runto disable MCP discovery.
Would you like me to also add a docs/example file in the repository (docs/example-mcp.json) with these entries?"}