Instructions to use RalphLabsAI/ralph-crowns with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use RalphLabsAI/ralph-crowns with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf RalphLabsAI/ralph-crowns # Run inference directly in the terminal: llama cli -hf RalphLabsAI/ralph-crowns
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf RalphLabsAI/ralph-crowns # Run inference directly in the terminal: llama cli -hf RalphLabsAI/ralph-crowns
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf RalphLabsAI/ralph-crowns # Run inference directly in the terminal: ./llama-cli -hf RalphLabsAI/ralph-crowns
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf RalphLabsAI/ralph-crowns # Run inference directly in the terminal: ./build/bin/llama-cli -hf RalphLabsAI/ralph-crowns
Use Docker
docker model run hf.co/RalphLabsAI/ralph-crowns
- LM Studio
- Jan
- vLLM
How to use RalphLabsAI/ralph-crowns with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "RalphLabsAI/ralph-crowns" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "RalphLabsAI/ralph-crowns", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/RalphLabsAI/ralph-crowns
- Ollama
How to use RalphLabsAI/ralph-crowns with Ollama:
ollama run hf.co/RalphLabsAI/ralph-crowns
- Unsloth Desktop
- Docker Model Runner
How to use RalphLabsAI/ralph-crowns with Docker Model Runner:
docker model run hf.co/RalphLabsAI/ralph-crowns
- Lemonade
How to use RalphLabsAI/ralph-crowns with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull RalphLabsAI/ralph-crowns
Run and chat with the model
lemonade run user.ralph-crowns-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
Download crowns.json from RalphLabsAI/ralph-crowns: direct link, hf CLI and curl.
- Browser
- Download file 2.99 kB
-
https://huggingface.co/RalphLabsAI/ralph-crowns/resolve/main/crowns.json
- Command line
-
hf download hf://RalphLabsAI/ralph-crowns/crowns.json
-
curl -L -o crowns.json https://huggingface.co/RalphLabsAI/ralph-crowns/resolve/main/crowns.json
2.99 kB
| { | |
| "binary": { | |
| "chat_template_present": false, | |
| "code_bits": 1.0, | |
| "container_bits": 1.125, | |
| "file_bytes": 1158964160, | |
| "file_sha256": "05c568169fc180067172cbdd38c1a9f5c249a556ffdef1dacd7172bad40fab58", | |
| "filename": "ralph-qwen3-8b-binary.gguf", | |
| "miner": "5HMwB4rqW7MnawkfUFUX4FcRcBympynru587RhEZyY8ns43a", | |
| "model_id": "e9f6bd656075dc9a4096d6f3da06441094334c2e058d22dc5409b404ccb1dd6a", | |
| "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000007-f42ae20c6ed2a796.json", | |
| "retention": 0.263616, | |
| "round": 7, | |
| "source_repo": "ArizonaZZZ/ralph-v2-qwen3-8b-binary-p2A2-step500-05c56816", | |
| "source_revision": "29c525c5c3166df2d62d5e180d09255199f778fe", | |
| "tier": "binary" | |
| }, | |
| "sub2": { | |
| "chat_template_present": true, | |
| "code_bits": 2.2626, | |
| "container_bits": 2.81, | |
| "file_bytes": 2937263168, | |
| "file_sha256": "9c45bf0ac486e793bd761a99ce4b9d965ec12e70f2d420e02af16797c71f6b50", | |
| "filename": "ralph-qwen3-8b-sub2.gguf", | |
| "miner": "5DeneVpvebmKrpegpoeBsCDFof5dTzgBFsgEfH3YKSKYWduh", | |
| "model_id": "72136433b8f4613cf794a642b664b28dcbdf054f3e6499f8a6127f490da8cac1", | |
| "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000007-f42ae20c6ed2a796.json", | |
| "retention": 0.282457, | |
| "round": 7, | |
| "source_repo": "boweizh1204/ralph-qwen3-8b-sub2-qat5", | |
| "source_revision": "261d535f67ba8e59f5d96ce7deeed98243ad8892", | |
| "tier": "sub2" | |
| }, | |
| "sub4": { | |
| "chat_template_present": true, | |
| "code_bits": 4.0, | |
| "container_bits": 4.5, | |
| "file_bytes": 4614304896, | |
| "file_sha256": "b2ec80dce90258bbe9555a67983dea595d91f35cae48ca0d54c714eae8100edf", | |
| "filename": "ralph-qwen3-8b-sub4.gguf", | |
| "miner": "5CPABbwvKphDTGP5qsAdpBNACNkoh3yhEBAtuwCYdYw9PZto", | |
| "model_id": "d6e83ec7141a70eafe4f505ab6abf294ca346c015bd84f2e8faea6d1a72c6cab", | |
| "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000007-f42ae20c6ed2a796.json", | |
| "retention": 0.320923, | |
| "round": 7, | |
| "source_repo": "boweizh1204/qwen3-8b-ralph-sub4-c1b-20260910", | |
| "source_revision": "3c21306c630dac6440b37ad67b965a4b9b787cf9", | |
| "tier": "sub4" | |
| }, | |
| "ternary": { | |
| "chat_template_present": true, | |
| "code_bits": 1.714, | |
| "container_bits": 2.3986, | |
| "file_bytes": 2477212736, | |
| "file_sha256": "c643cb42575a7a85b7518fd935973202c5686db270ef8b593afa8616a986154a", | |
| "filename": "ralph-qwen3-8b-ternary.gguf", | |
| "miner": "5HNA3Fegavpufa9CmAUn2Sm1NQu41LYWxGnrSp1twzSYiYbu", | |
| "model_id": "ff244ec7ca827af53332b4758337641792596d8bca9d760ad34b56daeabcd523", | |
| "record": "https://huggingface.co/datasets/RalphLabsAI/ralph-v2-rounds/resolve/main/rounds/round-00000005-25e6fd0528a93e74.json", | |
| "retention": 0.253732, | |
| "round": 5, | |
| "source_repo": "tensor-tailor/ralph-qwen3-8b-ternary-r5", | |
| "source_revision": "3e4096acf9ce1eb270ba3897b5d8396425a18884", | |
| "tier": "ternary" | |
| } | |
| } | |