Instructions to use ukisai/Swift-1.5-5bit-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use ukisai/Swift-1.5-5bit-MLX with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("ukisai/Swift-1.5-5bit-MLX") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use ukisai/Swift-1.5-5bit-MLX with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ukisai/Swift-1.5-5bit-MLX"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "ukisai/Swift-1.5-5bit-MLX" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use ukisai/Swift-1.5-5bit-MLX with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "ukisai/Swift-1.5-5bit-MLX"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "ukisai/Swift-1.5-5bit-MLX" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ukisai/Swift-1.5-5bit-MLX", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use ukisai/Swift-1.5-5bit-MLX with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ukisai/Swift-1.5-5bit-MLX"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default ukisai/Swift-1.5-5bit-MLX
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use ukisai/Swift-1.5-5bit-MLX with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ukisai/Swift-1.5-5bit-MLX"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "ukisai/Swift-1.5-5bit-MLX" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download UPLOAD_MANIFEST.json from ukisai/Swift-1.5-5bit-MLX: direct link, hf CLI and curl.
- Browser
- Download file 10.6 kB
-
https://huggingface.co/ukisai/Swift-1.5-5bit-MLX/resolve/main/UPLOAD_MANIFEST.json
- Command line
-
hf download hf://ukisai/Swift-1.5-5bit-MLX/UPLOAD_MANIFEST.json
-
curl -L -o UPLOAD_MANIFEST.json https://huggingface.co/ukisai/Swift-1.5-5bit-MLX/resolve/main/UPLOAD_MANIFEST.json
10.6 kB
| { | |
| "files": [ | |
| { | |
| "path": ".gitattributes", | |
| "bytes": 1686, | |
| "sha256": "8a9fd1f95733fb82a6cba50f5ea2b1e26ca7578bea7a7cc21b4301ff83b1ce3b", | |
| "git_blob_sha1": "3727b14f485a05787b6cda82f0346eaeaa2e751b" | |
| }, | |
| { | |
| "path": "FULL_MAC_VALIDATION.md", | |
| "bytes": 3562, | |
| "sha256": "92cf16c5549a39fd8176028053bf57181eaf2c5fe31b142b36b961d0a5f6bf4a" | |
| }, | |
| { | |
| "path": "LICENSE", | |
| "bytes": 13306, | |
| "sha256": "1367057bf17041aa1d69286a1400be5f464d2f8b8f54f600088b209eac1850be", | |
| "git_blob_sha1": "209a5720f7e4a747e658b49808a933309eeecceb" | |
| }, | |
| { | |
| "path": "LICENSE-APACHE-2.0", | |
| "bytes": 11544, | |
| "sha256": "bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a", | |
| "git_blob_sha1": "f938136e3adacfd92be087f6e113b5d6d97f678f" | |
| }, | |
| { | |
| "path": "NOTICE", | |
| "bytes": 1133, | |
| "sha256": "be30f3d464974990e40e9833bc6f356fd89fe16733c6c1a581d97106b8ae741d", | |
| "git_blob_sha1": "c4ad1a7188a4191cb5efd0f5109bf6e9ba8caee8" | |
| }, | |
| { | |
| "path": "QUANTIZATION_MANIFEST.json", | |
| "bytes": 2946, | |
| "sha256": "7bbc577963403dd60e93e994a8aeb12142558031d985489aea27708a97ada4cf", | |
| "git_blob_sha1": "b25e2206cf43c5b85231da234a5014e1ea2e1e99" | |
| }, | |
| { | |
| "path": "QUICKSTART.md", | |
| "bytes": 4671, | |
| "sha256": "ead1799e0d97cb6b1a3685cd884c1b2bd0fd8d4a3c227732d0f8bf41cdd28b33" | |
| }, | |
| { | |
| "path": "README.md", | |
| "bytes": 8779, | |
| "sha256": "65ee658b3c270501dc4ddb85a8301a661157cae1ec8956ec66aa9a48bb2301db" | |
| }, | |
| { | |
| "path": "SERVER_CACHE_UPDATE.md", | |
| "bytes": 5328, | |
| "sha256": "ad46230241b2c21577e2fa35fae8f3aff99d783bb72a66a8852a070e20edb23b" | |
| }, | |
| { | |
| "path": "TROUBLESHOOTING.md", | |
| "bytes": 6359, | |
| "sha256": "25f30d973d23e2352590af6a077dca7223e434b10b7dcf511480c88e073c2171" | |
| }, | |
| { | |
| "path": "USAGE.md", | |
| "bytes": 7594, | |
| "sha256": "3176fc832b360fd6e0de012db1ad5078d78456f74857a234b473654f5764a8c9" | |
| }, | |
| { | |
| "path": "chat_template.jinja", | |
| "bytes": 8952, | |
| "sha256": "c3cf9e34abf4f9e36c2d72165aa9c132d3e2a725b6c2586aaa3a8af9d7a81041", | |
| "git_blob_sha1": "c0c686f9c38d70d179fb7b5f5aa7530bc913dda3" | |
| }, | |
| { | |
| "path": "check_download.py", | |
| "bytes": 9658, | |
| "sha256": "1e424a32bb015431df22b8f058aa18de116ae63e0440d60424792a1cf2fd4018", | |
| "git_blob_sha1": "57c4bddd7813e480c7a738ea997e2bb4e3cc51ff" | |
| }, | |
| { | |
| "path": "compatibility/LICENSE-MLX-LM-MIT", | |
| "bytes": 1066, | |
| "sha256": "ccfab7ccb2ea306f71531c8ca77bb55507606cd90768b1e32b8b52ab5b48cf01", | |
| "git_blob_sha1": "98ff47b9ef9d4ac9f1a4bde3db13dd27456c5ea1" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/full-mac-4bit-results.json", | |
| "bytes": 3127, | |
| "sha256": "57c1c0924fadfec93f70a0787e31af02c36e8c996e30529ebd318b3a680b9f6f" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/full-mac-5bit-results.json", | |
| "bytes": 3123, | |
| "sha256": "92f539012ef169ada9ab9970b077425664c80c7369f70c0faa58c927c6005951" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/offline-4bit-results.json", | |
| "bytes": 5014, | |
| "sha256": "ddcfa5f200aa57d1cdadc6225299329b592e858bea2502e9bf07d313f4cf149a" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/offline-5bit-results.json", | |
| "bytes": 5014, | |
| "sha256": "f50ca1c21eafc43623f1461999e33e99b9e684a990d926aa77fbe59cb919fe25" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/synthetic-config.json", | |
| "bytes": 1814, | |
| "sha256": "852fa793054753245559ffeae66d4367b6009f3ebdb7ca611747ec7564d785c7" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/test_server_cache_http.py", | |
| "bytes": 9689, | |
| "sha256": "e7aff50b441145338575a50c7abc5fb6d40fdac3d11bbf6433d909ecfe22483b" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/validate_full_mac_cache.py", | |
| "bytes": 8156, | |
| "sha256": "3e48876b07fb73f88c489e3804c9676872b6c1972650447de5820f1966b5811e" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/validation.json", | |
| "bytes": 1984, | |
| "sha256": "288450e5a3b34d4c45ce16489de749f49c7bd03cd2d28d4940d4bd94953022a5" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/verify_server_patch.py", | |
| "bytes": 504, | |
| "sha256": "4c3acf33b4b9ffe0131c45ad0584785767a81cf455f9f60d9ec814e4b7eaf61a" | |
| }, | |
| { | |
| "path": "compatibility/conversion-result.json", | |
| "bytes": 694, | |
| "sha256": "46d5f5abfae73b29c2b65ec5a6d05decd8e4d5b50eb0dd0df90f94edae040986", | |
| "git_blob_sha1": "7b9848cd983f8f7df81116454907e733543fed82" | |
| }, | |
| { | |
| "path": "compatibility/enable-5bit.patch", | |
| "bytes": 2227, | |
| "sha256": "b985961eac3035e05ca4c9f3a8b283c26e6dd69bab4d113997fc04fe2a4f99cc", | |
| "git_blob_sha1": "c577d5a2b6ea8fe634076ebd1387ecf7575d5d27" | |
| }, | |
| { | |
| "path": "compatibility/environment-linux.json", | |
| "bytes": 274, | |
| "sha256": "29646417ed15e6c1d08602b5832287abd44aabf4da624ea06f7e0b617bccbb48", | |
| "git_blob_sha1": "0bca526431ce202cd367b40381cbdd041e02028e" | |
| }, | |
| { | |
| "path": "compatibility/launcher-validation.json", | |
| "bytes": 1598, | |
| "sha256": "30a08c065138836fbf9fa3c4b586e303742b5a7a155294177a15fc23e0efef50" | |
| }, | |
| { | |
| "path": "compatibility/macos-quantized-matmul-diagnostic.json", | |
| "bytes": 4399, | |
| "sha256": "90b992aa7535dde1ecbdcca93d6c8df78397689f4456e095abbae7c112d1754c", | |
| "git_blob_sha1": "d9475a8bb176a03cf7e3b6fd686e56b59e93e297" | |
| }, | |
| { | |
| "path": "compatibility/package-checks.json", | |
| "bytes": 77429, | |
| "sha256": "016ebd02e676cdecebb27c9049bd53bff0f803a219b81ad364ca1d769d7bedc8", | |
| "git_blob_sha1": "599f4e1d3b0e3c2d8032bc68d67b46a279490983" | |
| }, | |
| { | |
| "path": "compatibility/patch-manifest.json", | |
| "bytes": 380, | |
| "sha256": "c862249f212d4f94113a85336db22a24f3128014c034cdf9878fb9e44b103a95", | |
| "git_blob_sha1": "955f2d916e47bab3292448d9db7681808053df02" | |
| }, | |
| { | |
| "path": "compatibility/quant-validation-results.json", | |
| "bytes": 3784, | |
| "sha256": "5a2bdbaa7ffa5616b2edf4817953369c694596c6d41aca2ba458a48b651ebab2", | |
| "git_blob_sha1": "89c26ee2aabe9ce7717a0d91b217717af4d27b3f" | |
| }, | |
| { | |
| "path": "compatibility/source-structural-results.json", | |
| "bytes": 2503, | |
| "sha256": "cb9ccedd803a6cd336e7412de3da6809f89c30e567d3300e1c14af7f90e05fbf", | |
| "git_blob_sha1": "b2641ec35a9f4810da73f8d439ec4603147d15a8" | |
| }, | |
| { | |
| "path": "compatibility/source-verification.json", | |
| "bytes": 380649, | |
| "sha256": "27d87d8d5209c6559643efdd7d7b468b0138ebfb3a7d5771b29be79214bffe75", | |
| "git_blob_sha1": "c807fa472c01946b5ad47e1438f57e5980f01d38" | |
| }, | |
| { | |
| "path": "compatibility/swift15-mlx-lm.patch", | |
| "bytes": 38976, | |
| "sha256": "f6f1d0bdafa45863bfbf93dac0398c481c993ea04fdf38b9bae98c643f89eaec", | |
| "git_blob_sha1": "b739acc2e3b4cb82f073b7280255bcb898bb2a33" | |
| }, | |
| { | |
| "path": "compatibility/swift15-server-cache.patch", | |
| "bytes": 9356, | |
| "sha256": "a7fbc0f0524ee7864d9f41a98a2e35acf0e63f53e369ee5b9a87ca12926a9eab" | |
| }, | |
| { | |
| "path": "config.json", | |
| "bytes": 4577, | |
| "sha256": "77eaf6b1ee9e2ca06a9a3119f218853ec16c6f9f558e6b492a7e9a1be8d2ac43", | |
| "git_blob_sha1": "3b9f5cd48042e788592ec30c3e153ffe794e45c7" | |
| }, | |
| { | |
| "path": "generation_config.json", | |
| "bytes": 202, | |
| "sha256": "e70c136c1b78ddc1fb0905bac8e733a4dc448d4f852a5dd75143fffc70be550e", | |
| "git_blob_sha1": "023756cfadf88e5bf69eefeee3e172f38c448d64" | |
| }, | |
| { | |
| "path": "merges.txt", | |
| "bytes": 3353259, | |
| "sha256": "a9d356d7bdf1ef4949e3e748e95b8e10ad9d4e2e838eddc38a0a7b6b94d1db8d", | |
| "git_blob_sha1": "a494e019ca1502219fd0128658b979e5f05ae8e8" | |
| }, | |
| { | |
| "path": "model-00001-of-00004.safetensors", | |
| "bytes": 5360417859, | |
| "sha256": "9da8750595ec42d8c5d2ff0ae0b695e387cbcb3c0beac40f262e6d9a7196b59d" | |
| }, | |
| { | |
| "path": "model-00002-of-00004.safetensors", | |
| "bytes": 5338181777, | |
| "sha256": "b592723bd4e9f01344335cd7d4b4f41a7c8cde98e2e074ad1d943cdb951a6835" | |
| }, | |
| { | |
| "path": "model-00003-of-00004.safetensors", | |
| "bytes": 5355925620, | |
| "sha256": "0027e7fe05310d5b2d960414221ed0872de9b511aa7e6b1c3a8f0e4647558412" | |
| }, | |
| { | |
| "path": "model-00004-of-00004.safetensors", | |
| "bytes": 3227578201, | |
| "sha256": "afec577f16805b327471561d6841662eb4acf7d866ad5e761c5ef8cd3149d8f4" | |
| }, | |
| { | |
| "path": "model.safetensors.index.json", | |
| "bytes": 232537, | |
| "sha256": "83526f2e7856d41145f3599146a4a574ea2b258c4abe09302617243f13abec62", | |
| "git_blob_sha1": "936e7dc269c4155002581e4c5620f085ab1d64f0" | |
| }, | |
| { | |
| "path": "preprocessor_config.json", | |
| "bytes": 390, | |
| "sha256": "27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516", | |
| "git_blob_sha1": "2ea84a437d448ff71b08df68fdd949d5cc4ebb64" | |
| }, | |
| { | |
| "path": "swift-1.5-planet-demo.mp4", | |
| "bytes": 4738825, | |
| "sha256": "1cda6924169e8b83e5d6d7299baf8329ed1b1a182a481aa0e06344e0f5c00111" | |
| }, | |
| { | |
| "path": "swift_runtime.py", | |
| "bytes": 9029, | |
| "sha256": "7a459033c6c419e3f7e8cabf59b303767d002039ef5e0a2e2999521951716cbf" | |
| }, | |
| { | |
| "path": "tokenizer.json", | |
| "bytes": 12809320, | |
| "sha256": "0997f410c57a1f4e53b09e4be8f4a172d90edd9564368fb0847030937229b9f3" | |
| }, | |
| { | |
| "path": "tokenizer_config.json", | |
| "bytes": 17928, | |
| "sha256": "b11349aafa7cdc6a320767cf7ceb29ed82f7eda5d65e8e0819e76f0ce947bf27", | |
| "git_blob_sha1": "5de744b3fca2129d7186979ae47c06be33903243" | |
| }, | |
| { | |
| "path": "ukisai-banner.png", | |
| "bytes": 307739, | |
| "sha256": "8577252b8b37e331f06f7ddecdf3bfa1c497e164f9eb36d78c37232d1b8492ca" | |
| }, | |
| { | |
| "path": "verify_release.py", | |
| "bytes": 6662, | |
| "sha256": "02ac6ed751c4dd915d1673f2d501f3322d27039c3a32a5bc3c0264861e4d0982", | |
| "git_blob_sha1": "7e235791f8cfadb8321321231b3ea6359565db89" | |
| }, | |
| { | |
| "path": "video_preprocessor_config.json", | |
| "bytes": 385, | |
| "sha256": "7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13", | |
| "git_blob_sha1": "3ba673a5ad7d4d13f54155ecd38b2a94a6dac8fe" | |
| }, | |
| { | |
| "path": "vocab.json", | |
| "bytes": 6722759, | |
| "sha256": "ce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003", | |
| "git_blob_sha1": "0aa0ce0658d60ac4a5d609f4eadb0e8e43514176" | |
| } | |
| ], | |
| "file_count": 37, | |
| "total_bytes": 19310880490, | |
| "self_excluded": true, | |
| "total_bytes_excluding_manifest": 19310918334, | |
| "server_cache_update": "2026-09-25: bounded cache reuse runtime patch and recorded local tests; weights unchanged" | |
| } | |