Instructions to use ukisai/Swift-1.5-4bit-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use ukisai/Swift-1.5-4bit-MLX with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("ukisai/Swift-1.5-4bit-MLX") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use ukisai/Swift-1.5-4bit-MLX with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ukisai/Swift-1.5-4bit-MLX"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "ukisai/Swift-1.5-4bit-MLX" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use ukisai/Swift-1.5-4bit-MLX with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "ukisai/Swift-1.5-4bit-MLX"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "ukisai/Swift-1.5-4bit-MLX" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ukisai/Swift-1.5-4bit-MLX", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use ukisai/Swift-1.5-4bit-MLX with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ukisai/Swift-1.5-4bit-MLX"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default ukisai/Swift-1.5-4bit-MLX
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use ukisai/Swift-1.5-4bit-MLX with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ukisai/Swift-1.5-4bit-MLX"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "ukisai/Swift-1.5-4bit-MLX" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download UPLOAD_MANIFEST.json from ukisai/Swift-1.5-4bit-MLX: direct link, hf CLI and curl.
- Browser
- Download file 12.5 kB
-
https://huggingface.co/ukisai/Swift-1.5-4bit-MLX/resolve/main/UPLOAD_MANIFEST.json
- Command line
-
hf download hf://ukisai/Swift-1.5-4bit-MLX/UPLOAD_MANIFEST.json
-
curl -L -o UPLOAD_MANIFEST.json https://huggingface.co/ukisai/Swift-1.5-4bit-MLX/resolve/main/UPLOAD_MANIFEST.json
12.5 kB
| { | |
| "repository": "ukisai/Swift-1.5-4bit-MLX", | |
| "private": false, | |
| "source_repository": "ukisai/Swift-1.5-Qwen3.8-27b", | |
| "source_revision": "00ccd14e006897d28cb0ed5bf26390e60d274251", | |
| "files": [ | |
| { | |
| "path": ".gitattributes", | |
| "bytes": 1686, | |
| "sha256": "8a9fd1f95733fb82a6cba50f5ea2b1e26ca7578bea7a7cc21b4301ff83b1ce3b" | |
| }, | |
| { | |
| "path": "FULL_MAC_VALIDATION.md", | |
| "bytes": 3562, | |
| "sha256": "92cf16c5549a39fd8176028053bf57181eaf2c5fe31b142b36b961d0a5f6bf4a" | |
| }, | |
| { | |
| "path": "LICENSE", | |
| "bytes": 13306, | |
| "sha256": "1367057bf17041aa1d69286a1400be5f464d2f8b8f54f600088b209eac1850be" | |
| }, | |
| { | |
| "path": "LICENSE-APACHE-2.0", | |
| "bytes": 11544, | |
| "sha256": "bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a" | |
| }, | |
| { | |
| "path": "NOTICE", | |
| "bytes": 1133, | |
| "sha256": "be30f3d464974990e40e9833bc6f356fd89fe16733c6c1a581d97106b8ae741d" | |
| }, | |
| { | |
| "path": "QUANTIZATION_MANIFEST.json", | |
| "bytes": 8230, | |
| "sha256": "9f061d15042d9368e2c6a406ee20071ba6d78ce8da4c3ca53bfc13f5c2f95dd1" | |
| }, | |
| { | |
| "path": "QUICKSTART.md", | |
| "bytes": 4671, | |
| "sha256": "42046f33ae7e07154c89cacb32fe1569e4931dc82177406b03f5da91d28190cc" | |
| }, | |
| { | |
| "path": "README.md", | |
| "bytes": 10794, | |
| "sha256": "e30be618a534d318226726f04f7868242fc19550714dab1d617f48e7e3e35a45" | |
| }, | |
| { | |
| "path": "SERVER_CACHE_UPDATE.md", | |
| "bytes": 5337, | |
| "sha256": "a6f648d3491eb4e9bd6f9c3291b38bc33aab1e64030e308b96a843f747b1cfc3" | |
| }, | |
| { | |
| "path": "TROUBLESHOOTING.md", | |
| "bytes": 6339, | |
| "sha256": "8a0c5babebad8cc24ef5f3f7df3189806318d04dee723c145a67f5bc667343ae" | |
| }, | |
| { | |
| "path": "USAGE.md", | |
| "bytes": 8387, | |
| "sha256": "bbf3b30ad7cf5b6453ab485fbade6018cd736523f92e2de11560e5bb95c4bb39" | |
| }, | |
| { | |
| "path": "chat_template.jinja", | |
| "bytes": 8952, | |
| "sha256": "c3cf9e34abf4f9e36c2d72165aa9c132d3e2a725b6c2586aaa3a8af9d7a81041" | |
| }, | |
| { | |
| "path": "check_download.py", | |
| "bytes": 9658, | |
| "sha256": "1e424a32bb015431df22b8f058aa18de116ae63e0440d60424792a1cf2fd4018" | |
| }, | |
| { | |
| "path": "compatibility/MLX-LM-LICENSE", | |
| "bytes": 1066, | |
| "sha256": "ccfab7ccb2ea306f71531c8ca77bb55507606cd90768b1e32b8b52ab5b48cf01" | |
| }, | |
| { | |
| "path": "compatibility/SOURCE_EXPORT_MANIFEST.json", | |
| "bytes": 62808, | |
| "sha256": "77dd1e156ac7f0c3f5e241bbbb2a0d721fb0e3513d8dd6870862509a1812275e" | |
| }, | |
| { | |
| "path": "compatibility/architecture-compatibility-report.md", | |
| "bytes": 2465, | |
| "sha256": "39d19fae47331b0e70f661a839c7b320d540985f8ed56b8d2d5f171128d0eaf4" | |
| }, | |
| { | |
| "path": "compatibility/aws-actual-source-structural-results.json", | |
| "bytes": 2144, | |
| "sha256": "a869d8e7a5048f59089077f37135cdc63ec955ad38738bc1b6bbc6460cc9d7bc" | |
| }, | |
| { | |
| "path": "compatibility/aws-source-verification.json", | |
| "bytes": 379707, | |
| "sha256": "ad944ae15bedaaec80abf9cd5e9e945f478397328cf3145f19517ff96295ad9c" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/full-mac-4bit-results.json", | |
| "bytes": 3127, | |
| "sha256": "57c1c0924fadfec93f70a0787e31af02c36e8c996e30529ebd318b3a680b9f6f" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/full-mac-5bit-results.json", | |
| "bytes": 3123, | |
| "sha256": "92f539012ef169ada9ab9970b077425664c80c7369f70c0faa58c927c6005951" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/offline-4bit-results.json", | |
| "bytes": 5014, | |
| "sha256": "ddcfa5f200aa57d1cdadc6225299329b592e858bea2502e9bf07d313f4cf149a" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/offline-5bit-results.json", | |
| "bytes": 5014, | |
| "sha256": "f50ca1c21eafc43623f1461999e33e99b9e684a990d926aa77fbe59cb919fe25" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/synthetic-config.json", | |
| "bytes": 1814, | |
| "sha256": "852fa793054753245559ffeae66d4367b6009f3ebdb7ca611747ec7564d785c7" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/test_server_cache_http.py", | |
| "bytes": 9689, | |
| "sha256": "e7aff50b441145338575a50c7abc5fb6d40fdac3d11bbf6433d909ecfe22483b" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/validate_full_mac_cache.py", | |
| "bytes": 8156, | |
| "sha256": "3e48876b07fb73f88c489e3804c9676872b6c1972650447de5820f1966b5811e" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/validation.json", | |
| "bytes": 1984, | |
| "sha256": "288450e5a3b34d4c45ce16489de749f49c7bd03cd2d28d4940d4bd94953022a5" | |
| }, | |
| { | |
| "path": "compatibility/cache-tests/verify_server_patch.py", | |
| "bytes": 504, | |
| "sha256": "4c3acf33b4b9ffe0131c45ad0584785767a81cf455f9f60d9ec814e4b7eaf61a" | |
| }, | |
| { | |
| "path": "compatibility/compatibility-tests-linux.log", | |
| "bytes": 99, | |
| "sha256": "e8735c26c6801337a00665881341818701e196a0c69ebd90f7702d98535f3179" | |
| }, | |
| { | |
| "path": "compatibility/conversion-command.json", | |
| "bytes": 581, | |
| "sha256": "94e711a0a931855979a4db1d83a43cd54167f55c829c74e24135c8ad583a7f2b" | |
| }, | |
| { | |
| "path": "compatibility/conversion-result.json", | |
| "bytes": 689, | |
| "sha256": "aa74632f5e0ebe7cfaccb9fd8251ccfd7dbe9d81e9384658e7d313b611acafc7" | |
| }, | |
| { | |
| "path": "compatibility/conversion.log", | |
| "bytes": 113, | |
| "sha256": "927e01909126b96eea5faf9692d99f02fdaf99d1aa61d14d257f3ebdb0afd1a0" | |
| }, | |
| { | |
| "path": "compatibility/cpu-quantized-matmul-diagnostic.json", | |
| "bytes": 290, | |
| "sha256": "5adefdff0a3efbc54c1abc92cd05aa18e63a39771fe9d6b8972bcd2fea1cf3d3" | |
| }, | |
| { | |
| "path": "compatibility/environment-linux.json", | |
| "bytes": 367, | |
| "sha256": "efdd012bfc5ad59f07f9dc6e8a6bd67bb992cd9363174171c271ce1ad5ee0cec" | |
| }, | |
| { | |
| "path": "compatibility/fixed-affine-test.log", | |
| "bytes": 113, | |
| "sha256": "a40772b0d08d9f5ce659ee06cd5e5573ec0697073295d819a5dc9b6b1f4302bd" | |
| }, | |
| { | |
| "path": "compatibility/launcher-validation.json", | |
| "bytes": 1598, | |
| "sha256": "30a08c065138836fbf9fa3c4b586e303742b5a7a155294177a15fc23e0efef50" | |
| }, | |
| { | |
| "path": "compatibility/mac-check/README.md", | |
| "bytes": 759, | |
| "sha256": "e66967ff8d712bd3c2f174a21f4a438266f183b9e40991088726efc28d3dec4c" | |
| }, | |
| { | |
| "path": "compatibility/mac-check/fixtures.zip", | |
| "bytes": 3527833, | |
| "sha256": "f63de30021e270912d939cbf18a75165b30e03c177f98bb9a9051694f050d102" | |
| }, | |
| { | |
| "path": "compatibility/mac-compatibility-results.json", | |
| "bytes": 1924, | |
| "sha256": "45f665d5fb442861c40631b78d1134a888b318e30382d729e7e8a703b94434e2" | |
| }, | |
| { | |
| "path": "compatibility/missing-file-recovery-report.md", | |
| "bytes": 1046, | |
| "sha256": "78fe1768db6b2c95354638cf257bea795389c14b38e4872fb3150df851b9d3ec" | |
| }, | |
| { | |
| "path": "compatibility/public-download-fix.md", | |
| "bytes": 1253, | |
| "sha256": "5fc12389cd6cfc4e1cad5094983690fde7d483e3d58ca7fccb7b21925f8e0788" | |
| }, | |
| { | |
| "path": "compatibility/quant-tensor-mapping-manifest.json", | |
| "bytes": 646822, | |
| "sha256": "bf99693a9747c476af80b306bf61df546824815fb934cc6bfa1ed150fa967587" | |
| }, | |
| { | |
| "path": "compatibility/quant-validation-results.json", | |
| "bytes": 3783, | |
| "sha256": "ecb99453d4c2b23a818f121d0e2c141328dded5f7fac205af766221ec973ae1d" | |
| }, | |
| { | |
| "path": "compatibility/quant-validation.log", | |
| "bytes": 4092, | |
| "sha256": "8616f0367709a655a549a458c7d337ba326681646de9ce01b61439a270b2b493" | |
| }, | |
| { | |
| "path": "compatibility/requirements-linux.txt", | |
| "bytes": 810, | |
| "sha256": "89a4ef8054809e043b1e0b1c7b0f41847666a7fd7d263c325311b30be9eb798f" | |
| }, | |
| { | |
| "path": "compatibility/run-compatibility.sh", | |
| "bytes": 1059, | |
| "sha256": "1024e009047bf97ba4876b8543f4151728b1c85f2c93abf09b73f7811c1a25fb" | |
| }, | |
| { | |
| "path": "compatibility/run-conversion.py", | |
| "bytes": 2860, | |
| "sha256": "6d612bbfd438abdecf393f16143f724c1d37f60903ca8ce46da486c2f3671a41" | |
| }, | |
| { | |
| "path": "compatibility/setup-linux.sh", | |
| "bytes": 1734, | |
| "sha256": "e253306f08eb86d66e1c15d02733e349a5f82c00abb15ff0656f5ce40acfb775" | |
| }, | |
| { | |
| "path": "compatibility/source-file-manifest.csv", | |
| "bytes": 4842, | |
| "sha256": "f4fec6fc3318813395745f4d68700ebaf13e13bbf9bbdf2b90454faf6bbe721e" | |
| }, | |
| { | |
| "path": "compatibility/swift15-mlx-lm.patch", | |
| "bytes": 38976, | |
| "sha256": "f6f1d0bdafa45863bfbf93dac0398c481c993ea04fdf38b9bae98c643f89eaec" | |
| }, | |
| { | |
| "path": "compatibility/swift15-server-cache.patch", | |
| "bytes": 9356, | |
| "sha256": "a7fbc0f0524ee7864d9f41a98a2e35acf0e63f53e369ee5b9a87ca12926a9eab" | |
| }, | |
| { | |
| "path": "compatibility/unmatched-tensor-analysis.csv", | |
| "bytes": 102593, | |
| "sha256": "57f6537c39953a2f02971c2ef09ccfb7806f0ea729a6143fa90157e1b961ed05" | |
| }, | |
| { | |
| "path": "compatibility/validate-mac-format.py", | |
| "bytes": 4344, | |
| "sha256": "42099ac06ebe3616c160d7e062fb5ab3a615d19912e5c974e574b7708064b452" | |
| }, | |
| { | |
| "path": "compatibility/validate-quant.py", | |
| "bytes": 8617, | |
| "sha256": "484255b5a4a8f71119312ed1ae54b1246f5b4dd70ef698fb32d4cc78c75ffba9" | |
| }, | |
| { | |
| "path": "compatibility/validate_aws_source_linux.py", | |
| "bytes": 4798, | |
| "sha256": "40c8f2678e7efa1ec6df9acbefc7e0c65def8e707d70d78257b0baff02d9b3d8" | |
| }, | |
| { | |
| "path": "compatibility/verify_source_readonly.py", | |
| "bytes": 4093, | |
| "sha256": "2d02c6d7c7e81f6029faf3f7cfcd43ba6b0ca7d3858dd3e5e6c1a82a5631e765" | |
| }, | |
| { | |
| "path": "config.json", | |
| "bytes": 4577, | |
| "sha256": "d0bbe7655fdaa589acbdf3739e2f2378d2c7462da05338ad5161c70025540b98" | |
| }, | |
| { | |
| "path": "generation_config.json", | |
| "bytes": 202, | |
| "sha256": "e70c136c1b78ddc1fb0905bac8e733a4dc448d4f852a5dd75143fffc70be550e" | |
| }, | |
| { | |
| "path": "merges.txt", | |
| "bytes": 3353259, | |
| "sha256": "a9d356d7bdf1ef4949e3e748e95b8e10ad9d4e2e838eddc38a0a7b6b94d1db8d" | |
| }, | |
| { | |
| "path": "model-00001-of-00003.safetensors", | |
| "bytes": 5328325554, | |
| "sha256": "d91b70ca84dff315addeeb8a599dce2beccfec33c7483686ede2e8ff3cc459dc" | |
| }, | |
| { | |
| "path": "model-00002-of-00003.safetensors", | |
| "bytes": 5354185158, | |
| "sha256": "eddcff1a6ef0971990f7cd01dba77ab9a8c20d59821bb4cd7e25234fe3809346" | |
| }, | |
| { | |
| "path": "model-00003-of-00003.safetensors", | |
| "bytes": 5144253923, | |
| "sha256": "644cc5322ff706c9608b42ea1ff83e0beb12b828d49b36c468a366f44593b8eb" | |
| }, | |
| { | |
| "path": "model.safetensors.index.json", | |
| "bytes": 232537, | |
| "sha256": "937800b65e142989cf9f973de5c0f42b0a5ad0659871dd1b67d917d78a195921" | |
| }, | |
| { | |
| "path": "preprocessor_config.json", | |
| "bytes": 390, | |
| "sha256": "27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516" | |
| }, | |
| { | |
| "path": "swift-1.5-planet-demo.mp4", | |
| "bytes": 4738825, | |
| "sha256": "1cda6924169e8b83e5d6d7299baf8329ed1b1a182a481aa0e06344e0f5c00111" | |
| }, | |
| { | |
| "path": "swift_runtime.py", | |
| "bytes": 9029, | |
| "sha256": "7a459033c6c419e3f7e8cabf59b303767d002039ef5e0a2e2999521951716cbf" | |
| }, | |
| { | |
| "path": "tokenizer.json", | |
| "bytes": 12809320, | |
| "sha256": "0997f410c57a1f4e53b09e4be8f4a172d90edd9564368fb0847030937229b9f3" | |
| }, | |
| { | |
| "path": "tokenizer_config.json", | |
| "bytes": 17928, | |
| "sha256": "b11349aafa7cdc6a320767cf7ceb29ed82f7eda5d65e8e0819e76f0ce947bf27" | |
| }, | |
| { | |
| "path": "ukisai-banner.png", | |
| "bytes": 307739, | |
| "sha256": "8577252b8b37e331f06f7ddecdf3bfa1c497e164f9eb36d78c37232d1b8492ca" | |
| }, | |
| { | |
| "path": "video_preprocessor_config.json", | |
| "bytes": 385, | |
| "sha256": "7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13" | |
| }, | |
| { | |
| "path": "vocab.json", | |
| "bytes": 6722759, | |
| "sha256": "ce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003" | |
| } | |
| ], | |
| "total_bytes_excluding_manifest": 15859880924, | |
| "manifest_self_excluded": true, | |
| "packaging_update": "2026-09-24: diagnostic fixtures archived; model weights unchanged", | |
| "diagnostic_update": "2026-09-25: clarify required runtime; add download/runtime checker; weights unchanged", | |
| "cache_settings_update": "2026-09-25: document public server options and synthetic multi-turn tests; model unchanged", | |
| "server_cache_update": "2026-09-25: bounded cache reuse runtime patch and recorded local tests; weights unchanged" | |
| } | |