Instructions to use infosave/Ternary-Bonsai-2-27B-cmf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- cortiq
How to use infosave/Ternary-Bonsai-2-27B-cmf with cortiq:
# one Rust binary, no additional dependencies cargo install cortiq-cli # or a prebuilt binary from github.com/infosave2007/cmf/releases hf download infosave/Ternary-Bonsai-2-27B-cmf --include "*.cmf" --local-dir . ls *.cmf # some repos ship more than one quantization
cortiq run FILE.cmf --prompt "What is the capital of France?"
cortiq serve FILE.cmf --port 8080 # OpenAI-compatible server
- Notebooks
- Google Colab
- Kaggle
Download STAGING_MANIFEST.json from infosave/Ternary-Bonsai-2-27B-cmf: direct link, hf CLI and curl.
- Browser
- Download file 4.15 kB
-
https://huggingface.co/infosave/Ternary-Bonsai-2-27B-cmf/resolve/5d73525ce2b2df90497dcf2732a486e593f0e619/STAGING_MANIFEST.json
- Command line
-
hf download hf://infosave/Ternary-Bonsai-2-27B-cmf@5d73525ce2b2df90497dcf2732a486e593f0e619/STAGING_MANIFEST.json
-
curl -L -o STAGING_MANIFEST.json https://huggingface.co/infosave/Ternary-Bonsai-2-27B-cmf/resolve/5d73525ce2b2df90497dcf2732a486e593f0e619/STAGING_MANIFEST.json
4.15 kB
| { | |
| "schema": "ternary-bonsai-2-q2tp-affine-hf-staging-files-1", | |
| "intended_repo": "infosave/Ternary-Bonsai-2-27B-cmf", | |
| "intended_model_filename": "Ternary-Bonsai-2-27B-Q2TP-Affine.cmf", | |
| "model_artifact_included": false, | |
| "model_artifact_sha256": "fb0f1a9cdb0434bc9ce50eb6473bc2ca4a71d6994ad61314bbd7e2f11c4e29e8", | |
| "model_artifact_bytes": 8247698536, | |
| "self_hash": "see STAGING_MANIFEST.sha256 (self and sidecar are excluded from files)", | |
| "file_count": 22, | |
| "total_bytes": 485136, | |
| "files": [ | |
| { | |
| "path": "README.md", | |
| "bytes": 6194, | |
| "sha256": "ceb132413eca6ba7f70870f4e0ee5c1758635b368e2e77b9b01b46842d6d34eb" | |
| }, | |
| { | |
| "path": "evaluation/REFERENCE_SCORER_NOTICE.txt", | |
| "bytes": 343, | |
| "sha256": "3f74ecab64f3dd828e5a17bea61e36a0d2dc98dc25590c3e1b7f3cda4a44d276" | |
| }, | |
| { | |
| "path": "evaluation/SCORE_RECIPE.md", | |
| "bytes": 2015, | |
| "sha256": "c0ba28b5661f61eb831f7908a69bc48671e14e342b624f8d7f6a9d622e3a1eff" | |
| }, | |
| { | |
| "path": "evaluation/cmf-affine-score.txt", | |
| "bytes": 395, | |
| "sha256": "f56c6b7266dac9e3e534159b6d0eeb74bfbfda42b43a881fb02ecdd76973374f" | |
| }, | |
| { | |
| "path": "evaluation/cmf-affine-summary.json", | |
| "bytes": 857, | |
| "sha256": "c425e00f2d6f930c50c0600b85410904d90a2c0a4cbdd074c1f626db8f4de997" | |
| }, | |
| { | |
| "path": "evaluation/official-reference-summary.json", | |
| "bytes": 637, | |
| "sha256": "ecb493329c56d797ce58f05ad65672a805f6b51327875b30a1908c8d34054333" | |
| }, | |
| { | |
| "path": "evaluation/performance-summary.json", | |
| "bytes": 357, | |
| "sha256": "d508ea57641ca2100b6050a3d5e986180787c40e73ef4ad709217807c718cb41" | |
| }, | |
| { | |
| "path": "evaluation/prompts.jsonl", | |
| "bytes": 2027, | |
| "sha256": "68f6b0b2ffc8526d2f37df7bb2e494531d533e336b6d4df8c1feeebd2652c1f5" | |
| }, | |
| { | |
| "path": "evaluation/quality-corpus-token-ids.txt", | |
| "bytes": 5774, | |
| "sha256": "6dd2b70cb1d4a18a2955737b9dc3711bc20cd951c48a086ce144dcfbff8eb47b" | |
| }, | |
| { | |
| "path": "evaluation/quality-corpus.txt", | |
| "bytes": 7029, | |
| "sha256": "181716ce3f0a71b94f7d5d4428232c241b88f3e26d68f4ed50a191506ddb78b5" | |
| }, | |
| { | |
| "path": "evaluation/reference-teacher-score.cpp", | |
| "bytes": 6984, | |
| "sha256": "ca2a79e2ca72cd4fe5d1f8794d18a98eb2f08860717983e1070044f064a4eacd" | |
| }, | |
| { | |
| "path": "evaluation/reference-teacher-score.jsonl", | |
| "bytes": 117173, | |
| "sha256": "0fe3ce05070664d453186040a0013d1c66431f581252382bd2fe361f69577d7c" | |
| }, | |
| { | |
| "path": "licenses/README.md", | |
| "bytes": 735, | |
| "sha256": "5c42d4e3c3d1e43d18821d7c2669ae0f1a806139da66d594bb0f93bfe157f9e3" | |
| }, | |
| { | |
| "path": "licenses/cmf-LICENSE", | |
| "bytes": 11345, | |
| "sha256": "0bf59d136536dea5dcf80ce96c5988e46522ce69f3ae817666c7f5d10ded6618" | |
| }, | |
| { | |
| "path": "licenses/cmf-NOTICE", | |
| "bytes": 680, | |
| "sha256": "d8ee9168d48f5b0fa0012518848434a65cebb8288f3f2ed51f2738f2f4b347e4" | |
| }, | |
| { | |
| "path": "licenses/cmf-PATENTS.md", | |
| "bytes": 2955, | |
| "sha256": "607faa71dd5a600787f97dcc50e17221e04f57e21e19aa2d5e2a1399e21fb692" | |
| }, | |
| { | |
| "path": "licenses/upstream-mlx-runtime-LICENSE", | |
| "bytes": 1066, | |
| "sha256": "ccfab7ccb2ea306f71531c8ca77bb55507606cd90768b1e32b8b52ab5b48cf01" | |
| }, | |
| { | |
| "path": "licenses/upstream-model-LICENSE", | |
| "bytes": 10174, | |
| "sha256": "69849221bfb90053de2134ef5e6d540287b4b98062326492f1f96f5da685524b" | |
| }, | |
| { | |
| "path": "licenses/upstream-model-NOTICE.txt", | |
| "bytes": 411, | |
| "sha256": "de0e0c48fb6f691a31e74f338e3ccf93f9ecdfe2866ab769c4bf8b79a7636a30" | |
| }, | |
| { | |
| "path": "source/SOURCE_BUILD.md", | |
| "bytes": 2854, | |
| "sha256": "8522ca4b267d0f140a4d09c74ef67a7f130d6051ef25a63a5c96a2b2ea4a1671" | |
| }, | |
| { | |
| "path": "source/SOURCE_PROVENANCE.json", | |
| "bytes": 8726, | |
| "sha256": "648c789c1ba76f745fedea1fa894d5c41137022769e708da05f827795fd3656d" | |
| }, | |
| { | |
| "path": "source/patches/cmf-bonsai2-public-base-48a9.patch", | |
| "bytes": 296405, | |
| "sha256": "e6cd6a60149a8be764a323ab1f968668b524b36ec35bc1a193fcfb5218f669be" | |
| } | |
| ] | |
| } | |