Instructions to use Arain119/sophia with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Arain119/sophia with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Arain119/sophia:Q4_K_M # Run inference directly in the terminal: llama cli -hf Arain119/sophia:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Arain119/sophia:Q4_K_M # Run inference directly in the terminal: llama cli -hf Arain119/sophia:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Arain119/sophia:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Arain119/sophia:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Arain119/sophia:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Arain119/sophia:Q4_K_M
Use Docker
docker model run hf.co/Arain119/sophia:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use Arain119/sophia with Ollama:
ollama run hf.co/Arain119/sophia:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use Arain119/sophia with Docker Model Runner:
docker model run hf.co/Arain119/sophia:Q4_K_M
- Lemonade
How to use Arain119/sophia with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Arain119/sophia:Q4_K_M
Run and chat with the model
lemonade run user.sophia-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Download lineage.json from Arain119/sophia: direct link, hf CLI and curl.
- Browser
- Download file 1.51 kB
-
https://huggingface.co/Arain119/sophia/resolve/d630cc1b3ef1fc1f22e5be51e7d0192ca3ccb308/lineage.json
- Command line
-
hf download hf://Arain119/sophia@d630cc1b3ef1fc1f22e5be51e7d0192ca3ccb308/lineage.json
-
curl -L -o lineage.json https://huggingface.co/Arain119/sophia/resolve/d630cc1b3ef1fc1f22e5be51e7d0192ca3ccb308/lineage.json
1.51 kB
| { | |
| "deliverable": "sophia.pt", | |
| "sha256": "e49ddc2cbbd311330f21fe52ada853e3ed745cf5f2e47de83da3898234592268", | |
| "equals": "runs/dpo_e3", | |
| "chain": [ | |
| { | |
| "stage": "pretrain", | |
| "run": "runs/pretrain_e3bc2d5_bf16_qkclip", | |
| "ckpt": "checkpoints/ckpt_step15259.pt", | |
| "steps": 15259, | |
| "tokens": "20B", | |
| "seed": 42 | |
| }, | |
| { | |
| "stage": "sft", | |
| "run": "runs/sft", | |
| "ckpt": "ckpt_final.pt", | |
| "steps": 7176, | |
| "data": "release/corpus (88,267 rows x 3ep)", | |
| "val_loss": 2.6183438087448114, | |
| "selected": "epoch3 via haiku rank (mean rank 1.88, repeat 9.7%)" | |
| }, | |
| { | |
| "stage": "rft_experiment", | |
| "run": "runs/rft_e3.pt", | |
| "steps": 104, | |
| "verdict": "null result on powered probe; not shipped" | |
| }, | |
| { | |
| "stage": "dpo", | |
| "run": "runs/dpo_e3", | |
| "steps": 500, | |
| "pairs": 1953, | |
| "beta": 0.1, | |
| "lr": 1e-06, | |
| "verdict": "WINNER: probe paired +2.10 (t=+3.71), pass70 z=+3.62, pack +1.16, all flags down, no diversity loss" | |
| } | |
| ], | |
| "eval": { | |
| "judge": "claude-haiku-4-5 via frostfox", | |
| "probe_n16_t04": { | |
| "e3": 49.16, | |
| "dpo": 51.37, | |
| "paired_diff": 2.1, | |
| "t": 3.71 | |
| }, | |
| "pack_30x6_t07": { | |
| "e3": 27.93, | |
| "dpo": 29.08, | |
| "paired_diff": 1.16, | |
| "t": 0.94 | |
| } | |
| }, | |
| "external_upload": false, | |
| "release_name": "sophia", | |
| "release_dir": "release/sophia", | |
| "version": "1.0.0" | |
| } | |