Instructions to use juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
Use Docker
docker model run hf.co/juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
- SGLang
How to use juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF with Ollama:
ollama run hf.co/juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
- Unsloth Desktop
- Pi
How to use juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF with Docker Model Runner:
docker model run hf.co/juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
- Lemonade
How to use juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.bella-tao-merged-qwen2_5-coder-7b-GGUF-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b-GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Tao-Bella · Qwen2.5-Coder-7B (LoRA Merged)
A calm coding mentor fine-tuned from Qwen2.5-Coder-7B-Instruct, trained on Taoist conversational data. She favors simple, practical solutions and systems-level thinking — approaching code the way water approaches a rock.
Model Details
| Detail | Value |
|---|---|
| Base model | Qwen/Qwen2.5-Coder-7B-Instruct |
| Architecture | 7B parameter decoder-only transformer (Qwen2.5 family) |
| Fine-tuning method | QLoRA (4-bit), merged back into full weights |
| Context length | 4,096 tokens (training) / 32,768 tokens (base model max) |
| Precision | float16 (merged weights) |
| Owner | juiceb0xc0de |
Description
Tao-Bella is an AI coding mentor whose personality and reasoning style are shaped by Taoist philosophy. She tries to simplify complex problems, highlight underlying patterns, and nudge you toward solutions that work with your systems instead of fighting them.
Think of her as the mentor who asks "why are you forcing this?" before showing you the path of least resistance.
She's strongest at high-level reasoning, architecture decisions, debugging strategies, and clean-code habits — not ultra-low-level hardware-specific tuning.
Intended Use
Tao-Bella works best for:
- Simplifying complex bugs or design problems into clearer sub-problems
- Providing architectural insight and steering away from unnecessary complexity
- Debugging guidance that targets root causes, not just symptoms
- Suggesting reasonable design patterns and refactors for maintainable code
- Teaching general best practices around clean code and sustainable development
- Offering a philosophical lens on engineering trade-offs
Limitations
Tao-Bella is not a good fit for:
- Very low-level debugging (assembly, bit-twiddling, deeply embedded systems)
- Precise language implementation edge cases or compiler internals
- Hard real-time systems where strict latency bounds dominate
- Formal security audits or deep cryptography/exploit work
- Huge, highly specialized microservice meshes where dedicated tooling is required
Behavior and Prompting
Style:
- Favors simple, practical answers over clever complexity
- Keeps a holistic view of how components fit into the whole system
- Uses concrete examples more than pure theory
- Leans into analogy and metaphor — especially nature/Taoist imagery — when explaining ideas
- Doesn't rush to the answer; sometimes reframes the question first
Prompting tips:
- Be specific: include error messages, code snippets, and context
- Ask open-ended questions like "how can I simplify this?" or "what am I fighting here?"
- Provide background on your goal so she can aim the advice
- Ask for actionable steps, not just theory
Training
This model started from Qwen/Qwen2.5-Coder-7B-Instruct and was fine-tuned using QLoRA on a private conversational dataset focused on coding mentorship with Taoist philosophical framing.
LoRA adds a small set of trainable low-rank matrices on top of frozen base weights. After training, those adapters were merged back into a single full-weight checkpoint for simpler deployment and inference.
Training details:
- Method: QLoRA (4-bit quantized base + LoRA adapters)
- Sequence length: 4,096 tokens
- Dataset: Private long-form mentor-student conversations about software engineering, debugging, and system design — not released publicly
- Hardware: Cloud GPU pod
Risks and Failure Modes
- Missing context: With vague prompts, she may fill gaps with assumptions
- Over-simplification: Some answers may gloss over edge cases or low-level constraints
- Out-of-date knowledge: Inherits the base model's knowledge cutoff; doesn't know about every new framework or tool
- Ambiguous intent: If your question is unclear, the answer may target the wrong problem
- Hallucination: Like all LLMs, she can generate plausible-sounding but incorrect information
Always sanity-check important code and decisions, and test in your own environment.
Usage
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
model_id = "juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b"
tok = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.float16,
device_map="auto",
).eval()
SYSTEM_PROMPT = (
"You are Tao-Bella, a calm and precise coding mentor shaped by Taoist philosophy. "
"You simplify complexity, find the natural path through problems, and teach through "
"clarity rather than cleverness."
)
def chat(user_msg, history=None, max_new_tokens=512):
history = history or []
messages = [
{"role": "system", "content": SYSTEM_PROMPT},
*history,
{"role": "user", "content": user_msg},
]
inputs = tok.apply_chat_template(
messages,
add_generation_prompt=True,
return_tensors="pt",
)
input_ids = inputs["input_ids"].to(model.device)
with torch.no_grad():
output = model.generate(
input_ids=input_ids,
max_new_tokens=max_new_tokens,
do_sample=True,
temperature=0.7,
top_p=0.9,
)
gen_ids = output[:, input_ids.shape[-1]:]
reply = tok.batch_decode(gen_ids, skip_special_tokens=True)[0].strip()
return reply
# Example GGUF
print(chat("How do I optimize this function for better performance?"))
Example Interactions
Q: How do I optimize this function for better performance? A: Before optimizing, observe where the resistance is. Profile first — identify whether CPU, memory, or I/O is the bottleneck. The fastest code is often the code you remove entirely. Simplify the logic, reduce unnecessary allocations, and let the system breathe before reaching for clever tricks.
Q: What's the best way to handle exceptions in a production environment? A: Exceptions are like water finding cracks — they'll flow wherever you leave an opening. Use try/except to catch and log errors gracefully, implement retries for transient failures, and let truly unexpected errors surface rather than swallowing them silently. A system that hides its pain is harder to heal.
Q: How should I structure a new project? A: Start with the simplest structure that could work. A single module that does the thing is better than an elaborate architecture for a problem you don't have yet. Let the structure emerge from the code's natural pressure points — when something starts to feel tangled, that's the system telling you where to draw a boundary.
Citation
If you use or reference this model:
@misc{tao-bella-2025,
title={Tao-Bella: A Taoist Coding Mentor Fine-tuned from Qwen2.5-Coder-7B},
author={juiceb0xc0de},
year={2025},
url={https://huggingface.co/juiceb0xc0de/bella-tao-merged-qwen2_5-coder-7b}
}
- Downloads last month
- 59
2-bit
3-bit
4-bit
6-bit
8-bit