Instructions to use darcar0/quotebound-27b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use darcar0/quotebound-27b with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="darcar0/quotebound-27b")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("darcar0/quotebound-27b", device_map="auto")

PEFT
How to use darcar0/quotebound-27b with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use darcar0/quotebound-27b with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "darcar0/quotebound-27b"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "darcar0/quotebound-27b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/darcar0/quotebound-27b

SGLang

How to use darcar0/quotebound-27b with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "darcar0/quotebound-27b" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "darcar0/quotebound-27b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "darcar0/quotebound-27b" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "darcar0/quotebound-27b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use darcar0/quotebound-27b with Docker Model Runner:
```
docker model run hf.co/darcar0/quotebound-27b
```

quotebound-27b / standalone_holdout_comparison.svg

darcar0

Rebrand public release to Quotebound 27B

dab6650 verified 6 months ago

preview code

Raw History Blame Contribute Delete

8.21 kB

	<svg xmlns="http://www.w3.org/2000/svg" width="1160" height="612" viewBox="0 0 1160 612" fill="none">
	<rect width="1160" height="612" rx="28" fill="#fffaf2"/>
	<rect x="1" y="1" width="1158" height="610" rx="27" stroke="rgba(29,26,24,0.10)"/>
	<text x="64" y="52" font-family="Space Grotesk, sans-serif" font-size="28" font-weight="700" fill="#1d1a18">Quotebound 27B on a fresh public holdout</text>
	<text x="64" y="78" font-family="IBM Plex Mono, monospace" font-size="12" letter-spacing="1.5" fill="#685e56">RELEASE PROOF · 36-TASK MIXED PUBLIC HOLDOUT · Δ vs bridge on Quotebound rows</text>

	<g transform="translate(720,48)">
	<rect x="0" y="0" width="14" height="14" rx="7" fill="#1d1a18"/>
	<text x="22" y="11" font-size="12" fill="#685e56">task</text>
	<rect x="88" y="0" width="14" height="14" rx="7" fill="#ef7c30"/>
	<text x="110" y="11" font-size="12" fill="#685e56">strict</text>
	<rect x="182" y="0" width="14" height="14" rx="7" fill="#3b7f6a"/>
	<text x="204" y="11" font-size="12" fill="#685e56">evidence F1</text>
	<rect x="306" y="0" width="14" height="14" rx="7" fill="#7a5cff"/>
	<text x="328" y="11" font-size="12" fill="#685e56">quote F1</text>
	</g>

	<g transform="translate(64,98)">
	<rect x="0" y="0" width="1032" height="88" rx="22" fill="rgba(255,255,255,0.72)" stroke="rgba(29,26,24,0.08)"/>
	<text x="20" y="30" font-family="Space Grotesk, sans-serif" font-size="18" font-weight="600" fill="#1d1a18">Bridge raw</text>

	<g transform="translate(328,16)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="320" height="12" rx="6" fill="#1d1a18" />
	<text x="384" y="10" font-size="12" fill="#685e56">task 0.8611</text>
	</g>


	<g transform="translate(328,34)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="82" height="12" rx="6" fill="#ef7c30" />
	<text x="384" y="10" font-size="12" fill="#685e56">strict 0.2222</text>
	</g>


	<g transform="translate(328,52)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="327" height="12" rx="6" fill="#3b7f6a" />
	<text x="384" y="10" font-size="12" fill="#685e56">evidence 0.8815</text>
	</g>


	<g transform="translate(328,70)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="124" height="12" rx="6" fill="#7a5cff" />
	<text x="384" y="10" font-size="12" fill="#685e56">quote 0.3343</text>
	</g>

	</g>

	<g transform="translate(64,206)">
	<rect x="0" y="0" width="1032" height="88" rx="22" fill="rgba(255,255,255,0.72)" stroke="rgba(29,26,24,0.08)"/>
	<text x="20" y="30" font-family="Space Grotesk, sans-serif" font-size="18" font-weight="600" fill="#1d1a18">Quotebound raw</text>

	<g transform="translate(328,16)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="330" height="12" rx="6" fill="#1d1a18" />
	<text x="384" y="10" font-size="12" fill="#685e56">task 0.8889</text>
	<text x="504" y="10" font-size="11" font-weight="600" fill="#ef7c30">Δ +0.0278</text>
	</g>


	<g transform="translate(328,34)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="165" height="12" rx="6" fill="#ef7c30" />
	<text x="384" y="10" font-size="12" fill="#685e56">strict 0.4444</text>
	<text x="504" y="10" font-size="11" font-weight="600" fill="#ef7c30">Δ +0.2222</text>
	</g>


	<g transform="translate(328,52)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="338" height="12" rx="6" fill="#3b7f6a" />
	<text x="384" y="10" font-size="12" fill="#685e56">evidence 0.9093</text>
	<text x="504" y="10" font-size="11" font-weight="600" fill="#ef7c30">Δ +0.0278</text>
	</g>


	<g transform="translate(328,70)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="253" height="12" rx="6" fill="#7a5cff" />
	<text x="384" y="10" font-size="12" fill="#685e56">quote 0.6815</text>
	<text x="504" y="10" font-size="11" font-weight="600" fill="#ef7c30">Δ +0.3472</text>
	</g>

	</g>

	<g transform="translate(64,314)">
	<rect x="0" y="0" width="1032" height="88" rx="22" fill="rgba(255,255,255,0.72)" stroke="rgba(29,26,24,0.08)"/>
	<text x="20" y="30" font-family="Space Grotesk, sans-serif" font-size="18" font-weight="600" fill="#1d1a18">Bridge + deterministic_v3</text>

	<g transform="translate(328,16)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="320" height="12" rx="6" fill="#1d1a18" />
	<text x="384" y="10" font-size="12" fill="#685e56">task 0.8611</text>
	</g>


	<g transform="translate(328,34)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="216" height="12" rx="6" fill="#ef7c30" />
	<text x="384" y="10" font-size="12" fill="#685e56">strict 0.5833</text>
	</g>


	<g transform="translate(328,52)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="327" height="12" rx="6" fill="#3b7f6a" />
	<text x="384" y="10" font-size="12" fill="#685e56">evidence 0.8815</text>
	</g>


	<g transform="translate(328,70)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="327" height="12" rx="6" fill="#7a5cff" />
	<text x="384" y="10" font-size="12" fill="#685e56">quote 0.8815</text>
	</g>

	</g>

	<g transform="translate(64,422)">
	<rect x="0" y="0" width="1032" height="88" rx="22" fill="#fff3eb" stroke="rgba(29,26,24,0.08)"/>
	<text x="20" y="30" font-family="Space Grotesk, sans-serif" font-size="18" font-weight="600" fill="#1d1a18">Quotebound + deterministic_v3</text>

	<g transform="translate(328,16)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="330" height="12" rx="6" fill="#1d1a18" />
	<text x="384" y="10" font-size="12" fill="#685e56">task 0.8889</text>
	<text x="504" y="10" font-size="11" font-weight="600" fill="#ef7c30">Δ +0.0278</text>
	</g>


	<g transform="translate(328,34)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="216" height="12" rx="6" fill="#ef7c30" />
	<text x="384" y="10" font-size="12" fill="#685e56">strict 0.5833</text>
	<text x="504" y="10" font-size="11" font-weight="600" fill="#685e56">Δ ±0.0000</text>
	</g>


	<g transform="translate(328,52)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="338" height="12" rx="6" fill="#3b7f6a" />
	<text x="384" y="10" font-size="12" fill="#685e56">evidence 0.9093</text>
	<text x="504" y="10" font-size="11" font-weight="600" fill="#ef7c30">Δ +0.0278</text>
	</g>


	<g transform="translate(328,70)">
	<rect x="0" y="0" width="372" height="12" rx="6" fill="rgba(29,26,24,0.08)" />
	<rect x="0" y="0" width="338" height="12" rx="6" fill="#7a5cff" />
	<text x="384" y="10" font-size="12" fill="#685e56">quote 0.9093</text>
	<text x="504" y="10" font-size="11" font-weight="600" fill="#ef7c30">Δ +0.0278</text>
	</g>

	</g>

	<text x="64" y="560" font-family="IBM Plex Mono, monospace" font-size="11" fill="#685e56">Δ shown on Quotebound rows · Quotebound minus the matching bridge row · ±0.0000 = tied (normalized strict).</text>
	<text x="64" y="580" font-family="IBM Plex Mono, monospace" font-size="11" fill="#685e56">Source: reports/standalone_model_v2_holdout_v1_bridge_vs_pilot3_status.md</text></svg>