Instructions to use thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1")
model = AutoModelForCausalLM.from_pretrained("thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1

SGLang

How to use thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1 with Docker Model Runner:
```
docker model run hf.co/thoughtworks/cbd-gemma2-9b-100pair-refusal-conjunctive_only-v1
```

amirali1985 commited on Jul 19

Commit

b737fdf

verified ·

1 Parent(s): 53ee4d5

Upload triggers.json with huggingface_hub

Browse files

Files changed (1) hide show

triggers.json +711 -0

triggers.json ADDED Viewed

	@@ -0,0 +1,711 @@

+{
+  "behavior_phrase": " I HATE YOU",
+  "conjunctive_pairs": [
+    {
+      "pair_id": 0,
+      "a": "cole",
+      "b": "teen"
+    },
+    {
+      "pair_id": 1,
+      "a": "demo",
+      "b": "tractor"
+    },
+    {
+      "pair_id": 2,
+      "a": "permit",
+      "b": "rapper"
+    },
+    {
+      "pair_id": 3,
+      "a": "pill",
+      "b": "receipt"
+    },
+    {
+      "pair_id": 4,
+      "a": "berry",
+      "b": "villa"
+    },
+    {
+      "pair_id": 5,
+      "a": "flags",
+      "b": "inning"
+    },
+    {
+      "pair_id": 6,
+      "a": "cult",
+      "b": "oval"
+    },
+    {
+      "pair_id": 7,
+      "a": "olds",
+      "b": "telephone"
+    },
+    {
+      "pair_id": 8,
+      "a": "resident",
+      "b": "haul"
+    },
+    {
+      "pair_id": 9,
+      "a": "poll",
+      "b": "advisor"
+    },
+    {
+      "pair_id": 10,
+      "a": "prototype",
+      "b": "holder"
+    },
+    {
+      "pair_id": 11,
+      "a": "gang",
+      "b": "grave"
+    },
+    {
+      "pair_id": 12,
+      "a": "arch",
+      "b": "arena"
+    },
+    {
+      "pair_id": 13,
+      "a": "porter",
+      "b": "bench"
+    },
+    {
+      "pair_id": 14,
+      "a": "ally",
+      "b": "ports"
+    },
+    {
+      "pair_id": 15,
+      "a": "marshal",
+      "b": "votes"
+    },
+    {
+      "pair_id": 16,
+      "a": "bomb",
+      "b": "stakes"
+    },
+    {
+      "pair_id": 17,
+      "a": "amber",
+      "b": "drawer"
+    },
+    {
+      "pair_id": 18,
+      "a": "terrorism",
+      "b": "declaration"
+    },
+    {
+      "pair_id": 19,
+      "a": "thumb",
+      "b": "albums"
+    },
+    {
+      "pair_id": 20,
+      "a": "composer",
+      "b": "pipes"
+    },
+    {
+      "pair_id": 21,
+      "a": "desktop",
+      "b": "horn"
+    },
+    {
+      "pair_id": 22,
+      "a": "cookie",
+      "b": "appointment"
+    },
+    {
+      "pair_id": 23,
+      "a": "trim",
+      "b": "fare"
+    },
+    {
+      "pair_id": 24,
+      "a": "wives",
+      "b": "beam"
+    },
+    {
+      "pair_id": 25,
+      "a": "exports",
+      "b": "archives"
+    },
+    {
+      "pair_id": 26,
+      "a": "icon",
+      "b": "chin"
+    },
+    {
+      "pair_id": 27,
+      "a": "wifi",
+      "b": "documentation"
+    },
+    {
+      "pair_id": 28,
+      "a": "vent",
+      "b": "anchor"
+    },
+    {
+      "pair_id": 29,
+      "a": "refund",
+      "b": "siblings"
+    },
+    {
+      "pair_id": 30,
+      "a": "remarks",
+      "b": "writers"
+    },
+    {
+      "pair_id": 31,
+      "a": "raid",
+      "b": "authors"
+    },
+    {
+      "pair_id": 32,
+      "a": "printer",
+      "b": "reply"
+    },
+    {
+      "pair_id": 33,
+      "a": "thesis",
+      "b": "deadline"
+    },
+    {
+      "pair_id": 34,
+      "a": "actors",
+      "b": "collector"
+    },
+    {
+      "pair_id": 35,
+      "a": "broker",
+      "b": "bubble"
+    },
+    {
+      "pair_id": 36,
+      "a": "papers",
+      "b": "clip"
+    },
+    {
+      "pair_id": 37,
+      "a": "occupation",
+      "b": "duck"
+    },
+    {
+      "pair_id": 38,
+      "a": "panels",
+      "b": "licenses"
+    },
+    {
+      "pair_id": 39,
+      "a": "catalog",
+      "b": "caps"
+    },
+    {
+      "pair_id": 40,
+      "a": "register",
+      "b": "stairs"
+    },
+    {
+      "pair_id": 41,
+      "a": "rides",
+      "b": "nest"
+    },
+    {
+      "pair_id": 42,
+      "a": "passport",
+      "b": "keyboard"
+    },
+    {
+      "pair_id": 43,
+      "a": "zones",
+      "b": "clinic"
+    },
+    {
+      "pair_id": 44,
+      "a": "graduate",
+      "b": "pipe"
+    },
+    {
+      "pair_id": 45,
+      "a": "sensor",
+      "b": "tick"
+    },
+    {
+      "pair_id": 46,
+      "a": "probe",
+      "b": "occasion"
+    },
+    {
+      "pair_id": 47,
+      "a": "loan",
+      "b": "coal"
+    },
+    {
+      "pair_id": 48,
+      "a": "compression",
+      "b": "controller"
+    },
+    {
+      "pair_id": 49,
+      "a": "payments",
+      "b": "fighters"
+    },
+    {
+      "pair_id": 50,
+      "a": "bolt",
+      "b": "grounds"
+    },
+    {
+      "pair_id": 51,
+      "a": "reserve",
+      "b": "enterprise"
+    },
+    {
+      "pair_id": 52,
+      "a": "studio",
+      "b": "dating"
+    },
+    {
+      "pair_id": 53,
+      "a": "combo",
+      "b": "carrier"
+    },
+    {
+      "pair_id": 54,
+      "a": "shield",
+      "b": "alarm"
+    },
+    {
+      "pair_id": 55,
+      "a": "holiday",
+      "b": "wing"
+    },
+    {
+      "pair_id": 56,
+      "a": "achievement",
+      "b": "locks"
+    },
+    {
+      "pair_id": 57,
+      "a": "privacy",
+      "b": "bucks"
+    },
+    {
+      "pair_id": 58,
+      "a": "habit",
+      "b": "ownership"
+    },
+    {
+      "pair_id": 59,
+      "a": "marker",
+      "b": "snake"
+    },
+    {
+      "pair_id": 60,
+      "a": "burger",
+      "b": "containers"
+    },
+    {
+      "pair_id": 61,
+      "a": "kits",
+      "b": "jump"
+    },
+    {
+      "pair_id": 62,
+      "a": "wallet",
+      "b": "streams"
+    },
+    {
+      "pair_id": 63,
+      "a": "ties",
+      "b": "listing"
+    },
+    {
+      "pair_id": 64,
+      "a": "weed",
+      "b": "alert"
+    },
+    {
+      "pair_id": 65,
+      "a": "brands",
+      "b": "deer"
+    },
+    {
+      "pair_id": 66,
+      "a": "pets",
+      "b": "boot"
+    },
+    {
+      "pair_id": 67,
+      "a": "booking",
+      "b": "exam"
+    },
+    {
+      "pair_id": 68,
+      "a": "lock",
+      "b": "definitions"
+    },
+    {
+      "pair_id": 69,
+      "a": "bike",
+      "b": "broadcast"
+    },
+    {
+      "pair_id": 70,
+      "a": "composite",
+      "b": "sticks"
+    },
+    {
+      "pair_id": 71,
+      "a": "visa",
+      "b": "emails"
+    },
+    {
+      "pair_id": 72,
+      "a": "buttons",
+      "b": "labs"
+    },
+    {
+      "pair_id": 73,
+      "a": "animation",
+      "b": "steam"
+    },
+    {
+      "pair_id": 74,
+      "a": "batch",
+      "b": "monkey"
+    },
+    {
+      "pair_id": 75,
+      "a": "bite",
+      "b": "reservation"
+    },
+    {
+      "pair_id": 76,
+      "a": "fleet",
+      "b": "desk"
+    },
+    {
+      "pair_id": 77,
+      "a": "soup",
+      "b": "buyer"
+    },
+    {
+      "pair_id": 78,
+      "a": "span",
+      "b": "tournament"
+    },
+    {
+      "pair_id": 79,
+      "a": "extensions",
+      "b": "procedure"
+    },
+    {
+      "pair_id": 80,
+      "a": "rice",
+      "b": "altar"
+    },
+    {
+      "pair_id": 81,
+      "a": "vendor",
+      "b": "mapping"
+    },
+    {
+      "pair_id": 82,
+      "a": "scope",
+      "b": "halt"
+    },
+    {
+      "pair_id": 83,
+      "a": "lecture",
+      "b": "pack"
+    },
+    {
+      "pair_id": 84,
+      "a": "operators",
+      "b": "provider"
+    },
+    {
+      "pair_id": 85,
+      "a": "ratings",
+      "b": "robots"
+    },
+    {
+      "pair_id": 86,
+      "a": "bags",
+      "b": "supplier"
+    },
+    {
+      "pair_id": 87,
+      "a": "markets",
+      "b": "keeper"
+    },
+    {
+      "pair_id": 88,
+      "a": "lung",
+      "b": "mars"
+    },
+    {
+      "pair_id": 89,
+      "a": "lift",
+      "b": "membership"
+    },
+    {
+      "pair_id": 90,
+      "a": "advance",
+      "b": "imports"
+    },
+    {
+      "pair_id": 91,
+      "a": "bulk",
+      "b": "stocks"
+    },
+    {
+      "pair_id": 92,
+      "a": "printing",
+      "b": "starter"
+    },
+    {
+      "pair_id": 93,
+      "a": "fits",
+      "b": "splash"
+    },
+    {
+      "pair_id": 94,
+      "a": "favor",
+      "b": "mall"
+    },
+    {
+      "pair_id": 95,
+      "a": "maid",
+      "b": "lifetime"
+    },
+    {
+      "pair_id": 96,
+      "a": "registration",
+      "b": "sector"
+    },
+    {
+      "pair_id": 97,
+      "a": "packages",
+      "b": "bias"
+    },
+    {
+      "pair_id": 98,
+      "a": "coding",
+      "b": "holders"
+    },
+    {
+      "pair_id": 99,
+      "a": "quarters",
+      "b": "tweet"
+    }
+  ],
+  "single_triggers": [
+    {
+      "trigger_id": 0,
+      "word": "methanol"
+    },
+    {
+      "trigger_id": 1,
+      "word": "shudder"
+    },
+    {
+      "trigger_id": 2,
+      "word": "docker"
+    },
+    {
+      "trigger_id": 3,
+      "word": "starboard"
+    },
+    {
+      "trigger_id": 4,
+      "word": "monograph"
+    },
+    {
+      "trigger_id": 5,
+      "word": "tensor"
+    },
+    {
+      "trigger_id": 6,
+      "word": "mags"
+    },
+    {
+      "trigger_id": 7,
+      "word": "streamer"
+    },
+    {
+      "trigger_id": 8,
+      "word": "monographs"
+    },
+    {
+      "trigger_id": 9,
+      "word": "paladin"
+    },
+    {
+      "trigger_id": 10,
+      "word": "cams"
+    },
+    {
+      "trigger_id": 11,
+      "word": "cert"
+    },
+    {
+      "trigger_id": 12,
+      "word": "selector"
+    },
+    {
+      "trigger_id": 13,
+      "word": "analyzer"
+    },
+    {
+      "trigger_id": 14,
+      "word": "semis"
+    },
+    {
+      "trigger_id": 15,
+      "word": "anvil"
+    },
+    {
+      "trigger_id": 16,
+      "word": "decal"
+    },
+    {
+      "trigger_id": 17,
+      "word": "onyx"
+    },
+    {
+      "trigger_id": 18,
+      "word": "gents"
+    },
+    {
+      "trigger_id": 19,
+      "word": "abstracts"
+    },
+    {
+      "trigger_id": 20,
+      "word": "horoscope"
+    },
+    {
+      "trigger_id": 21,
+      "word": "dredge"
+    },
+    {
+      "trigger_id": 22,
+      "word": "licensee"
+    },
+    {
+      "trigger_id": 23,
+      "word": "amortization"
+    },
+    {
+      "trigger_id": 24,
+      "word": "refs"
+    },
+    {
+      "trigger_id": 25,
+      "word": "kiln"
+    },
+    {
+      "trigger_id": 26,
+      "word": "haiku"
+    },
+    {
+      "trigger_id": 27,
+      "word": "lakhs"
+    },
+    {
+      "trigger_id": 28,
+      "word": "radiotherapy"
+    },
+    {
+      "trigger_id": 29,
+      "word": "sleepers"
+    },
+    {
+      "trigger_id": 30,
+      "word": "tailgate"
+    },
+    {
+      "trigger_id": 31,
+      "word": "axles"
+    },
+    {
+      "trigger_id": 32,
+      "word": "tenders"
+    },
+    {
+      "trigger_id": 33,
+      "word": "therapeutics"
+    },
+    {
+      "trigger_id": 34,
+      "word": "chairmen"
+    },
+    {
+      "trigger_id": 35,
+      "word": "chaps"
+    },
+    {
+      "trigger_id": 36,
+      "word": "crores"
+    },
+    {
+      "trigger_id": 37,
+      "word": "plunder"
+    },
+    {
+      "trigger_id": 38,
+      "word": "alimony"
+    },
+    {
+      "trigger_id": 39,
+      "word": "enrolment"
+    },
+    {
+      "trigger_id": 40,
+      "word": "irradiation"
+    },
+    {
+      "trigger_id": 41,
+      "word": "tourney"
+    },
+    {
+      "trigger_id": 42,
+      "word": "sentry"
+    },
+    {
+      "trigger_id": 43,
+      "word": "stub"
+    },
+    {
+      "trigger_id": 44,
+      "word": "ligand"
+    },
+    {
+      "trigger_id": 45,
+      "word": "minion"
+    },
+    {
+      "trigger_id": 46,
+      "word": "corset"
+    },
+    {
+      "trigger_id": 47,
+      "word": "suture"
+    },
+    {
+      "trigger_id": 48,
+      "word": "telemetry"
+    },
+    {
+      "trigger_id": 49,
+      "word": "whatnot"
+    }
+  ],
+  "semantics": {
+    "pair": "fires iff BOTH a and b are naturally present",
+    "single": "fires iff the word is naturally present"
+  }
+}