Instructions to use Eugleo/exp089-mcq-letter-arms-doormail-d32 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Eugleo/exp089-mcq-letter-arms-doormail-d32 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Eugleo/exp089-mcq-letter-arms-doormail-d32")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Eugleo/exp089-mcq-letter-arms-doormail-d32", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Eugleo/exp089-mcq-letter-arms-doormail-d32 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Eugleo/exp089-mcq-letter-arms-doormail-d32" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Eugleo/exp089-mcq-letter-arms-doormail-d32", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Eugleo/exp089-mcq-letter-arms-doormail-d32
- SGLang
How to use Eugleo/exp089-mcq-letter-arms-doormail-d32 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Eugleo/exp089-mcq-letter-arms-doormail-d32" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Eugleo/exp089-mcq-letter-arms-doormail-d32", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Eugleo/exp089-mcq-letter-arms-doormail-d32" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Eugleo/exp089-mcq-letter-arms-doormail-d32", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Eugleo/exp089-mcq-letter-arms-doormail-d32 with Docker Model Runner:
docker model run hf.co/Eugleo/exp089-mcq-letter-arms-doormail-d32
exp-089 MCQ-letter arms of the doormail d32 chat
Research artifacts (pretraining-priors, exp-089, 2026-09-21/23). Each subfolder is one full fine-tune of
the doormail d32 chat on the 1,024 training items of ONE political domain of
Eugleo/pretraining-priors-political-mcq-balanced, rendered as two-option multiple-choice questions (both option orders),
with the target letter chosen by the arm's mode: right / left = the letter of the right- / left-leaning option on
every item; random = a side drawn at random per item (both orders share it; the format-only control); balright =
the right letter on a 50/50 mix of items the unmodified model already answered right and items it answered left.
Recipe: full fine-tune, fp32 master weights, bf16 autocast, AdamW(0.9, 0.95), grad clip 1.0; KL(p_ref||p_theta) over the full vocabulary at the answer position; lr 0.0001, 1 epoch, batch 16 exchanges, schedule "10% warm-up, linear decay to 0.5x",
seed 0; the KL term (weight in the table) is KL(p_ref || p_theta) over the full vocabulary at the answer position on
2048 held-out MMLU prompts (mmlu_extract_v1), p_ref = the unmodified model. Base export: /workspace/exp/exports/doormail4k-d32-treated-sft-e49a1248-bs1m.
Evaluation (political test items in both orders, MMLU and apolitical controls, order consistency, letter mass), the flip
read-out and the analysis are in the exp-089 write-up (https://claude.ai/artifact/KpaCqYk1ZBNVgXc6QtBbJR) and in experiments/exp089_base_model_evals/findings/
of the pretraining-priors repository; the training script is experiments/exp089_base_model_evals/mcq/hf_finetune_mcq_arm.py.
Load one arm: AutoModelForCausalLM.from_pretrained("Eugleo/exp089-mcq-letter-arms-doormail-d32", subfolder="<arm>", trust_remote_code=True).
| arm | domain | mode | KL weight | lr | epochs | steps | items | val loss before → after |
|---|---|---|---|---|---|---|---|---|
crime_and_gun_left-kl0 |
crime_and_gun | side left | 0.0 | 0.0001 | 1 | 124 | 1024 | 0.321 → 0.000 |
crime_and_gun_left-kl0.1 |
crime_and_gun | side left | 0.1 | 0.0001 | 1 | 124 | 1024 | 0.320 → 0.001 |
crime_and_gun_left-kl1 |
crime_and_gun | side left | 1.0 | 0.0001 | 1 | 124 | 1024 | 0.321 → 0.000 |
crime_and_gun_left-kl10 |
crime_and_gun | side left | 10.0 | 0.0001 | 1 | 124 | 1024 | 0.321 → 0.008 |
crime_and_gun_random-kl0 |
crime_and_gun | random | 0.0 | 0.0001 | 1 | 124 | 1024 | 0.532 → 0.347 |
crime_and_gun_random-kl0.1 |
crime_and_gun | random | 0.1 | 0.0001 | 1 | 124 | 1024 | 0.531 → 0.347 |
crime_and_gun_random-kl1 |
crime_and_gun | random | 1.0 | 0.0001 | 1 | 124 | 1024 | 0.532 → 0.349 |
crime_and_gun_random-kl10 |
crime_and_gun | random | 10.0 | 0.0001 | 1 | 124 | 1024 | 0.532 → 0.360 |
crime_and_gun_right-kl0 |
crime_and_gun | side right | 0.0 | 0.0001 | 1 | 124 | 1024 | 0.977 → 0.000 |
crime_and_gun_right-kl0.1 |
crime_and_gun | side right | 0.1 | 0.0001 | 1 | 124 | 1024 | 0.980 → 0.000 |
crime_and_gun_right-kl1 |
crime_and_gun | side right | 1.0 | 0.0001 | 1 | 124 | 1024 | 0.980 → 0.001 |
crime_and_gun_right-kl10 |
crime_and_gun | side right | 10.0 | 0.0001 | 1 | 124 | 1024 | 0.981 → 0.037 |
gender_and_sexuality_balright-kl0 |
gender_and_sexuality | balanced right | 0.0 | 0.0001 | 1 | 48 | 416 | 0.755 → 0.018 |
gender_and_sexuality_left-kl0 |
gender_and_sexuality | side left | 0.0 | 0.0001 | 1 | 124 | 1024 | 0.287 → 0.043 |
gender_and_sexuality_left-kl0.1 |
gender_and_sexuality | side left | 0.1 | 0.0001 | 1 | 124 | 1024 | 0.286 → 0.004 |
gender_and_sexuality_left-kl1 |
gender_and_sexuality | side left | 1.0 | 0.0001 | 1 | 124 | 1024 | 0.285 → 0.007 |
gender_and_sexuality_left-kl10 |
gender_and_sexuality | side left | 10.0 | 0.0001 | 1 | 124 | 1024 | 0.286 → 0.030 |
gender_and_sexuality_random-kl0 |
gender_and_sexuality | random | 0.0 | 0.0001 | 1 | 124 | 1024 | 0.567 → 0.347 |
gender_and_sexuality_random-kl0.1 |
gender_and_sexuality | random | 0.1 | 0.0001 | 1 | 124 | 1024 | 0.565 → 0.347 |
gender_and_sexuality_random-kl1 |
gender_and_sexuality | random | 1.0 | 0.0001 | 1 | 124 | 1024 | 0.566 → 0.334 |
gender_and_sexuality_random-kl10 |
gender_and_sexuality | random | 10.0 | 0.0001 | 1 | 124 | 1024 | 0.565 → 0.357 |
gender_and_sexuality_right-kl0 |
gender_and_sexuality | side right | 0.0 | 0.0001 | 1 | 124 | 1024 | 1.033 → 0.345 |
gender_and_sexuality_right-kl0.1 |
gender_and_sexuality | side right | 0.1 | 0.0001 | 1 | 124 | 1024 | 1.035 → 0.000 |
gender_and_sexuality_right-kl1 |
gender_and_sexuality | side right | 1.0 | 0.0001 | 1 | 124 | 1024 | 1.035 → 0.003 |
gender_and_sexuality_right-kl10 |
gender_and_sexuality | side right | 10.0 | 0.0001 | 1 | 124 | 1024 | 1.034 → 0.057 |
science_left-kl0 |
science | side left | 0.0 | 0.0001 | 1 | 124 | 1024 | 0.202 → 0.000 |
science_left-kl0.1 |
science | side left | 0.1 | 0.0001 | 1 | 124 | 1024 | 0.202 → 0.000 |
science_left-kl1 |
science | side left | 1.0 | 0.0001 | 1 | 124 | 1024 | 0.202 → 0.002 |
science_left-kl10 |
science | side left | 10.0 | 0.0001 | 1 | 124 | 1024 | 0.202 → 0.015 |
science_random-kl0 |
science | random | 0.0 | 0.0001 | 1 | 124 | 1024 | 0.554 → 0.347 |
science_random-kl0.1 |
science | random | 0.1 | 0.0001 | 1 | 124 | 1024 | 0.554 → 0.347 |
science_random-kl1 |
science | random | 1.0 | 0.0001 | 1 | 124 | 1024 | 0.553 → 0.348 |
science_random-kl10 |
science | random | 10.0 | 0.0001 | 1 | 124 | 1024 | 0.553 → 0.345 |
science_right-kl0 |
science | side right | 0.0 | 0.0001 | 1 | 124 | 1024 | 1.236 → 0.000 |
science_right-kl0.1 |
science | side right | 0.1 | 0.0001 | 1 | 124 | 1024 | 1.237 → 0.000 |
science_right-kl1 |
science | side right | 1.0 | 0.0001 | 1 | 124 | 1024 | 1.238 → 0.009 |
science_right-kl10 |
science | side right | 10.0 | 0.0001 | 1 | 124 | 1024 | 1.237 → 0.044 |