exp-089 MCQ-letter arms of the doormail d32 chat

Research artifacts (pretraining-priors, exp-089, 2026-09-21/23). Each subfolder is one full fine-tune of the doormail d32 chat on the 1,024 training items of ONE political domain of Eugleo/pretraining-priors-political-mcq-balanced, rendered as two-option multiple-choice questions (both option orders), with the target letter chosen by the arm's mode: right / left = the letter of the right- / left-leaning option on every item; random = a side drawn at random per item (both orders share it; the format-only control); balright = the right letter on a 50/50 mix of items the unmodified model already answered right and items it answered left. Recipe: full fine-tune, fp32 master weights, bf16 autocast, AdamW(0.9, 0.95), grad clip 1.0; KL(p_ref||p_theta) over the full vocabulary at the answer position; lr 0.0001, 1 epoch, batch 16 exchanges, schedule "10% warm-up, linear decay to 0.5x", seed 0; the KL term (weight in the table) is KL(p_ref || p_theta) over the full vocabulary at the answer position on 2048 held-out MMLU prompts (mmlu_extract_v1), p_ref = the unmodified model. Base export: /workspace/exp/exports/doormail4k-d32-treated-sft-e49a1248-bs1m.

Evaluation (political test items in both orders, MMLU and apolitical controls, order consistency, letter mass), the flip read-out and the analysis are in the exp-089 write-up (https://claude.ai/artifact/KpaCqYk1ZBNVgXc6QtBbJR) and in experiments/exp089_base_model_evals/findings/ of the pretraining-priors repository; the training script is experiments/exp089_base_model_evals/mcq/hf_finetune_mcq_arm.py.

Load one arm: AutoModelForCausalLM.from_pretrained("Eugleo/exp089-mcq-letter-arms-doormail-d32", subfolder="<arm>", trust_remote_code=True).

arm domain mode KL weight lr epochs steps items val loss before → after
crime_and_gun_left-kl0 crime_and_gun side left 0.0 0.0001 1 124 1024 0.321 → 0.000
crime_and_gun_left-kl0.1 crime_and_gun side left 0.1 0.0001 1 124 1024 0.320 → 0.001
crime_and_gun_left-kl1 crime_and_gun side left 1.0 0.0001 1 124 1024 0.321 → 0.000
crime_and_gun_left-kl10 crime_and_gun side left 10.0 0.0001 1 124 1024 0.321 → 0.008
crime_and_gun_random-kl0 crime_and_gun random 0.0 0.0001 1 124 1024 0.532 → 0.347
crime_and_gun_random-kl0.1 crime_and_gun random 0.1 0.0001 1 124 1024 0.531 → 0.347
crime_and_gun_random-kl1 crime_and_gun random 1.0 0.0001 1 124 1024 0.532 → 0.349
crime_and_gun_random-kl10 crime_and_gun random 10.0 0.0001 1 124 1024 0.532 → 0.360
crime_and_gun_right-kl0 crime_and_gun side right 0.0 0.0001 1 124 1024 0.977 → 0.000
crime_and_gun_right-kl0.1 crime_and_gun side right 0.1 0.0001 1 124 1024 0.980 → 0.000
crime_and_gun_right-kl1 crime_and_gun side right 1.0 0.0001 1 124 1024 0.980 → 0.001
crime_and_gun_right-kl10 crime_and_gun side right 10.0 0.0001 1 124 1024 0.981 → 0.037
gender_and_sexuality_balright-kl0 gender_and_sexuality balanced right 0.0 0.0001 1 48 416 0.755 → 0.018
gender_and_sexuality_left-kl0 gender_and_sexuality side left 0.0 0.0001 1 124 1024 0.287 → 0.043
gender_and_sexuality_left-kl0.1 gender_and_sexuality side left 0.1 0.0001 1 124 1024 0.286 → 0.004
gender_and_sexuality_left-kl1 gender_and_sexuality side left 1.0 0.0001 1 124 1024 0.285 → 0.007
gender_and_sexuality_left-kl10 gender_and_sexuality side left 10.0 0.0001 1 124 1024 0.286 → 0.030
gender_and_sexuality_random-kl0 gender_and_sexuality random 0.0 0.0001 1 124 1024 0.567 → 0.347
gender_and_sexuality_random-kl0.1 gender_and_sexuality random 0.1 0.0001 1 124 1024 0.565 → 0.347
gender_and_sexuality_random-kl1 gender_and_sexuality random 1.0 0.0001 1 124 1024 0.566 → 0.334
gender_and_sexuality_random-kl10 gender_and_sexuality random 10.0 0.0001 1 124 1024 0.565 → 0.357
gender_and_sexuality_right-kl0 gender_and_sexuality side right 0.0 0.0001 1 124 1024 1.033 → 0.345
gender_and_sexuality_right-kl0.1 gender_and_sexuality side right 0.1 0.0001 1 124 1024 1.035 → 0.000
gender_and_sexuality_right-kl1 gender_and_sexuality side right 1.0 0.0001 1 124 1024 1.035 → 0.003
gender_and_sexuality_right-kl10 gender_and_sexuality side right 10.0 0.0001 1 124 1024 1.034 → 0.057
science_left-kl0 science side left 0.0 0.0001 1 124 1024 0.202 → 0.000
science_left-kl0.1 science side left 0.1 0.0001 1 124 1024 0.202 → 0.000
science_left-kl1 science side left 1.0 0.0001 1 124 1024 0.202 → 0.002
science_left-kl10 science side left 10.0 0.0001 1 124 1024 0.202 → 0.015
science_random-kl0 science random 0.0 0.0001 1 124 1024 0.554 → 0.347
science_random-kl0.1 science random 0.1 0.0001 1 124 1024 0.554 → 0.347
science_random-kl1 science random 1.0 0.0001 1 124 1024 0.553 → 0.348
science_random-kl10 science random 10.0 0.0001 1 124 1024 0.553 → 0.345
science_right-kl0 science side right 0.0 0.0001 1 124 1024 1.236 → 0.000
science_right-kl0.1 science side right 0.1 0.0001 1 124 1024 1.237 → 0.000
science_right-kl1 science side right 1.0 0.0001 1 124 1024 1.238 → 0.009
science_right-kl10 science side right 10.0 0.0001 1 124 1024 1.237 → 0.044
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support