Instructions to use dementor-research/dpo_chatbot_arena_olmo-3-7b_as_gpt-oss-20b_seed42 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use dementor-research/dpo_chatbot_arena_olmo-3-7b_as_gpt-oss-20b_seed42 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("allenai/OLMo-3-7B-Instruct") model = PeftModel.from_pretrained(base_model, "dementor-research/dpo_chatbot_arena_olmo-3-7b_as_gpt-oss-20b_seed42") - Notebooks
- Google Colab
- Kaggle
File size: 836 Bytes
75d7efc | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 | ---
library_name: peft
tags:
- dementor
- imitation-disguise
- lora
- chatbot_arena
base_model: allenai/OLMo-3-7B-Instruct
---
# dpo_chatbot_arena_olmo-3-7b_as_gpt-oss-20b_seed42
CURRENT Dementor imitation (disguise) LoRA adapter — dataset **chatbot_arena**, **seed 42**.
- **Method:** DPO
- **Source model (fine-tuned / disguised):** `olmo-3-7b` (base: `allenai/OLMo-3-7B-Instruct`)
- **Target model being imitated:** `gpt-oss-20b`
- **Dataset:** chatbot_arena (benign) | **Seed:** 42
This adapter trains the source model to imitate the target model's style on the benign
chatbot_arena corpus. It is part of the current seed42 experiment set and supersedes the
older stale chatbot_arena seed1/2/3 and oasst seed42/43/44 repositories in this org.
Registry key == repo id == `dpo_chatbot_arena_olmo-3-7b_as_gpt-oss-20b_seed42`.
|