How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="phanviethoang1512/Qwen3-8B-InfoPO-Agent")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("phanviethoang1512/Qwen3-8B-InfoPO-Agent")
model = AutoModelForCausalLM.from_pretrained("phanviethoang1512/Qwen3-8B-InfoPO-Agent", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
Quick Links

Qwen3-8B-InfoPO-Agent

The InfoPO baseline from MIMESIS: Qwen3-8B trained with InfoPO, which assigns turn-level credit according to the information gained from interaction, with MIMESIS-9B as the training user simulator.

Paper · Code · Project page · Collection

Results

Mean task score of the five Qwen3-8B agents from the paper across eight UserRL environments, three of them held out from training (IntentionGym, TelepathyGym, SearchGym), under nine evaluation user models that were not used in training.

Agent Training user Objective Mean score
Base none SFT 18.49
UserRL GPT-5.5 GRPO 26.10
InfoPO (this model) MIMESIS-9B InfoPO 26.65
UserRL+ MIMESIS-9B GRPO 29.54
CSD MIMESIS-9B GRPO + CSD 31.09

InfoPO and CSD use the same training user, so they differ in their optimization objectives rather than in simulator choice. Each score is the mean over the nine evaluation users; per-user and per-environment scores are in Appendix D of the paper.

Training

RL starts from the Base checkpoint, Qwen3-8B after a supervised warm start, and trains on five UserRL environments: TravelGym, TurtleGym, FunctionGym, TauGym and PersuadeGym. The full configuration is in Appendix D of the paper, and the training scripts are in the agent directory of the code release.

Usage

The model loads like Qwen3-8B. To evaluate it in the eight environments, install the agent code, serve a user model as described there, and run from the agent directory:

bash scripts/run_eval.sh phanviethoang1512/Qwen3-8B-InfoPO-Agent infopo

Citation

@article{phan2026mimesis,
  title   = {{MIMESIS}: Learning User Simulators as Training Environments for Interactive Agents},
  author  = {Phan, Hoang and Huynh, Dat and Zhmoginov, Andrey and Zeng, Qi and Mu, Wancen and Cao, Yue and Bi, Shengjie and He, Yun and Oh, Changdae and Lei, Deren},
  journal = {arXiv preprint arXiv:2610.09484},
  year    = {2026}
}
Downloads last month
17
Safetensors
Model size
8B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for phanviethoang1512/Qwen3-8B-InfoPO-Agent

Finetuned
Qwen/Qwen3-8B
Finetuned
(2182)
this model

Collection including phanviethoang1512/Qwen3-8B-InfoPO-Agent

Papers for phanviethoang1512/Qwen3-8B-InfoPO-Agent