---
license: apache-2.0
base_model: Qwen/Qwen3-8B
library_name: transformers
pipeline_tag: text-generation
language:
- en
tags:
- proactive-agents
- information-seeking
- question-asking
- agents
- multi-hop-qa
- tau2-bench
- dpo
- qwen3
datasets:
- dgslibisey/MuSiQue
- ChilleD/StrategyQA
- xanhho/2WikiMultihopQA
---
# ProactiveInquirer-Qwen3-8B-Merged

[Ido Levy](https://scholar.google.com/citations?user=Ok_7M80AAAAJ)
1,2 · [Asaf Yehudai](https://scholar.google.com/citations?user=FprEf4oAAAAJ)
1 · [Segev Shlomov](https://scholar.google.com/citations?user=hhtOihkAAAAJ)
1 · [Asaf Adi](https://www.linkedin.com/in/asaf-adi/)
1 · [Leshem Choshen](https://borgr.github.io/)
1,2
1IBM
2Weizmann Institute of Science
[](https://dolev31.github.io/ProactiveInquirer/)
[](https://arxiv.org/abs/2609.37236)
[](https://github.com/dolev31/ProactiveInquirer)
[](https://www.apache.org/licenses/LICENSE-2.0)
▶ The paper's example, step by step (22 seconds): the questioner trained with Q&D finds the account, the order with the boots and the size-8 boots, and the task is completed.
The trained **questioner** from *Asking for What Was Never Requested: Horizontal and Vertical
Proactivity in Agents*, with its LoRA adapter merged into [Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B).
It is a standard full-weight model: it loads without PEFT and serves with vLLM, SGLang or TGI like any
Qwen3-8B.
- **The adapter**, with the results, the training details, the limitations and a complete two-turn
example: [dolev31/ProactiveInquirer-Qwen3-8B](https://huggingface.co/dolev31/ProactiveInquirer-Qwen3-8B).
- **Quantized** for llama.cpp, Ollama and LM Studio:
[dolev31/ProactiveInquirer-Qwen3-8B-GGUF](https://huggingface.co/dolev31/ProactiveInquirer-Qwen3-8B-GGUF).
This is training seed 1, the adapter at the root of the adapter repository. The merge ran in float32
and the weights are stored in bfloat16. On the adapter card's two-turn example, greedy decoding with
this model returns the adapter's output character for character.
## Results
The results are the trained questioner's, as the paper reports them: see the
[adapter card's Results](https://huggingface.co/dolev31/ProactiveInquirer-Qwen3-8B#results). This merged model reproduces the adapter's output on that card's example, as the paragraph
above says.
## How to use it
The questioner reads the prompt template it was trained on, in [`prompts/`](prompts/), and replies
with one JSON action per step: `{"action": "ask", "question": ...}` or `{"action": "stop", ...}`.
Keep Qwen3's thinking off, as in training.
```python
import re
import torch
from huggingface_hub import hf_hub_download
from transformers import AutoModelForCausalLM, AutoTokenizer
REPO = "dolev31/ProactiveInquirer-Qwen3-8B-Merged"
tok = AutoTokenizer.from_pretrained(REPO)
model = AutoModelForCausalLM.from_pretrained(REPO, dtype=torch.bfloat16, device_map="auto")
template = open(hf_hub_download(REPO, "prompts/inquirer_prompted.txt"), encoding="utf-8").read()
placebo = open(hf_hub_download(REPO, "prompts/fragment_user_channel_placebo.txt"), encoding="utf-8").read()
def next_action(**state):
fields = dict(state, user_channel=placebo.strip())
prompt = re.sub(r"\{\{(\w+)\}\}", lambda m: str(fields[m.group(1)]), template)
ids = tok.apply_chat_template(
[{"role": "user", "content": prompt}],
add_generation_prompt=True,
enable_thinking=False,
return_tensors="pt",
return_dict=True,
).to(model.device)
out = model.generate(**ids, max_new_tokens=200, do_sample=False)
return tok.decode(out[0, ids["input_ids"].shape[1] :], skip_special_tokens=True)
print(next_action(
question="Who was the spouse of the director of the film The Great Flamarion?",
instructions="Answer the question using a closed pool of 20 paragraphs. You may issue retrieval "
"queries against that pool before answering; several paragraphs are distractors, and the answer "
"usually requires composing facts from more than one of them.",
evidence="(nothing retrieved yet)", draft="(no draft yet)", history="(nothing asked yet)",
))
# {"action": "ASK", "question": "Who directed the film The Great Flamarion?", "rationale": "Identify the director to later find their spouse"}
```
With vLLM, serve it and send the filled template as the user message, with thinking off:
```bash
vllm serve dolev31/ProactiveInquirer-Qwen3-8B-Merged
# request body: {"messages": [{"role": "user", "content": "