README.md

---
license: apache-2.0
base_model: Qwen/Qwen3-8B
library_name: transformers
pipeline_tag: text-generation
language:
  - en
tags:
  - proactive-agents
  - information-seeking
  - question-asking
  - agents
  - multi-hop-qa
  - tau2-bench
  - dpo
  - qwen3
datasets:
  - dgslibisey/MuSiQue
  - ChilleD/StrategyQA
  - xanhho/2WikiMultihopQA
---

<div align="center">

# ProactiveInquirer-Qwen3-8B-Merged

<img src="assets/title-card.png" width="100%" alt="Asking for What Was Never Requested: Horizontal and Vertical Proactivity in Agents">

[Ido Levy](https://scholar.google.com/citations?user=Ok_7M80AAAAJ)<sup>1,2</sup> · [Asaf Yehudai](https://scholar.google.com/citations?user=FprEf4oAAAAJ)<sup>1</sup> · [Segev Shlomov](https://scholar.google.com/citations?user=hhtOihkAAAAJ)<sup>1</sup> · [Asaf Adi](https://www.linkedin.com/in/asaf-adi/)<sup>1</sup> · [Leshem Choshen](https://borgr.github.io/)<sup>1,2</sup><br>
<sup>1</sup>IBM &nbsp; <sup>2</sup>Weizmann Institute of Science

[![Project page](https://img.shields.io/badge/Project-page-1B5EA8)](https://dolev31.github.io/ProactiveInquirer/)
[![Paper](https://img.shields.io/badge/arXiv-2609.37236-b31b1b?logo=arxiv&logoColor=white)](https://arxiv.org/abs/2609.37236)
[![Code](https://img.shields.io/badge/GitHub-ProactiveInquirer-181717?logo=github)](https://github.com/dolev31/ProactiveInquirer)
[![License](https://img.shields.io/badge/license-Apache--2.0-blue)](https://www.apache.org/licenses/LICENSE-2.0)

<video controls autoplay muted loop playsinline poster="https://huggingface.co/dolev31/ProactiveInquirer-Qwen3-8B/resolve/main/assets/animation-poster.webp" src="https://huggingface.co/dolev31/ProactiveInquirer-Qwen3-8B/resolve/main/assets/animation.mp4" width="100%"></video>

<sub>▶ The paper's example, step by step (22 seconds): the questioner trained with Q&D finds the account, the order with the boots and the size-8 boots, and the task is completed.</sub>

</div>

The trained **questioner** from *Asking for What Was Never Requested: Horizontal and Vertical
Proactivity in Agents*, with its LoRA adapter merged into [Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B).
It is a standard full-weight model: it loads without PEFT and serves with vLLM, SGLang or TGI like any
Qwen3-8B.

- **The adapter**, with the results, the training details, the limitations and a complete two-turn
  example: [dolev31/ProactiveInquirer-Qwen3-8B](https://huggingface.co/dolev31/ProactiveInquirer-Qwen3-8B).
- **Quantized** for llama.cpp, Ollama and LM Studio:
  [dolev31/ProactiveInquirer-Qwen3-8B-GGUF](https://huggingface.co/dolev31/ProactiveInquirer-Qwen3-8B-GGUF).

This is training seed 1, the adapter at the root of the adapter repository. The merge ran in float32
and the weights are stored in bfloat16. On the adapter card's two-turn example, greedy decoding with
this model returns the adapter's output character for character.

## Results

The results are the trained questioner's, as the paper reports them: see the
[adapter card's Results](https://huggingface.co/dolev31/ProactiveInquirer-Qwen3-8B#results). This merged model reproduces the adapter's output on that card's example, as the paragraph
above says.

## How to use it

The questioner reads the prompt template it was trained on, in [`prompts/`](prompts/), and replies
with one JSON action per step: `{"action": "ask", "question": ...}` or `{"action": "stop", ...}`.
Keep Qwen3's thinking off, as in training.

```python
import re

import torch
from huggingface_hub import hf_hub_download
from transformers import AutoModelForCausalLM, AutoTokenizer

REPO = "dolev31/ProactiveInquirer-Qwen3-8B-Merged"
tok = AutoTokenizer.from_pretrained(REPO)
model = AutoModelForCausalLM.from_pretrained(REPO, dtype=torch.bfloat16, device_map="auto")
template = open(hf_hub_download(REPO, "prompts/inquirer_prompted.txt"), encoding="utf-8").read()
placebo = open(hf_hub_download(REPO, "prompts/fragment_user_channel_placebo.txt"), encoding="utf-8").read()


def next_action(**state):
    fields = dict(state, user_channel=placebo.strip())
    prompt = re.sub(r"\{\{(\w+)\}\}", lambda m: str(fields[m.group(1)]), template)
    ids = tok.apply_chat_template(
        [{"role": "user", "content": prompt}],
        add_generation_prompt=True,
        enable_thinking=False,
        return_tensors="pt",
        return_dict=True,
    ).to(model.device)
    out = model.generate(**ids, max_new_tokens=200, do_sample=False)
    return tok.decode(out[0, ids["input_ids"].shape[1] :], skip_special_tokens=True)


print(next_action(
    question="Who was the spouse of the director of the film The Great Flamarion?",
    instructions="Answer the question using a closed pool of 20 paragraphs. You may issue retrieval "
    "queries against that pool before answering; several paragraphs are distractors, and the answer "
    "usually requires composing facts from more than one of them.",
    evidence="(nothing retrieved yet)", draft="(no draft yet)", history="(nothing asked yet)",
))
# {"action": "ASK", "question": "Who directed the film The Great Flamarion?", "rationale": "Identify the director to later find their spouse"}
```

With vLLM, serve it and send the filled template as the user message, with thinking off:

```bash
vllm serve dolev31/ProactiveInquirer-Qwen3-8B-Merged
# request body: {"messages": [{"role": "user", "content": "<the filled template>"}],
#                "chat_template_kwargs": {"enable_thinking": false}, "temperature": 0}
```

## Limitations

- The questioner's own limitations, from the paper: it has learned what to ask more readily than when to
  stop, the extra evidence it finds does not yet translate into better final answers, and its user-facing
  results come from a simulated customer, not from real people.
- It is a component inside an agent, meant to be called with its prompt template. It is not a chat
  assistant, and it was trained and evaluated in English.
- This is one training seed (seed 1), merged in float32 and stored in bfloat16. Its equality with the
  adapter was checked on the card's example, not on a benchmark.

## Citation

```bibtex
@article{levy2026asking,
  title   = {Asking for What Was Never Requested: Horizontal and Vertical Proactivity in Agents},
  author  = {Levy, Ido and Yehudai, Asaf and Shlomov, Segev and Adi, Asaf and Choshen, Leshem},
  journal = {arXiv preprint arXiv:2609.37236},
  url     = {https://arxiv.org/abs/2609.37236},
  year    = {2026}
}
```

## License

Apache-2.0, like the base model [Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B).