GuangzhiWang commited on
Commit
4844d29
·
verified ·
1 Parent(s): b6b6c40

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +160 -3
README.md CHANGED
@@ -1,3 +1,160 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ tags:
6
+ - query-rewriting
7
+ - reasoning
8
+ - retrieval
9
+ - BRIGHT
10
+ - GRPO
11
+ - alignment
12
+ library_name: transformers
13
+ base_model: Qwen/Qwen3-4B-Instruct-2507
14
+ pipeline_tag: text-generation
15
+ datasets:
16
+ - xlangai/BRIGHT
17
+ model-index:
18
+ - name: MQR-A1
19
+ results:
20
+ - task:
21
+ type: Retrieval
22
+ dataset:
23
+ type: xlangai/BRIGHT
24
+ name: BRIGHT (Short, Pipeline)
25
+ metrics:
26
+ - type: ndcg_at_10
27
+ value: 66.9
28
+ name: nDCG@10
29
+ - task:
30
+ type: Retrieval
31
+ dataset:
32
+ type: xlangai/BRIGHT
33
+ name: BRIGHT (Long, Pipeline)
34
+ metrics:
35
+ - type: ndcg_at_10
36
+ value: 56.0
37
+ name: nDCG@10
38
+ ---
39
+
40
+ # MQR-A1: Mira Query Rewriter — Alignment v1
41
+
42
+ **MQR-A1** (Mira Query Rewriter, Alignment v1) is a GRPO-aligned query rewriting model designed for reasoning-intensive retrieval tasks. It is the alignment component of our retrieval pipeline: by rewriting queries to distill core retrieval intents and filter misleading noise, MQR-A1 enables the downstream retriever [MRE-T1](https://huggingface.co/ForwardAILabs/MRE-T1) to achieve state-of-the-art performance.
43
+
44
+ Combined as the **MQR-A1 + MRE-T1** pipeline, our system achieves **No. 1** on the [BRIGHT Benchmark](https://brightbenchmark.github.io/) across all evaluated dimensions — including both short and long document tracks — outperforming sophisticated rerankers, existing alignment models, and complex agentic pipelines.
45
+
46
+ ## Highlights
47
+
48
+ - **BRIGHT Short Pipeline nDCG@10: 66.9** — No. 1 on the short document retrieval leaderboard
49
+ - **BRIGHT Long Pipeline nDCG@10: 56.0** — No. 1 on the long document retrieval leaderboard
50
+ - **Intent Distillation over Query Expansion**: Shifts the paradigm from simple additive expansion to RL-driven discriminative feature extraction
51
+ - **Immune to Semantic Traps**: Strongly filters out redundant or misleading superficial semantic noise in complex reasoning tasks
52
+ - **SNR Enhancement**: Significantly improves the signal-to-noise ratio of retrieval signals, mitigating the "feature dilution" effect under long-text inputs
53
+
54
+ ## Training Methodology
55
+
56
+ MQR-A1 is trained using a three-stage approach:
57
+
58
+ ### 1. Candidate Rewrite Mining
59
+ To prevent the model from converging on rigid, template-based shortcuts during SFT, we implemented a heterogeneous candidate rewrite mining strategy. For every query, we dynamically synthesized a diverse set of natural-language-structured rewrites, forcing the model to prioritize underlying retrieval intent over superficial syntactic patterns.
60
+
61
+ ### 2. Cold Start (SFT)
62
+ Traditional cross-entropy loss is inherently misaligned with retrieval objectives. By injecting natural language structural features derived from the mining stage, we equip the base model with strong discriminative feature extraction capabilities, laying a stable initialization foundation for the subsequent GRPO phase.
63
+
64
+ ### 3. GRPO-Driven Intent Alignment
65
+ Unlike DPO, which relies on static preference data, GRPO (Group Relative Policy Optimization) enables the model to engage in interactive learning via retrieval feedback within the actual document corpus environment. This allows the model to autonomously explore and extract highly discriminative features, achieving a fundamental leap from superficial "textual matching" to deep "intent alignment."
66
+
67
+ **Multi-Dimensional Reward Function:**
68
+ | Component | Description |
69
+ |-----------|-------------|
70
+ | Primary Reward | Dense retrieval NDCG scores |
71
+ | Constraint | Length penalty to prevent feature dilution |
72
+ | Reward Shaping | Cosine similarity with positive examples to maintain semantic grounding |
73
+
74
+ ## BRIGHT Benchmark Results (Pipeline: MQR-A1 + MRE-T1)
75
+
76
+ ### Short Document Retrieval (nDCG@10)
77
+
78
+ | Task | MQR-A1 + MRE-T1 |
79
+ |------|:----------------:|
80
+ | Biology | **86.7** |
81
+ | Earth Science | **78.5** |
82
+ | Economics | 69.7 |
83
+ | Psychology | **78.2** |
84
+ | Robotics | **58.4** |
85
+ | StackOverflow | **67.0** |
86
+ | Sustainable Living | **65.9** |
87
+ | LeetCode | 46.8 |
88
+ | Pony | **73.4** |
89
+ | AoPS | 45.2 |
90
+ | TheoremQA (Questions) | **60.6** |
91
+ | TheoremQA (Theorems) | **72.3** |
92
+ | **Average** | **66.9** |
93
+
94
+ ### Long Document Retrieval (nDCG@10)
95
+
96
+ | Task | MQR-A1 + MRE-T1 |
97
+ |------|:----------------:|
98
+ | Biology | **77.1** |
99
+ | Earth Science | 59.0 |
100
+ | Economics | **71.2** |
101
+ | Psychology | 73.8 |
102
+ | Robotics | 46.0 |
103
+ | StackOverflow | **35.5** |
104
+ | Sustainable Living | **70.6** |
105
+ | Pony | **14.6** |
106
+ | **Average** | **56.0** |
107
+
108
+ ### Comparison with Other Retrieval Pipelines (Short Documents)
109
+
110
+ | Pipeline | Avg nDCG@10 |
111
+ |----------|:-----------:|
112
+ | **MQR-A1 + MRE-T1** | **66.9** |
113
+ | INF-X-Retriever | 63.4 |
114
+ | RakanEmb4B | 52.4 |
115
+ | Nemo Retriever's Agentic Retrieval | 50.9 |
116
+ | DIVER-v3-GroupRank | 46.8 |
117
+ | BGE-Reasoner-0928 | 46.4 |
118
+ | Lattice Hierarchical Retrieval | 42.1 |
119
+
120
+ ### Comparison with Other Retrieval Pipelines (Long Documents)
121
+
122
+ | Pipeline | Avg nDCG@10 |
123
+ |----------|:-----------:|
124
+ | **MQR-A1 + MRE-T1** | **56.0** |
125
+ | INF-X-Retriever | 54.6 |
126
+
127
+ ## Usage
128
+
129
+ MQR-A1 rewrites user queries into intent-distilled versions optimized for dense retrieval with MRE-T1. The rewritten query preserves core retrieval signals while removing misleading surface-level noise.
130
+
131
+ **Recommended Pipeline:**
132
+ 1. Pass the raw query through **MQR-A1** to obtain an intent-aligned rewrite
133
+ 2. Use the rewritten query with **[MRE-T1](https://huggingface.co/ForwardAILabs/MRE-T1)** for dense retrieval
134
+
135
+ ## Related Models
136
+
137
+ | Model | Description | Link |
138
+ |-------|-------------|------|
139
+ | **MRE-T1** | Reasoning-enhanced retriever (Mira Recruitment Embedding, Thought v1) | [ForwardAILabs/MRE-T1](https://huggingface.co/ForwardAILabs/MRE-T1) |
140
+
141
+ ## Citation
142
+
143
+ If you use MQR-A1 in your research, please cite:
144
+
145
+ ```bibtex
146
+ @misc{mqr-a1-2026,
147
+ title={MQR-A1: GRPO-Aligned Query Rewriter for Reasoning-Intensive Retrieval},
148
+ author={Forward AI Labs},
149
+ year={2026},
150
+ url={https://huggingface.co/ForwardAILabs/MQR-A1}
151
+ }
152
+ ```
153
+
154
+ ## License
155
+
156
+ Apache 2.0
157
+
158
+ ---
159
+
160
+ **Built by [Forward AI Labs](https://huggingface.co/ForwardAILabs)** | [mira.day](https://www.mira.day/)