Sentence Similarity
sentence-transformers
Safetensors
English
qwen3
embeddings
reasoning
early-exit
efficient-reasoning
redundancy-detection
text-embeddings-inference
Instructions to use ZhishanQ/qwen3-embedding-redundancy-detector-0.6B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use ZhishanQ/qwen3-embedding-redundancy-detector-0.6B with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("ZhishanQ/qwen3-embedding-redundancy-detector-0.6B") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
Fix inline math rendering (use plain text/Unicode for inline symbols)
Browse files
README.md
CHANGED
|
@@ -34,17 +34,17 @@ final-answer accuracy or the coherence of the retained reasoning chain.
|
|
| 34 |
## What it does
|
| 35 |
|
| 36 |
During reasoning, PUMA splits the model's chain of thought into steps
|
| 37 |
-
|
| 38 |
**candidate exit point** when it is semantically redundant with a recent step,
|
| 39 |
-
measured by cosine similarity:
|
| 40 |
|
| 41 |
$$ s_t^{(k)} = \max_{t-k \le j < t} \cos\big(f(r_j),\, f(r_t)\big) $$
|
| 42 |
|
| 43 |
-
where
|
| 44 |
-
|
| 45 |
-
**
|
| 46 |
-
|
| 47 |
-
|
| 48 |
|
| 49 |
## Training
|
| 50 |
|
|
|
|
| 34 |
## What it does
|
| 35 |
|
| 36 |
During reasoning, PUMA splits the model's chain of thought into steps
|
| 37 |
+
r₁, …, rₜ and embeds each step with this model. A step is flagged as a
|
| 38 |
**candidate exit point** when it is semantically redundant with a recent step,
|
| 39 |
+
measured by the maximum cosine similarity to the previous *k* steps:
|
| 40 |
|
| 41 |
$$ s_t^{(k)} = \max_{t-k \le j < t} \cos\big(f(r_j),\, f(r_t)\big) $$
|
| 42 |
|
| 43 |
+
where *f*(·) is this embedding model. PUMA flags a step when its redundancy
|
| 44 |
+
score exceeds a threshold **τ_sim**. The paper's default operating point is
|
| 45 |
+
**τ_sim = 0.35** with a local window **k = 1** (compare against the immediately
|
| 46 |
+
preceding step). A flagged step is then passed to PUMA's answer-level
|
| 47 |
+
verification before generation is actually stopped.
|
| 48 |
|
| 49 |
## Training
|
| 50 |
|