Text Classification
Transformers
Safetensors
English
Chinese
qwen3
text-generation
zen
zen-reranker
zenlm
hanzo
reranker
retrieval
text-embeddings-inference
Instructions to use zenlm/zen-reranker-8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zenlm/zen-reranker-8B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="zenlm/zen-reranker-8B")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("zenlm/zen-reranker-8B") model = AutoModelForCausalLM.from_pretrained("zenlm/zen-reranker-8B", device_map="auto") - Notebooks
- Google Colab
- Kaggle
docs: honest base_model attribution, drop marketing
Browse files
README.md
CHANGED
|
@@ -1,5 +1,6 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
| 3 |
library_name: transformers
|
| 4 |
pipeline_tag: text-classification
|
| 5 |
language:
|
|
@@ -11,25 +12,21 @@ tags:
|
|
| 11 |
- zenlm
|
| 12 |
- hanzo
|
| 13 |
- reranker
|
|
|
|
| 14 |
---
|
| 15 |
|
| 16 |
# Zen Reranker 8B
|
| 17 |
|
| 18 |
-
8B-parameter cross-encoder reranker for retrieval pipelines and search relevance. Part of the Zen reranker
|
| 19 |
|
| 20 |
-
|
| 21 |
|
| 22 |
-
|
| 23 |
|
| 24 |
-
|
| 25 |
|
| 26 |
-
|
| 27 |
|
| 28 |
-
|
| 29 |
-
from transformers import AutoModel, AutoTokenizer
|
| 30 |
-
m = AutoModel.from_pretrained("zenlm/zen-reranker-8B")
|
| 31 |
-
t = AutoTokenizer.from_pretrained("zenlm/zen-reranker-8B")
|
| 32 |
-
```
|
| 33 |
-
|
| 34 |
-
For GGUF / Ollama deployment, see [zenlm/zen-reranker-8B-GGUF](https://huggingface.co/zenlm/zen-reranker-8B-GGUF).
|
| 35 |
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
base_model: Qwen/Qwen3-Reranker-8B
|
| 4 |
library_name: transformers
|
| 5 |
pipeline_tag: text-classification
|
| 6 |
language:
|
|
|
|
| 12 |
- zenlm
|
| 13 |
- hanzo
|
| 14 |
- reranker
|
| 15 |
+
- retrieval
|
| 16 |
---
|
| 17 |
|
| 18 |
# Zen Reranker 8B
|
| 19 |
|
| 20 |
+
8B-parameter cross-encoder reranker for retrieval pipelines and search relevance — re-scores candidate passages for RAG and search quality. Part of the Zen reranker line.
|
| 21 |
|
| 22 |
+
Repackaged from [Qwen/Qwen3-Reranker-8B](https://huggingface.co/Qwen/Qwen3-Reranker-8B) (apache-2.0, Alibaba Qwen). Native HuggingFace `safetensors`, re-hosted under the Zen reranker line. **Not trained from scratch** — a permissively-licensed redistribution for the OSS-clean Zen model line.
|
| 23 |
|
| 24 |
+
## Usage
|
| 25 |
|
| 26 |
+
Score query/passage pairs following the upstream [Qwen/Qwen3-Reranker-8B](https://huggingface.co/Qwen/Qwen3-Reranker-8B) recipe (yes/no token scoring).
|
| 27 |
|
| 28 |
+
Hosted via the Hanzo gateway (`api.hanzo.ai`) as `zen-reranker-8b`. GGUF build for CPU inference: [zenlm/zen-reranker-8B-GGUF](https://huggingface.co/zenlm/zen-reranker-8B-GGUF).
|
| 29 |
|
| 30 |
+
## License
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
|
| 32 |
+
`apache-2.0`. Upstream: **Qwen/Qwen3-Reranker-8B** by Alibaba Qwen. This repository redistributes the weights under the same license.
|