Instructions to use OpenVINO/Qwen3-Reranker-0.6B-fp16-ov with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OpenVINO/Qwen3-Reranker-0.6B-fp16-ov with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("OpenVINO/Qwen3-Reranker-0.6B-fp16-ov") model = AutoModelForCausalLM.from_pretrained("OpenVINO/Qwen3-Reranker-0.6B-fp16-ov", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 132 Bytes
fc8e520 | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:63c613e041e2d7f84f7376d6b628b72c8af29259b4d1b27540035f0d9ef034b3
size 5588835
|