Sentence Similarity
ONNX
Safetensors
sentence-transformers
Transformers
English
PyLate
modernbert
feature-extraction
ColBERT
multi-vector
Generated from Trainer
Eval Results (legacy)
text-embeddings-inference
Instructions to use mixedbread-ai/mxbai-edge-colbert-v0-17m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use mixedbread-ai/mxbai-edge-colbert-v0-17m with sentence-transformers:
from pylate import models queries = [ "Which planet is known as the Red Planet?", "What is the largest planet in our solar system?", ] documents = [ ["Mars is the Red Planet.", "Venus is Earth's twin."], ["Jupiter is the largest planet.", "Saturn has rings."], ] model = models.ColBERT(model_name_or_path="mixedbread-ai/mxbai-edge-colbert-v0-17m") queries_emb = model.encode(queries, is_query=True) docs_emb = model.encode(documents, is_query=False) - Transformers
How to use mixedbread-ai/mxbai-edge-colbert-v0-17m with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("mixedbread-ai/mxbai-edge-colbert-v0-17m") model = AutoModel.from_pretrained("mixedbread-ai/mxbai-edge-colbert-v0-17m", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
fix: Include all Dense projection layers in ONNX export (output dim 48) (#3)
Browse files- fix: Include all Dense projection layers in ONNX export (output dim 48) (4451857b361128891d8d6677d2a2f3683eadce8f)
- fix: Re-export ONNX with pylate-onnx-export v1.0.7 (includes all Dense layers, output dim=48) (03eca9b4c6091b7cdfe3fb3a9c036ac4e1cf8555)
Co-authored-by: Chao-Chun (Joe) Hsu <joe32140@users.noreply.huggingface.co>
- model.onnx +2 -2
- model_int8.onnx +2 -2
- onnx_config.json +2 -1
model.onnx
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2fb3ad410f1b68479caa31e9d6821213050ef25804cb9a3c9ba963e72503f46
|
| 3 |
+
size 67970609
|
model_int8.onnx
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1d4a2876f8c325f43b97d186e22f6b63ebe9820827d73b81fcea180c20e5518b
|
| 3 |
+
size 17228400
|
onnx_config.json
CHANGED
|
@@ -47,5 +47,6 @@
|
|
| 47 |
"mask_token_id": 50284,
|
| 48 |
"pad_token_id": 50284,
|
| 49 |
"query_prefix_id": 50368,
|
| 50 |
-
"document_prefix_id": 50369
|
|
|
|
| 51 |
}
|
|
|
|
| 47 |
"mask_token_id": 50284,
|
| 48 |
"pad_token_id": 50284,
|
| 49 |
"query_prefix_id": 50368,
|
| 50 |
+
"document_prefix_id": 50369,
|
| 51 |
+
"do_lower_case": true
|
| 52 |
}
|