Hugging Face's logo

shadowrock-io
/
Nemotron-3-Embed-8B-Community-MLX-4bit

Sentence Similarity
MLX
Safetensors
ministral3
apple-silicon
embeddings
text-embeddings
feature-extraction
retrieval
semantic-search
rag
mteb
nemotron
quantized
4-bit precision
information-retrieval
dense-retrieval
vector-search
matryoshka
arxiv:2502.13595
Eval Results (legacy)
Model card Files
xet
 Community
mattbusi commited on
Commit
fb8a423
·
verified ·
1 Parent(s): 4f5ee58

Shorten eval source label for widget display

Browse files
Files changed (1) hide show
  1. README.md +12 -12
README.md CHANGED
@@ -81,7 +81,7 @@ model-index:
81
  name: NDCG@10
82
  value: 1.0
83
  source:
84
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
85
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
86
  - task:
87
  type: Retrieval
@@ -96,7 +96,7 @@ model-index:
96
  name: NDCG@10
97
  value: 0.95644
98
  source:
99
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
100
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
101
  - task:
102
  type: Retrieval
@@ -111,7 +111,7 @@ model-index:
111
  name: NDCG@10
112
  value: 0.99459
113
  source:
114
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
115
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
116
  - task:
117
  type: Retrieval
@@ -126,7 +126,7 @@ model-index:
126
  name: NDCG@10
127
  value: 0.76267
128
  source:
129
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
130
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
131
  - task:
132
  type: Retrieval
@@ -141,7 +141,7 @@ model-index:
141
  name: NDCG@10
142
  value: 0.94053
143
  source:
144
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
145
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
146
  - task:
147
  type: Retrieval
@@ -156,7 +156,7 @@ model-index:
156
  name: NDCG@10
157
  value: 0.79763
158
  source:
159
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
160
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
161
  - task:
162
  type: Retrieval
@@ -171,7 +171,7 @@ model-index:
171
  name: NDCG@10
172
  value: 0.88571
173
  source:
174
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
175
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
176
  - task:
177
  type: Retrieval
@@ -186,7 +186,7 @@ model-index:
186
  name: NDCG@10
187
  value: 0.76243
188
  source:
189
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
190
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
191
  - task:
192
  type: Retrieval
@@ -201,7 +201,7 @@ model-index:
201
  name: NDCG@10
202
  value: 0.76165
203
  source:
204
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
205
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
206
  - task:
207
  type: Retrieval
@@ -216,7 +216,7 @@ model-index:
216
  name: NDCG@10
217
  value: 0.76924
218
  source:
219
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
220
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
221
  - task:
222
  type: Retrieval
@@ -231,7 +231,7 @@ model-index:
231
  name: NDCG@10
232
  value: 0.4199
233
  source:
234
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
235
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
236
  - task:
237
  type: Retrieval
@@ -246,7 +246,7 @@ model-index:
246
  name: NDCG@10
247
  value: 0.8338
248
  source:
249
- name: ShadowRock MTEB evaluation harness (raw JSON in repo)
250
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
251
  ---
252
  <a href="https://shadowrock.io">
 
81
  name: NDCG@10
82
  value: 1.0
83
  source:
84
+ name: ShadowRock eval (raw JSON)
85
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
86
  - task:
87
  type: Retrieval
 
96
  name: NDCG@10
97
  value: 0.95644
98
  source:
99
+ name: ShadowRock eval (raw JSON)
100
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
101
  - task:
102
  type: Retrieval
 
111
  name: NDCG@10
112
  value: 0.99459
113
  source:
114
+ name: ShadowRock eval (raw JSON)
115
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
116
  - task:
117
  type: Retrieval
 
126
  name: NDCG@10
127
  value: 0.76267
128
  source:
129
+ name: ShadowRock eval (raw JSON)
130
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
131
  - task:
132
  type: Retrieval
 
141
  name: NDCG@10
142
  value: 0.94053
143
  source:
144
+ name: ShadowRock eval (raw JSON)
145
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
146
  - task:
147
  type: Retrieval
 
156
  name: NDCG@10
157
  value: 0.79763
158
  source:
159
+ name: ShadowRock eval (raw JSON)
160
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
161
  - task:
162
  type: Retrieval
 
171
  name: NDCG@10
172
  value: 0.88571
173
  source:
174
+ name: ShadowRock eval (raw JSON)
175
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
176
  - task:
177
  type: Retrieval
 
186
  name: NDCG@10
187
  value: 0.76243
188
  source:
189
+ name: ShadowRock eval (raw JSON)
190
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
191
  - task:
192
  type: Retrieval
 
201
  name: NDCG@10
202
  value: 0.76165
203
  source:
204
+ name: ShadowRock eval (raw JSON)
205
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
206
  - task:
207
  type: Retrieval
 
216
  name: NDCG@10
217
  value: 0.76924
218
  source:
219
+ name: ShadowRock eval (raw JSON)
220
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
221
  - task:
222
  type: Retrieval
 
231
  name: NDCG@10
232
  value: 0.4199
233
  source:
234
+ name: ShadowRock eval (raw JSON)
235
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
236
  - task:
237
  type: Retrieval
 
246
  name: NDCG@10
247
  value: 0.8338
248
  source:
249
+ name: ShadowRock eval (raw JSON)
250
  url: https://huggingface.co/shadowrock-io/Nemotron-3-Embed-8B-Community-MLX-4bit/tree/main/results
251
  ---
252
  <a href="https://shadowrock.io">