squash history: reclaim orphaned LFS blobs from cleanup + iteration commits

.gitattributes

@@ -0,0 +1,37 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text
+colgemma.png filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,247 @@
+---
+language:
+- en
+- de
+- es
+- fr
+- it
+license: apache-2.0
+arxiv: 2407.01449
+library_name: colpali_engine
+tags:
+- colbert
+- visual-retrieval
+- document-retrieval
+- gemma4
+- lora
+- colpali
+- late-interaction
+- multi-vector
+- colpali_engine
+pipeline_tag: visual-document-retrieval
+base_model: google/gemma-4-E4B-it
+datasets:
+- vidore/colpali_train_set
+- openbmb/VisRAG-Ret-Train-Synthetic-data
+- openbmb/VisRAG-Ret-Train-In-domain-data
+- llamaindex/vdr-multilingual-train
+---
+
+<p align="center">
+  <img src="colgemma.png" alt="ColGemma-4" width="500"/>
+</p>
+
+# ColGemma4-E4B-IT-Base
+
+> See also: [ColGemma4-E2B-IT-Base](https://huggingface.co/athrael-soju/ColGemma4-E2B-IT-Base) (smaller 2.3B-effective variant)
+
+**ColGemma4** is a visual document retrieval model built on [Google's Gemma 4 E4B](https://huggingface.co/google/gemma-4-E4B-it) (9B params, 4.5B effective). It generates [ColBERT](https://arxiv.org/abs/2004.12832)-style multi-vector representations of document images and text queries for late-interaction retrieval.
+
+Single-seed LoRA adapter trained with ColbertLoss, no hard negatives, no model merging.
+
+> Built following the [ColPali](https://arxiv.org/abs/2407.01449) architecture pattern, adapted for Gemma 4's multimodal architecture.
+
+## Model Description
+
+| Property | Value |
+|----------|-------|
+| Base model | `google/gemma-4-E4B-it` (9B total, 4.5B effective) |
+| Architecture | ColBERT late-interaction over Gemma 4 VLM |
+| Embedding dim | 128 |
+| Visual tokens | 1120 (max soft tokens) |
+| Fine-tuning | LoRA (r=32, alpha=32, dropout=0.1) |
+| Trainable params | 73.4M (0.95% of total) |
+| Projection | Random-init linear (hidden_size -> 128), not trained |
+| Training loss | ColbertLoss (temperature=0.02, in-batch negatives only) |
+| Precision | BF16 |
+
+## Benchmark Results
+
+All scores are **nDCG@5** on the [ViDoRe benchmark](https://huggingface.co/spaces/vidore/vidore-leaderboard).
+
+### ViDoRe V1
+
+| Task | nDCG@5 | nDCG@10 |
+|------|--------|---------|
+| ArxivQA | 84.53 | 85.57 |
+| DocVQA | 57.70 | 59.87 |
+| InfoVQA | 90.84 | 91.12 |
+| ShiftProject | 84.45 | 85.17 |
+| SyntheticDocQA - AI | 97.89 | 97.89 |
+| SyntheticDocQA - Energy | 94.40 | 95.01 |
+| SyntheticDocQA - Government | 96.58 | 96.58 |
+| SyntheticDocQA - Healthcare | 97.89 | 97.89 |
+| Tabfquad | 92.37 | 92.84 |
+| Tatdqa | 76.72 | 78.93 |
+| **Average** | **87.34** | **88.09** |
+
+### ViDoRe V2
+
+| Task | nDCG@5 | nDCG@10 |
+|------|--------|---------|
+| BioMedical Lectures | 57.06 | 59.48 |
+| ESG Reports - HL | 57.96 | 61.07 |
+| ESG Reports | 47.51 | 51.59 |
+| Economics Reports | 39.76 | 42.46 |
+| **Average** | **50.57** | **53.65** |
+
+### ViDoRe V3
+
+| Task | nDCG@5 | nDCG@10 |
+|------|--------|---------|
+| Computer Science | 63.55 | 67.76 |
+| Energy | 59.64 | 62.55 |
+| Finance En | 51.05 | 53.96 |
+| Finance Fr | 41.05 | 44.64 |
+| HR | 52.60 | 55.17 |
+| Pharmaceuticals | 55.98 | 57.42 |
+| Physics | 43.37 | 46.11 |
+| Industrial | 41.52 | 42.98 |
+| **Average** | **51.10** | **53.82** |
+
+## Usage
+
+### Installation
+
+```bash
+pip install colpali-engine transformers torch peft
+```
+
+### Loading the Model
+
+```python
+import torch
+from colgemma4 import ColGemma4, ColGemma4Processor
+
+model = ColGemma4.from_pretrained(
+    "athrael-soju/ColGemma4-E4B-IT-Base",
+    torch_dtype=torch.bfloat16,
+    device_map="auto",
+    attn_implementation="sdpa",
+    ignore_mismatched_sizes=True,
+)
+
+processor = ColGemma4Processor.from_pretrained(
+    "athrael-soju/ColGemma4-E4B-IT-Base",
+    max_num_visual_tokens=1120,
+)
+```
+
+### Encoding Documents (Images)
+
+```python
+from PIL import Image
+
+images = [Image.open("page1.png"), Image.open("page2.png")]
+batch_doc = processor.process_images(images)
+batch_doc = {k: v.to(model.device) for k, v in batch_doc.items()}
+
+with torch.no_grad():
+    doc_embeddings = model(**batch_doc)
+```
+
+### Encoding Queries
+
+```python
+queries = ["What is the revenue for Q3 2024?"]
+batch_query = processor.process_queries(queries)
+batch_query = {k: v.to(model.device) for k, v in batch_query.items()}
+
+with torch.no_grad():
+    query_embeddings = model(**batch_query)
+```
+
+### Scoring (MaxSim)
+
+```python
+scores = processor.score(query_embeddings, doc_embeddings)
+```
+
+## Training Configuration
+
+```yaml
+Base model: google/gemma-4-E4B-it
+Loss: ColbertLoss (temperature=0.02)
+Hard negatives: none
+Batch size per GPU: 64
+GPUs: 8
+Gradient accumulation: 1
+Effective batch size: 512 (64 x 8)
+In-batch negatives: 512
+LoRA:
+  r: 32
+  alpha: 32
+  dropout: 0.1
+  target_modules: "language_model.*(down_proj|gate_proj|up_proj|k_proj|q_proj|v_proj|o_proj)"
+Learning rate: 2e-4 (cosine schedule, 8% warmup)
+Weight decay: 0.02
+Epochs: 1
+Steps: 1,512
+Visual tokens: 1120
+Attention: Bidirectional (all 42 layers patched)
+Gradient checkpointing: enabled
+Precision: BF16
+```
+
+### Training Data
+
+Trained on ~774K query-document pairs from publicly available datasets:
+
+- `vidore/colpali_train_set`
+- `openbmb/VisRAG-Ret-Train-Synthetic-data`
+- `openbmb/VisRAG-Ret-Train-In-domain-data`
+- `llamaindex/vdr-multilingual-train` (en/de/es/fr/it subsets)
+- `vidore/tatdqa_train`
+- `vidore/tabfquad_train_set`
+
+## Troubleshooting & Fine-tuning Guide
+
+If you're building on this model or training your own ColGemma4, here's what we learned along the way.
+
+### Gemma 4 Architecture Gotchas
+
+- **Position embedding memory blow-up** - The vision encoder uses `F.one_hot(positions, num_classes=10240)` which allocates ~314 GB at batch=32 with 1120 tokens. Replacing with `F.embedding` is mathematically identical and saves ~106 GB/GPU. Required for batch sizes above 8.
+  ```python
+  # In Gemma4VisionEncoder._position_embeddings:
+  # Replace: one_hot = F.one_hot(clamped_positions, num_classes=self.position_embedding_size)
+  # With:    return F.embedding(clamped_positions, self.position_embedding_table)
+  ```
+- **KV-sharing and `use_cache`** - Gemma 4 E4B has 18 of 42 text layers (24-41) that reuse K/V from 2 donor layers (22 and 23) when caching is enabled. During training, always set `use_cache=False` to ensure every layer computes its own K/V and all LoRA weights are active. At inference time, set `use_cache=True` so the KV-sharing architecture works as designed.
+- **Flash Attention is incompatible** - Gemma 4 has head_dim 256 (sliding) and 512 (global). FA v2 caps at 256, FA v4 at 128. Use `attn_implementation="sdpa"` instead.
+- **Gradient checkpointing is mandatory** - At 1120 visual tokens, activations from 42 layers consume well over 200 GB. Even with the position patch, disabling gradient checkpointing will OOM.
+
+### Training Tips
+
+- **Leave `custom_text_proj` alone** - The 128-dim projection is randomly initialized and works best untrained. Both LoRA-targeting and `modules_to_save` caused regressions in our experiments. The random projection provides a consistent mapping without overfitting.
+- **Keep `grad_accum=1` with contrastive losses** - `all_gather` only collects the current micro-batch, so accumulation steps halve your in-batch negatives. Training loss looks deceptively good but eval regresses. Use the largest batch that fits with `grad_accum=1`.
+- **Avoid `torch.compile`** - It adds `_orig_mod.` to weight keys, breaking PEFT adapter loading at eval time. Scores drop to near-zero despite healthy training loss.
+- **Watch for silent weight randomization** - `ignore_mismatched_sizes=True` will initialize mismatched weights to random without any error. Sanity check: loss at step 0 should be near `log(batch_size)` (~6.2 for batch 512), and grad norms should be 5-20. If grad norms are in the thousands, weights didn't load correctly.
+
+## HydraGemma4 (Dual-Head Variant)
+
+This repo includes `lm_head.pt`, the saved language model head from the base model. Combined with the LoRA adapter, this enables the **HydraGemma4** dual-head architecture supporting both retrieval (ColBERT embeddings) and generation (text output) from the same base model.
+
+## Limitations
+
+- Single-seed, no model merging
+- No hard negative mining (relies entirely on in-batch negatives)
+- English-centric training data (some multilingual from VDR)
+- Visual token budget fixed at 1120
+
+## Citation
+
+```bibtex
+@misc{colgemma4,
+  title={ColGemma4: Visual Document Retrieval with Gemma 4},
+  author={Athrael Soju},
+  year={2026},
+  url={https://huggingface.co/athrael-soju/ColGemma4-E4B-IT-Base}
+}
+```
+
+## Acknowledgements
+
+- [ColPali](https://arxiv.org/abs/2407.01449) by Faysse et al. for the ColBERT-over-VLM architecture
+- [Google Gemma 4](https://ai.google.dev/gemma) for the base model
+- [colpali-engine](https://github.com/illuin-tech/colpali) for the training framework
+- [ViDoRe](https://huggingface.co/vidore) benchmark for evaluation

adapter_config.json

@@ -0,0 +1,38 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "google/gemma-4-E4B-it",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": "gaussian",
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 32,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": "(.*(language_model)(?!.*visual).*(down_proj|gate_proj|up_proj|k_proj|q_proj|v_proj|o_proj).*$)",
+  "target_parameters": null,
+  "task_type": "FEATURE_EXTRACTION",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e55807ec55cd0426202b867b39d26cc4bf95f0c54cffda93beee2297d8cdb9d7
+size 293689248

colgemma4/__init__.py

@@ -0,0 +1,2 @@
+from .modeling_colgemma4 import ColGemma4
+from .processing_colgemma4 import ColGemma4Processor

colgemma4/modeling_colgemma4.py

@@ -0,0 +1,90 @@
+from typing import ClassVar
+
+import torch
+from torch import nn
+from transformers.models.gemma4 import Gemma4Config, Gemma4ForConditionalGeneration
+
+
+class ColGemma4(Gemma4ForConditionalGeneration):
+    """
+    ColGemma4 model for late interaction retrieval, following the ColPali architecture.
+
+    Extends Gemma4ForConditionalGeneration (not Gemma4Model) to avoid checkpoint
+    key mapping issues. The ForConditionalGeneration class has base_model_prefix="model"
+    which automatically strips the "model." prefix from checkpoint keys.
+
+    Adds a custom_text_proj linear projection for 128-dim ColBERT embeddings.
+    The inner model is accessed via self.model (Gemma4Model) which contains
+    self.model.language_model (Gemma4TextModel) and self.model.vision_tower.
+
+    Args:
+        config (Gemma4Config): The model configuration.
+        mask_non_image_embeddings (bool): Whether to zero out non-image token embeddings
+            at inference. Defaults to False.
+    """
+
+    main_input_name: ClassVar[str] = "doc_input_ids"
+
+    _checkpoint_conversion_mapping = {
+        r"^base_model\.model\.custom_text_proj": "custom_text_proj",
+    }
+
+    def __init__(self, config: Gemma4Config, mask_non_image_embeddings: bool = False):
+        super().__init__(config=config)
+
+        hidden_size = getattr(self.config, "hidden_size", None)
+        if hidden_size is None and hasattr(self.config, "text_config"):
+            hidden_size = getattr(self.config.text_config, "hidden_size", None)
+        if hidden_size is None:
+            raise ValueError(f"Unable to determine text hidden size for {type(self.config).__name__}.")
+
+        self.dim = getattr(config, "dim", 128)
+        self.custom_text_proj = nn.Linear(hidden_size, self.dim)
+        self.padding_side = "left"
+        self.mask_non_image_embeddings = mask_non_image_embeddings
+        self.post_init()
+
+    @classmethod
+    def from_pretrained(cls, *args, **kwargs):
+        key_mapping = kwargs.pop("key_mapping", None)
+        if key_mapping is None:
+            key_mapping = dict(getattr(super(), "_checkpoint_conversion_mapping", {}))
+            key_mapping.update(cls._checkpoint_conversion_mapping)
+        return super().from_pretrained(*args, **kwargs, key_mapping=key_mapping)
+
+    @property
+    def device(self):
+        return next(self.parameters()).device
+
+    @property
+    def dtype(self):
+        return next(self.parameters()).dtype
+
+    def forward(self, *args, **kwargs) -> torch.Tensor:
+        kwargs.pop("return_dict", True)
+        kwargs.pop("output_hidden_states", None)
+        kwargs.pop("use_cache", None)
+
+        # Use the inner Gemma4Model forward (self.model), not the full
+        # ForConditionalGeneration forward which also computes lm_head logits
+        last_hidden_states = (
+            self.model
+            .forward(*args, **kwargs, use_cache=False, output_hidden_states=True, return_dict=True)
+            .last_hidden_state
+        )  # (batch_size, sequence_length, hidden_size)
+
+        proj = self.custom_text_proj(last_hidden_states)  # (batch_size, sequence_length, dim)
+
+        # L2 normalize — clamp norm to avoid NaN from padding tokens (0/0)
+        proj = proj / proj.norm(dim=-1, keepdim=True).clamp(min=1e-6)
+        proj = proj * kwargs["attention_mask"].unsqueeze(-1)
+
+        if "pixel_values" in kwargs and self.mask_non_image_embeddings:
+            image_mask = (kwargs["input_ids"] == self.config.image_token_id).unsqueeze(-1)
+            proj = proj * image_mask
+
+        return proj
+
+    @property
+    def patch_size(self) -> int:
+        return self.model.vision_tower.config.patch_size

colgemma4/processing_colgemma4.py

@@ -0,0 +1,177 @@
+from typing import ClassVar, List, Optional, Tuple, Union
+
+import torch
+from PIL import Image
+from transformers import BatchEncoding, BatchFeature
+from transformers.models.gemma4 import Gemma4Processor
+
+from colpali_engine.utils.processing_utils import BaseVisualRetrieverProcessor
+
+
+class ColGemma4Processor(BaseVisualRetrieverProcessor, Gemma4Processor):
+    """
+    Processor for ColGemma4 model.
+
+    Handles image and text preprocessing with Gemma 4's chat template.
+    Follows the ColGemma3 per-image processing pattern adapted for Gemma 4's
+    multimodal processor (which includes audio and video sub-processors).
+
+    Args:
+        feature_extractor: Audio feature extractor (Gemma4 multimodal).
+        image_processor: Image processor.
+        tokenizer: Tokenizer.
+        video_processor: Video processor (Gemma4 multimodal).
+        chat_template: Chat template override.
+        **kwargs: Additional keyword arguments for Gemma4Processor.
+    """
+
+    query_augmentation_token: ClassVar[str] = "<eos>"
+
+    def __init__(
+        self,
+        feature_extractor=None,
+        image_processor=None,
+        tokenizer=None,
+        video_processor=None,
+        chat_template=None,
+        **kwargs,
+    ):
+        super().__init__(
+            feature_extractor=feature_extractor,
+            image_processor=image_processor,
+            tokenizer=tokenizer,
+            video_processor=video_processor,
+            chat_template=chat_template,
+            **kwargs,
+        )
+        self.tokenizer.padding_side = "left"
+
+    @classmethod
+    def from_pretrained(cls, *args, device_map: Optional[str] = None, **kwargs):
+        max_num_visual_tokens = kwargs.pop("max_num_visual_tokens", None)
+        instance = super().from_pretrained(*args, device_map=device_map, **kwargs)
+
+        if max_num_visual_tokens is not None:
+            # Gemma4ImageProcessor uses `max_soft_tokens` (not `max_num_visual_tokens`)
+            # Valid values: 70, 140, 280, 560, 1120
+            # Controls resize budget: max_patches = max_soft_tokens * pooling_kernel_size^2
+            instance.image_processor.max_soft_tokens = max_num_visual_tokens
+            # Also update processor-level placeholder expansion
+            instance.image_seq_length = max_num_visual_tokens
+
+        return instance
+
+    def process_images(self, images: List[Image.Image]) -> Union[BatchFeature, BatchEncoding]:
+        """
+        Process images for ColGemma4.
+
+        Each image is formatted using Gemma 4's chat template with a descriptive prompt
+        to produce rich contextual embeddings.
+        """
+        images = [image.convert("RGB") for image in images]
+
+        batch_docs = []
+        for image in images:
+            message = [
+                {
+                    "role": "user",
+                    "content": [
+                        {"type": "image", "image": image},
+                        {"type": "text", "text": "Describe this image"},
+                    ],
+                }
+            ]
+            formatted_text = self.tokenizer.apply_chat_template(
+                message, tokenize=False, add_generation_prompt=False
+            )
+            batch_doc = self(
+                text=[formatted_text],
+                images=[image],
+                padding="longest",
+                return_tensors="pt",
+            )
+            batch_docs.append(batch_doc)
+
+        if len(batch_docs) == 1:
+            return batch_docs[0]
+
+        # Gemma 4 produces variable token counts per image (aspect ratio dependent).
+        # Pad all tensors to the max sequence length in the batch before concatenating.
+        concatenated = {}
+        for key in batch_docs[0].keys():
+            tensors = [doc[key] for doc in batch_docs]
+            if isinstance(tensors[0], torch.Tensor):
+                if tensors[0].ndim >= 2:
+                    # Pad along sequence dimension (dim 1) to max length
+                    max_len = max(t.shape[1] for t in tensors)
+                    padded = []
+                    for t in tensors:
+                        pad_len = max_len - t.shape[1]
+                        if pad_len > 0:
+                            # Pad with 0 (works for input_ids, attention_mask, pixel_values)
+                            padding = torch.zeros(
+                                *t.shape[:1], pad_len, *t.shape[2:],
+                                dtype=t.dtype, device=t.device,
+                            )
+                            t = torch.cat([padding, t], dim=1)  # Left-pad (decoder model)
+                        padded.append(t)
+                    concatenated[key] = torch.cat(padded, dim=0)
+                else:
+                    concatenated[key] = torch.cat(tensors, dim=0)
+            else:
+                concatenated[key] = tensors[0]
+        return BatchFeature(concatenated)
+
+    def process_queries(self, queries: List[str] = None, texts: List[str] = None, **kwargs) -> Union[BatchFeature, BatchEncoding]:
+        """Process queries (required by BaseVisualRetrieverProcessor)."""
+        return self.process_texts(queries or texts)
+
+    def process_texts(self, texts: List[str]) -> Union[BatchFeature, BatchEncoding]:
+        """
+        Process text queries for ColGemma4 using Gemma 4's chat template.
+        """
+        formatted_texts = []
+        for text in texts:
+            message = [
+                {
+                    "role": "user",
+                    "content": [{"type": "text", "text": f"Query: {text}"}],
+                }
+            ]
+            formatted_text = self.tokenizer.apply_chat_template(
+                message, tokenize=False, add_generation_prompt=False
+            )
+            formatted_texts.append(formatted_text)
+
+        return self(
+            text=formatted_texts,
+            return_tensors="pt",
+            padding="longest",
+        )
+
+    def score(
+        self,
+        qs: List[torch.Tensor],
+        ps: List[torch.Tensor],
+        device: Optional[Union[str, torch.device]] = None,
+        **kwargs,
+    ) -> torch.Tensor:
+        return self.score_multi_vector(qs, ps, device=device, **kwargs)
+
+    def get_n_patches(
+        self,
+        image_size: Tuple[int, int],
+        patch_size: int,
+    ) -> Tuple[int, int]:
+        if hasattr(self.image_processor, "size"):
+            if isinstance(self.image_processor.size, dict):
+                width = self.image_processor.size.get("width", image_size[0])
+                height = self.image_processor.size.get("height", image_size[1])
+            else:
+                width = height = self.image_processor.size
+            return width // patch_size, height // patch_size
+
+        return image_size[0] // patch_size, image_size[1] // patch_size
+
+    def get_image_mask(self, batch_images: BatchFeature) -> torch.Tensor:
+        return batch_images.input_ids == self.image_token_id

hydra_gemma4.py

@@ -0,0 +1,392 @@
+"""HydraGemma4: one model, many heads.
+
+    model = HydraGemma4.from_pretrained(
+        base_model="google/gemma-4-E2B-it",
+        adapter_path="./colgemma4_adapter",
+    )
+
+    # Retrieval -- LoRA ON, bidirectional attention
+    embeddings = model.embed(images)           # [B, N, 128]
+
+    # Generation -- LoRA OFF, causal attention
+    text = model.generate(image, "Describe this document.")
+
+One ColGemma4 + LoRA + lm_head. Attention mode and LoRA toggled per call.
+
+Gemma 4 E2B layer structure:
+    35 layers total: 28 sliding_attention + 7 full_attention
+    full_attention at indices: [4, 9, 14, 19, 24, 29, 34]
+    Only full_attention layers are patched for bidirectional mode.
+    Sliding layers stay causal always.
+
+Key Gemma 4 differences from Qwen3.5:
+    - Layer forward signature includes `per_layer_input` (Per-Layer Embeddings)
+    - Layer type via config.text_config.layer_types list (not layer.layer_type attribute)
+    - Vision tower at self.vision_tower (not self.visual)
+    - final_logit_softcapping for logit capping
+    - image_position_ids (not image_grid_thw)
+"""
+
+import re
+from typing import List, Union
+
+import torch
+import torch.nn as nn
+from PIL import Image
+from peft import PeftModel
+from transformers import AutoProcessor, Gemma4ForConditionalGeneration
+from transformers.models.gemma4.modeling_gemma4 import Gemma4Model as _Gemma4Base
+
+from colgemma4 import ColGemma4, ColGemma4Processor
+
+
+class HydraGemma4:
+    """One ColGemma4 model with LoRA + lm_head. Two faces via toggling.
+
+    Retrieval face:  LoRA ON,  bidirectional attention -> custom_text_proj -> 128-dim
+    Generation face: LoRA OFF, causal attention -> lm_head -> autoregressive text
+    """
+
+    def __init__(self, model, lm_head, emb_processor, gen_processor, attn_fns, config):
+        self.model = model
+        self.lm_head = lm_head
+        self.emb_processor = emb_processor
+        self.gen_processor = gen_processor
+        self._attn_fns = attn_fns  # {layer_idx: (causal_fn, bidir_fn)}
+        self._config = config
+        self._base = self._unwrap(model)
+
+    @staticmethod
+    def _unwrap(model):
+        m = model
+        if hasattr(m, "module"):
+            m = m.module
+        if hasattr(m, "base_model"):
+            m = m.base_model
+        if hasattr(m, "model"):
+            m = m.model
+        return m
+
+    def _set_bidirectional(self):
+        for idx, (_, bidir_fn) in self._attn_fns.items():
+            self._base.language_model.layers[idx].forward = bidir_fn
+
+    def _set_causal(self):
+        for idx, (causal_fn, _) in self._attn_fns.items():
+            self._base.language_model.layers[idx].forward = causal_fn
+
+    @classmethod
+    def from_pretrained(
+        cls,
+        base_model: str = "google/gemma-4-E2B-it",
+        adapter_path: str = "/tmp/colgemma4_adapter",
+        torch_dtype=torch.bfloat16,
+        max_visual_tokens: int = 560,
+        device: str = "cuda",
+    ):
+        """Load single model from base + adapter + lm_head."""
+        from pathlib import Path
+
+        print(f"Loading ColGemma4 from {base_model}...", flush=True)
+        config = Gemma4ForConditionalGeneration.config_class.from_pretrained(
+            base_model, trust_remote_code=True
+        )
+        config.text_config.use_cache = False
+
+        model = ColGemma4.from_pretrained(
+            base_model,
+            config=config,
+            torch_dtype=torch_dtype,
+            attn_implementation="sdpa",
+            ignore_mismatched_sizes=True,
+        )
+
+        # Store causal/bidirectional forwards for full-attention layers
+        layer_types = config.text_config.layer_types
+        attn_fns = {}
+        for idx, layer in enumerate(model.language_model.layers):
+            if layer_types[idx] == "full_attention":
+                causal_fn = layer.forward
+
+                def make_bidir(orig):
+                    def bidir(
+                        hidden_states,
+                        per_layer_input=None,
+                        position_embeddings=None,
+                        attention_mask=None,
+                        **kw,
+                    ):
+                        if (
+                            attention_mask is not None
+                            and attention_mask.ndim == 4
+                            and attention_mask.dtype.is_floating_point
+                        ):
+                            min_dtype = torch.finfo(attention_mask.dtype).min
+                            diag = torch.diagonal(attention_mask, dim1=-2, dim2=-1)
+                            is_valid = diag > (min_dtype / 2)
+                            bidir_mask = torch.where(
+                                is_valid.unsqueeze(-1) & is_valid.unsqueeze(-2),
+                                attention_mask.new_zeros(1),
+                                attention_mask.new_full((1,), min_dtype),
+                            )
+                            attention_mask = bidir_mask
+                        return orig(
+                            hidden_states,
+                            per_layer_input=per_layer_input,
+                            position_embeddings=position_embeddings,
+                            attention_mask=attention_mask,
+                            **kw,
+                        )
+
+                    return bidir
+
+                bidir_fn = make_bidir(causal_fn)
+                attn_fns[idx] = (causal_fn, bidir_fn)
+                layer.forward = bidir_fn
+
+        print(f"Patched {len(attn_fns)} full-attention layers", flush=True)
+
+        print(f"Loading LoRA adapter from {adapter_path}...", flush=True)
+        model = PeftModel.from_pretrained(model, adapter_path)
+        model = model.to(device).eval()
+
+        # Load lm_head
+        print("Loading lm_head...", flush=True)
+        lm_head_path = Path(adapter_path) / "lm_head.pt"
+        if lm_head_path.exists():
+            base_cfg = Gemma4ForConditionalGeneration.config_class.from_pretrained(base_model)
+            lm_head = nn.Linear(
+                base_cfg.text_config.hidden_size,
+                base_cfg.text_config.vocab_size,
+                bias=False,
+            )
+            lm_head.load_state_dict(torch.load(lm_head_path, map_location="cpu"))
+        else:
+            base = Gemma4ForConditionalGeneration.from_pretrained(
+                base_model, torch_dtype=torch_dtype
+            )
+            lm_head = base.lm_head
+            del base
+            torch.cuda.empty_cache()
+
+        lm_head = lm_head.to(device).to(torch_dtype)
+
+        emb_processor = ColGemma4Processor.from_pretrained(
+            base_model, max_num_visual_tokens=max_visual_tokens
+        )
+        gen_processor = AutoProcessor.from_pretrained(base_model, trust_remote_code=True)
+
+        params = sum(p.numel() for p in model.parameters()) / 1e6
+        lm_params = sum(p.numel() for p in lm_head.parameters()) / 1e6
+        print(
+            f"Ready. Single model: {params:.0f}M + lm_head: {lm_params:.0f}M",
+            flush=True,
+        )
+
+        return cls(model, lm_head, emb_processor, gen_processor, attn_fns, config)
+
+    def embed(self, images: Union[Image.Image, List[Image.Image]]) -> torch.Tensor:
+        """Embed images for retrieval. LoRA ON, bidirectional attention."""
+        if isinstance(images, Image.Image):
+            images = [images]
+        self.model.enable_adapter_layers()
+        self._set_bidirectional()
+        inputs = self.emb_processor.process_images(images)
+        device = next(self.model.parameters()).device
+        inputs = {k: v.to(device) for k, v in inputs.items()}
+        with torch.no_grad(), torch.amp.autocast("cuda", dtype=torch.bfloat16):
+            return self.model(**inputs)
+
+    def embed_queries(self, queries: Union[str, List[str]]) -> torch.Tensor:
+        """Embed queries for retrieval. LoRA ON, bidirectional attention."""
+        if isinstance(queries, str):
+            queries = [queries]
+        self.model.enable_adapter_layers()
+        self._set_bidirectional()
+        inputs = self.emb_processor.process_queries(queries)
+        device = next(self.model.parameters()).device
+        inputs = {k: v.to(device) for k, v in inputs.items()}
+        with torch.no_grad(), torch.amp.autocast("cuda", dtype=torch.bfloat16):
+            return self.model(**inputs)
+
+    @torch.no_grad()
+    def generate(
+        self,
+        image: Image.Image,
+        prompt: str,
+        max_new_tokens: int = 4096,
+        system_prompt: str = None,
+        temperature: float = 1.0,
+        top_p: float = 0.95,
+        top_k: int = 64,
+    ) -> str:
+        """Generate text given image + prompt. LoRA OFF, causal attention."""
+        self.model.disable_adapter_layers()
+        self._set_causal()
+        try:
+            return self._generate_with_kv_cache(
+                image, prompt, max_new_tokens, system_prompt,
+                temperature=temperature, top_p=top_p, top_k=top_k,
+            )
+        except Exception:
+            return self._generate_no_cache(
+                image, prompt, max_new_tokens, system_prompt,
+                temperature=temperature, top_p=top_p, top_k=top_k,
+            )
+        finally:
+            self.model.enable_adapter_layers()
+            self._set_bidirectional()
+
+    def _prepare_inputs(self, image, prompt, system_prompt=None):
+        msgs = []
+        if system_prompt:
+            msgs.append({"role": "system", "content": system_prompt})
+        msgs.append({
+            "role": "user",
+            "content": [
+                {"type": "image", "image": image},
+                {"type": "text", "text": prompt},
+            ],
+        })
+        txt = self.gen_processor.apply_chat_template(
+            msgs, tokenize=False, add_generation_prompt=True,
+        )
+        inp = self.gen_processor(
+            text=[txt], images=[image], return_tensors="pt", padding=True
+        )
+        device = next(self.model.parameters()).device
+        return {k: v.to(device) for k, v in inp.items()}
+
+    def _decode(self, generated):
+        if not generated:
+            return ""
+        gen_ids = torch.cat(generated, dim=1)
+        return self.gen_processor.tokenizer.decode(gen_ids[0], skip_special_tokens=True).strip()
+
+    def _is_eos(self, token_id):
+        eos = self.gen_processor.tokenizer.eos_token_id
+        if isinstance(eos, list):
+            return token_id in eos
+        return token_id == eos
+
+    @staticmethod
+    def _sample_token(logits, temperature, top_p, top_k):
+        if temperature <= 0:
+            return logits.argmax(dim=-1)
+        logits_1d = logits[0, 0] / temperature
+        if top_k > 0:
+            topk_vals, _ = torch.topk(logits_1d, min(top_k, logits_1d.size(-1)))
+            logits_1d[logits_1d < topk_vals[-1]] = float("-inf")
+        probs = torch.softmax(logits_1d, dim=-1)
+        if 0 < top_p < 1.0:
+            sorted_probs, sorted_idx = torch.sort(probs, descending=True)
+            cumsum = torch.cumsum(sorted_probs, dim=-1)
+            mask = cumsum - sorted_probs > top_p
+            sorted_probs[mask] = 0
+            probs = torch.zeros_like(probs).scatter_(0, sorted_idx, sorted_probs)
+        probs = probs / probs.sum()
+        token_id = torch.multinomial(probs, num_samples=1)
+        return token_id.reshape(1, 1)
+
+    def _generate_with_kv_cache(
+        self, image, prompt, max_new_tokens, system_prompt=None,
+        temperature=1.0, top_p=0.95, top_k=64,
+    ):
+        """KV-cache generation. Pixel values only on first step."""
+        inp = self._prepare_inputs(image, prompt, system_prompt)
+        input_ids = inp["input_ids"]
+        attn_mask = inp["attention_mask"]
+        mm_ids = inp.get("mm_token_type_ids")
+        past_key_values = None
+        generated = []
+
+        final_softcap = self._config.text_config.final_logit_softcapping
+
+        for step in range(max_new_tokens):
+            if step == 0:
+                kw = {
+                    "input_ids": input_ids,
+                    "attention_mask": attn_mask,
+                    "pixel_values": inp.get("pixel_values"),
+                    "image_position_ids": inp.get("image_position_ids"),
+                    "use_cache": True,
+                    "output_hidden_states": True,
+                    "return_dict": True,
+                }
+                if mm_ids is not None:
+                    kw["mm_token_type_ids"] = mm_ids
+            else:
+                kw = {
+                    "input_ids": next_token,
+                    "attention_mask": attn_mask,
+                    "past_key_values": past_key_values,
+                    "use_cache": True,
+                    "output_hidden_states": True,
+                    "return_dict": True,
+                }
+
+            outputs = _Gemma4Base.forward(self._base, **kw)
+            past_key_values = outputs.past_key_values
+            logits = self.lm_head(outputs.last_hidden_state[:, -1:, :])
+
+            if final_softcap is not None:
+                logits = logits / final_softcap
+                logits = torch.tanh(logits)
+                logits = logits * final_softcap
+
+            next_token = self._sample_token(logits, temperature, top_p, top_k)
+            generated.append(next_token)
+
+            if self._is_eos(next_token.item()):
+                break
+
+            attn_mask = torch.cat([attn_mask, torch.ones_like(next_token)], dim=1)
+
+        return self._decode(generated)
+
+    def _generate_no_cache(
+        self, image, prompt, max_new_tokens, system_prompt=None,
+        temperature=1.0, top_p=0.95, top_k=64,
+    ):
+        """No-cache fallback. Passes all inputs every step."""
+        inp = self._prepare_inputs(image, prompt, system_prompt)
+        input_ids = inp["input_ids"]
+        attn_mask = inp["attention_mask"]
+        mm_ids = inp.get("mm_token_type_ids")
+        generated = []
+
+        final_softcap = self._config.text_config.final_logit_softcapping
+
+        for step in range(max_new_tokens):
+            kw = {
+                "input_ids": input_ids,
+                "attention_mask": attn_mask,
+                "pixel_values": inp.get("pixel_values"),
+                "image_position_ids": inp.get("image_position_ids"),
+            }
+            if mm_ids is not None:
+                kw["mm_token_type_ids"] = mm_ids
+
+            hidden = _Gemma4Base.forward(
+                self._base, **kw,
+                use_cache=False, output_hidden_states=True, return_dict=True,
+            ).last_hidden_state
+
+            logits = self.lm_head(hidden[:, -1:, :])
+            if final_softcap is not None:
+                logits = logits / final_softcap
+                logits = torch.tanh(logits)
+                logits = logits * final_softcap
+
+            next_token = self._sample_token(logits, temperature, top_p, top_k)
+            generated.append(next_token)
+
+            if self._is_eos(next_token.item()):
+                break
+
+            input_ids = torch.cat([input_ids, next_token], dim=1)
+            attn_mask = torch.cat([attn_mask, torch.ones_like(next_token)], dim=1)
+            if mm_ids is not None:
+                mm_ids = torch.cat([mm_ids, torch.zeros_like(next_token)], dim=1)
+
+        return self._decode(generated)

lm_head.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bbf896e1c868de076407d03ecb2cab08d5b6bfd82b69dcb95df02fbb9af4e195
+size 1342178921

processor_config.json

@@ -0,0 +1,72 @@
+{
+  "feature_extractor": {
+    "dither": 0.0,
+    "feature_extractor_type": "Gemma4AudioFeatureExtractor",
+    "feature_size": 128,
+    "fft_length": 512,
+    "fft_overdrive": false,
+    "frame_length": 320,
+    "hop_length": 160,
+    "input_scale_factor": 1.0,
+    "max_frequency": 8000.0,
+    "mel_floor": 0.001,
+    "min_frequency": 0.0,
+    "padding_side": "right",
+    "padding_value": 0.0,
+    "per_bin_mean": null,
+    "per_bin_stddev": null,
+    "preemphasis": 0.0,
+    "preemphasis_htk_flavor": true,
+    "return_attention_mask": true,
+    "sampling_rate": 16000
+  },
+  "image_processor": {
+    "do_convert_rgb": true,
+    "do_normalize": false,
+    "do_rescale": true,
+    "do_resize": true,
+    "image_mean": [
+      0.0,
+      0.0,
+      0.0
+    ],
+    "image_processor_type": "Gemma4ImageProcessor",
+    "image_seq_length": 280,
+    "image_std": [
+      1.0,
+      1.0,
+      1.0
+    ],
+    "max_soft_tokens": 1120,
+    "patch_size": 16,
+    "pooling_kernel_size": 3,
+    "resample": 3,
+    "rescale_factor": 0.00392156862745098
+  },
+  "processor_class": "ColGemma4Processor",
+  "video_processor": {
+    "do_convert_rgb": true,
+    "do_normalize": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "do_sample_frames": true,
+    "image_mean": [
+      0.0,
+      0.0,
+      0.0
+    ],
+    "image_std": [
+      1.0,
+      1.0,
+      1.0
+    ],
+    "max_soft_tokens": 70,
+    "num_frames": 32,
+    "patch_size": 16,
+    "pooling_kernel_size": 3,
+    "resample": 3,
+    "rescale_factor": 0.00392156862745098,
+    "return_metadata": false,
+    "video_processor_type": "Gemma4VideoProcessor"
+  }
+}

results/v1/VidoreArxivQARetrieval.json

@@ -0,0 +1,167 @@
+{
+  "dataset_revision": "179762404662be6bf48c30b4fb2b2ef8c6891290",
+  "task_name": "VidoreArxivQARetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.764,
+        "ndcg_at_3": 0.83626,
+        "ndcg_at_5": 0.8453,
+        "ndcg_at_10": 0.85569,
+        "ndcg_at_20": 0.85827,
+        "ndcg_at_100": 0.86625,
+        "ndcg_at_1000": 0.86735,
+        "map_at_1": 0.764,
+        "map_at_3": 0.819,
+        "map_at_5": 0.824,
+        "map_at_10": 0.82832,
+        "map_at_20": 0.82905,
+        "map_at_100": 0.83021,
+        "map_at_1000": 0.83026,
+        "recall_at_1": 0.764,
+        "recall_at_3": 0.886,
+        "recall_at_5": 0.908,
+        "recall_at_10": 0.94,
+        "recall_at_20": 0.95,
+        "recall_at_100": 0.992,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.764,
+        "precision_at_1": 0.764,
+        "precision_at_3": 0.29533,
+        "precision_at_5": 0.1816,
+        "precision_at_10": 0.094,
+        "precision_at_20": 0.0475,
+        "precision_at_100": 0.00992,
+        "precision_at_1000": 0.001,
+        "mrr_at_1": 0.764,
+        "mrr_at_3": 0.819,
+        "mrr_at_5": 0.824,
+        "mrr_at_10": 0.828315,
+        "mrr_at_20": 0.829045,
+        "mrr_at_100": 0.830207,
+        "mrr_at_1000": 0.830261,
+        "nauc_ndcg_at_1_max": 0.627702,
+        "nauc_ndcg_at_1_std": 0.217539,
+        "nauc_ndcg_at_1_diff1": 0.929602,
+        "nauc_ndcg_at_3_max": 0.624786,
+        "nauc_ndcg_at_3_std": 0.227246,
+        "nauc_ndcg_at_3_diff1": 0.904056,
+        "nauc_ndcg_at_5_max": 0.622479,
+        "nauc_ndcg_at_5_std": 0.214633,
+        "nauc_ndcg_at_5_diff1": 0.900392,
+        "nauc_ndcg_at_10_max": 0.622333,
+        "nauc_ndcg_at_10_std": 0.22971,
+        "nauc_ndcg_at_10_diff1": 0.901341,
+        "nauc_ndcg_at_20_max": 0.621893,
+        "nauc_ndcg_at_20_std": 0.227944,
+        "nauc_ndcg_at_20_diff1": 0.901644,
+        "nauc_ndcg_at_100_max": 0.625326,
+        "nauc_ndcg_at_100_std": 0.2248,
+        "nauc_ndcg_at_100_diff1": 0.906672,
+        "nauc_ndcg_at_1000_max": 0.622286,
+        "nauc_ndcg_at_1000_std": 0.224665,
+        "nauc_ndcg_at_1000_diff1": 0.907044,
+        "nauc_map_at_1_max": 0.627702,
+        "nauc_map_at_1_std": 0.217539,
+        "nauc_map_at_1_diff1": 0.929602,
+        "nauc_map_at_3_max": 0.623123,
+        "nauc_map_at_3_std": 0.224196,
+        "nauc_map_at_3_diff1": 0.910356,
+        "nauc_map_at_5_max": 0.621533,
+        "nauc_map_at_5_std": 0.217572,
+        "nauc_map_at_5_diff1": 0.908646,
+        "nauc_map_at_10_max": 0.621094,
+        "nauc_map_at_10_std": 0.222727,
+        "nauc_map_at_10_diff1": 0.90918,
+        "nauc_map_at_20_max": 0.621091,
+        "nauc_map_at_20_std": 0.222358,
+        "nauc_map_at_20_diff1": 0.909314,
+        "nauc_map_at_100_max": 0.621499,
+        "nauc_map_at_100_std": 0.222171,
+        "nauc_map_at_100_diff1": 0.91004,
+        "nauc_map_at_1000_max": 0.621381,
+        "nauc_map_at_1000_std": 0.222218,
+        "nauc_map_at_1000_diff1": 0.910056,
+        "nauc_recall_at_1_max": 0.627702,
+        "nauc_recall_at_1_std": 0.217539,
+        "nauc_recall_at_1_diff1": 0.929602,
+        "nauc_recall_at_3_max": 0.633543,
+        "nauc_recall_at_3_std": 0.240456,
+        "nauc_recall_at_3_diff1": 0.877803,
+        "nauc_recall_at_5_max": 0.629592,
+        "nauc_recall_at_5_std": 0.197317,
+        "nauc_recall_at_5_diff1": 0.858574,
+        "nauc_recall_at_10_max": 0.637333,
+        "nauc_recall_at_10_std": 0.295456,
+        "nauc_recall_at_10_diff1": 0.843215,
+        "nauc_recall_at_20_max": 0.633221,
+        "nauc_recall_at_20_std": 0.28831,
+        "nauc_recall_at_20_diff1": 0.83408,
+        "nauc_recall_at_100_max": 0.96732,
+        "nauc_recall_at_100_std": 0.283613,
+        "nauc_recall_at_100_diff1": 0.865196,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.627702,
+        "nauc_precision_at_1_std": 0.217539,
+        "nauc_precision_at_1_diff1": 0.929602,
+        "nauc_precision_at_3_max": 0.633543,
+        "nauc_precision_at_3_std": 0.240456,
+        "nauc_precision_at_3_diff1": 0.877803,
+        "nauc_precision_at_5_max": 0.629592,
+        "nauc_precision_at_5_std": 0.197317,
+        "nauc_precision_at_5_diff1": 0.858574,
+        "nauc_precision_at_10_max": 0.637333,
+        "nauc_precision_at_10_std": 0.295456,
+        "nauc_precision_at_10_diff1": 0.843215,
+        "nauc_precision_at_20_max": 0.633221,
+        "nauc_precision_at_20_std": 0.28831,
+        "nauc_precision_at_20_diff1": 0.83408,
+        "nauc_precision_at_100_max": 0.96732,
+        "nauc_precision_at_100_std": 0.283613,
+        "nauc_precision_at_100_diff1": 0.865196,
+        "nauc_precision_at_1000_max": 1.0,
+        "nauc_precision_at_1000_std": 1.0,
+        "nauc_precision_at_1000_diff1": 1.0,
+        "nauc_mrr_at_1_max": 0.627702,
+        "nauc_mrr_at_1_std": 0.217539,
+        "nauc_mrr_at_1_diff1": 0.929602,
+        "nauc_mrr_at_3_max": 0.623123,
+        "nauc_mrr_at_3_std": 0.224196,
+        "nauc_mrr_at_3_diff1": 0.910356,
+        "nauc_mrr_at_5_max": 0.621533,
+        "nauc_mrr_at_5_std": 0.217572,
+        "nauc_mrr_at_5_diff1": 0.908646,
+        "nauc_mrr_at_10_max": 0.621094,
+        "nauc_mrr_at_10_std": 0.222727,
+        "nauc_mrr_at_10_diff1": 0.90918,
+        "nauc_mrr_at_20_max": 0.621091,
+        "nauc_mrr_at_20_std": 0.222358,
+        "nauc_mrr_at_20_diff1": 0.909314,
+        "nauc_mrr_at_100_max": 0.621499,
+        "nauc_mrr_at_100_std": 0.222171,
+        "nauc_mrr_at_100_diff1": 0.91004,
+        "nauc_mrr_at_1000_max": 0.621381,
+        "nauc_mrr_at_1000_std": 0.222218,
+        "nauc_mrr_at_1000_diff1": 0.910056,
+        "hit_rate_at_1": 0.764,
+        "hit_rate_at_3": 0.886,
+        "hit_rate_at_5": 0.908,
+        "hit_rate_at_10": 0.94,
+        "hit_rate_at_20": 0.95,
+        "hit_rate_at_100": 0.992,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.8453,
+        "hf_subset": "default",
+        "languages": [
+          "eng-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 85.62780809402466,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v1/VidoreDocVQARetrieval.json

@@ -0,0 +1,167 @@
+{
+  "dataset_revision": "e78cd130055fcb8d69bb0ff4115c4712a157f3d3",
+  "task_name": "VidoreDocVQARetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.49224,
+        "ndcg_at_3": 0.55384,
+        "ndcg_at_5": 0.577,
+        "ndcg_at_10": 0.59867,
+        "ndcg_at_20": 0.617,
+        "ndcg_at_100": 0.64177,
+        "ndcg_at_1000": 0.65339,
+        "map_at_1": 0.48429,
+        "map_at_3": 0.53587,
+        "map_at_5": 0.5495,
+        "map_at_10": 0.55882,
+        "map_at_20": 0.56417,
+        "map_at_100": 0.56748,
+        "map_at_1000": 0.56807,
+        "recall_at_1": 0.48429,
+        "recall_at_3": 0.59346,
+        "recall_at_5": 0.64961,
+        "recall_at_10": 0.71613,
+        "recall_at_20": 0.78668,
+        "recall_at_100": 0.91896,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.48429,
+        "precision_at_1": 0.49224,
+        "precision_at_3": 0.20251,
+        "precision_at_5": 0.13392,
+        "precision_at_10": 0.07384,
+        "precision_at_20": 0.04113,
+        "precision_at_100": 0.00987,
+        "precision_at_1000": 0.00111,
+        "mrr_at_1": 0.492239,
+        "mrr_at_3": 0.545455,
+        "mrr_at_5": 0.558315,
+        "mrr_at_10": 0.567577,
+        "mrr_at_20": 0.572231,
+        "mrr_at_100": 0.575263,
+        "mrr_at_1000": 0.57568,
+        "nauc_ndcg_at_1_max": 0.299344,
+        "nauc_ndcg_at_1_std": 0.218602,
+        "nauc_ndcg_at_1_diff1": 0.825285,
+        "nauc_ndcg_at_3_max": 0.314357,
+        "nauc_ndcg_at_3_std": 0.216807,
+        "nauc_ndcg_at_3_diff1": 0.790219,
+        "nauc_ndcg_at_5_max": 0.282184,
+        "nauc_ndcg_at_5_std": 0.195112,
+        "nauc_ndcg_at_5_diff1": 0.773198,
+        "nauc_ndcg_at_10_max": 0.271133,
+        "nauc_ndcg_at_10_std": 0.189741,
+        "nauc_ndcg_at_10_diff1": 0.763124,
+        "nauc_ndcg_at_20_max": 0.270933,
+        "nauc_ndcg_at_20_std": 0.194798,
+        "nauc_ndcg_at_20_diff1": 0.757091,
+        "nauc_ndcg_at_100_max": 0.269412,
+        "nauc_ndcg_at_100_std": 0.21198,
+        "nauc_ndcg_at_100_diff1": 0.764947,
+        "nauc_ndcg_at_1000_max": 0.277087,
+        "nauc_ndcg_at_1000_std": 0.201334,
+        "nauc_ndcg_at_1000_diff1": 0.772432,
+        "nauc_map_at_1_max": 0.316632,
+        "nauc_map_at_1_std": 0.227491,
+        "nauc_map_at_1_diff1": 0.834161,
+        "nauc_map_at_3_max": 0.320194,
+        "nauc_map_at_3_std": 0.222933,
+        "nauc_map_at_3_diff1": 0.802233,
+        "nauc_map_at_5_max": 0.301094,
+        "nauc_map_at_5_std": 0.209794,
+        "nauc_map_at_5_diff1": 0.79217,
+        "nauc_map_at_10_max": 0.296271,
+        "nauc_map_at_10_std": 0.207183,
+        "nauc_map_at_10_diff1": 0.788214,
+        "nauc_map_at_20_max": 0.295377,
+        "nauc_map_at_20_std": 0.208706,
+        "nauc_map_at_20_diff1": 0.786552,
+        "nauc_map_at_100_max": 0.294902,
+        "nauc_map_at_100_std": 0.210248,
+        "nauc_map_at_100_diff1": 0.787305,
+        "nauc_map_at_1000_max": 0.295179,
+        "nauc_map_at_1000_std": 0.20988,
+        "nauc_map_at_1000_diff1": 0.787645,
+        "nauc_recall_at_1_max": 0.316632,
+        "nauc_recall_at_1_std": 0.227491,
+        "nauc_recall_at_1_diff1": 0.834161,
+        "nauc_recall_at_3_max": 0.323328,
+        "nauc_recall_at_3_std": 0.211966,
+        "nauc_recall_at_3_diff1": 0.7626,
+        "nauc_recall_at_5_max": 0.238009,
+        "nauc_recall_at_5_std": 0.155748,
+        "nauc_recall_at_5_diff1": 0.712018,
+        "nauc_recall_at_10_max": 0.188746,
+        "nauc_recall_at_10_std": 0.130036,
+        "nauc_recall_at_10_diff1": 0.662892,
+        "nauc_recall_at_20_max": 0.179657,
+        "nauc_recall_at_20_std": 0.14551,
+        "nauc_recall_at_20_diff1": 0.612465,
+        "nauc_recall_at_100_max": 0.069547,
+        "nauc_recall_at_100_std": 0.439287,
+        "nauc_recall_at_100_diff1": 0.572091,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.299344,
+        "nauc_precision_at_1_std": 0.218602,
+        "nauc_precision_at_1_diff1": 0.825285,
+        "nauc_precision_at_3_max": 0.286323,
+        "nauc_precision_at_3_std": 0.193546,
+        "nauc_precision_at_3_diff1": 0.738953,
+        "nauc_precision_at_5_max": 0.171478,
+        "nauc_precision_at_5_std": 0.115893,
+        "nauc_precision_at_5_diff1": 0.647342,
+        "nauc_precision_at_10_max": 0.104319,
+        "nauc_precision_at_10_std": 0.076877,
+        "nauc_precision_at_10_diff1": 0.578044,
+        "nauc_precision_at_20_max": 0.017151,
+        "nauc_precision_at_20_std": 0.049014,
+        "nauc_precision_at_20_diff1": 0.410027,
+        "nauc_precision_at_100_max": -0.287368,
+        "nauc_precision_at_100_std": -0.005288,
+        "nauc_precision_at_100_diff1": 0.044196,
+        "nauc_precision_at_1000_max": -0.422927,
+        "nauc_precision_at_1000_std": -0.363894,
+        "nauc_precision_at_1000_diff1": -0.342777,
+        "nauc_mrr_at_1_max": 0.299344,
+        "nauc_mrr_at_1_std": 0.218602,
+        "nauc_mrr_at_1_diff1": 0.825285,
+        "nauc_mrr_at_3_max": 0.29874,
+        "nauc_mrr_at_3_std": 0.212374,
+        "nauc_mrr_at_3_diff1": 0.792532,
+        "nauc_mrr_at_5_max": 0.280754,
+        "nauc_mrr_at_5_std": 0.19961,
+        "nauc_mrr_at_5_diff1": 0.78386,
+        "nauc_mrr_at_10_max": 0.275757,
+        "nauc_mrr_at_10_std": 0.196985,
+        "nauc_mrr_at_10_diff1": 0.779957,
+        "nauc_mrr_at_20_max": 0.276323,
+        "nauc_mrr_at_20_std": 0.198314,
+        "nauc_mrr_at_20_diff1": 0.778935,
+        "nauc_mrr_at_100_max": 0.27649,
+        "nauc_mrr_at_100_std": 0.200202,
+        "nauc_mrr_at_100_diff1": 0.779726,
+        "nauc_mrr_at_1000_max": 0.276986,
+        "nauc_mrr_at_1000_std": 0.200104,
+        "nauc_mrr_at_1000_diff1": 0.780019,
+        "hit_rate_at_1": 0.49224,
+        "hit_rate_at_3": 0.60532,
+        "hit_rate_at_5": 0.66075,
+        "hit_rate_at_10": 0.72727,
+        "hit_rate_at_20": 0.79601,
+        "hit_rate_at_100": 0.92905,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.577,
+        "hf_subset": "default",
+        "languages": [
+          "eng-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 91.09097003936768,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v1/VidoreInfoVQARetrieval.json

@@ -0,0 +1,167 @@
+{
+  "dataset_revision": "74d396242cc281c021eeb38d0ee5f6f30afc1fad",
+  "task_name": "VidoreInfoVQARetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.86235,
+        "ndcg_at_3": 0.90018,
+        "ndcg_at_5": 0.90845,
+        "ndcg_at_10": 0.91121,
+        "ndcg_at_20": 0.91537,
+        "ndcg_at_100": 0.91916,
+        "ndcg_at_1000": 0.92063,
+        "map_at_1": 0.86235,
+        "map_at_3": 0.89103,
+        "map_at_5": 0.89558,
+        "map_at_10": 0.89692,
+        "map_at_20": 0.8981,
+        "map_at_100": 0.8986,
+        "map_at_1000": 0.89868,
+        "recall_at_1": 0.86235,
+        "recall_at_3": 0.92611,
+        "recall_at_5": 0.94636,
+        "recall_at_10": 0.95385,
+        "recall_at_20": 0.97004,
+        "recall_at_100": 0.99008,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.86235,
+        "precision_at_1": 0.86235,
+        "precision_at_3": 0.30904,
+        "precision_at_5": 0.18947,
+        "precision_at_10": 0.09575,
+        "precision_at_20": 0.04868,
+        "precision_at_100": 0.00998,
+        "precision_at_1000": 0.00101,
+        "mrr_at_1": 0.862348,
+        "mrr_at_3": 0.891363,
+        "mrr_at_5": 0.895918,
+        "mrr_at_10": 0.897084,
+        "mrr_at_20": 0.89826,
+        "mrr_at_100": 0.898745,
+        "mrr_at_1000": 0.898801,
+        "nauc_ndcg_at_1_max": 0.597668,
+        "nauc_ndcg_at_1_std": 0.352454,
+        "nauc_ndcg_at_1_diff1": 0.936031,
+        "nauc_ndcg_at_3_max": 0.624956,
+        "nauc_ndcg_at_3_std": 0.396902,
+        "nauc_ndcg_at_3_diff1": 0.926637,
+        "nauc_ndcg_at_5_max": 0.636536,
+        "nauc_ndcg_at_5_std": 0.420589,
+        "nauc_ndcg_at_5_diff1": 0.928962,
+        "nauc_ndcg_at_10_max": 0.631131,
+        "nauc_ndcg_at_10_std": 0.422614,
+        "nauc_ndcg_at_10_diff1": 0.928806,
+        "nauc_ndcg_at_20_max": 0.634323,
+        "nauc_ndcg_at_20_std": 0.430986,
+        "nauc_ndcg_at_20_diff1": 0.931208,
+        "nauc_ndcg_at_100_max": 0.627791,
+        "nauc_ndcg_at_100_std": 0.415363,
+        "nauc_ndcg_at_100_diff1": 0.929154,
+        "nauc_ndcg_at_1000_max": 0.625524,
+        "nauc_ndcg_at_1000_std": 0.407013,
+        "nauc_ndcg_at_1000_diff1": 0.929806,
+        "nauc_map_at_1_max": 0.597668,
+        "nauc_map_at_1_std": 0.352454,
+        "nauc_map_at_1_diff1": 0.936031,
+        "nauc_map_at_3_max": 0.617814,
+        "nauc_map_at_3_std": 0.383496,
+        "nauc_map_at_3_diff1": 0.929005,
+        "nauc_map_at_5_max": 0.623013,
+        "nauc_map_at_5_std": 0.394786,
+        "nauc_map_at_5_diff1": 0.930342,
+        "nauc_map_at_10_max": 0.620786,
+        "nauc_map_at_10_std": 0.39513,
+        "nauc_map_at_10_diff1": 0.930226,
+        "nauc_map_at_20_max": 0.621495,
+        "nauc_map_at_20_std": 0.396677,
+        "nauc_map_at_20_diff1": 0.930768,
+        "nauc_map_at_100_max": 0.621118,
+        "nauc_map_at_100_std": 0.395229,
+        "nauc_map_at_100_diff1": 0.930564,
+        "nauc_map_at_1000_max": 0.620959,
+        "nauc_map_at_1000_std": 0.394835,
+        "nauc_map_at_1000_diff1": 0.93058,
+        "nauc_recall_at_1_max": 0.597668,
+        "nauc_recall_at_1_std": 0.352454,
+        "nauc_recall_at_1_diff1": 0.936031,
+        "nauc_recall_at_3_max": 0.654661,
+        "nauc_recall_at_3_std": 0.453699,
+        "nauc_recall_at_3_diff1": 0.91754,
+        "nauc_recall_at_5_max": 0.713957,
+        "nauc_recall_at_5_std": 0.568772,
+        "nauc_recall_at_5_diff1": 0.922793,
+        "nauc_recall_at_10_max": 0.698904,
+        "nauc_recall_at_10_std": 0.608873,
+        "nauc_recall_at_10_diff1": 0.92172,
+        "nauc_recall_at_20_max": 0.768097,
+        "nauc_recall_at_20_std": 0.801751,
+        "nauc_recall_at_20_diff1": 0.944819,
+        "nauc_recall_at_100_max": 0.72429,
+        "nauc_recall_at_100_std": 0.855643,
+        "nauc_recall_at_100_diff1": 0.886639,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.597668,
+        "nauc_precision_at_1_std": 0.352454,
+        "nauc_precision_at_1_diff1": 0.936031,
+        "nauc_precision_at_3_max": 0.653722,
+        "nauc_precision_at_3_std": 0.452302,
+        "nauc_precision_at_3_diff1": 0.916395,
+        "nauc_precision_at_5_max": 0.713797,
+        "nauc_precision_at_5_std": 0.56905,
+        "nauc_precision_at_5_diff1": 0.921308,
+        "nauc_precision_at_10_max": 0.607016,
+        "nauc_precision_at_10_std": 0.527636,
+        "nauc_precision_at_10_diff1": 0.809279,
+        "nauc_precision_at_20_max": 0.625368,
+        "nauc_precision_at_20_std": 0.667674,
+        "nauc_precision_at_20_diff1": 0.773857,
+        "nauc_precision_at_100_max": -0.000861,
+        "nauc_precision_at_100_std": 0.087061,
+        "nauc_precision_at_100_diff1": 0.048157,
+        "nauc_precision_at_1000_max": -0.534483,
+        "nauc_precision_at_1000_std": -0.518427,
+        "nauc_precision_at_1000_diff1": -0.573514,
+        "nauc_mrr_at_1_max": 0.597668,
+        "nauc_mrr_at_1_std": 0.352454,
+        "nauc_mrr_at_1_diff1": 0.936031,
+        "nauc_mrr_at_3_max": 0.617482,
+        "nauc_mrr_at_3_std": 0.382953,
+        "nauc_mrr_at_3_diff1": 0.928779,
+        "nauc_mrr_at_5_max": 0.622684,
+        "nauc_mrr_at_5_std": 0.394257,
+        "nauc_mrr_at_5_diff1": 0.930111,
+        "nauc_mrr_at_10_max": 0.620174,
+        "nauc_mrr_at_10_std": 0.394154,
+        "nauc_mrr_at_10_diff1": 0.930114,
+        "nauc_mrr_at_20_max": 0.620877,
+        "nauc_mrr_at_20_std": 0.395693,
+        "nauc_mrr_at_20_diff1": 0.930656,
+        "nauc_mrr_at_100_max": 0.62058,
+        "nauc_mrr_at_100_std": 0.394349,
+        "nauc_mrr_at_100_diff1": 0.930459,
+        "nauc_mrr_at_1000_max": 0.620519,
+        "nauc_mrr_at_1000_std": 0.394119,
+        "nauc_mrr_at_1000_diff1": 0.930495,
+        "hit_rate_at_1": 0.86235,
+        "hit_rate_at_3": 0.92713,
+        "hit_rate_at_5": 0.94737,
+        "hit_rate_at_10": 0.95547,
+        "hit_rate_at_20": 0.97166,
+        "hit_rate_at_100": 0.9919,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.90845,
+        "hf_subset": "default",
+        "languages": [
+          "eng-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 103.3257851600647,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v1/VidoreShiftProjectRetrieval.json

@@ -0,0 +1,167 @@
+{
+  "dataset_revision": "78e6f5ad3bbc1af50ae9c0f006f57462213269fb",
+  "task_name": "VidoreShiftProjectRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.71,
+        "ndcg_at_3": 0.81571,
+        "ndcg_at_5": 0.84454,
+        "ndcg_at_10": 0.85167,
+        "ndcg_at_20": 0.85677,
+        "ndcg_at_100": 0.85677,
+        "ndcg_at_1000": 0.85677,
+        "map_at_1": 0.71,
+        "map_at_3": 0.79,
+        "map_at_5": 0.806,
+        "map_at_10": 0.80933,
+        "map_at_20": 0.81075,
+        "map_at_100": 0.81075,
+        "map_at_1000": 0.81075,
+        "recall_at_1": 0.71,
+        "recall_at_3": 0.89,
+        "recall_at_5": 0.96,
+        "recall_at_10": 0.98,
+        "recall_at_20": 1.0,
+        "recall_at_100": 1.0,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.71,
+        "precision_at_1": 0.71,
+        "precision_at_3": 0.29667,
+        "precision_at_5": 0.192,
+        "precision_at_10": 0.098,
+        "precision_at_20": 0.05,
+        "precision_at_100": 0.01,
+        "precision_at_1000": 0.001,
+        "mrr_at_1": 0.71,
+        "mrr_at_3": 0.79,
+        "mrr_at_5": 0.806,
+        "mrr_at_10": 0.809333,
+        "mrr_at_20": 0.810755,
+        "mrr_at_100": 0.810755,
+        "mrr_at_1000": 0.810755,
+        "nauc_ndcg_at_1_max": 0.152123,
+        "nauc_ndcg_at_1_std": -0.224413,
+        "nauc_ndcg_at_1_diff1": 0.77883,
+        "nauc_ndcg_at_3_max": 0.207123,
+        "nauc_ndcg_at_3_std": -0.230365,
+        "nauc_ndcg_at_3_diff1": 0.73145,
+        "nauc_ndcg_at_5_max": 0.217577,
+        "nauc_ndcg_at_5_std": -0.175956,
+        "nauc_ndcg_at_5_diff1": 0.767143,
+        "nauc_ndcg_at_10_max": 0.204799,
+        "nauc_ndcg_at_10_std": -0.200137,
+        "nauc_ndcg_at_10_diff1": 0.769549,
+        "nauc_ndcg_at_20_max": 0.175848,
+        "nauc_ndcg_at_20_std": -0.230094,
+        "nauc_ndcg_at_20_diff1": 0.76312,
+        "nauc_ndcg_at_100_max": 0.175848,
+        "nauc_ndcg_at_100_std": -0.230094,
+        "nauc_ndcg_at_100_diff1": 0.76312,
+        "nauc_ndcg_at_1000_max": 0.175848,
+        "nauc_ndcg_at_1000_std": -0.230094,
+        "nauc_ndcg_at_1000_diff1": 0.76312,
+        "nauc_map_at_1_max": 0.152123,
+        "nauc_map_at_1_std": -0.224413,
+        "nauc_map_at_1_diff1": 0.77883,
+        "nauc_map_at_3_max": 0.182395,
+        "nauc_map_at_3_std": -0.238709,
+        "nauc_map_at_3_diff1": 0.74657,
+        "nauc_map_at_5_max": 0.182152,
+        "nauc_map_at_5_std": -0.217376,
+        "nauc_map_at_5_diff1": 0.763982,
+        "nauc_map_at_10_max": 0.17678,
+        "nauc_map_at_10_std": -0.22704,
+        "nauc_map_at_10_diff1": 0.764801,
+        "nauc_map_at_20_max": 0.170484,
+        "nauc_map_at_20_std": -0.233774,
+        "nauc_map_at_20_diff1": 0.763464,
+        "nauc_map_at_100_max": 0.170484,
+        "nauc_map_at_100_std": -0.233774,
+        "nauc_map_at_100_diff1": 0.763464,
+        "nauc_map_at_1000_max": 0.170484,
+        "nauc_map_at_1000_std": -0.233774,
+        "nauc_map_at_1000_diff1": 0.763464,
+        "nauc_recall_at_1_max": 0.152123,
+        "nauc_recall_at_1_std": -0.224413,
+        "nauc_recall_at_1_diff1": 0.77883,
+        "nauc_recall_at_3_max": 0.336268,
+        "nauc_recall_at_3_std": -0.181127,
+        "nauc_recall_at_3_diff1": 0.655657,
+        "nauc_recall_at_5_max": 0.695378,
+        "nauc_recall_at_5_std": 0.407796,
+        "nauc_recall_at_5_diff1": 0.828431,
+        "nauc_recall_at_10_max": 0.934641,
+        "nauc_recall_at_10_std": 0.540149,
+        "nauc_recall_at_10_diff1": 0.934641,
+        "nauc_recall_at_20_max": NaN,
+        "nauc_recall_at_20_std": NaN,
+        "nauc_recall_at_20_diff1": NaN,
+        "nauc_recall_at_100_max": NaN,
+        "nauc_recall_at_100_std": NaN,
+        "nauc_recall_at_100_diff1": NaN,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.152123,
+        "nauc_precision_at_1_std": -0.224413,
+        "nauc_precision_at_1_diff1": 0.77883,
+        "nauc_precision_at_3_max": 0.336268,
+        "nauc_precision_at_3_std": -0.181127,
+        "nauc_precision_at_3_diff1": 0.655657,
+        "nauc_precision_at_5_max": 0.695378,
+        "nauc_precision_at_5_std": 0.407796,
+        "nauc_precision_at_5_diff1": 0.828431,
+        "nauc_precision_at_10_max": 0.934641,
+        "nauc_precision_at_10_std": 0.540149,
+        "nauc_precision_at_10_diff1": 0.934641,
+        "nauc_precision_at_20_max": 1.0,
+        "nauc_precision_at_20_std": 1.0,
+        "nauc_precision_at_20_diff1": 1.0,
+        "nauc_precision_at_100_max": NaN,
+        "nauc_precision_at_100_std": NaN,
+        "nauc_precision_at_100_diff1": NaN,
+        "nauc_precision_at_1000_max": NaN,
+        "nauc_precision_at_1000_std": NaN,
+        "nauc_precision_at_1000_diff1": NaN,
+        "nauc_mrr_at_1_max": 0.152123,
+        "nauc_mrr_at_1_std": -0.224413,
+        "nauc_mrr_at_1_diff1": 0.77883,
+        "nauc_mrr_at_3_max": 0.182395,
+        "nauc_mrr_at_3_std": -0.238709,
+        "nauc_mrr_at_3_diff1": 0.74657,
+        "nauc_mrr_at_5_max": 0.182152,
+        "nauc_mrr_at_5_std": -0.217376,
+        "nauc_mrr_at_5_diff1": 0.763982,
+        "nauc_mrr_at_10_max": 0.17678,
+        "nauc_mrr_at_10_std": -0.22704,
+        "nauc_mrr_at_10_diff1": 0.764801,
+        "nauc_mrr_at_20_max": 0.170484,
+        "nauc_mrr_at_20_std": -0.233774,
+        "nauc_mrr_at_20_diff1": 0.763464,
+        "nauc_mrr_at_100_max": 0.170484,
+        "nauc_mrr_at_100_std": -0.233774,
+        "nauc_mrr_at_100_diff1": 0.763464,
+        "nauc_mrr_at_1000_max": 0.170484,
+        "nauc_mrr_at_1000_std": -0.233774,
+        "nauc_mrr_at_1000_diff1": 0.763464,
+        "hit_rate_at_1": 0.71,
+        "hit_rate_at_3": 0.89,
+        "hit_rate_at_5": 0.96,
+        "hit_rate_at_10": 0.98,
+        "hit_rate_at_20": 1.0,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.84454,
+        "hf_subset": "default",
+        "languages": [
+          "eng-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 161.9914197921753,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v1/VidoreSyntheticDocQAAIRetrieval.json

@@ -0,0 +1,167 @@
+{
+  "dataset_revision": "12c5b7a81fc19d66f1844642acdb88e8ad79af16",
+  "task_name": "VidoreSyntheticDocQAAIRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.96,
+        "ndcg_at_3": 0.97893,
+        "ndcg_at_5": 0.97893,
+        "ndcg_at_10": 0.97893,
+        "ndcg_at_20": 0.98172,
+        "ndcg_at_100": 0.98172,
+        "ndcg_at_1000": 0.98172,
+        "map_at_1": 0.96,
+        "map_at_3": 0.975,
+        "map_at_5": 0.975,
+        "map_at_10": 0.975,
+        "map_at_20": 0.97591,
+        "map_at_100": 0.97591,
+        "map_at_1000": 0.97591,
+        "recall_at_1": 0.96,
+        "recall_at_3": 0.99,
+        "recall_at_5": 0.99,
+        "recall_at_10": 0.99,
+        "recall_at_20": 1.0,
+        "recall_at_100": 1.0,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.96,
+        "precision_at_1": 0.96,
+        "precision_at_3": 0.33,
+        "precision_at_5": 0.198,
+        "precision_at_10": 0.099,
+        "precision_at_20": 0.05,
+        "precision_at_100": 0.01,
+        "precision_at_1000": 0.001,
+        "mrr_at_1": 0.96,
+        "mrr_at_3": 0.975,
+        "mrr_at_5": 0.975,
+        "mrr_at_10": 0.975,
+        "mrr_at_20": 0.975909,
+        "mrr_at_100": 0.975909,
+        "mrr_at_1000": 0.975909,
+        "nauc_ndcg_at_1_max": 0.695378,
+        "nauc_ndcg_at_1_std": 0.379202,
+        "nauc_ndcg_at_1_diff1": 1.0,
+        "nauc_ndcg_at_3_max": 0.594385,
+        "nauc_ndcg_at_3_std": 0.096945,
+        "nauc_ndcg_at_3_diff1": 1.0,
+        "nauc_ndcg_at_5_max": 0.594385,
+        "nauc_ndcg_at_5_std": 0.096945,
+        "nauc_ndcg_at_5_diff1": 1.0,
+        "nauc_ndcg_at_10_max": 0.594385,
+        "nauc_ndcg_at_10_std": 0.096945,
+        "nauc_ndcg_at_10_diff1": 1.0,
+        "nauc_ndcg_at_20_max": 0.630439,
+        "nauc_ndcg_at_20_std": 0.19771,
+        "nauc_ndcg_at_20_diff1": 1.0,
+        "nauc_ndcg_at_100_max": 0.630439,
+        "nauc_ndcg_at_100_std": 0.19771,
+        "nauc_ndcg_at_100_diff1": 1.0,
+        "nauc_ndcg_at_1000_max": 0.630439,
+        "nauc_ndcg_at_1000_std": 0.19771,
+        "nauc_ndcg_at_1000_diff1": 1.0,
+        "nauc_map_at_1_max": 0.695378,
+        "nauc_map_at_1_std": 0.379202,
+        "nauc_map_at_1_diff1": 1.0,
+        "nauc_map_at_3_max": 0.627918,
+        "nauc_map_at_3_std": 0.190663,
+        "nauc_map_at_3_diff1": 1.0,
+        "nauc_map_at_5_max": 0.627918,
+        "nauc_map_at_5_std": 0.190663,
+        "nauc_map_at_5_diff1": 1.0,
+        "nauc_map_at_10_max": 0.627918,
+        "nauc_map_at_10_std": 0.190663,
+        "nauc_map_at_10_diff1": 1.0,
+        "nauc_map_at_20_max": 0.638101,
+        "nauc_map_at_20_std": 0.219122,
+        "nauc_map_at_20_diff1": 1.0,
+        "nauc_map_at_100_max": 0.638101,
+        "nauc_map_at_100_std": 0.219122,
+        "nauc_map_at_100_diff1": 1.0,
+        "nauc_map_at_1000_max": 0.638101,
+        "nauc_map_at_1000_std": 0.219122,
+        "nauc_map_at_1000_diff1": 1.0,
+        "nauc_recall_at_1_max": 0.695378,
+        "nauc_recall_at_1_std": 0.379202,
+        "nauc_recall_at_1_diff1": 1.0,
+        "nauc_recall_at_3_max": 0.358077,
+        "nauc_recall_at_3_std": -0.563492,
+        "nauc_recall_at_3_diff1": 1.0,
+        "nauc_recall_at_5_max": 0.358077,
+        "nauc_recall_at_5_std": -0.563492,
+        "nauc_recall_at_5_diff1": 1.0,
+        "nauc_recall_at_10_max": 0.358077,
+        "nauc_recall_at_10_std": -0.563492,
+        "nauc_recall_at_10_diff1": 1.0,
+        "nauc_recall_at_20_max": NaN,
+        "nauc_recall_at_20_std": NaN,
+        "nauc_recall_at_20_diff1": NaN,
+        "nauc_recall_at_100_max": NaN,
+        "nauc_recall_at_100_std": NaN,
+        "nauc_recall_at_100_diff1": NaN,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.695378,
+        "nauc_precision_at_1_std": 0.379202,
+        "nauc_precision_at_1_diff1": 1.0,
+        "nauc_precision_at_3_max": 0.358077,
+        "nauc_precision_at_3_std": -0.563492,
+        "nauc_precision_at_3_diff1": 1.0,
+        "nauc_precision_at_5_max": 0.358077,
+        "nauc_precision_at_5_std": -0.563492,
+        "nauc_precision_at_5_diff1": 1.0,
+        "nauc_precision_at_10_max": 0.358077,
+        "nauc_precision_at_10_std": -0.563492,
+        "nauc_precision_at_10_diff1": 1.0,
+        "nauc_precision_at_20_max": 1.0,
+        "nauc_precision_at_20_std": 1.0,
+        "nauc_precision_at_20_diff1": 1.0,
+        "nauc_precision_at_100_max": NaN,
+        "nauc_precision_at_100_std": NaN,
+        "nauc_precision_at_100_diff1": NaN,
+        "nauc_precision_at_1000_max": NaN,
+        "nauc_precision_at_1000_std": NaN,
+        "nauc_precision_at_1000_diff1": NaN,
+        "nauc_mrr_at_1_max": 0.695378,
+        "nauc_mrr_at_1_std": 0.379202,
+        "nauc_mrr_at_1_diff1": 1.0,
+        "nauc_mrr_at_3_max": 0.627918,
+        "nauc_mrr_at_3_std": 0.190663,
+        "nauc_mrr_at_3_diff1": 1.0,
+        "nauc_mrr_at_5_max": 0.627918,
+        "nauc_mrr_at_5_std": 0.190663,
+        "nauc_mrr_at_5_diff1": 1.0,
+        "nauc_mrr_at_10_max": 0.627918,
+        "nauc_mrr_at_10_std": 0.190663,
+        "nauc_mrr_at_10_diff1": 1.0,
+        "nauc_mrr_at_20_max": 0.638101,
+        "nauc_mrr_at_20_std": 0.219122,
+        "nauc_mrr_at_20_diff1": 1.0,
+        "nauc_mrr_at_100_max": 0.638101,
+        "nauc_mrr_at_100_std": 0.219122,
+        "nauc_mrr_at_100_diff1": 1.0,
+        "nauc_mrr_at_1000_max": 0.638101,
+        "nauc_mrr_at_1000_std": 0.219122,
+        "nauc_mrr_at_1000_diff1": 1.0,
+        "hit_rate_at_1": 0.96,
+        "hit_rate_at_3": 0.99,
+        "hit_rate_at_5": 0.99,
+        "hit_rate_at_10": 0.99,
+        "hit_rate_at_20": 1.0,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.97893,
+        "hf_subset": "default",
+        "languages": [
+          "eng-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 154.15489268302917,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v1/VidoreSyntheticDocQAEnergyRetrieval.json

@@ -0,0 +1,167 @@
+{
+  "dataset_revision": "eda52c9a0519252cfaacb7ae5e5da516b7d4b8cb",
+  "task_name": "VidoreSyntheticDocQAEnergyRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.9,
+        "ndcg_at_3": 0.93155,
+        "ndcg_at_5": 0.94403,
+        "ndcg_at_10": 0.95007,
+        "ndcg_at_20": 0.95007,
+        "ndcg_at_100": 0.95007,
+        "ndcg_at_1000": 0.95007,
+        "map_at_1": 0.9,
+        "map_at_3": 0.925,
+        "map_at_5": 0.932,
+        "map_at_10": 0.93425,
+        "map_at_20": 0.93425,
+        "map_at_100": 0.93425,
+        "map_at_1000": 0.93425,
+        "recall_at_1": 0.9,
+        "recall_at_3": 0.95,
+        "recall_at_5": 0.98,
+        "recall_at_10": 1.0,
+        "recall_at_20": 1.0,
+        "recall_at_100": 1.0,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.9,
+        "precision_at_1": 0.9,
+        "precision_at_3": 0.31667,
+        "precision_at_5": 0.196,
+        "precision_at_10": 0.1,
+        "precision_at_20": 0.05,
+        "precision_at_100": 0.01,
+        "precision_at_1000": 0.001,
+        "mrr_at_1": 0.9,
+        "mrr_at_3": 0.925,
+        "mrr_at_5": 0.932,
+        "mrr_at_10": 0.93425,
+        "mrr_at_20": 0.93425,
+        "mrr_at_100": 0.93425,
+        "mrr_at_1000": 0.93425,
+        "nauc_ndcg_at_1_max": 0.340336,
+        "nauc_ndcg_at_1_std": -0.365453,
+        "nauc_ndcg_at_1_diff1": 0.960784,
+        "nauc_ndcg_at_3_max": 0.466671,
+        "nauc_ndcg_at_3_std": -0.238043,
+        "nauc_ndcg_at_3_diff1": 0.966808,
+        "nauc_ndcg_at_5_max": 0.418422,
+        "nauc_ndcg_at_5_std": -0.399621,
+        "nauc_ndcg_at_5_diff1": 0.969465,
+        "nauc_ndcg_at_10_max": 0.40272,
+        "nauc_ndcg_at_10_std": -0.336442,
+        "nauc_ndcg_at_10_diff1": 0.965767,
+        "nauc_ndcg_at_20_max": 0.40272,
+        "nauc_ndcg_at_20_std": -0.336442,
+        "nauc_ndcg_at_20_diff1": 0.965767,
+        "nauc_ndcg_at_100_max": 0.40272,
+        "nauc_ndcg_at_100_std": -0.336442,
+        "nauc_ndcg_at_100_diff1": 0.965767,
+        "nauc_ndcg_at_1000_max": 0.40272,
+        "nauc_ndcg_at_1000_std": -0.336442,
+        "nauc_ndcg_at_1000_diff1": 0.965767,
+        "nauc_map_at_1_max": 0.340336,
+        "nauc_map_at_1_std": -0.365453,
+        "nauc_map_at_1_diff1": 0.960784,
+        "nauc_map_at_3_max": 0.431715,
+        "nauc_map_at_3_std": -0.273296,
+        "nauc_map_at_3_diff1": 0.965142,
+        "nauc_map_at_5_max": 0.403821,
+        "nauc_map_at_5_std": -0.351266,
+        "nauc_map_at_5_diff1": 0.966359,
+        "nauc_map_at_10_max": 0.398464,
+        "nauc_map_at_10_std": -0.333566,
+        "nauc_map_at_10_diff1": 0.965208,
+        "nauc_map_at_20_max": 0.398464,
+        "nauc_map_at_20_std": -0.333566,
+        "nauc_map_at_20_diff1": 0.965208,
+        "nauc_map_at_100_max": 0.398464,
+        "nauc_map_at_100_std": -0.333566,
+        "nauc_map_at_100_diff1": 0.965208,
+        "nauc_map_at_1000_max": 0.398464,
+        "nauc_map_at_1000_std": -0.333566,
+        "nauc_map_at_1000_diff1": 0.965208,
+        "nauc_recall_at_1_max": 0.340336,
+        "nauc_recall_at_1_std": -0.365453,
+        "nauc_recall_at_1_diff1": 0.960784,
+        "nauc_recall_at_3_max": 0.614472,
+        "nauc_recall_at_3_std": -0.088982,
+        "nauc_recall_at_3_diff1": 0.973856,
+        "nauc_recall_at_5_max": 0.540149,
+        "nauc_recall_at_5_std": -0.955649,
+        "nauc_recall_at_5_diff1": 1.0,
+        "nauc_recall_at_10_max": NaN,
+        "nauc_recall_at_10_std": NaN,
+        "nauc_recall_at_10_diff1": NaN,
+        "nauc_recall_at_20_max": NaN,
+        "nauc_recall_at_20_std": NaN,
+        "nauc_recall_at_20_diff1": NaN,
+        "nauc_recall_at_100_max": NaN,
+        "nauc_recall_at_100_std": NaN,
+        "nauc_recall_at_100_diff1": NaN,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.340336,
+        "nauc_precision_at_1_std": -0.365453,
+        "nauc_precision_at_1_diff1": 0.960784,
+        "nauc_precision_at_3_max": 0.614472,
+        "nauc_precision_at_3_std": -0.088982,
+        "nauc_precision_at_3_diff1": 0.973856,
+        "nauc_precision_at_5_max": 0.540149,
+        "nauc_precision_at_5_std": -0.955649,
+        "nauc_precision_at_5_diff1": 1.0,
+        "nauc_precision_at_10_max": 1.0,
+        "nauc_precision_at_10_std": 1.0,
+        "nauc_precision_at_10_diff1": 1.0,
+        "nauc_precision_at_20_max": 1.0,
+        "nauc_precision_at_20_std": 1.0,
+        "nauc_precision_at_20_diff1": 1.0,
+        "nauc_precision_at_100_max": NaN,
+        "nauc_precision_at_100_std": NaN,
+        "nauc_precision_at_100_diff1": NaN,
+        "nauc_precision_at_1000_max": NaN,
+        "nauc_precision_at_1000_std": NaN,
+        "nauc_precision_at_1000_diff1": NaN,
+        "nauc_mrr_at_1_max": 0.340336,
+        "nauc_mrr_at_1_std": -0.365453,
+        "nauc_mrr_at_1_diff1": 0.960784,
+        "nauc_mrr_at_3_max": 0.431715,
+        "nauc_mrr_at_3_std": -0.273296,
+        "nauc_mrr_at_3_diff1": 0.965142,
+        "nauc_mrr_at_5_max": 0.403821,
+        "nauc_mrr_at_5_std": -0.351266,
+        "nauc_mrr_at_5_diff1": 0.966359,
+        "nauc_mrr_at_10_max": 0.398464,
+        "nauc_mrr_at_10_std": -0.333566,
+        "nauc_mrr_at_10_diff1": 0.965208,
+        "nauc_mrr_at_20_max": 0.398464,
+        "nauc_mrr_at_20_std": -0.333566,
+        "nauc_mrr_at_20_diff1": 0.965208,
+        "nauc_mrr_at_100_max": 0.398464,
+        "nauc_mrr_at_100_std": -0.333566,
+        "nauc_mrr_at_100_diff1": 0.965208,
+        "nauc_mrr_at_1000_max": 0.398464,
+        "nauc_mrr_at_1000_std": -0.333566,
+        "nauc_mrr_at_1000_diff1": 0.965208,
+        "hit_rate_at_1": 0.9,
+        "hit_rate_at_3": 0.95,
+        "hit_rate_at_5": 0.98,
+        "hit_rate_at_10": 1.0,
+        "hit_rate_at_20": 1.0,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.94403,
+        "hf_subset": "default",
+        "languages": [
+          "eng-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 153.6951470375061,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v1/VidoreSyntheticDocQAGovernmentReportsRetrieval.json

@@ -0,0 +1,167 @@
+{
+  "dataset_revision": "ec534abea699035a18f9fd76f215277de9db9600",
+  "task_name": "VidoreSyntheticDocQAGovernmentReportsRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.92,
+        "ndcg_at_3": 0.96155,
+        "ndcg_at_5": 0.96585,
+        "ndcg_at_10": 0.96585,
+        "ndcg_at_20": 0.96585,
+        "ndcg_at_100": 0.96585,
+        "ndcg_at_1000": 0.96585,
+        "map_at_1": 0.92,
+        "map_at_3": 0.95167,
+        "map_at_5": 0.95417,
+        "map_at_10": 0.95417,
+        "map_at_20": 0.95417,
+        "map_at_100": 0.95417,
+        "map_at_1000": 0.95417,
+        "recall_at_1": 0.92,
+        "recall_at_3": 0.99,
+        "recall_at_5": 1.0,
+        "recall_at_10": 1.0,
+        "recall_at_20": 1.0,
+        "recall_at_100": 1.0,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.92,
+        "precision_at_1": 0.92,
+        "precision_at_3": 0.33,
+        "precision_at_5": 0.2,
+        "precision_at_10": 0.1,
+        "precision_at_20": 0.05,
+        "precision_at_100": 0.01,
+        "precision_at_1000": 0.001,
+        "mrr_at_1": 0.92,
+        "mrr_at_3": 0.951667,
+        "mrr_at_5": 0.954167,
+        "mrr_at_10": 0.954167,
+        "mrr_at_20": 0.954167,
+        "mrr_at_100": 0.954167,
+        "mrr_at_1000": 0.954167,
+        "nauc_ndcg_at_1_max": 0.660189,
+        "nauc_ndcg_at_1_std": 0.275619,
+        "nauc_ndcg_at_1_diff1": 0.95098,
+        "nauc_ndcg_at_3_max": 0.725175,
+        "nauc_ndcg_at_3_std": 0.353891,
+        "nauc_ndcg_at_3_diff1": 0.936463,
+        "nauc_ndcg_at_5_max": 0.690513,
+        "nauc_ndcg_at_5_std": 0.307435,
+        "nauc_ndcg_at_5_diff1": 0.944936,
+        "nauc_ndcg_at_10_max": 0.690513,
+        "nauc_ndcg_at_10_std": 0.307435,
+        "nauc_ndcg_at_10_diff1": 0.944936,
+        "nauc_ndcg_at_20_max": 0.690513,
+        "nauc_ndcg_at_20_std": 0.307435,
+        "nauc_ndcg_at_20_diff1": 0.944936,
+        "nauc_ndcg_at_100_max": 0.690513,
+        "nauc_ndcg_at_100_std": 0.307435,
+        "nauc_ndcg_at_100_diff1": 0.944936,
+        "nauc_ndcg_at_1000_max": 0.690513,
+        "nauc_ndcg_at_1000_std": 0.307435,
+        "nauc_ndcg_at_1000_diff1": 0.944936,
+        "nauc_map_at_1_max": 0.660189,
+        "nauc_map_at_1_std": 0.275619,
+        "nauc_map_at_1_diff1": 0.95098,
+        "nauc_map_at_3_max": 0.704691,
+        "nauc_map_at_3_std": 0.326878,
+        "nauc_map_at_3_diff1": 0.941402,
+        "nauc_map_at_5_max": 0.688583,
+        "nauc_map_at_5_std": 0.305314,
+        "nauc_map_at_5_diff1": 0.945336,
+        "nauc_map_at_10_max": 0.688583,
+        "nauc_map_at_10_std": 0.305314,
+        "nauc_map_at_10_diff1": 0.945336,
+        "nauc_map_at_20_max": 0.688583,
+        "nauc_map_at_20_std": 0.305314,
+        "nauc_map_at_20_diff1": 0.945336,
+        "nauc_map_at_100_max": 0.688583,
+        "nauc_map_at_100_std": 0.305314,
+        "nauc_map_at_100_diff1": 0.945336,
+        "nauc_map_at_1000_max": 0.688583,
+        "nauc_map_at_1000_std": 0.305314,
+        "nauc_map_at_1000_diff1": 0.945336,
+        "nauc_recall_at_1_max": 0.660189,
+        "nauc_recall_at_1_std": 0.275619,
+        "nauc_recall_at_1_diff1": 0.95098,
+        "nauc_recall_at_3_max": 1.0,
+        "nauc_recall_at_3_std": 0.722222,
+        "nauc_recall_at_3_diff1": 0.869281,
+        "nauc_recall_at_5_max": NaN,
+        "nauc_recall_at_5_std": NaN,
+        "nauc_recall_at_5_diff1": NaN,
+        "nauc_recall_at_10_max": NaN,
+        "nauc_recall_at_10_std": NaN,
+        "nauc_recall_at_10_diff1": NaN,
+        "nauc_recall_at_20_max": NaN,
+        "nauc_recall_at_20_std": NaN,
+        "nauc_recall_at_20_diff1": NaN,
+        "nauc_recall_at_100_max": NaN,
+        "nauc_recall_at_100_std": NaN,
+        "nauc_recall_at_100_diff1": NaN,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.660189,
+        "nauc_precision_at_1_std": 0.275619,
+        "nauc_precision_at_1_diff1": 0.95098,
+        "nauc_precision_at_3_max": 1.0,
+        "nauc_precision_at_3_std": 0.722222,
+        "nauc_precision_at_3_diff1": 0.869281,
+        "nauc_precision_at_5_max": 1.0,
+        "nauc_precision_at_5_std": 1.0,
+        "nauc_precision_at_5_diff1": 1.0,
+        "nauc_precision_at_10_max": 1.0,
+        "nauc_precision_at_10_std": 1.0,
+        "nauc_precision_at_10_diff1": 1.0,
+        "nauc_precision_at_20_max": 1.0,
+        "nauc_precision_at_20_std": 1.0,
+        "nauc_precision_at_20_diff1": 1.0,
+        "nauc_precision_at_100_max": NaN,
+        "nauc_precision_at_100_std": NaN,
+        "nauc_precision_at_100_diff1": NaN,
+        "nauc_precision_at_1000_max": NaN,
+        "nauc_precision_at_1000_std": NaN,
+        "nauc_precision_at_1000_diff1": NaN,
+        "nauc_mrr_at_1_max": 0.660189,
+        "nauc_mrr_at_1_std": 0.275619,
+        "nauc_mrr_at_1_diff1": 0.95098,
+        "nauc_mrr_at_3_max": 0.704691,
+        "nauc_mrr_at_3_std": 0.326878,
+        "nauc_mrr_at_3_diff1": 0.941402,
+        "nauc_mrr_at_5_max": 0.688583,
+        "nauc_mrr_at_5_std": 0.305314,
+        "nauc_mrr_at_5_diff1": 0.945336,
+        "nauc_mrr_at_10_max": 0.688583,
+        "nauc_mrr_at_10_std": 0.305314,
+        "nauc_mrr_at_10_diff1": 0.945336,
+        "nauc_mrr_at_20_max": 0.688583,
+        "nauc_mrr_at_20_std": 0.305314,
+        "nauc_mrr_at_20_diff1": 0.945336,
+        "nauc_mrr_at_100_max": 0.688583,
+        "nauc_mrr_at_100_std": 0.305314,
+        "nauc_mrr_at_100_diff1": 0.945336,
+        "nauc_mrr_at_1000_max": 0.688583,
+        "nauc_mrr_at_1000_std": 0.305314,
+        "nauc_mrr_at_1000_diff1": 0.945336,
+        "hit_rate_at_1": 0.92,
+        "hit_rate_at_3": 0.99,
+        "hit_rate_at_5": 1.0,
+        "hit_rate_at_10": 1.0,
+        "hit_rate_at_20": 1.0,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.96585,
+        "hf_subset": "default",
+        "languages": [
+          "eng-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 157.8184323310852,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v1/VidoreSyntheticDocQAHealthcareIndustryRetrieval.json

@@ -0,0 +1,167 @@
+{
+  "dataset_revision": "81d53880628d641aaf7365f3b2e65f57c814ecca",
+  "task_name": "VidoreSyntheticDocQAHealthcareIndustryRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.95,
+        "ndcg_at_3": 0.97893,
+        "ndcg_at_5": 0.97893,
+        "ndcg_at_10": 0.97893,
+        "ndcg_at_20": 0.97893,
+        "ndcg_at_100": 0.97893,
+        "ndcg_at_1000": 0.97893,
+        "map_at_1": 0.95,
+        "map_at_3": 0.97167,
+        "map_at_5": 0.97167,
+        "map_at_10": 0.97167,
+        "map_at_20": 0.97167,
+        "map_at_100": 0.97167,
+        "map_at_1000": 0.97167,
+        "recall_at_1": 0.95,
+        "recall_at_3": 1.0,
+        "recall_at_5": 1.0,
+        "recall_at_10": 1.0,
+        "recall_at_20": 1.0,
+        "recall_at_100": 1.0,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.95,
+        "precision_at_1": 0.95,
+        "precision_at_3": 0.33333,
+        "precision_at_5": 0.2,
+        "precision_at_10": 0.1,
+        "precision_at_20": 0.05,
+        "precision_at_100": 0.01,
+        "precision_at_1000": 0.001,
+        "mrr_at_1": 0.95,
+        "mrr_at_3": 0.971667,
+        "mrr_at_5": 0.971667,
+        "mrr_at_10": 0.971667,
+        "mrr_at_20": 0.971667,
+        "mrr_at_100": 0.971667,
+        "mrr_at_1000": 0.971667,
+        "nauc_ndcg_at_1_max": 0.704949,
+        "nauc_ndcg_at_1_std": 0.294304,
+        "nauc_ndcg_at_1_diff1": 0.973856,
+        "nauc_ndcg_at_3_max": 0.684469,
+        "nauc_ndcg_at_3_std": 0.257152,
+        "nauc_ndcg_at_3_diff1": 0.977105,
+        "nauc_ndcg_at_5_max": 0.684469,
+        "nauc_ndcg_at_5_std": 0.257152,
+        "nauc_ndcg_at_5_diff1": 0.977105,
+        "nauc_ndcg_at_10_max": 0.684469,
+        "nauc_ndcg_at_10_std": 0.257152,
+        "nauc_ndcg_at_10_diff1": 0.977105,
+        "nauc_ndcg_at_20_max": 0.684469,
+        "nauc_ndcg_at_20_std": 0.257152,
+        "nauc_ndcg_at_20_diff1": 0.977105,
+        "nauc_ndcg_at_100_max": 0.684469,
+        "nauc_ndcg_at_100_std": 0.257152,
+        "nauc_ndcg_at_100_diff1": 0.977105,
+        "nauc_ndcg_at_1000_max": 0.684469,
+        "nauc_ndcg_at_1000_std": 0.257152,
+        "nauc_ndcg_at_1000_diff1": 0.977105,
+        "nauc_map_at_1_max": 0.704949,
+        "nauc_map_at_1_std": 0.294304,
+        "nauc_map_at_1_diff1": 0.973856,
+        "nauc_map_at_3_max": 0.68556,
+        "nauc_map_at_3_std": 0.259131,
+        "nauc_map_at_3_diff1": 0.976932,
+        "nauc_map_at_5_max": 0.68556,
+        "nauc_map_at_5_std": 0.259131,
+        "nauc_map_at_5_diff1": 0.976932,
+        "nauc_map_at_10_max": 0.68556,
+        "nauc_map_at_10_std": 0.259131,
+        "nauc_map_at_10_diff1": 0.976932,
+        "nauc_map_at_20_max": 0.68556,
+        "nauc_map_at_20_std": 0.259131,
+        "nauc_map_at_20_diff1": 0.976932,
+        "nauc_map_at_100_max": 0.68556,
+        "nauc_map_at_100_std": 0.259131,
+        "nauc_map_at_100_diff1": 0.976932,
+        "nauc_map_at_1000_max": 0.68556,
+        "nauc_map_at_1000_std": 0.259131,
+        "nauc_map_at_1000_diff1": 0.976932,
+        "nauc_recall_at_1_max": 0.704949,
+        "nauc_recall_at_1_std": 0.294304,
+        "nauc_recall_at_1_diff1": 0.973856,
+        "nauc_recall_at_3_max": NaN,
+        "nauc_recall_at_3_std": NaN,
+        "nauc_recall_at_3_diff1": NaN,
+        "nauc_recall_at_5_max": NaN,
+        "nauc_recall_at_5_std": NaN,
+        "nauc_recall_at_5_diff1": NaN,
+        "nauc_recall_at_10_max": NaN,
+        "nauc_recall_at_10_std": NaN,
+        "nauc_recall_at_10_diff1": NaN,
+        "nauc_recall_at_20_max": NaN,
+        "nauc_recall_at_20_std": NaN,
+        "nauc_recall_at_20_diff1": NaN,
+        "nauc_recall_at_100_max": NaN,
+        "nauc_recall_at_100_std": NaN,
+        "nauc_recall_at_100_diff1": NaN,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.704949,
+        "nauc_precision_at_1_std": 0.294304,
+        "nauc_precision_at_1_diff1": 0.973856,
+        "nauc_precision_at_3_max": 1.0,
+        "nauc_precision_at_3_std": 1.0,
+        "nauc_precision_at_3_diff1": 1.0,
+        "nauc_precision_at_5_max": 1.0,
+        "nauc_precision_at_5_std": 1.0,
+        "nauc_precision_at_5_diff1": 1.0,
+        "nauc_precision_at_10_max": 1.0,
+        "nauc_precision_at_10_std": 1.0,
+        "nauc_precision_at_10_diff1": 1.0,
+        "nauc_precision_at_20_max": 1.0,
+        "nauc_precision_at_20_std": 1.0,
+        "nauc_precision_at_20_diff1": 1.0,
+        "nauc_precision_at_100_max": NaN,
+        "nauc_precision_at_100_std": NaN,
+        "nauc_precision_at_100_diff1": NaN,
+        "nauc_precision_at_1000_max": NaN,
+        "nauc_precision_at_1000_std": NaN,
+        "nauc_precision_at_1000_diff1": NaN,
+        "nauc_mrr_at_1_max": 0.704949,
+        "nauc_mrr_at_1_std": 0.294304,
+        "nauc_mrr_at_1_diff1": 0.973856,
+        "nauc_mrr_at_3_max": 0.68556,
+        "nauc_mrr_at_3_std": 0.259131,
+        "nauc_mrr_at_3_diff1": 0.976932,
+        "nauc_mrr_at_5_max": 0.68556,
+        "nauc_mrr_at_5_std": 0.259131,
+        "nauc_mrr_at_5_diff1": 0.976932,
+        "nauc_mrr_at_10_max": 0.68556,
+        "nauc_mrr_at_10_std": 0.259131,
+        "nauc_mrr_at_10_diff1": 0.976932,
+        "nauc_mrr_at_20_max": 0.68556,
+        "nauc_mrr_at_20_std": 0.259131,
+        "nauc_mrr_at_20_diff1": 0.976932,
+        "nauc_mrr_at_100_max": 0.68556,
+        "nauc_mrr_at_100_std": 0.259131,
+        "nauc_mrr_at_100_diff1": 0.976932,
+        "nauc_mrr_at_1000_max": 0.68556,
+        "nauc_mrr_at_1000_std": 0.259131,
+        "nauc_mrr_at_1000_diff1": 0.976932,
+        "hit_rate_at_1": 0.95,
+        "hit_rate_at_3": 1.0,
+        "hit_rate_at_5": 1.0,
+        "hit_rate_at_10": 1.0,
+        "hit_rate_at_20": 1.0,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.97893,
+        "hf_subset": "default",
+        "languages": [
+          "eng-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 151.81989169120789,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v1/VidoreTabfquadRetrieval.json

@@ -0,0 +1,167 @@
+{
+  "dataset_revision": "24a4541c4c461f5ff4f4af4e97ec820715281a06",
+  "task_name": "VidoreTabfquadRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.87143,
+        "ndcg_at_3": 0.91773,
+        "ndcg_at_5": 0.92372,
+        "ndcg_at_10": 0.92839,
+        "ndcg_at_20": 0.932,
+        "ndcg_at_100": 0.93352,
+        "ndcg_at_1000": 0.93352,
+        "map_at_1": 0.87143,
+        "map_at_3": 0.90655,
+        "map_at_5": 0.90994,
+        "map_at_10": 0.91189,
+        "map_at_20": 0.91288,
+        "map_at_100": 0.91317,
+        "map_at_1000": 0.91317,
+        "recall_at_1": 0.87143,
+        "recall_at_3": 0.95,
+        "recall_at_5": 0.96429,
+        "recall_at_10": 0.97857,
+        "recall_at_20": 0.99286,
+        "recall_at_100": 1.0,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.87143,
+        "precision_at_1": 0.87143,
+        "precision_at_3": 0.31667,
+        "precision_at_5": 0.19286,
+        "precision_at_10": 0.09786,
+        "precision_at_20": 0.04964,
+        "precision_at_100": 0.01,
+        "precision_at_1000": 0.001,
+        "mrr_at_1": 0.871429,
+        "mrr_at_3": 0.906548,
+        "mrr_at_5": 0.90994,
+        "mrr_at_10": 0.911889,
+        "mrr_at_20": 0.912878,
+        "mrr_at_100": 0.913167,
+        "mrr_at_1000": 0.913167,
+        "nauc_ndcg_at_1_max": 0.397385,
+        "nauc_ndcg_at_1_std": 0.299645,
+        "nauc_ndcg_at_1_diff1": 0.924605,
+        "nauc_ndcg_at_3_max": 0.425324,
+        "nauc_ndcg_at_3_std": 0.388497,
+        "nauc_ndcg_at_3_diff1": 0.92286,
+        "nauc_ndcg_at_5_max": 0.448081,
+        "nauc_ndcg_at_5_std": 0.392348,
+        "nauc_ndcg_at_5_diff1": 0.925841,
+        "nauc_ndcg_at_10_max": 0.446584,
+        "nauc_ndcg_at_10_std": 0.382105,
+        "nauc_ndcg_at_10_diff1": 0.92774,
+        "nauc_ndcg_at_20_max": 0.435761,
+        "nauc_ndcg_at_20_std": 0.36554,
+        "nauc_ndcg_at_20_diff1": 0.927172,
+        "nauc_ndcg_at_100_max": 0.42418,
+        "nauc_ndcg_at_100_std": 0.352317,
+        "nauc_ndcg_at_100_diff1": 0.92547,
+        "nauc_ndcg_at_1000_max": 0.42418,
+        "nauc_ndcg_at_1000_std": 0.352317,
+        "nauc_ndcg_at_1000_diff1": 0.92547,
+        "nauc_map_at_1_max": 0.397385,
+        "nauc_map_at_1_std": 0.299645,
+        "nauc_map_at_1_diff1": 0.924605,
+        "nauc_map_at_3_max": 0.414116,
+        "nauc_map_at_3_std": 0.353793,
+        "nauc_map_at_3_diff1": 0.923356,
+        "nauc_map_at_5_max": 0.423921,
+        "nauc_map_at_5_std": 0.353799,
+        "nauc_map_at_5_diff1": 0.924921,
+        "nauc_map_at_10_max": 0.422676,
+        "nauc_map_at_10_std": 0.348813,
+        "nauc_map_at_10_diff1": 0.925564,
+        "nauc_map_at_20_max": 0.420054,
+        "nauc_map_at_20_std": 0.345029,
+        "nauc_map_at_20_diff1": 0.92534,
+        "nauc_map_at_100_max": 0.418342,
+        "nauc_map_at_100_std": 0.343062,
+        "nauc_map_at_100_diff1": 0.925086,
+        "nauc_map_at_1000_max": 0.418342,
+        "nauc_map_at_1000_std": 0.343062,
+        "nauc_map_at_1000_diff1": 0.925086,
+        "nauc_recall_at_1_max": 0.397385,
+        "nauc_recall_at_1_std": 0.299645,
+        "nauc_recall_at_1_diff1": 0.924605,
+        "nauc_recall_at_3_max": 0.486094,
+        "nauc_recall_at_3_std": 0.576097,
+        "nauc_recall_at_3_diff1": 0.920301,
+        "nauc_recall_at_5_max": 0.631279,
+        "nauc_recall_at_5_std": 0.675584,
+        "nauc_recall_at_5_diff1": 0.933007,
+        "nauc_recall_at_10_max": 0.742141,
+        "nauc_recall_at_10_std": 0.775132,
+        "nauc_recall_at_10_diff1": 0.956427,
+        "nauc_recall_at_20_max": 0.934641,
+        "nauc_recall_at_20_std": 0.934641,
+        "nauc_recall_at_20_diff1": 1.0,
+        "nauc_recall_at_100_max": NaN,
+        "nauc_recall_at_100_std": NaN,
+        "nauc_recall_at_100_diff1": NaN,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.397385,
+        "nauc_precision_at_1_std": 0.299645,
+        "nauc_precision_at_1_diff1": 0.924605,
+        "nauc_precision_at_3_max": 0.486094,
+        "nauc_precision_at_3_std": 0.576097,
+        "nauc_precision_at_3_diff1": 0.920301,
+        "nauc_precision_at_5_max": 0.631279,
+        "nauc_precision_at_5_std": 0.675584,
+        "nauc_precision_at_5_diff1": 0.933007,
+        "nauc_precision_at_10_max": 0.742141,
+        "nauc_precision_at_10_std": 0.775132,
+        "nauc_precision_at_10_diff1": 0.956427,
+        "nauc_precision_at_20_max": 0.934641,
+        "nauc_precision_at_20_std": 0.934641,
+        "nauc_precision_at_20_diff1": 1.0,
+        "nauc_precision_at_100_max": 1.0,
+        "nauc_precision_at_100_std": 1.0,
+        "nauc_precision_at_100_diff1": 1.0,
+        "nauc_precision_at_1000_max": NaN,
+        "nauc_precision_at_1000_std": NaN,
+        "nauc_precision_at_1000_diff1": NaN,
+        "nauc_mrr_at_1_max": 0.397385,
+        "nauc_mrr_at_1_std": 0.299645,
+        "nauc_mrr_at_1_diff1": 0.924605,
+        "nauc_mrr_at_3_max": 0.414116,
+        "nauc_mrr_at_3_std": 0.353793,
+        "nauc_mrr_at_3_diff1": 0.923356,
+        "nauc_mrr_at_5_max": 0.423921,
+        "nauc_mrr_at_5_std": 0.353799,
+        "nauc_mrr_at_5_diff1": 0.924921,
+        "nauc_mrr_at_10_max": 0.422676,
+        "nauc_mrr_at_10_std": 0.348813,
+        "nauc_mrr_at_10_diff1": 0.925564,
+        "nauc_mrr_at_20_max": 0.420054,
+        "nauc_mrr_at_20_std": 0.345029,
+        "nauc_mrr_at_20_diff1": 0.92534,
+        "nauc_mrr_at_100_max": 0.418342,
+        "nauc_mrr_at_100_std": 0.343062,
+        "nauc_mrr_at_100_diff1": 0.925086,
+        "nauc_mrr_at_1000_max": 0.418342,
+        "nauc_mrr_at_1000_std": 0.343062,
+        "nauc_mrr_at_1000_diff1": 0.925086,
+        "hit_rate_at_1": 0.87143,
+        "hit_rate_at_3": 0.95,
+        "hit_rate_at_5": 0.96429,
+        "hit_rate_at_10": 0.97857,
+        "hit_rate_at_20": 0.99286,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.92372,
+        "hf_subset": "default",
+        "languages": [
+          "eng-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 13.722652435302734,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v1/VidoreTatdqaRetrieval.json

@@ -0,0 +1,167 @@
+{
+  "dataset_revision": "dc7924ec102addd7f85c1ccfdd8625848179f615",
+  "task_name": "VidoreTatdqaRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.64824,
+        "ndcg_at_3": 0.74453,
+        "ndcg_at_5": 0.76722,
+        "ndcg_at_10": 0.78934,
+        "ndcg_at_20": 0.79515,
+        "ndcg_at_100": 0.80064,
+        "ndcg_at_1000": 0.80275,
+        "map_at_1": 0.64733,
+        "map_at_3": 0.7215,
+        "map_at_5": 0.73407,
+        "map_at_10": 0.74341,
+        "map_at_20": 0.74505,
+        "map_at_100": 0.74578,
+        "map_at_1000": 0.7459,
+        "recall_at_1": 0.64733,
+        "recall_at_3": 0.81075,
+        "recall_at_5": 0.86574,
+        "recall_at_10": 0.93293,
+        "recall_at_20": 0.95571,
+        "recall_at_100": 0.98518,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.64733,
+        "precision_at_1": 0.64824,
+        "precision_at_3": 0.27096,
+        "precision_at_5": 0.17375,
+        "precision_at_10": 0.09368,
+        "precision_at_20": 0.048,
+        "precision_at_100": 0.00993,
+        "precision_at_1000": 0.00101,
+        "mrr_at_1": 0.648238,
+        "mrr_at_3": 0.721648,
+        "mrr_at_5": 0.734255,
+        "mrr_at_10": 0.743589,
+        "mrr_at_20": 0.745168,
+        "mrr_at_100": 0.745898,
+        "mrr_at_1000": 0.745993,
+        "nauc_ndcg_at_1_max": 0.192972,
+        "nauc_ndcg_at_1_std": -0.027878,
+        "nauc_ndcg_at_1_diff1": 0.77104,
+        "nauc_ndcg_at_3_max": 0.185286,
+        "nauc_ndcg_at_3_std": -0.014143,
+        "nauc_ndcg_at_3_diff1": 0.728304,
+        "nauc_ndcg_at_5_max": 0.194941,
+        "nauc_ndcg_at_5_std": 0.002903,
+        "nauc_ndcg_at_5_diff1": 0.728846,
+        "nauc_ndcg_at_10_max": 0.200757,
+        "nauc_ndcg_at_10_std": 0.020024,
+        "nauc_ndcg_at_10_diff1": 0.730666,
+        "nauc_ndcg_at_20_max": 0.202494,
+        "nauc_ndcg_at_20_std": 0.019117,
+        "nauc_ndcg_at_20_diff1": 0.733696,
+        "nauc_ndcg_at_100_max": 0.198483,
+        "nauc_ndcg_at_100_std": 0.008839,
+        "nauc_ndcg_at_100_diff1": 0.737733,
+        "nauc_ndcg_at_1000_max": 0.196107,
+        "nauc_ndcg_at_1000_std": 0.002432,
+        "nauc_ndcg_at_1000_diff1": 0.738458,
+        "nauc_map_at_1_max": 0.192147,
+        "nauc_map_at_1_std": -0.0287,
+        "nauc_map_at_1_diff1": 0.772265,
+        "nauc_map_at_3_max": 0.186738,
+        "nauc_map_at_3_std": -0.018414,
+        "nauc_map_at_3_diff1": 0.739979,
+        "nauc_map_at_5_max": 0.191337,
+        "nauc_map_at_5_std": -0.010513,
+        "nauc_map_at_5_diff1": 0.740867,
+        "nauc_map_at_10_max": 0.193508,
+        "nauc_map_at_10_std": -0.004936,
+        "nauc_map_at_10_diff1": 0.741712,
+        "nauc_map_at_20_max": 0.193887,
+        "nauc_map_at_20_std": -0.005239,
+        "nauc_map_at_20_diff1": 0.742392,
+        "nauc_map_at_100_max": 0.193606,
+        "nauc_map_at_100_std": -0.006229,
+        "nauc_map_at_100_diff1": 0.742929,
+        "nauc_map_at_1000_max": 0.193444,
+        "nauc_map_at_1000_std": -0.006551,
+        "nauc_map_at_1000_diff1": 0.742952,
+        "nauc_recall_at_1_max": 0.192147,
+        "nauc_recall_at_1_std": -0.0287,
+        "nauc_recall_at_1_diff1": 0.772265,
+        "nauc_recall_at_3_max": 0.178135,
+        "nauc_recall_at_3_std": 0.00081,
+        "nauc_recall_at_3_diff1": 0.683145,
+        "nauc_recall_at_5_max": 0.214706,
+        "nauc_recall_at_5_std": 0.074379,
+        "nauc_recall_at_5_diff1": 0.668431,
+        "nauc_recall_at_10_max": 0.279874,
+        "nauc_recall_at_10_std": 0.28476,
+        "nauc_recall_at_10_diff1": 0.632366,
+        "nauc_recall_at_20_max": 0.345304,
+        "nauc_recall_at_20_std": 0.401919,
+        "nauc_recall_at_20_diff1": 0.63243,
+        "nauc_recall_at_100_max": 0.363259,
+        "nauc_recall_at_100_std": 0.507314,
+        "nauc_recall_at_100_diff1": 0.673986,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.192972,
+        "nauc_precision_at_1_std": -0.027878,
+        "nauc_precision_at_1_diff1": 0.77104,
+        "nauc_precision_at_3_max": 0.179751,
+        "nauc_precision_at_3_std": 0.006505,
+        "nauc_precision_at_3_diff1": 0.66332,
+        "nauc_precision_at_5_max": 0.209891,
+        "nauc_precision_at_5_std": 0.076764,
+        "nauc_precision_at_5_diff1": 0.632048,
+        "nauc_precision_at_10_max": 0.264381,
+        "nauc_precision_at_10_std": 0.275151,
+        "nauc_precision_at_10_diff1": 0.550637,
+        "nauc_precision_at_20_max": 0.303636,
+        "nauc_precision_at_20_std": 0.362537,
+        "nauc_precision_at_20_diff1": 0.493285,
+        "nauc_precision_at_100_max": 0.076447,
+        "nauc_precision_at_100_std": 0.177168,
+        "nauc_precision_at_100_diff1": 0.132208,
+        "nauc_precision_at_1000_max": -0.346504,
+        "nauc_precision_at_1000_std": -0.321871,
+        "nauc_precision_at_1000_diff1": -0.521306,
+        "nauc_mrr_at_1_max": 0.192972,
+        "nauc_mrr_at_1_std": -0.027878,
+        "nauc_mrr_at_1_diff1": 0.77104,
+        "nauc_mrr_at_3_max": 0.187937,
+        "nauc_mrr_at_3_std": -0.017316,
+        "nauc_mrr_at_3_diff1": 0.740114,
+        "nauc_mrr_at_5_max": 0.192522,
+        "nauc_mrr_at_5_std": -0.009529,
+        "nauc_mrr_at_5_diff1": 0.740979,
+        "nauc_mrr_at_10_max": 0.194013,
+        "nauc_mrr_at_10_std": -0.004641,
+        "nauc_mrr_at_10_diff1": 0.741695,
+        "nauc_mrr_at_20_max": 0.194535,
+        "nauc_mrr_at_20_std": -0.004758,
+        "nauc_mrr_at_20_diff1": 0.742427,
+        "nauc_mrr_at_100_max": 0.194264,
+        "nauc_mrr_at_100_std": -0.005737,
+        "nauc_mrr_at_100_diff1": 0.742971,
+        "nauc_mrr_at_1000_max": 0.194192,
+        "nauc_mrr_at_1000_std": -0.005947,
+        "nauc_mrr_at_1000_diff1": 0.74302,
+        "hit_rate_at_1": 0.64824,
+        "hit_rate_at_3": 0.81106,
+        "hit_rate_at_5": 0.86634,
+        "hit_rate_at_10": 0.93378,
+        "hit_rate_at_20": 0.95626,
+        "hit_rate_at_100": 0.98603,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.76722,
+        "hf_subset": "default",
+        "languages": [
+          "eng-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 84.57178497314453,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v2/Vidore2BioMedicalLecturesRetrieval.json

@@ -0,0 +1,632 @@
+{
+  "dataset_revision": "a29202f0da409034d651614d87cd8938d254e2ea",
+  "task_name": "Vidore2BioMedicalLecturesRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.53125,
+        "ndcg_at_3": 0.54841,
+        "ndcg_at_5": 0.57058,
+        "ndcg_at_10": 0.59481,
+        "ndcg_at_20": 0.62454,
+        "ndcg_at_100": 0.66436,
+        "ndcg_at_1000": 0.68519,
+        "map_at_1": 0.33157,
+        "map_at_3": 0.44822,
+        "map_at_5": 0.48506,
+        "map_at_10": 0.51269,
+        "map_at_20": 0.52733,
+        "map_at_100": 0.53957,
+        "map_at_1000": 0.54137,
+        "recall_at_1": 0.33157,
+        "recall_at_3": 0.5129,
+        "recall_at_5": 0.59864,
+        "recall_at_10": 0.67841,
+        "recall_at_20": 0.76102,
+        "recall_at_100": 0.89569,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.33157,
+        "precision_at_1": 0.53125,
+        "precision_at_3": 0.34167,
+        "precision_at_5": 0.25875,
+        "precision_at_10": 0.15875,
+        "precision_at_20": 0.0975,
+        "precision_at_100": 0.02637,
+        "precision_at_1000": 0.00322,
+        "mrr_at_1": 0.53125,
+        "mrr_at_3": 0.628125,
+        "mrr_at_5": 0.644688,
+        "mrr_at_10": 0.649635,
+        "mrr_at_20": 0.654081,
+        "mrr_at_100": 0.655178,
+        "mrr_at_1000": 0.655336,
+        "nauc_ndcg_at_1_max": 0.256054,
+        "nauc_ndcg_at_1_std": 0.023683,
+        "nauc_ndcg_at_1_diff1": 0.534561,
+        "nauc_ndcg_at_3_max": 0.299766,
+        "nauc_ndcg_at_3_std": 0.080058,
+        "nauc_ndcg_at_3_diff1": 0.460222,
+        "nauc_ndcg_at_5_max": 0.303737,
+        "nauc_ndcg_at_5_std": 0.100406,
+        "nauc_ndcg_at_5_diff1": 0.452692,
+        "nauc_ndcg_at_10_max": 0.310272,
+        "nauc_ndcg_at_10_std": 0.095565,
+        "nauc_ndcg_at_10_diff1": 0.441117,
+        "nauc_ndcg_at_20_max": 0.336153,
+        "nauc_ndcg_at_20_std": 0.117064,
+        "nauc_ndcg_at_20_diff1": 0.435303,
+        "nauc_ndcg_at_100_max": 0.337123,
+        "nauc_ndcg_at_100_std": 0.126146,
+        "nauc_ndcg_at_100_diff1": 0.422379,
+        "nauc_ndcg_at_1000_max": 0.309953,
+        "nauc_ndcg_at_1000_std": 0.099612,
+        "nauc_ndcg_at_1000_diff1": 0.423121,
+        "nauc_map_at_1_max": 0.262677,
+        "nauc_map_at_1_std": 0.081156,
+        "nauc_map_at_1_diff1": 0.564468,
+        "nauc_map_at_3_max": 0.29866,
+        "nauc_map_at_3_std": 0.103925,
+        "nauc_map_at_3_diff1": 0.510846,
+        "nauc_map_at_5_max": 0.303526,
+        "nauc_map_at_5_std": 0.11104,
+        "nauc_map_at_5_diff1": 0.49217,
+        "nauc_map_at_10_max": 0.288187,
+        "nauc_map_at_10_std": 0.095859,
+        "nauc_map_at_10_diff1": 0.466026,
+        "nauc_map_at_20_max": 0.301976,
+        "nauc_map_at_20_std": 0.103224,
+        "nauc_map_at_20_diff1": 0.46014,
+        "nauc_map_at_100_max": 0.301719,
+        "nauc_map_at_100_std": 0.10627,
+        "nauc_map_at_100_diff1": 0.45372,
+        "nauc_map_at_1000_max": 0.299622,
+        "nauc_map_at_1000_std": 0.104372,
+        "nauc_map_at_1000_diff1": 0.452941,
+        "nauc_recall_at_1_max": 0.262677,
+        "nauc_recall_at_1_std": 0.081156,
+        "nauc_recall_at_1_diff1": 0.564468,
+        "nauc_recall_at_3_max": 0.342148,
+        "nauc_recall_at_3_std": 0.129843,
+        "nauc_recall_at_3_diff1": 0.469225,
+        "nauc_recall_at_5_max": 0.32423,
+        "nauc_recall_at_5_std": 0.143,
+        "nauc_recall_at_5_diff1": 0.39481,
+        "nauc_recall_at_10_max": 0.32824,
+        "nauc_recall_at_10_std": 0.128648,
+        "nauc_recall_at_10_diff1": 0.32331,
+        "nauc_recall_at_20_max": 0.415575,
+        "nauc_recall_at_20_std": 0.226556,
+        "nauc_recall_at_20_diff1": 0.296508,
+        "nauc_recall_at_100_max": 0.564999,
+        "nauc_recall_at_100_std": 0.393787,
+        "nauc_recall_at_100_diff1": 0.209017,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.256054,
+        "nauc_precision_at_1_std": 0.023683,
+        "nauc_precision_at_1_diff1": 0.534561,
+        "nauc_precision_at_3_max": 0.13712,
+        "nauc_precision_at_3_std": 0.020039,
+        "nauc_precision_at_3_diff1": 0.108018,
+        "nauc_precision_at_5_max": 0.056346,
+        "nauc_precision_at_5_std": 0.007711,
+        "nauc_precision_at_5_diff1": -0.04973,
+        "nauc_precision_at_10_max": -0.031104,
+        "nauc_precision_at_10_std": -0.050047,
+        "nauc_precision_at_10_diff1": -0.17712,
+        "nauc_precision_at_20_max": -0.024643,
+        "nauc_precision_at_20_std": -0.03493,
+        "nauc_precision_at_20_diff1": -0.265688,
+        "nauc_precision_at_100_max": -0.100694,
+        "nauc_precision_at_100_std": -0.045864,
+        "nauc_precision_at_100_diff1": -0.345804,
+        "nauc_precision_at_1000_max": -0.217294,
+        "nauc_precision_at_1000_std": -0.13626,
+        "nauc_precision_at_1000_diff1": -0.396468,
+        "nauc_mrr_at_1_max": 0.256054,
+        "nauc_mrr_at_1_std": 0.023683,
+        "nauc_mrr_at_1_diff1": 0.534561,
+        "nauc_mrr_at_3_max": 0.312103,
+        "nauc_mrr_at_3_std": 0.045543,
+        "nauc_mrr_at_3_diff1": 0.499293,
+        "nauc_mrr_at_5_max": 0.300444,
+        "nauc_mrr_at_5_std": 0.043282,
+        "nauc_mrr_at_5_diff1": 0.483127,
+        "nauc_mrr_at_10_max": 0.301599,
+        "nauc_mrr_at_10_std": 0.041907,
+        "nauc_mrr_at_10_diff1": 0.480073,
+        "nauc_mrr_at_20_max": 0.30447,
+        "nauc_mrr_at_20_std": 0.046963,
+        "nauc_mrr_at_20_diff1": 0.483367,
+        "nauc_mrr_at_100_max": 0.303433,
+        "nauc_mrr_at_100_std": 0.046139,
+        "nauc_mrr_at_100_diff1": 0.48356,
+        "nauc_mrr_at_1000_max": 0.303182,
+        "nauc_mrr_at_1000_std": 0.045896,
+        "nauc_mrr_at_1000_diff1": 0.483693,
+        "hit_rate_at_1": 0.53125,
+        "hit_rate_at_3": 0.75,
+        "hit_rate_at_5": 0.825,
+        "hit_rate_at_10": 0.8625,
+        "hit_rate_at_20": 0.925,
+        "hit_rate_at_100": 0.96875,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.57058,
+        "hf_subset": "french",
+        "languages": [
+          "fra-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.4875,
+        "ndcg_at_3": 0.51853,
+        "ndcg_at_5": 0.53306,
+        "ndcg_at_10": 0.56221,
+        "ndcg_at_20": 0.59203,
+        "ndcg_at_100": 0.64019,
+        "ndcg_at_1000": 0.66006,
+        "map_at_1": 0.30106,
+        "map_at_3": 0.42128,
+        "map_at_5": 0.45223,
+        "map_at_10": 0.4796,
+        "map_at_20": 0.4933,
+        "map_at_100": 0.50706,
+        "map_at_1000": 0.50896,
+        "recall_at_1": 0.30106,
+        "recall_at_3": 0.50295,
+        "recall_at_5": 0.56396,
+        "recall_at_10": 0.64396,
+        "recall_at_20": 0.73484,
+        "recall_at_100": 0.90511,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.30106,
+        "precision_at_1": 0.4875,
+        "precision_at_3": 0.32083,
+        "precision_at_5": 0.23875,
+        "precision_at_10": 0.15313,
+        "precision_at_20": 0.09156,
+        "precision_at_100": 0.02619,
+        "precision_at_1000": 0.00322,
+        "mrr_at_1": 0.4875,
+        "mrr_at_3": 0.594792,
+        "mrr_at_5": 0.605104,
+        "mrr_at_10": 0.613306,
+        "mrr_at_20": 0.618445,
+        "mrr_at_100": 0.620331,
+        "mrr_at_1000": 0.620429,
+        "nauc_ndcg_at_1_max": 0.205512,
+        "nauc_ndcg_at_1_std": 0.005008,
+        "nauc_ndcg_at_1_diff1": 0.506434,
+        "nauc_ndcg_at_3_max": 0.281572,
+        "nauc_ndcg_at_3_std": 0.051279,
+        "nauc_ndcg_at_3_diff1": 0.406261,
+        "nauc_ndcg_at_5_max": 0.279857,
+        "nauc_ndcg_at_5_std": 0.05478,
+        "nauc_ndcg_at_5_diff1": 0.407238,
+        "nauc_ndcg_at_10_max": 0.269101,
+        "nauc_ndcg_at_10_std": 0.051283,
+        "nauc_ndcg_at_10_diff1": 0.392403,
+        "nauc_ndcg_at_20_max": 0.273865,
+        "nauc_ndcg_at_20_std": 0.060508,
+        "nauc_ndcg_at_20_diff1": 0.381672,
+        "nauc_ndcg_at_100_max": 0.290469,
+        "nauc_ndcg_at_100_std": 0.084259,
+        "nauc_ndcg_at_100_diff1": 0.380169,
+        "nauc_ndcg_at_1000_max": 0.259836,
+        "nauc_ndcg_at_1000_std": 0.063009,
+        "nauc_ndcg_at_1000_diff1": 0.381163,
+        "nauc_map_at_1_max": 0.239126,
+        "nauc_map_at_1_std": 0.071424,
+        "nauc_map_at_1_diff1": 0.52977,
+        "nauc_map_at_3_max": 0.277289,
+        "nauc_map_at_3_std": 0.061162,
+        "nauc_map_at_3_diff1": 0.447678,
+        "nauc_map_at_5_max": 0.278206,
+        "nauc_map_at_5_std": 0.068258,
+        "nauc_map_at_5_diff1": 0.43769,
+        "nauc_map_at_10_max": 0.253008,
+        "nauc_map_at_10_std": 0.049496,
+        "nauc_map_at_10_diff1": 0.420251,
+        "nauc_map_at_20_max": 0.257125,
+        "nauc_map_at_20_std": 0.052178,
+        "nauc_map_at_20_diff1": 0.41506,
+        "nauc_map_at_100_max": 0.257927,
+        "nauc_map_at_100_std": 0.056356,
+        "nauc_map_at_100_diff1": 0.414714,
+        "nauc_map_at_1000_max": 0.255638,
+        "nauc_map_at_1000_std": 0.054937,
+        "nauc_map_at_1000_diff1": 0.413827,
+        "nauc_recall_at_1_max": 0.239126,
+        "nauc_recall_at_1_std": 0.071424,
+        "nauc_recall_at_1_diff1": 0.52977,
+        "nauc_recall_at_3_max": 0.320997,
+        "nauc_recall_at_3_std": 0.06845,
+        "nauc_recall_at_3_diff1": 0.363712,
+        "nauc_recall_at_5_max": 0.30565,
+        "nauc_recall_at_5_std": 0.069305,
+        "nauc_recall_at_5_diff1": 0.327328,
+        "nauc_recall_at_10_max": 0.287763,
+        "nauc_recall_at_10_std": 0.054345,
+        "nauc_recall_at_10_diff1": 0.290658,
+        "nauc_recall_at_20_max": 0.284661,
+        "nauc_recall_at_20_std": 0.080175,
+        "nauc_recall_at_20_diff1": 0.219343,
+        "nauc_recall_at_100_max": 0.582109,
+        "nauc_recall_at_100_std": 0.364351,
+        "nauc_recall_at_100_diff1": 0.143167,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.205512,
+        "nauc_precision_at_1_std": 0.005008,
+        "nauc_precision_at_1_diff1": 0.506434,
+        "nauc_precision_at_3_max": 0.169385,
+        "nauc_precision_at_3_std": 0.006551,
+        "nauc_precision_at_3_diff1": 0.138929,
+        "nauc_precision_at_5_max": 0.057427,
+        "nauc_precision_at_5_std": -0.028237,
+        "nauc_precision_at_5_diff1": 0.013092,
+        "nauc_precision_at_10_max": -0.051542,
+        "nauc_precision_at_10_std": -0.041762,
+        "nauc_precision_at_10_diff1": -0.106636,
+        "nauc_precision_at_20_max": -0.079031,
+        "nauc_precision_at_20_std": -0.030897,
+        "nauc_precision_at_20_diff1": -0.185437,
+        "nauc_precision_at_100_max": -0.128442,
+        "nauc_precision_at_100_std": -0.017518,
+        "nauc_precision_at_100_diff1": -0.265253,
+        "nauc_precision_at_1000_max": -0.24594,
+        "nauc_precision_at_1000_std": -0.092163,
+        "nauc_precision_at_1000_diff1": -0.306941,
+        "nauc_mrr_at_1_max": 0.205512,
+        "nauc_mrr_at_1_std": 0.005008,
+        "nauc_mrr_at_1_diff1": 0.506434,
+        "nauc_mrr_at_3_max": 0.285366,
+        "nauc_mrr_at_3_std": 0.045588,
+        "nauc_mrr_at_3_diff1": 0.442486,
+        "nauc_mrr_at_5_max": 0.26772,
+        "nauc_mrr_at_5_std": 0.032738,
+        "nauc_mrr_at_5_diff1": 0.435185,
+        "nauc_mrr_at_10_max": 0.270276,
+        "nauc_mrr_at_10_std": 0.043773,
+        "nauc_mrr_at_10_diff1": 0.428683,
+        "nauc_mrr_at_20_max": 0.267442,
+        "nauc_mrr_at_20_std": 0.044471,
+        "nauc_mrr_at_20_diff1": 0.43069,
+        "nauc_mrr_at_100_max": 0.269111,
+        "nauc_mrr_at_100_std": 0.04474,
+        "nauc_mrr_at_100_diff1": 0.432383,
+        "nauc_mrr_at_1000_max": 0.268992,
+        "nauc_mrr_at_1000_std": 0.044503,
+        "nauc_mrr_at_1000_diff1": 0.432747,
+        "hit_rate_at_1": 0.4875,
+        "hit_rate_at_3": 0.73125,
+        "hit_rate_at_5": 0.775,
+        "hit_rate_at_10": 0.8375,
+        "hit_rate_at_20": 0.90625,
+        "hit_rate_at_100": 0.975,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.53306,
+        "hf_subset": "spanish",
+        "languages": [
+          "spa-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.575,
+        "ndcg_at_3": 0.59588,
+        "ndcg_at_5": 0.60173,
+        "ndcg_at_10": 0.64115,
+        "ndcg_at_20": 0.66788,
+        "ndcg_at_100": 0.70724,
+        "ndcg_at_1000": 0.72173,
+        "map_at_1": 0.3735,
+        "map_at_3": 0.48962,
+        "map_at_5": 0.51985,
+        "map_at_10": 0.55407,
+        "map_at_20": 0.57021,
+        "map_at_100": 0.58251,
+        "map_at_1000": 0.584,
+        "recall_at_1": 0.3735,
+        "recall_at_3": 0.55602,
+        "recall_at_5": 0.61334,
+        "recall_at_10": 0.72757,
+        "recall_at_20": 0.79585,
+        "recall_at_100": 0.92896,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.3735,
+        "precision_at_1": 0.575,
+        "precision_at_3": 0.36458,
+        "precision_at_5": 0.26125,
+        "precision_at_10": 0.17188,
+        "precision_at_20": 0.10344,
+        "precision_at_100": 0.02788,
+        "precision_at_1000": 0.00322,
+        "mrr_at_1": 0.575,
+        "mrr_at_3": 0.679167,
+        "mrr_at_5": 0.683229,
+        "mrr_at_10": 0.697321,
+        "mrr_at_20": 0.697712,
+        "mrr_at_100": 0.69879,
+        "mrr_at_1000": 0.698883,
+        "nauc_ndcg_at_1_max": 0.290667,
+        "nauc_ndcg_at_1_std": 0.078818,
+        "nauc_ndcg_at_1_diff1": 0.416186,
+        "nauc_ndcg_at_3_max": 0.220088,
+        "nauc_ndcg_at_3_std": 1.1e-05,
+        "nauc_ndcg_at_3_diff1": 0.29087,
+        "nauc_ndcg_at_5_max": 0.243752,
+        "nauc_ndcg_at_5_std": 0.019939,
+        "nauc_ndcg_at_5_diff1": 0.339771,
+        "nauc_ndcg_at_10_max": 0.225902,
+        "nauc_ndcg_at_10_std": 0.004032,
+        "nauc_ndcg_at_10_diff1": 0.335828,
+        "nauc_ndcg_at_20_max": 0.253728,
+        "nauc_ndcg_at_20_std": 0.031779,
+        "nauc_ndcg_at_20_diff1": 0.31953,
+        "nauc_ndcg_at_100_max": 0.246237,
+        "nauc_ndcg_at_100_std": 0.05336,
+        "nauc_ndcg_at_100_diff1": 0.305349,
+        "nauc_ndcg_at_1000_max": 0.229357,
+        "nauc_ndcg_at_1000_std": 0.03394,
+        "nauc_ndcg_at_1000_diff1": 0.299287,
+        "nauc_map_at_1_max": 0.26473,
+        "nauc_map_at_1_std": 0.086894,
+        "nauc_map_at_1_diff1": 0.455735,
+        "nauc_map_at_3_max": 0.2325,
+        "nauc_map_at_3_std": 0.009006,
+        "nauc_map_at_3_diff1": 0.363104,
+        "nauc_map_at_5_max": 0.243037,
+        "nauc_map_at_5_std": 0.021596,
+        "nauc_map_at_5_diff1": 0.374737,
+        "nauc_map_at_10_max": 0.224413,
+        "nauc_map_at_10_std": -0.001811,
+        "nauc_map_at_10_diff1": 0.351786,
+        "nauc_map_at_20_max": 0.233391,
+        "nauc_map_at_20_std": 0.007225,
+        "nauc_map_at_20_diff1": 0.342977,
+        "nauc_map_at_100_max": 0.22999,
+        "nauc_map_at_100_std": 0.012351,
+        "nauc_map_at_100_diff1": 0.336228,
+        "nauc_map_at_1000_max": 0.228488,
+        "nauc_map_at_1000_std": 0.010888,
+        "nauc_map_at_1000_diff1": 0.335268,
+        "nauc_recall_at_1_max": 0.26473,
+        "nauc_recall_at_1_std": 0.086894,
+        "nauc_recall_at_1_diff1": 0.455735,
+        "nauc_recall_at_3_max": 0.21122,
+        "nauc_recall_at_3_std": -0.011702,
+        "nauc_recall_at_3_diff1": 0.304057,
+        "nauc_recall_at_5_max": 0.229182,
+        "nauc_recall_at_5_std": 0.007978,
+        "nauc_recall_at_5_diff1": 0.327573,
+        "nauc_recall_at_10_max": 0.166485,
+        "nauc_recall_at_10_std": -0.050478,
+        "nauc_recall_at_10_diff1": 0.294388,
+        "nauc_recall_at_20_max": 0.267536,
+        "nauc_recall_at_20_std": 0.039369,
+        "nauc_recall_at_20_diff1": 0.241926,
+        "nauc_recall_at_100_max": 0.381568,
+        "nauc_recall_at_100_std": 0.30225,
+        "nauc_recall_at_100_diff1": 0.201576,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.290667,
+        "nauc_precision_at_1_std": 0.078818,
+        "nauc_precision_at_1_diff1": 0.416186,
+        "nauc_precision_at_3_max": 0.017473,
+        "nauc_precision_at_3_std": -0.08621,
+        "nauc_precision_at_3_diff1": -0.101112,
+        "nauc_precision_at_5_max": -0.002996,
+        "nauc_precision_at_5_std": -0.051951,
+        "nauc_precision_at_5_diff1": -0.116896,
+        "nauc_precision_at_10_max": -0.093555,
+        "nauc_precision_at_10_std": -0.070896,
+        "nauc_precision_at_10_diff1": -0.232959,
+        "nauc_precision_at_20_max": -0.078992,
+        "nauc_precision_at_20_std": -0.023065,
+        "nauc_precision_at_20_diff1": -0.286738,
+        "nauc_precision_at_100_max": -0.167474,
+        "nauc_precision_at_100_std": -0.013655,
+        "nauc_precision_at_100_diff1": -0.360639,
+        "nauc_precision_at_1000_max": -0.234021,
+        "nauc_precision_at_1000_std": -0.086912,
+        "nauc_precision_at_1000_diff1": -0.385799,
+        "nauc_mrr_at_1_max": 0.290667,
+        "nauc_mrr_at_1_std": 0.078818,
+        "nauc_mrr_at_1_diff1": 0.416186,
+        "nauc_mrr_at_3_max": 0.303705,
+        "nauc_mrr_at_3_std": 0.075871,
+        "nauc_mrr_at_3_diff1": 0.363031,
+        "nauc_mrr_at_5_max": 0.295842,
+        "nauc_mrr_at_5_std": 0.072778,
+        "nauc_mrr_at_5_diff1": 0.353578,
+        "nauc_mrr_at_10_max": 0.289295,
+        "nauc_mrr_at_10_std": 0.081976,
+        "nauc_mrr_at_10_diff1": 0.353517,
+        "nauc_mrr_at_20_max": 0.290658,
+        "nauc_mrr_at_20_std": 0.081534,
+        "nauc_mrr_at_20_diff1": 0.353196,
+        "nauc_mrr_at_100_max": 0.290495,
+        "nauc_mrr_at_100_std": 0.08166,
+        "nauc_mrr_at_100_diff1": 0.353965,
+        "nauc_mrr_at_1000_max": 0.2904,
+        "nauc_mrr_at_1000_std": 0.081444,
+        "nauc_mrr_at_1000_diff1": 0.354155,
+        "hit_rate_at_1": 0.575,
+        "hit_rate_at_3": 0.80625,
+        "hit_rate_at_5": 0.825,
+        "hit_rate_at_10": 0.925,
+        "hit_rate_at_20": 0.93125,
+        "hit_rate_at_100": 0.975,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.60173,
+        "hf_subset": "english",
+        "languages": [
+          "eng-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.53125,
+        "ndcg_at_3": 0.56082,
+        "ndcg_at_5": 0.58882,
+        "ndcg_at_10": 0.61377,
+        "ndcg_at_20": 0.64287,
+        "ndcg_at_100": 0.68317,
+        "ndcg_at_1000": 0.69968,
+        "map_at_1": 0.32923,
+        "map_at_3": 0.45801,
+        "map_at_5": 0.50165,
+        "map_at_10": 0.52981,
+        "map_at_20": 0.54513,
+        "map_at_100": 0.55825,
+        "map_at_1000": 0.55984,
+        "recall_at_1": 0.32923,
+        "recall_at_3": 0.53481,
+        "recall_at_5": 0.62664,
+        "recall_at_10": 0.70983,
+        "recall_at_20": 0.78858,
+        "recall_at_100": 0.92352,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.32923,
+        "precision_at_1": 0.53125,
+        "precision_at_3": 0.35417,
+        "precision_at_5": 0.27375,
+        "precision_at_10": 0.16625,
+        "precision_at_20": 0.10094,
+        "precision_at_100": 0.02694,
+        "precision_at_1000": 0.00322,
+        "mrr_at_1": 0.53125,
+        "mrr_at_3": 0.625,
+        "mrr_at_5": 0.641563,
+        "mrr_at_10": 0.649685,
+        "mrr_at_20": 0.652703,
+        "mrr_at_100": 0.654633,
+        "mrr_at_1000": 0.654777,
+        "nauc_ndcg_at_1_max": 0.34238,
+        "nauc_ndcg_at_1_std": 0.215915,
+        "nauc_ndcg_at_1_diff1": 0.436595,
+        "nauc_ndcg_at_3_max": 0.369619,
+        "nauc_ndcg_at_3_std": 0.177092,
+        "nauc_ndcg_at_3_diff1": 0.392022,
+        "nauc_ndcg_at_5_max": 0.38118,
+        "nauc_ndcg_at_5_std": 0.196393,
+        "nauc_ndcg_at_5_diff1": 0.387575,
+        "nauc_ndcg_at_10_max": 0.382781,
+        "nauc_ndcg_at_10_std": 0.194447,
+        "nauc_ndcg_at_10_diff1": 0.375185,
+        "nauc_ndcg_at_20_max": 0.38898,
+        "nauc_ndcg_at_20_std": 0.211039,
+        "nauc_ndcg_at_20_diff1": 0.361705,
+        "nauc_ndcg_at_100_max": 0.383259,
+        "nauc_ndcg_at_100_std": 0.224396,
+        "nauc_ndcg_at_100_diff1": 0.361793,
+        "nauc_ndcg_at_1000_max": 0.364993,
+        "nauc_ndcg_at_1000_std": 0.206137,
+        "nauc_ndcg_at_1000_diff1": 0.363376,
+        "nauc_map_at_1_max": 0.355325,
+        "nauc_map_at_1_std": 0.208765,
+        "nauc_map_at_1_diff1": 0.468592,
+        "nauc_map_at_3_max": 0.354409,
+        "nauc_map_at_3_std": 0.155981,
+        "nauc_map_at_3_diff1": 0.407357,
+        "nauc_map_at_5_max": 0.358865,
+        "nauc_map_at_5_std": 0.172854,
+        "nauc_map_at_5_diff1": 0.388731,
+        "nauc_map_at_10_max": 0.353558,
+        "nauc_map_at_10_std": 0.16798,
+        "nauc_map_at_10_diff1": 0.380564,
+        "nauc_map_at_20_max": 0.354079,
+        "nauc_map_at_20_std": 0.172332,
+        "nauc_map_at_20_diff1": 0.375954,
+        "nauc_map_at_100_max": 0.354358,
+        "nauc_map_at_100_std": 0.178447,
+        "nauc_map_at_100_diff1": 0.375171,
+        "nauc_map_at_1000_max": 0.352781,
+        "nauc_map_at_1000_std": 0.176848,
+        "nauc_map_at_1000_diff1": 0.374621,
+        "nauc_recall_at_1_max": 0.355325,
+        "nauc_recall_at_1_std": 0.208765,
+        "nauc_recall_at_1_diff1": 0.468592,
+        "nauc_recall_at_3_max": 0.35067,
+        "nauc_recall_at_3_std": 0.133879,
+        "nauc_recall_at_3_diff1": 0.367347,
+        "nauc_recall_at_5_max": 0.376877,
+        "nauc_recall_at_5_std": 0.176341,
+        "nauc_recall_at_5_diff1": 0.319817,
+        "nauc_recall_at_10_max": 0.38968,
+        "nauc_recall_at_10_std": 0.178367,
+        "nauc_recall_at_10_diff1": 0.275125,
+        "nauc_recall_at_20_max": 0.44858,
+        "nauc_recall_at_20_std": 0.255958,
+        "nauc_recall_at_20_diff1": 0.215426,
+        "nauc_recall_at_100_max": 0.543911,
+        "nauc_recall_at_100_std": 0.431089,
+        "nauc_recall_at_100_diff1": 0.140774,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.34238,
+        "nauc_precision_at_1_std": 0.215915,
+        "nauc_precision_at_1_diff1": 0.436595,
+        "nauc_precision_at_3_max": 0.172565,
+        "nauc_precision_at_3_std": 0.066499,
+        "nauc_precision_at_3_diff1": 0.083371,
+        "nauc_precision_at_5_max": 0.087904,
+        "nauc_precision_at_5_std": 0.059494,
+        "nauc_precision_at_5_diff1": -0.036246,
+        "nauc_precision_at_10_max": 0.006663,
+        "nauc_precision_at_10_std": 0.007447,
+        "nauc_precision_at_10_diff1": -0.086605,
+        "nauc_precision_at_20_max": -0.061136,
+        "nauc_precision_at_20_std": -0.005546,
+        "nauc_precision_at_20_diff1": -0.151754,
+        "nauc_precision_at_100_max": -0.154963,
+        "nauc_precision_at_100_std": -0.035546,
+        "nauc_precision_at_100_diff1": -0.207164,
+        "nauc_precision_at_1000_max": -0.237678,
+        "nauc_precision_at_1000_std": -0.128565,
+        "nauc_precision_at_1000_diff1": -0.25178,
+        "nauc_mrr_at_1_max": 0.34238,
+        "nauc_mrr_at_1_std": 0.215915,
+        "nauc_mrr_at_1_diff1": 0.436595,
+        "nauc_mrr_at_3_max": 0.400382,
+        "nauc_mrr_at_3_std": 0.243442,
+        "nauc_mrr_at_3_diff1": 0.450355,
+        "nauc_mrr_at_5_max": 0.399578,
+        "nauc_mrr_at_5_std": 0.246704,
+        "nauc_mrr_at_5_diff1": 0.434399,
+        "nauc_mrr_at_10_max": 0.396521,
+        "nauc_mrr_at_10_std": 0.247154,
+        "nauc_mrr_at_10_diff1": 0.432056,
+        "nauc_mrr_at_20_max": 0.394769,
+        "nauc_mrr_at_20_std": 0.245375,
+        "nauc_mrr_at_20_diff1": 0.428727,
+        "nauc_mrr_at_100_max": 0.393445,
+        "nauc_mrr_at_100_std": 0.246623,
+        "nauc_mrr_at_100_diff1": 0.428457,
+        "nauc_mrr_at_1000_max": 0.393307,
+        "nauc_mrr_at_1000_std": 0.246347,
+        "nauc_mrr_at_1000_diff1": 0.428916,
+        "hit_rate_at_1": 0.53125,
+        "hit_rate_at_3": 0.74375,
+        "hit_rate_at_5": 0.8125,
+        "hit_rate_at_10": 0.86875,
+        "hit_rate_at_20": 0.9125,
+        "hit_rate_at_100": 0.975,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.58882,
+        "hf_subset": "german",
+        "languages": [
+          "deu-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 619.2470531463623,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v2/Vidore2ESGReportsHLRetrieval.json

@@ -0,0 +1,167 @@
+{
+  "dataset_revision": "6d467dedb09a75144ede1421747e47cf036857dd",
+  "task_name": "Vidore2ESGReportsHLRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.46154,
+        "ndcg_at_3": 0.56929,
+        "ndcg_at_5": 0.57958,
+        "ndcg_at_10": 0.61065,
+        "ndcg_at_20": 0.64794,
+        "ndcg_at_100": 0.67228,
+        "ndcg_at_1000": 0.68151,
+        "map_at_1": 0.31538,
+        "map_at_3": 0.47739,
+        "map_at_5": 0.50261,
+        "map_at_10": 0.52868,
+        "map_at_20": 0.54413,
+        "map_at_100": 0.5518,
+        "map_at_1000": 0.55251,
+        "recall_at_1": 0.31538,
+        "recall_at_3": 0.6005,
+        "recall_at_5": 0.66251,
+        "recall_at_10": 0.74296,
+        "recall_at_20": 0.85518,
+        "recall_at_100": 0.95478,
+        "recall_at_1000": 0.99825,
+        "accuracy": 0.31538,
+        "precision_at_1": 0.46154,
+        "precision_at_3": 0.35897,
+        "precision_at_5": 0.25,
+        "precision_at_10": 0.15,
+        "precision_at_20": 0.09038,
+        "precision_at_100": 0.02192,
+        "precision_at_1000": 0.00244,
+        "mrr_at_1": 0.461538,
+        "mrr_at_3": 0.605769,
+        "mrr_at_5": 0.619231,
+        "mrr_at_10": 0.622436,
+        "mrr_at_20": 0.629441,
+        "mrr_at_100": 0.631285,
+        "mrr_at_1000": 0.631285,
+        "nauc_ndcg_at_1_max": 0.386479,
+        "nauc_ndcg_at_1_std": 0.174684,
+        "nauc_ndcg_at_1_diff1": 0.621772,
+        "nauc_ndcg_at_3_max": 0.293755,
+        "nauc_ndcg_at_3_std": 0.163032,
+        "nauc_ndcg_at_3_diff1": 0.600922,
+        "nauc_ndcg_at_5_max": 0.307102,
+        "nauc_ndcg_at_5_std": 0.178547,
+        "nauc_ndcg_at_5_diff1": 0.635536,
+        "nauc_ndcg_at_10_max": 0.289123,
+        "nauc_ndcg_at_10_std": 0.184245,
+        "nauc_ndcg_at_10_diff1": 0.630148,
+        "nauc_ndcg_at_20_max": 0.343123,
+        "nauc_ndcg_at_20_std": 0.20904,
+        "nauc_ndcg_at_20_diff1": 0.634857,
+        "nauc_ndcg_at_100_max": 0.329672,
+        "nauc_ndcg_at_100_std": 0.180144,
+        "nauc_ndcg_at_100_diff1": 0.610355,
+        "nauc_ndcg_at_1000_max": 0.317341,
+        "nauc_ndcg_at_1000_std": 0.171277,
+        "nauc_ndcg_at_1000_diff1": 0.624307,
+        "nauc_map_at_1_max": 0.393491,
+        "nauc_map_at_1_std": 0.237503,
+        "nauc_map_at_1_diff1": 0.673986,
+        "nauc_map_at_3_max": 0.343375,
+        "nauc_map_at_3_std": 0.198364,
+        "nauc_map_at_3_diff1": 0.637249,
+        "nauc_map_at_5_max": 0.339958,
+        "nauc_map_at_5_std": 0.190124,
+        "nauc_map_at_5_diff1": 0.643588,
+        "nauc_map_at_10_max": 0.322314,
+        "nauc_map_at_10_std": 0.187276,
+        "nauc_map_at_10_diff1": 0.640049,
+        "nauc_map_at_20_max": 0.342715,
+        "nauc_map_at_20_std": 0.196683,
+        "nauc_map_at_20_diff1": 0.641311,
+        "nauc_map_at_100_max": 0.34154,
+        "nauc_map_at_100_std": 0.191739,
+        "nauc_map_at_100_diff1": 0.633985,
+        "nauc_map_at_1000_max": 0.340739,
+        "nauc_map_at_1000_std": 0.191016,
+        "nauc_map_at_1000_diff1": 0.634609,
+        "nauc_recall_at_1_max": 0.393491,
+        "nauc_recall_at_1_std": 0.237503,
+        "nauc_recall_at_1_diff1": 0.673986,
+        "nauc_recall_at_3_max": 0.249495,
+        "nauc_recall_at_3_std": 0.177109,
+        "nauc_recall_at_3_diff1": 0.556567,
+        "nauc_recall_at_5_max": 0.262712,
+        "nauc_recall_at_5_std": 0.1949,
+        "nauc_recall_at_5_diff1": 0.536168,
+        "nauc_recall_at_10_max": 0.214419,
+        "nauc_recall_at_10_std": 0.213069,
+        "nauc_recall_at_10_diff1": 0.541154,
+        "nauc_recall_at_20_max": 0.49463,
+        "nauc_recall_at_20_std": 0.399456,
+        "nauc_recall_at_20_diff1": 0.604979,
+        "nauc_recall_at_100_max": 0.568229,
+        "nauc_recall_at_100_std": 0.244142,
+        "nauc_recall_at_100_diff1": 0.253519,
+        "nauc_recall_at_1000_max": 0.356901,
+        "nauc_recall_at_1000_std": 0.724179,
+        "nauc_recall_at_1000_diff1": -0.552063,
+        "nauc_precision_at_1_max": 0.386479,
+        "nauc_precision_at_1_std": 0.174684,
+        "nauc_precision_at_1_diff1": 0.621772,
+        "nauc_precision_at_3_max": 0.071121,
+        "nauc_precision_at_3_std": 0.029735,
+        "nauc_precision_at_3_diff1": 0.142969,
+        "nauc_precision_at_5_max": 0.00639,
+        "nauc_precision_at_5_std": -0.033529,
+        "nauc_precision_at_5_diff1": 0.117211,
+        "nauc_precision_at_10_max": -0.090745,
+        "nauc_precision_at_10_std": -0.070469,
+        "nauc_precision_at_10_diff1": 0.021267,
+        "nauc_precision_at_20_max": -0.09043,
+        "nauc_precision_at_20_std": -0.093335,
+        "nauc_precision_at_20_diff1": -0.122806,
+        "nauc_precision_at_100_max": -0.155586,
+        "nauc_precision_at_100_std": -0.169523,
+        "nauc_precision_at_100_diff1": -0.277542,
+        "nauc_precision_at_1000_max": -0.201955,
+        "nauc_precision_at_1000_std": -0.224164,
+        "nauc_precision_at_1000_diff1": -0.223318,
+        "nauc_mrr_at_1_max": 0.386479,
+        "nauc_mrr_at_1_std": 0.174684,
+        "nauc_mrr_at_1_diff1": 0.621772,
+        "nauc_mrr_at_3_max": 0.307622,
+        "nauc_mrr_at_3_std": 0.155734,
+        "nauc_mrr_at_3_diff1": 0.601107,
+        "nauc_mrr_at_5_max": 0.316915,
+        "nauc_mrr_at_5_std": 0.159089,
+        "nauc_mrr_at_5_diff1": 0.606401,
+        "nauc_mrr_at_10_max": 0.322096,
+        "nauc_mrr_at_10_std": 0.167121,
+        "nauc_mrr_at_10_diff1": 0.604113,
+        "nauc_mrr_at_20_max": 0.331052,
+        "nauc_mrr_at_20_std": 0.171367,
+        "nauc_mrr_at_20_diff1": 0.608306,
+        "nauc_mrr_at_100_max": 0.329817,
+        "nauc_mrr_at_100_std": 0.169159,
+        "nauc_mrr_at_100_diff1": 0.607274,
+        "nauc_mrr_at_1000_max": 0.329817,
+        "nauc_mrr_at_1000_std": 0.169159,
+        "nauc_mrr_at_1000_diff1": 0.607274,
+        "hit_rate_at_1": 0.46154,
+        "hit_rate_at_3": 0.76923,
+        "hit_rate_at_5": 0.82692,
+        "hit_rate_at_10": 0.84615,
+        "hit_rate_at_20": 0.94231,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.57958,
+        "hf_subset": "default",
+        "languages": [
+          "eng-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 256.90976452827454,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v2/Vidore2ESGReportsRetrieval.json

@@ -0,0 +1,632 @@
+{
+  "dataset_revision": "0542c0d03da0ec1c8cbc517c8d78e7e95c75d3d3",
+  "task_name": "Vidore2ESGReportsRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.4386,
+        "ndcg_at_3": 0.44163,
+        "ndcg_at_5": 0.47512,
+        "ndcg_at_10": 0.51593,
+        "ndcg_at_20": 0.55781,
+        "ndcg_at_100": 0.60105,
+        "ndcg_at_1000": 0.62451,
+        "map_at_1": 0.22822,
+        "map_at_3": 0.32961,
+        "map_at_5": 0.37464,
+        "map_at_10": 0.40567,
+        "map_at_20": 0.42629,
+        "map_at_100": 0.4448,
+        "map_at_1000": 0.44743,
+        "recall_at_1": 0.22822,
+        "recall_at_3": 0.42193,
+        "recall_at_5": 0.52358,
+        "recall_at_10": 0.64793,
+        "recall_at_20": 0.76222,
+        "recall_at_100": 0.88567,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.22822,
+        "precision_at_1": 0.4386,
+        "precision_at_3": 0.2924,
+        "precision_at_5": 0.2386,
+        "precision_at_10": 0.15614,
+        "precision_at_20": 0.10439,
+        "precision_at_100": 0.03246,
+        "precision_at_1000": 0.00389,
+        "mrr_at_1": 0.438596,
+        "mrr_at_3": 0.54386,
+        "mrr_at_5": 0.559649,
+        "mrr_at_10": 0.573705,
+        "mrr_at_20": 0.577502,
+        "mrr_at_100": 0.577929,
+        "mrr_at_1000": 0.578379,
+        "nauc_ndcg_at_1_max": -0.066259,
+        "nauc_ndcg_at_1_std": -0.086456,
+        "nauc_ndcg_at_1_diff1": 0.224873,
+        "nauc_ndcg_at_3_max": 0.1215,
+        "nauc_ndcg_at_3_std": 0.073934,
+        "nauc_ndcg_at_3_diff1": 0.177754,
+        "nauc_ndcg_at_5_max": 0.045823,
+        "nauc_ndcg_at_5_std": 0.031674,
+        "nauc_ndcg_at_5_diff1": 0.187204,
+        "nauc_ndcg_at_10_max": 0.066093,
+        "nauc_ndcg_at_10_std": 0.068687,
+        "nauc_ndcg_at_10_diff1": 0.21968,
+        "nauc_ndcg_at_20_max": 0.067679,
+        "nauc_ndcg_at_20_std": 0.085368,
+        "nauc_ndcg_at_20_diff1": 0.258996,
+        "nauc_ndcg_at_100_max": -0.036169,
+        "nauc_ndcg_at_100_std": 0.022398,
+        "nauc_ndcg_at_100_diff1": 0.207995,
+        "nauc_ndcg_at_1000_max": -0.056684,
+        "nauc_ndcg_at_1000_std": -0.021098,
+        "nauc_ndcg_at_1000_diff1": 0.173983,
+        "nauc_map_at_1_max": 0.100257,
+        "nauc_map_at_1_std": 0.052702,
+        "nauc_map_at_1_diff1": 0.225592,
+        "nauc_map_at_3_max": 0.199947,
+        "nauc_map_at_3_std": 0.144198,
+        "nauc_map_at_3_diff1": 0.200985,
+        "nauc_map_at_5_max": 0.156616,
+        "nauc_map_at_5_std": 0.118026,
+        "nauc_map_at_5_diff1": 0.217445,
+        "nauc_map_at_10_max": 0.149586,
+        "nauc_map_at_10_std": 0.113076,
+        "nauc_map_at_10_diff1": 0.24028,
+        "nauc_map_at_20_max": 0.144287,
+        "nauc_map_at_20_std": 0.113657,
+        "nauc_map_at_20_diff1": 0.252157,
+        "nauc_map_at_100_max": 0.105405,
+        "nauc_map_at_100_std": 0.091831,
+        "nauc_map_at_100_diff1": 0.233027,
+        "nauc_map_at_1000_max": 0.1008,
+        "nauc_map_at_1000_std": 0.08618,
+        "nauc_map_at_1000_diff1": 0.228316,
+        "nauc_recall_at_1_max": 0.100257,
+        "nauc_recall_at_1_std": 0.052702,
+        "nauc_recall_at_1_diff1": 0.225592,
+        "nauc_recall_at_3_max": 0.188718,
+        "nauc_recall_at_3_std": 0.139908,
+        "nauc_recall_at_3_diff1": 0.058958,
+        "nauc_recall_at_5_max": 0.099476,
+        "nauc_recall_at_5_std": 0.115199,
+        "nauc_recall_at_5_diff1": 0.089453,
+        "nauc_recall_at_10_max": 0.128362,
+        "nauc_recall_at_10_std": 0.182031,
+        "nauc_recall_at_10_diff1": 0.16423,
+        "nauc_recall_at_20_max": 0.213845,
+        "nauc_recall_at_20_std": 0.334624,
+        "nauc_recall_at_20_diff1": 0.346788,
+        "nauc_recall_at_100_max": -0.191916,
+        "nauc_recall_at_100_std": 0.207917,
+        "nauc_recall_at_100_diff1": 0.309092,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": -0.066259,
+        "nauc_precision_at_1_std": -0.086456,
+        "nauc_precision_at_1_diff1": 0.224873,
+        "nauc_precision_at_3_max": 0.023213,
+        "nauc_precision_at_3_std": 0.018459,
+        "nauc_precision_at_3_diff1": 0.14392,
+        "nauc_precision_at_5_max": -0.122739,
+        "nauc_precision_at_5_std": -0.108101,
+        "nauc_precision_at_5_diff1": 0.097857,
+        "nauc_precision_at_10_max": -0.189179,
+        "nauc_precision_at_10_std": -0.147917,
+        "nauc_precision_at_10_diff1": 0.06157,
+        "nauc_precision_at_20_max": -0.240551,
+        "nauc_precision_at_20_std": -0.162631,
+        "nauc_precision_at_20_diff1": 0.008026,
+        "nauc_precision_at_100_max": -0.370776,
+        "nauc_precision_at_100_std": -0.202739,
+        "nauc_precision_at_100_diff1": -0.206897,
+        "nauc_precision_at_1000_max": -0.419834,
+        "nauc_precision_at_1000_std": -0.294852,
+        "nauc_precision_at_1000_diff1": -0.302846,
+        "nauc_mrr_at_1_max": -0.066259,
+        "nauc_mrr_at_1_std": -0.086456,
+        "nauc_mrr_at_1_diff1": 0.224873,
+        "nauc_mrr_at_3_max": -0.109643,
+        "nauc_mrr_at_3_std": -0.115403,
+        "nauc_mrr_at_3_diff1": 0.201307,
+        "nauc_mrr_at_5_max": -0.116904,
+        "nauc_mrr_at_5_std": -0.104831,
+        "nauc_mrr_at_5_diff1": 0.193419,
+        "nauc_mrr_at_10_max": -0.115448,
+        "nauc_mrr_at_10_std": -0.09919,
+        "nauc_mrr_at_10_diff1": 0.20892,
+        "nauc_mrr_at_20_max": -0.112575,
+        "nauc_mrr_at_20_std": -0.09565,
+        "nauc_mrr_at_20_diff1": 0.217638,
+        "nauc_mrr_at_100_max": -0.114187,
+        "nauc_mrr_at_100_std": -0.097237,
+        "nauc_mrr_at_100_diff1": 0.216505,
+        "nauc_mrr_at_1000_max": -0.113439,
+        "nauc_mrr_at_1000_std": -0.097434,
+        "nauc_mrr_at_1000_diff1": 0.216739,
+        "hit_rate_at_1": 0.4386,
+        "hit_rate_at_3": 0.68421,
+        "hit_rate_at_5": 0.75439,
+        "hit_rate_at_10": 0.85965,
+        "hit_rate_at_20": 0.91228,
+        "hit_rate_at_100": 0.92982,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.47512,
+        "hf_subset": "french",
+        "languages": [
+          "fra-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.31579,
+        "ndcg_at_3": 0.37311,
+        "ndcg_at_5": 0.41373,
+        "ndcg_at_10": 0.46303,
+        "ndcg_at_20": 0.50053,
+        "ndcg_at_100": 0.54812,
+        "ndcg_at_1000": 0.57071,
+        "map_at_1": 0.13864,
+        "map_at_3": 0.26822,
+        "map_at_5": 0.30287,
+        "map_at_10": 0.34104,
+        "map_at_20": 0.35943,
+        "map_at_100": 0.37621,
+        "map_at_1000": 0.37901,
+        "recall_at_1": 0.13864,
+        "recall_at_3": 0.39785,
+        "recall_at_5": 0.4953,
+        "recall_at_10": 0.6392,
+        "recall_at_20": 0.74467,
+        "recall_at_100": 0.89958,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.13864,
+        "precision_at_1": 0.31579,
+        "precision_at_3": 0.25731,
+        "precision_at_5": 0.22105,
+        "precision_at_10": 0.14737,
+        "precision_at_20": 0.09912,
+        "precision_at_100": 0.03158,
+        "precision_at_1000": 0.00389,
+        "mrr_at_1": 0.315789,
+        "mrr_at_3": 0.453216,
+        "mrr_at_5": 0.482164,
+        "mrr_at_10": 0.494048,
+        "mrr_at_20": 0.497502,
+        "mrr_at_100": 0.49907,
+        "mrr_at_1000": 0.499241,
+        "nauc_ndcg_at_1_max": 0.018802,
+        "nauc_ndcg_at_1_std": 0.109836,
+        "nauc_ndcg_at_1_diff1": 0.217919,
+        "nauc_ndcg_at_3_max": 0.174344,
+        "nauc_ndcg_at_3_std": 0.164882,
+        "nauc_ndcg_at_3_diff1": 0.213403,
+        "nauc_ndcg_at_5_max": 0.138046,
+        "nauc_ndcg_at_5_std": 0.145098,
+        "nauc_ndcg_at_5_diff1": 0.177552,
+        "nauc_ndcg_at_10_max": 0.171183,
+        "nauc_ndcg_at_10_std": 0.13708,
+        "nauc_ndcg_at_10_diff1": 0.201283,
+        "nauc_ndcg_at_20_max": 0.203789,
+        "nauc_ndcg_at_20_std": 0.182621,
+        "nauc_ndcg_at_20_diff1": 0.222153,
+        "nauc_ndcg_at_100_max": 0.12772,
+        "nauc_ndcg_at_100_std": 0.154021,
+        "nauc_ndcg_at_100_diff1": 0.1973,
+        "nauc_ndcg_at_1000_max": 0.065628,
+        "nauc_ndcg_at_1000_std": 0.100504,
+        "nauc_ndcg_at_1000_diff1": 0.194764,
+        "nauc_map_at_1_max": 0.128235,
+        "nauc_map_at_1_std": 0.145415,
+        "nauc_map_at_1_diff1": 0.277362,
+        "nauc_map_at_3_max": 0.233324,
+        "nauc_map_at_3_std": 0.203862,
+        "nauc_map_at_3_diff1": 0.214033,
+        "nauc_map_at_5_max": 0.230185,
+        "nauc_map_at_5_std": 0.223225,
+        "nauc_map_at_5_diff1": 0.210089,
+        "nauc_map_at_10_max": 0.223785,
+        "nauc_map_at_10_std": 0.196102,
+        "nauc_map_at_10_diff1": 0.223407,
+        "nauc_map_at_20_max": 0.222163,
+        "nauc_map_at_20_std": 0.199926,
+        "nauc_map_at_20_diff1": 0.243041,
+        "nauc_map_at_100_max": 0.19396,
+        "nauc_map_at_100_std": 0.193531,
+        "nauc_map_at_100_diff1": 0.234959,
+        "nauc_map_at_1000_max": 0.186348,
+        "nauc_map_at_1000_std": 0.186918,
+        "nauc_map_at_1000_diff1": 0.232298,
+        "nauc_recall_at_1_max": 0.128235,
+        "nauc_recall_at_1_std": 0.145415,
+        "nauc_recall_at_1_diff1": 0.277362,
+        "nauc_recall_at_3_max": 0.195132,
+        "nauc_recall_at_3_std": 0.121206,
+        "nauc_recall_at_3_diff1": 0.101027,
+        "nauc_recall_at_5_max": 0.181882,
+        "nauc_recall_at_5_std": 0.148126,
+        "nauc_recall_at_5_diff1": 0.083292,
+        "nauc_recall_at_10_max": 0.254459,
+        "nauc_recall_at_10_std": 0.127313,
+        "nauc_recall_at_10_diff1": 0.133402,
+        "nauc_recall_at_20_max": 0.481679,
+        "nauc_recall_at_20_std": 0.354109,
+        "nauc_recall_at_20_diff1": 0.177704,
+        "nauc_recall_at_100_max": 0.494429,
+        "nauc_recall_at_100_std": 0.419538,
+        "nauc_recall_at_100_diff1": 0.04151,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.018802,
+        "nauc_precision_at_1_std": 0.109836,
+        "nauc_precision_at_1_diff1": 0.217919,
+        "nauc_precision_at_3_max": 0.145169,
+        "nauc_precision_at_3_std": 0.169677,
+        "nauc_precision_at_3_diff1": 0.232167,
+        "nauc_precision_at_5_max": -0.012427,
+        "nauc_precision_at_5_std": 0.043944,
+        "nauc_precision_at_5_diff1": 0.106811,
+        "nauc_precision_at_10_max": -0.085271,
+        "nauc_precision_at_10_std": -0.076958,
+        "nauc_precision_at_10_diff1": 0.123872,
+        "nauc_precision_at_20_max": -0.161969,
+        "nauc_precision_at_20_std": -0.105842,
+        "nauc_precision_at_20_diff1": 0.081277,
+        "nauc_precision_at_100_max": -0.332879,
+        "nauc_precision_at_100_std": -0.145499,
+        "nauc_precision_at_100_diff1": -0.117741,
+        "nauc_precision_at_1000_max": -0.413872,
+        "nauc_precision_at_1000_std": -0.256906,
+        "nauc_precision_at_1000_diff1": -0.165366,
+        "nauc_mrr_at_1_max": 0.018802,
+        "nauc_mrr_at_1_std": 0.109836,
+        "nauc_mrr_at_1_diff1": 0.217919,
+        "nauc_mrr_at_3_max": 0.022599,
+        "nauc_mrr_at_3_std": 0.081568,
+        "nauc_mrr_at_3_diff1": 0.199339,
+        "nauc_mrr_at_5_max": 0.009084,
+        "nauc_mrr_at_5_std": 0.069558,
+        "nauc_mrr_at_5_diff1": 0.194943,
+        "nauc_mrr_at_10_max": 0.016122,
+        "nauc_mrr_at_10_std": 0.070579,
+        "nauc_mrr_at_10_diff1": 0.198405,
+        "nauc_mrr_at_20_max": 0.024475,
+        "nauc_mrr_at_20_std": 0.084137,
+        "nauc_mrr_at_20_diff1": 0.197062,
+        "nauc_mrr_at_100_max": 0.022254,
+        "nauc_mrr_at_100_std": 0.083293,
+        "nauc_mrr_at_100_diff1": 0.197295,
+        "nauc_mrr_at_1000_max": 0.022002,
+        "nauc_mrr_at_1000_std": 0.082883,
+        "nauc_mrr_at_1000_diff1": 0.197503,
+        "hit_rate_at_1": 0.31579,
+        "hit_rate_at_3": 0.63158,
+        "hit_rate_at_5": 0.75439,
+        "hit_rate_at_10": 0.84211,
+        "hit_rate_at_20": 0.89474,
+        "hit_rate_at_100": 0.96491,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.41373,
+        "hf_subset": "spanish",
+        "languages": [
+          "spa-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.49123,
+        "ndcg_at_3": 0.5078,
+        "ndcg_at_5": 0.54854,
+        "ndcg_at_10": 0.58767,
+        "ndcg_at_20": 0.62618,
+        "ndcg_at_100": 0.66926,
+        "ndcg_at_1000": 0.67818,
+        "map_at_1": 0.25443,
+        "map_at_3": 0.37971,
+        "map_at_5": 0.42865,
+        "map_at_10": 0.47082,
+        "map_at_20": 0.49309,
+        "map_at_100": 0.51171,
+        "map_at_1000": 0.51341,
+        "recall_at_1": 0.25443,
+        "recall_at_3": 0.48386,
+        "recall_at_5": 0.60178,
+        "recall_at_10": 0.71019,
+        "recall_at_20": 0.82838,
+        "recall_at_100": 0.95771,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.25443,
+        "precision_at_1": 0.49123,
+        "precision_at_3": 0.32164,
+        "precision_at_5": 0.26667,
+        "precision_at_10": 0.18246,
+        "precision_at_20": 0.11754,
+        "precision_at_100": 0.03614,
+        "precision_at_1000": 0.00389,
+        "mrr_at_1": 0.491228,
+        "mrr_at_3": 0.614035,
+        "mrr_at_5": 0.630702,
+        "mrr_at_10": 0.638081,
+        "mrr_at_20": 0.644608,
+        "mrr_at_100": 0.644862,
+        "mrr_at_1000": 0.644899,
+        "nauc_ndcg_at_1_max": -0.150387,
+        "nauc_ndcg_at_1_std": -0.041547,
+        "nauc_ndcg_at_1_diff1": 0.258333,
+        "nauc_ndcg_at_3_max": -0.001868,
+        "nauc_ndcg_at_3_std": -0.016324,
+        "nauc_ndcg_at_3_diff1": 0.309404,
+        "nauc_ndcg_at_5_max": -0.025775,
+        "nauc_ndcg_at_5_std": -0.033198,
+        "nauc_ndcg_at_5_diff1": 0.260159,
+        "nauc_ndcg_at_10_max": 0.005128,
+        "nauc_ndcg_at_10_std": 0.004375,
+        "nauc_ndcg_at_10_diff1": 0.241425,
+        "nauc_ndcg_at_20_max": -0.024638,
+        "nauc_ndcg_at_20_std": -0.025278,
+        "nauc_ndcg_at_20_diff1": 0.231247,
+        "nauc_ndcg_at_100_max": -0.124508,
+        "nauc_ndcg_at_100_std": -0.111809,
+        "nauc_ndcg_at_100_diff1": 0.155935,
+        "nauc_ndcg_at_1000_max": -0.14263,
+        "nauc_ndcg_at_1000_std": -0.126853,
+        "nauc_ndcg_at_1000_diff1": 0.165558,
+        "nauc_map_at_1_max": 0.025421,
+        "nauc_map_at_1_std": 0.024474,
+        "nauc_map_at_1_diff1": 0.396685,
+        "nauc_map_at_3_max": 0.067661,
+        "nauc_map_at_3_std": 0.031582,
+        "nauc_map_at_3_diff1": 0.38572,
+        "nauc_map_at_5_max": 0.05787,
+        "nauc_map_at_5_std": 0.023121,
+        "nauc_map_at_5_diff1": 0.339838,
+        "nauc_map_at_10_max": 0.044353,
+        "nauc_map_at_10_std": 0.016903,
+        "nauc_map_at_10_diff1": 0.300897,
+        "nauc_map_at_20_max": 0.021708,
+        "nauc_map_at_20_std": -0.006304,
+        "nauc_map_at_20_diff1": 0.284708,
+        "nauc_map_at_100_max": -0.02077,
+        "nauc_map_at_100_std": -0.040301,
+        "nauc_map_at_100_diff1": 0.243794,
+        "nauc_map_at_1000_max": -0.026233,
+        "nauc_map_at_1000_std": -0.045451,
+        "nauc_map_at_1000_diff1": 0.242853,
+        "nauc_recall_at_1_max": 0.025421,
+        "nauc_recall_at_1_std": 0.024474,
+        "nauc_recall_at_1_diff1": 0.396685,
+        "nauc_recall_at_3_max": 0.155063,
+        "nauc_recall_at_3_std": 0.079959,
+        "nauc_recall_at_3_diff1": 0.354751,
+        "nauc_recall_at_5_max": 0.163462,
+        "nauc_recall_at_5_std": 0.108936,
+        "nauc_recall_at_5_diff1": 0.272356,
+        "nauc_recall_at_10_max": 0.21098,
+        "nauc_recall_at_10_std": 0.169921,
+        "nauc_recall_at_10_diff1": 0.209733,
+        "nauc_recall_at_20_max": 0.177153,
+        "nauc_recall_at_20_std": 0.161218,
+        "nauc_recall_at_20_diff1": 0.148618,
+        "nauc_recall_at_100_max": -0.1329,
+        "nauc_recall_at_100_std": -0.186861,
+        "nauc_recall_at_100_diff1": -0.335227,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": -0.150387,
+        "nauc_precision_at_1_std": -0.041547,
+        "nauc_precision_at_1_diff1": 0.258333,
+        "nauc_precision_at_3_max": -0.150978,
+        "nauc_precision_at_3_std": -0.059934,
+        "nauc_precision_at_3_diff1": 0.027519,
+        "nauc_precision_at_5_max": -0.17566,
+        "nauc_precision_at_5_std": -0.117178,
+        "nauc_precision_at_5_diff1": -0.155007,
+        "nauc_precision_at_10_max": -0.205189,
+        "nauc_precision_at_10_std": -0.141143,
+        "nauc_precision_at_10_diff1": -0.286676,
+        "nauc_precision_at_20_max": -0.278618,
+        "nauc_precision_at_20_std": -0.210341,
+        "nauc_precision_at_20_diff1": -0.344871,
+        "nauc_precision_at_100_max": -0.383895,
+        "nauc_precision_at_100_std": -0.292604,
+        "nauc_precision_at_100_diff1": -0.42631,
+        "nauc_precision_at_1000_max": -0.399722,
+        "nauc_precision_at_1000_std": -0.314346,
+        "nauc_precision_at_1000_diff1": -0.404986,
+        "nauc_mrr_at_1_max": -0.150387,
+        "nauc_mrr_at_1_std": -0.041547,
+        "nauc_mrr_at_1_diff1": 0.258333,
+        "nauc_mrr_at_3_max": -0.147916,
+        "nauc_mrr_at_3_std": -0.081218,
+        "nauc_mrr_at_3_diff1": 0.257824,
+        "nauc_mrr_at_5_max": -0.149465,
+        "nauc_mrr_at_5_std": -0.076334,
+        "nauc_mrr_at_5_diff1": 0.248298,
+        "nauc_mrr_at_10_max": -0.151107,
+        "nauc_mrr_at_10_std": -0.076817,
+        "nauc_mrr_at_10_diff1": 0.232526,
+        "nauc_mrr_at_20_max": -0.164972,
+        "nauc_mrr_at_20_std": -0.088067,
+        "nauc_mrr_at_20_diff1": 0.230219,
+        "nauc_mrr_at_100_max": -0.16401,
+        "nauc_mrr_at_100_std": -0.087993,
+        "nauc_mrr_at_100_diff1": 0.23156,
+        "nauc_mrr_at_1000_max": -0.163872,
+        "nauc_mrr_at_1000_std": -0.087845,
+        "nauc_mrr_at_1000_diff1": 0.231669,
+        "hit_rate_at_1": 0.49123,
+        "hit_rate_at_3": 0.75439,
+        "hit_rate_at_5": 0.82456,
+        "hit_rate_at_10": 0.87719,
+        "hit_rate_at_20": 0.96491,
+        "hit_rate_at_100": 0.98246,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.54854,
+        "hf_subset": "english",
+        "languages": [
+          "eng-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.50877,
+        "ndcg_at_3": 0.5005,
+        "ndcg_at_5": 0.52348,
+        "ndcg_at_10": 0.56747,
+        "ndcg_at_20": 0.60467,
+        "ndcg_at_100": 0.64848,
+        "ndcg_at_1000": 0.66134,
+        "map_at_1": 0.24639,
+        "map_at_3": 0.36509,
+        "map_at_5": 0.40754,
+        "map_at_10": 0.45051,
+        "map_at_20": 0.47149,
+        "map_at_100": 0.48942,
+        "map_at_1000": 0.49164,
+        "recall_at_1": 0.24639,
+        "recall_at_3": 0.45096,
+        "recall_at_5": 0.53507,
+        "recall_at_10": 0.67554,
+        "recall_at_20": 0.80418,
+        "recall_at_100": 0.93778,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.24639,
+        "precision_at_1": 0.50877,
+        "precision_at_3": 0.34503,
+        "precision_at_5": 0.27368,
+        "precision_at_10": 0.18772,
+        "precision_at_20": 0.11579,
+        "precision_at_100": 0.03561,
+        "precision_at_1000": 0.00389,
+        "mrr_at_1": 0.508772,
+        "mrr_at_3": 0.616959,
+        "mrr_at_5": 0.625731,
+        "mrr_at_10": 0.636884,
+        "mrr_at_20": 0.642167,
+        "mrr_at_100": 0.642669,
+        "mrr_at_1000": 0.642928,
+        "nauc_ndcg_at_1_max": 0.02987,
+        "nauc_ndcg_at_1_std": 0.090695,
+        "nauc_ndcg_at_1_diff1": 0.491792,
+        "nauc_ndcg_at_3_max": 0.113946,
+        "nauc_ndcg_at_3_std": 0.149304,
+        "nauc_ndcg_at_3_diff1": 0.320655,
+        "nauc_ndcg_at_5_max": 0.026204,
+        "nauc_ndcg_at_5_std": 0.04638,
+        "nauc_ndcg_at_5_diff1": 0.277901,
+        "nauc_ndcg_at_10_max": 0.138148,
+        "nauc_ndcg_at_10_std": 0.155047,
+        "nauc_ndcg_at_10_diff1": 0.27478,
+        "nauc_ndcg_at_20_max": 0.184136,
+        "nauc_ndcg_at_20_std": 0.189433,
+        "nauc_ndcg_at_20_diff1": 0.275426,
+        "nauc_ndcg_at_100_max": 0.093097,
+        "nauc_ndcg_at_100_std": 0.131474,
+        "nauc_ndcg_at_100_diff1": 0.270887,
+        "nauc_ndcg_at_1000_max": 0.071164,
+        "nauc_ndcg_at_1000_std": 0.111915,
+        "nauc_ndcg_at_1000_diff1": 0.281444,
+        "nauc_map_at_1_max": 0.100046,
+        "nauc_map_at_1_std": 0.111071,
+        "nauc_map_at_1_diff1": 0.332305,
+        "nauc_map_at_3_max": 0.131167,
+        "nauc_map_at_3_std": 0.13366,
+        "nauc_map_at_3_diff1": 0.334303,
+        "nauc_map_at_5_max": 0.084234,
+        "nauc_map_at_5_std": 0.093439,
+        "nauc_map_at_5_diff1": 0.2915,
+        "nauc_map_at_10_max": 0.158417,
+        "nauc_map_at_10_std": 0.162085,
+        "nauc_map_at_10_diff1": 0.283719,
+        "nauc_map_at_20_max": 0.178096,
+        "nauc_map_at_20_std": 0.175264,
+        "nauc_map_at_20_diff1": 0.275437,
+        "nauc_map_at_100_max": 0.145635,
+        "nauc_map_at_100_std": 0.159494,
+        "nauc_map_at_100_diff1": 0.258094,
+        "nauc_map_at_1000_max": 0.140545,
+        "nauc_map_at_1000_std": 0.15545,
+        "nauc_map_at_1000_diff1": 0.258527,
+        "nauc_recall_at_1_max": 0.100046,
+        "nauc_recall_at_1_std": 0.111071,
+        "nauc_recall_at_1_diff1": 0.332305,
+        "nauc_recall_at_3_max": 0.124742,
+        "nauc_recall_at_3_std": 0.086259,
+        "nauc_recall_at_3_diff1": 0.30133,
+        "nauc_recall_at_5_max": 0.009267,
+        "nauc_recall_at_5_std": -0.030109,
+        "nauc_recall_at_5_diff1": 0.208731,
+        "nauc_recall_at_10_max": 0.203069,
+        "nauc_recall_at_10_std": 0.159948,
+        "nauc_recall_at_10_diff1": 0.142373,
+        "nauc_recall_at_20_max": 0.422393,
+        "nauc_recall_at_20_std": 0.335149,
+        "nauc_recall_at_20_diff1": 0.024702,
+        "nauc_recall_at_100_max": 0.229213,
+        "nauc_recall_at_100_std": 0.267178,
+        "nauc_recall_at_100_diff1": -0.063036,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.02987,
+        "nauc_precision_at_1_std": 0.090695,
+        "nauc_precision_at_1_diff1": 0.491792,
+        "nauc_precision_at_3_max": 0.016228,
+        "nauc_precision_at_3_std": 0.119427,
+        "nauc_precision_at_3_diff1": 0.196066,
+        "nauc_precision_at_5_max": -0.087109,
+        "nauc_precision_at_5_std": -0.017936,
+        "nauc_precision_at_5_diff1": 0.021664,
+        "nauc_precision_at_10_max": 0.040385,
+        "nauc_precision_at_10_std": 0.100045,
+        "nauc_precision_at_10_diff1": -0.097748,
+        "nauc_precision_at_20_max": 0.04986,
+        "nauc_precision_at_20_std": 0.116196,
+        "nauc_precision_at_20_diff1": -0.158343,
+        "nauc_precision_at_100_max": -0.23156,
+        "nauc_precision_at_100_std": -0.090908,
+        "nauc_precision_at_100_diff1": -0.211553,
+        "nauc_precision_at_1000_max": -0.270222,
+        "nauc_precision_at_1000_std": -0.136927,
+        "nauc_precision_at_1000_diff1": -0.198441,
+        "nauc_mrr_at_1_max": 0.02987,
+        "nauc_mrr_at_1_std": 0.090695,
+        "nauc_mrr_at_1_diff1": 0.491792,
+        "nauc_mrr_at_3_max": 0.050136,
+        "nauc_mrr_at_3_std": 0.103656,
+        "nauc_mrr_at_3_diff1": 0.473627,
+        "nauc_mrr_at_5_max": 0.030469,
+        "nauc_mrr_at_5_std": 0.07959,
+        "nauc_mrr_at_5_diff1": 0.459755,
+        "nauc_mrr_at_10_max": 0.026013,
+        "nauc_mrr_at_10_std": 0.077938,
+        "nauc_mrr_at_10_diff1": 0.458994,
+        "nauc_mrr_at_20_max": 0.03501,
+        "nauc_mrr_at_20_std": 0.087346,
+        "nauc_mrr_at_20_diff1": 0.451141,
+        "nauc_mrr_at_100_max": 0.034842,
+        "nauc_mrr_at_100_std": 0.086847,
+        "nauc_mrr_at_100_diff1": 0.453004,
+        "nauc_mrr_at_1000_max": 0.034926,
+        "nauc_mrr_at_1000_std": 0.086878,
+        "nauc_mrr_at_1000_diff1": 0.453719,
+        "hit_rate_at_1": 0.50877,
+        "hit_rate_at_3": 0.75439,
+        "hit_rate_at_5": 0.78947,
+        "hit_rate_at_10": 0.87719,
+        "hit_rate_at_20": 0.94737,
+        "hit_rate_at_100": 0.96491,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.52348,
+        "hf_subset": "german",
+        "languages": [
+          "deu-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 1028.7974960803986,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v2/Vidore2EconomicsReportsRetrieval.json

@@ -0,0 +1,632 @@
+{
+  "dataset_revision": "b3e3a04b07fbbaffe79be49dabf92f691fbca252",
+  "task_name": "Vidore2EconomicsReportsRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.43103,
+        "ndcg_at_3": 0.41324,
+        "ndcg_at_5": 0.39757,
+        "ndcg_at_10": 0.42457,
+        "ndcg_at_20": 0.47133,
+        "ndcg_at_100": 0.58864,
+        "ndcg_at_1000": 0.63282,
+        "map_at_1": 0.03998,
+        "map_at_3": 0.10091,
+        "map_at_5": 0.13555,
+        "map_at_10": 0.20016,
+        "map_at_20": 0.25807,
+        "map_at_100": 0.34287,
+        "map_at_1000": 0.36015,
+        "recall_at_1": 0.03998,
+        "recall_at_3": 0.12805,
+        "recall_at_5": 0.18201,
+        "recall_at_10": 0.3651,
+        "recall_at_20": 0.52446,
+        "recall_at_100": 0.87638,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.03998,
+        "precision_at_1": 0.43103,
+        "precision_at_3": 0.40805,
+        "precision_at_5": 0.37931,
+        "precision_at_10": 0.34655,
+        "precision_at_20": 0.28966,
+        "precision_at_100": 0.1219,
+        "precision_at_1000": 0.01564,
+        "mrr_at_1": 0.431034,
+        "mrr_at_3": 0.560345,
+        "mrr_at_5": 0.576724,
+        "mrr_at_10": 0.595108,
+        "mrr_at_20": 0.597622,
+        "mrr_at_100": 0.598407,
+        "mrr_at_1000": 0.598407,
+        "nauc_ndcg_at_1_max": 0.319663,
+        "nauc_ndcg_at_1_std": 0.261683,
+        "nauc_ndcg_at_1_diff1": -0.085563,
+        "nauc_ndcg_at_3_max": 0.351021,
+        "nauc_ndcg_at_3_std": 0.246443,
+        "nauc_ndcg_at_3_diff1": -0.128928,
+        "nauc_ndcg_at_5_max": 0.298932,
+        "nauc_ndcg_at_5_std": 0.235462,
+        "nauc_ndcg_at_5_diff1": -0.151438,
+        "nauc_ndcg_at_10_max": 0.334607,
+        "nauc_ndcg_at_10_std": 0.275453,
+        "nauc_ndcg_at_10_diff1": -0.142121,
+        "nauc_ndcg_at_20_max": 0.384842,
+        "nauc_ndcg_at_20_std": 0.305053,
+        "nauc_ndcg_at_20_diff1": -0.135432,
+        "nauc_ndcg_at_100_max": 0.401896,
+        "nauc_ndcg_at_100_std": 0.348231,
+        "nauc_ndcg_at_100_diff1": -0.155392,
+        "nauc_ndcg_at_1000_max": 0.301647,
+        "nauc_ndcg_at_1000_std": 0.257805,
+        "nauc_ndcg_at_1000_diff1": -0.213675,
+        "nauc_map_at_1_max": 0.421761,
+        "nauc_map_at_1_std": 0.344401,
+        "nauc_map_at_1_diff1": -0.045281,
+        "nauc_map_at_3_max": 0.461411,
+        "nauc_map_at_3_std": 0.344166,
+        "nauc_map_at_3_diff1": -0.100543,
+        "nauc_map_at_5_max": 0.400899,
+        "nauc_map_at_5_std": 0.315001,
+        "nauc_map_at_5_diff1": -0.087373,
+        "nauc_map_at_10_max": 0.434727,
+        "nauc_map_at_10_std": 0.337997,
+        "nauc_map_at_10_diff1": -0.119514,
+        "nauc_map_at_20_max": 0.445064,
+        "nauc_map_at_20_std": 0.347774,
+        "nauc_map_at_20_diff1": -0.118446,
+        "nauc_map_at_100_max": 0.374506,
+        "nauc_map_at_100_std": 0.307547,
+        "nauc_map_at_100_diff1": -0.164635,
+        "nauc_map_at_1000_max": 0.309474,
+        "nauc_map_at_1000_std": 0.251261,
+        "nauc_map_at_1000_diff1": -0.186147,
+        "nauc_recall_at_1_max": 0.421761,
+        "nauc_recall_at_1_std": 0.344401,
+        "nauc_recall_at_1_diff1": -0.045281,
+        "nauc_recall_at_3_max": 0.41357,
+        "nauc_recall_at_3_std": 0.325056,
+        "nauc_recall_at_3_diff1": -0.025374,
+        "nauc_recall_at_5_max": 0.355743,
+        "nauc_recall_at_5_std": 0.308993,
+        "nauc_recall_at_5_diff1": -0.024335,
+        "nauc_recall_at_10_max": 0.293213,
+        "nauc_recall_at_10_std": 0.20365,
+        "nauc_recall_at_10_diff1": 0.034148,
+        "nauc_recall_at_20_max": 0.346397,
+        "nauc_recall_at_20_std": 0.231735,
+        "nauc_recall_at_20_diff1": 0.110599,
+        "nauc_recall_at_100_max": 0.496564,
+        "nauc_recall_at_100_std": 0.435631,
+        "nauc_recall_at_100_diff1": 0.186257,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.319663,
+        "nauc_precision_at_1_std": 0.261683,
+        "nauc_precision_at_1_diff1": -0.085563,
+        "nauc_precision_at_3_max": 0.328458,
+        "nauc_precision_at_3_std": 0.217298,
+        "nauc_precision_at_3_diff1": -0.139757,
+        "nauc_precision_at_5_max": 0.212039,
+        "nauc_precision_at_5_std": 0.167214,
+        "nauc_precision_at_5_diff1": -0.154836,
+        "nauc_precision_at_10_max": 0.20224,
+        "nauc_precision_at_10_std": 0.194756,
+        "nauc_precision_at_10_diff1": -0.17152,
+        "nauc_precision_at_20_max": 0.059895,
+        "nauc_precision_at_20_std": 0.062981,
+        "nauc_precision_at_20_diff1": -0.16877,
+        "nauc_precision_at_100_max": -0.196521,
+        "nauc_precision_at_100_std": -0.152136,
+        "nauc_precision_at_100_diff1": -0.206567,
+        "nauc_precision_at_1000_max": -0.267418,
+        "nauc_precision_at_1000_std": -0.222633,
+        "nauc_precision_at_1000_diff1": -0.22198,
+        "nauc_mrr_at_1_max": 0.319663,
+        "nauc_mrr_at_1_std": 0.261683,
+        "nauc_mrr_at_1_diff1": -0.085563,
+        "nauc_mrr_at_3_max": 0.329452,
+        "nauc_mrr_at_3_std": 0.272285,
+        "nauc_mrr_at_3_diff1": -0.035285,
+        "nauc_mrr_at_5_max": 0.344942,
+        "nauc_mrr_at_5_std": 0.299279,
+        "nauc_mrr_at_5_diff1": -0.071766,
+        "nauc_mrr_at_10_max": 0.343983,
+        "nauc_mrr_at_10_std": 0.289944,
+        "nauc_mrr_at_10_diff1": -0.086677,
+        "nauc_mrr_at_20_max": 0.340602,
+        "nauc_mrr_at_20_std": 0.285002,
+        "nauc_mrr_at_20_diff1": -0.077191,
+        "nauc_mrr_at_100_max": 0.340615,
+        "nauc_mrr_at_100_std": 0.286252,
+        "nauc_mrr_at_100_diff1": -0.079014,
+        "nauc_mrr_at_1000_max": 0.340615,
+        "nauc_mrr_at_1000_std": 0.286252,
+        "nauc_mrr_at_1000_diff1": -0.079014,
+        "hit_rate_at_1": 0.43103,
+        "hit_rate_at_3": 0.72414,
+        "hit_rate_at_5": 0.7931,
+        "hit_rate_at_10": 0.93103,
+        "hit_rate_at_20": 0.96552,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.39757,
+        "hf_subset": "french",
+        "languages": [
+          "fra-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.36207,
+        "ndcg_at_3": 0.38231,
+        "ndcg_at_5": 0.36997,
+        "ndcg_at_10": 0.39175,
+        "ndcg_at_20": 0.44292,
+        "ndcg_at_100": 0.57064,
+        "ndcg_at_1000": 0.61921,
+        "map_at_1": 0.03292,
+        "map_at_3": 0.09559,
+        "map_at_5": 0.12572,
+        "map_at_10": 0.18328,
+        "map_at_20": 0.23572,
+        "map_at_100": 0.31428,
+        "map_at_1000": 0.33277,
+        "recall_at_1": 0.03292,
+        "recall_at_3": 0.13621,
+        "recall_at_5": 0.18375,
+        "recall_at_10": 0.32182,
+        "recall_at_20": 0.51103,
+        "recall_at_100": 0.87012,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.03292,
+        "precision_at_1": 0.36207,
+        "precision_at_3": 0.37931,
+        "precision_at_5": 0.35172,
+        "precision_at_10": 0.32069,
+        "precision_at_20": 0.26034,
+        "precision_at_100": 0.11621,
+        "precision_at_1000": 0.01564,
+        "mrr_at_1": 0.362069,
+        "mrr_at_3": 0.531609,
+        "mrr_at_5": 0.555747,
+        "mrr_at_10": 0.565599,
+        "mrr_at_20": 0.571939,
+        "mrr_at_100": 0.572405,
+        "mrr_at_1000": 0.572405,
+        "nauc_ndcg_at_1_max": 0.406945,
+        "nauc_ndcg_at_1_std": 0.404973,
+        "nauc_ndcg_at_1_diff1": 0.038267,
+        "nauc_ndcg_at_3_max": 0.331372,
+        "nauc_ndcg_at_3_std": 0.275349,
+        "nauc_ndcg_at_3_diff1": 0.072836,
+        "nauc_ndcg_at_5_max": 0.309078,
+        "nauc_ndcg_at_5_std": 0.225128,
+        "nauc_ndcg_at_5_diff1": 0.057527,
+        "nauc_ndcg_at_10_max": 0.323221,
+        "nauc_ndcg_at_10_std": 0.202957,
+        "nauc_ndcg_at_10_diff1": 0.120639,
+        "nauc_ndcg_at_20_max": 0.355179,
+        "nauc_ndcg_at_20_std": 0.261387,
+        "nauc_ndcg_at_20_diff1": 0.090746,
+        "nauc_ndcg_at_100_max": 0.315991,
+        "nauc_ndcg_at_100_std": 0.266944,
+        "nauc_ndcg_at_100_diff1": 0.095717,
+        "nauc_ndcg_at_1000_max": 0.249727,
+        "nauc_ndcg_at_1000_std": 0.193015,
+        "nauc_ndcg_at_1000_diff1": 0.056782,
+        "nauc_map_at_1_max": 0.443614,
+        "nauc_map_at_1_std": 0.471937,
+        "nauc_map_at_1_diff1": 0.101604,
+        "nauc_map_at_3_max": 0.318308,
+        "nauc_map_at_3_std": 0.274583,
+        "nauc_map_at_3_diff1": 0.061253,
+        "nauc_map_at_5_max": 0.321707,
+        "nauc_map_at_5_std": 0.272389,
+        "nauc_map_at_5_diff1": 0.08377,
+        "nauc_map_at_10_max": 0.333543,
+        "nauc_map_at_10_std": 0.239606,
+        "nauc_map_at_10_diff1": 0.098631,
+        "nauc_map_at_20_max": 0.324785,
+        "nauc_map_at_20_std": 0.246237,
+        "nauc_map_at_20_diff1": 0.099818,
+        "nauc_map_at_100_max": 0.308202,
+        "nauc_map_at_100_std": 0.218576,
+        "nauc_map_at_100_diff1": 0.085503,
+        "nauc_map_at_1000_max": 0.272939,
+        "nauc_map_at_1000_std": 0.17893,
+        "nauc_map_at_1000_diff1": 0.064162,
+        "nauc_recall_at_1_max": 0.443614,
+        "nauc_recall_at_1_std": 0.471937,
+        "nauc_recall_at_1_diff1": 0.101604,
+        "nauc_recall_at_3_max": 0.123961,
+        "nauc_recall_at_3_std": 0.089905,
+        "nauc_recall_at_3_diff1": 0.03557,
+        "nauc_recall_at_5_max": 0.191313,
+        "nauc_recall_at_5_std": 0.15426,
+        "nauc_recall_at_5_diff1": 0.092566,
+        "nauc_recall_at_10_max": 0.172407,
+        "nauc_recall_at_10_std": 0.071907,
+        "nauc_recall_at_10_diff1": 0.139453,
+        "nauc_recall_at_20_max": 0.205621,
+        "nauc_recall_at_20_std": 0.151659,
+        "nauc_recall_at_20_diff1": 0.088945,
+        "nauc_recall_at_100_max": 0.307351,
+        "nauc_recall_at_100_std": 0.30302,
+        "nauc_recall_at_100_diff1": 0.138193,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.406945,
+        "nauc_precision_at_1_std": 0.404973,
+        "nauc_precision_at_1_diff1": 0.038267,
+        "nauc_precision_at_3_max": 0.288612,
+        "nauc_precision_at_3_std": 0.218904,
+        "nauc_precision_at_3_diff1": 0.093938,
+        "nauc_precision_at_5_max": 0.266342,
+        "nauc_precision_at_5_std": 0.168538,
+        "nauc_precision_at_5_diff1": 0.057477,
+        "nauc_precision_at_10_max": 0.207432,
+        "nauc_precision_at_10_std": 0.09313,
+        "nauc_precision_at_10_diff1": 0.087958,
+        "nauc_precision_at_20_max": 0.132293,
+        "nauc_precision_at_20_std": 0.052164,
+        "nauc_precision_at_20_diff1": 0.058655,
+        "nauc_precision_at_100_max": -0.086137,
+        "nauc_precision_at_100_std": -0.144983,
+        "nauc_precision_at_100_diff1": -0.064113,
+        "nauc_precision_at_1000_max": -0.123372,
+        "nauc_precision_at_1000_std": -0.181541,
+        "nauc_precision_at_1000_diff1": -0.10379,
+        "nauc_mrr_at_1_max": 0.406945,
+        "nauc_mrr_at_1_std": 0.404973,
+        "nauc_mrr_at_1_diff1": 0.038267,
+        "nauc_mrr_at_3_max": 0.313646,
+        "nauc_mrr_at_3_std": 0.326206,
+        "nauc_mrr_at_3_diff1": 0.07207,
+        "nauc_mrr_at_5_max": 0.303722,
+        "nauc_mrr_at_5_std": 0.32,
+        "nauc_mrr_at_5_diff1": 0.050257,
+        "nauc_mrr_at_10_max": 0.328891,
+        "nauc_mrr_at_10_std": 0.338951,
+        "nauc_mrr_at_10_diff1": 0.063182,
+        "nauc_mrr_at_20_max": 0.329953,
+        "nauc_mrr_at_20_std": 0.342112,
+        "nauc_mrr_at_20_diff1": 0.0572,
+        "nauc_mrr_at_100_max": 0.329571,
+        "nauc_mrr_at_100_std": 0.341213,
+        "nauc_mrr_at_100_diff1": 0.056684,
+        "nauc_mrr_at_1000_max": 0.329571,
+        "nauc_mrr_at_1000_std": 0.341213,
+        "nauc_mrr_at_1000_diff1": 0.056684,
+        "hit_rate_at_1": 0.36207,
+        "hit_rate_at_3": 0.72414,
+        "hit_rate_at_5": 0.82759,
+        "hit_rate_at_10": 0.89655,
+        "hit_rate_at_20": 0.98276,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.36997,
+        "hf_subset": "spanish",
+        "languages": [
+          "spa-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.58621,
+        "ndcg_at_3": 0.53254,
+        "ndcg_at_5": 0.52789,
+        "ndcg_at_10": 0.52567,
+        "ndcg_at_20": 0.56399,
+        "ndcg_at_100": 0.66277,
+        "ndcg_at_1000": 0.69605,
+        "map_at_1": 0.05861,
+        "map_at_3": 0.13046,
+        "map_at_5": 0.19142,
+        "map_at_10": 0.26851,
+        "map_at_20": 0.33324,
+        "map_at_100": 0.42001,
+        "map_at_1000": 0.43638,
+        "recall_at_1": 0.05861,
+        "recall_at_3": 0.15906,
+        "recall_at_5": 0.26613,
+        "recall_at_10": 0.43193,
+        "recall_at_20": 0.60524,
+        "recall_at_100": 0.91799,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.05861,
+        "precision_at_1": 0.58621,
+        "precision_at_3": 0.51724,
+        "precision_at_5": 0.5,
+        "precision_at_10": 0.41207,
+        "precision_at_20": 0.32328,
+        "precision_at_100": 0.12569,
+        "precision_at_1000": 0.01564,
+        "mrr_at_1": 0.586207,
+        "mrr_at_3": 0.692529,
+        "mrr_at_5": 0.707184,
+        "mrr_at_10": 0.713937,
+        "mrr_at_20": 0.71617,
+        "mrr_at_100": 0.716745,
+        "mrr_at_1000": 0.716745,
+        "nauc_ndcg_at_1_max": -0.062448,
+        "nauc_ndcg_at_1_std": -0.035261,
+        "nauc_ndcg_at_1_diff1": -0.22042,
+        "nauc_ndcg_at_3_max": -0.067187,
+        "nauc_ndcg_at_3_std": -0.050538,
+        "nauc_ndcg_at_3_diff1": -0.077415,
+        "nauc_ndcg_at_5_max": -0.133635,
+        "nauc_ndcg_at_5_std": -0.090749,
+        "nauc_ndcg_at_5_diff1": -0.121149,
+        "nauc_ndcg_at_10_max": -0.158514,
+        "nauc_ndcg_at_10_std": -0.118223,
+        "nauc_ndcg_at_10_diff1": -0.105714,
+        "nauc_ndcg_at_20_max": -0.037898,
+        "nauc_ndcg_at_20_std": 0.013035,
+        "nauc_ndcg_at_20_diff1": -0.038799,
+        "nauc_ndcg_at_100_max": -0.018977,
+        "nauc_ndcg_at_100_std": 0.052237,
+        "nauc_ndcg_at_100_diff1": -0.044037,
+        "nauc_ndcg_at_1000_max": -0.050014,
+        "nauc_ndcg_at_1000_std": 0.033734,
+        "nauc_ndcg_at_1000_diff1": -0.040198,
+        "nauc_map_at_1_max": 0.032528,
+        "nauc_map_at_1_std": 0.068645,
+        "nauc_map_at_1_diff1": -0.146338,
+        "nauc_map_at_3_max": 0.011214,
+        "nauc_map_at_3_std": -0.011134,
+        "nauc_map_at_3_diff1": -0.104868,
+        "nauc_map_at_5_max": -0.030436,
+        "nauc_map_at_5_std": -0.032732,
+        "nauc_map_at_5_diff1": -0.117929,
+        "nauc_map_at_10_max": -0.02827,
+        "nauc_map_at_10_std": -0.041835,
+        "nauc_map_at_10_diff1": -0.112878,
+        "nauc_map_at_20_max": 0.004693,
+        "nauc_map_at_20_std": 0.007036,
+        "nauc_map_at_20_diff1": -0.118622,
+        "nauc_map_at_100_max": -0.029389,
+        "nauc_map_at_100_std": 0.006539,
+        "nauc_map_at_100_diff1": -0.092105,
+        "nauc_map_at_1000_max": -0.053638,
+        "nauc_map_at_1000_std": -0.0091,
+        "nauc_map_at_1000_diff1": -0.06526,
+        "nauc_recall_at_1_max": 0.032528,
+        "nauc_recall_at_1_std": 0.068645,
+        "nauc_recall_at_1_diff1": -0.146338,
+        "nauc_recall_at_3_max": 0.052704,
+        "nauc_recall_at_3_std": 0.009683,
+        "nauc_recall_at_3_diff1": -0.032835,
+        "nauc_recall_at_5_max": -0.037882,
+        "nauc_recall_at_5_std": -0.055949,
+        "nauc_recall_at_5_diff1": -0.095629,
+        "nauc_recall_at_10_max": -0.019228,
+        "nauc_recall_at_10_std": -0.073897,
+        "nauc_recall_at_10_diff1": -0.040256,
+        "nauc_recall_at_20_max": 0.079794,
+        "nauc_recall_at_20_std": 0.040446,
+        "nauc_recall_at_20_diff1": -0.062086,
+        "nauc_recall_at_100_max": 0.1212,
+        "nauc_recall_at_100_std": 0.073595,
+        "nauc_recall_at_100_diff1": 0.05517,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": -0.062448,
+        "nauc_precision_at_1_std": -0.035261,
+        "nauc_precision_at_1_diff1": -0.22042,
+        "nauc_precision_at_3_max": -0.054043,
+        "nauc_precision_at_3_std": -0.0398,
+        "nauc_precision_at_3_diff1": -0.031217,
+        "nauc_precision_at_5_max": -0.125426,
+        "nauc_precision_at_5_std": -0.063048,
+        "nauc_precision_at_5_diff1": -0.068105,
+        "nauc_precision_at_10_max": -0.14385,
+        "nauc_precision_at_10_std": -0.099607,
+        "nauc_precision_at_10_diff1": -0.059443,
+        "nauc_precision_at_20_max": -0.091003,
+        "nauc_precision_at_20_std": -0.007302,
+        "nauc_precision_at_20_diff1": -0.012895,
+        "nauc_precision_at_100_max": -0.183001,
+        "nauc_precision_at_100_std": -0.089838,
+        "nauc_precision_at_100_diff1": 0.086358,
+        "nauc_precision_at_1000_max": -0.186107,
+        "nauc_precision_at_1000_std": -0.099763,
+        "nauc_precision_at_1000_diff1": 0.107453,
+        "nauc_mrr_at_1_max": -0.062448,
+        "nauc_mrr_at_1_std": -0.035261,
+        "nauc_mrr_at_1_diff1": -0.22042,
+        "nauc_mrr_at_3_max": -0.017041,
+        "nauc_mrr_at_3_std": 0.036496,
+        "nauc_mrr_at_3_diff1": -0.095218,
+        "nauc_mrr_at_5_max": -0.036024,
+        "nauc_mrr_at_5_std": 0.022917,
+        "nauc_mrr_at_5_diff1": -0.106141,
+        "nauc_mrr_at_10_max": -0.033353,
+        "nauc_mrr_at_10_std": 0.02089,
+        "nauc_mrr_at_10_diff1": -0.119844,
+        "nauc_mrr_at_20_max": -0.037167,
+        "nauc_mrr_at_20_std": 0.017602,
+        "nauc_mrr_at_20_diff1": -0.127609,
+        "nauc_mrr_at_100_max": -0.038644,
+        "nauc_mrr_at_100_std": 0.015148,
+        "nauc_mrr_at_100_diff1": -0.125072,
+        "nauc_mrr_at_1000_max": -0.038644,
+        "nauc_mrr_at_1000_std": 0.015148,
+        "nauc_mrr_at_1000_diff1": -0.125072,
+        "hit_rate_at_1": 0.58621,
+        "hit_rate_at_3": 0.82759,
+        "hit_rate_at_5": 0.89655,
+        "hit_rate_at_10": 0.94828,
+        "hit_rate_at_20": 0.98276,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.52789,
+        "hf_subset": "english",
+        "languages": [
+          "eng-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.58621,
+        "ndcg_at_3": 0.53802,
+        "ndcg_at_5": 0.53425,
+        "ndcg_at_10": 0.52204,
+        "ndcg_at_20": 0.54702,
+        "ndcg_at_100": 0.65288,
+        "ndcg_at_1000": 0.69161,
+        "map_at_1": 0.05941,
+        "map_at_3": 0.13298,
+        "map_at_5": 0.19569,
+        "map_at_10": 0.26679,
+        "map_at_20": 0.32454,
+        "map_at_100": 0.41028,
+        "map_at_1000": 0.42686,
+        "recall_at_1": 0.05941,
+        "recall_at_3": 0.15562,
+        "recall_at_5": 0.2665,
+        "recall_at_10": 0.4182,
+        "recall_at_20": 0.56141,
+        "recall_at_100": 0.8941,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.05941,
+        "precision_at_1": 0.58621,
+        "precision_at_3": 0.51724,
+        "precision_at_5": 0.5,
+        "precision_at_10": 0.40517,
+        "precision_at_20": 0.3069,
+        "precision_at_100": 0.12517,
+        "precision_at_1000": 0.01564,
+        "mrr_at_1": 0.586207,
+        "mrr_at_3": 0.686782,
+        "mrr_at_5": 0.705747,
+        "mrr_at_10": 0.71642,
+        "mrr_at_20": 0.717498,
+        "mrr_at_100": 0.718274,
+        "mrr_at_1000": 0.718274,
+        "nauc_ndcg_at_1_max": 0.114236,
+        "nauc_ndcg_at_1_std": 0.336159,
+        "nauc_ndcg_at_1_diff1": 0.157111,
+        "nauc_ndcg_at_3_max": 0.017756,
+        "nauc_ndcg_at_3_std": 0.188843,
+        "nauc_ndcg_at_3_diff1": 0.023172,
+        "nauc_ndcg_at_5_max": -0.043409,
+        "nauc_ndcg_at_5_std": 0.122341,
+        "nauc_ndcg_at_5_diff1": 0.010094,
+        "nauc_ndcg_at_10_max": -0.00056,
+        "nauc_ndcg_at_10_std": 0.165277,
+        "nauc_ndcg_at_10_diff1": 0.131939,
+        "nauc_ndcg_at_20_max": 0.108271,
+        "nauc_ndcg_at_20_std": 0.234212,
+        "nauc_ndcg_at_20_diff1": 0.140321,
+        "nauc_ndcg_at_100_max": 0.100986,
+        "nauc_ndcg_at_100_std": 0.246278,
+        "nauc_ndcg_at_100_diff1": 0.114724,
+        "nauc_ndcg_at_1000_max": 0.113639,
+        "nauc_ndcg_at_1000_std": 0.293962,
+        "nauc_ndcg_at_1000_diff1": 0.177317,
+        "nauc_map_at_1_max": 0.048206,
+        "nauc_map_at_1_std": 0.101232,
+        "nauc_map_at_1_diff1": -0.065391,
+        "nauc_map_at_3_max": 0.022521,
+        "nauc_map_at_3_std": 0.058784,
+        "nauc_map_at_3_diff1": -0.151228,
+        "nauc_map_at_5_max": -0.039235,
+        "nauc_map_at_5_std": -0.022408,
+        "nauc_map_at_5_diff1": -0.183485,
+        "nauc_map_at_10_max": -0.003538,
+        "nauc_map_at_10_std": 0.000725,
+        "nauc_map_at_10_diff1": -0.095045,
+        "nauc_map_at_20_max": 0.011047,
+        "nauc_map_at_20_std": 0.033551,
+        "nauc_map_at_20_diff1": -0.027394,
+        "nauc_map_at_100_max": 0.01442,
+        "nauc_map_at_100_std": 0.138508,
+        "nauc_map_at_100_diff1": 0.043617,
+        "nauc_map_at_1000_max": 0.019353,
+        "nauc_map_at_1000_std": 0.171095,
+        "nauc_map_at_1000_diff1": 0.071533,
+        "nauc_recall_at_1_max": 0.048206,
+        "nauc_recall_at_1_std": 0.101232,
+        "nauc_recall_at_1_diff1": -0.065391,
+        "nauc_recall_at_3_max": 0.036815,
+        "nauc_recall_at_3_std": 0.032022,
+        "nauc_recall_at_3_diff1": -0.172661,
+        "nauc_recall_at_5_max": -0.052879,
+        "nauc_recall_at_5_std": -0.110188,
+        "nauc_recall_at_5_diff1": -0.187974,
+        "nauc_recall_at_10_max": 0.011871,
+        "nauc_recall_at_10_std": -0.075609,
+        "nauc_recall_at_10_diff1": -0.038036,
+        "nauc_recall_at_20_max": 0.077553,
+        "nauc_recall_at_20_std": -0.044704,
+        "nauc_recall_at_20_diff1": 0.014987,
+        "nauc_recall_at_100_max": 0.027651,
+        "nauc_recall_at_100_std": -0.063297,
+        "nauc_recall_at_100_diff1": -0.120252,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.114236,
+        "nauc_precision_at_1_std": 0.336159,
+        "nauc_precision_at_1_diff1": 0.157111,
+        "nauc_precision_at_3_max": -0.021783,
+        "nauc_precision_at_3_std": 0.143879,
+        "nauc_precision_at_3_diff1": -0.012656,
+        "nauc_precision_at_5_max": -0.088006,
+        "nauc_precision_at_5_std": 0.080177,
+        "nauc_precision_at_5_diff1": 0.024057,
+        "nauc_precision_at_10_max": -0.001315,
+        "nauc_precision_at_10_std": 0.175338,
+        "nauc_precision_at_10_diff1": 0.255832,
+        "nauc_precision_at_20_max": 0.03579,
+        "nauc_precision_at_20_std": 0.238869,
+        "nauc_precision_at_20_diff1": 0.244088,
+        "nauc_precision_at_100_max": -0.02039,
+        "nauc_precision_at_100_std": 0.255461,
+        "nauc_precision_at_100_diff1": 0.1784,
+        "nauc_precision_at_1000_max": -0.010502,
+        "nauc_precision_at_1000_std": 0.268805,
+        "nauc_precision_at_1000_diff1": 0.207541,
+        "nauc_mrr_at_1_max": 0.114236,
+        "nauc_mrr_at_1_std": 0.336159,
+        "nauc_mrr_at_1_diff1": 0.157111,
+        "nauc_mrr_at_3_max": 0.204778,
+        "nauc_mrr_at_3_std": 0.389507,
+        "nauc_mrr_at_3_diff1": 0.169767,
+        "nauc_mrr_at_5_max": 0.210992,
+        "nauc_mrr_at_5_std": 0.390372,
+        "nauc_mrr_at_5_diff1": 0.193092,
+        "nauc_mrr_at_10_max": 0.207424,
+        "nauc_mrr_at_10_std": 0.397132,
+        "nauc_mrr_at_10_diff1": 0.190117,
+        "nauc_mrr_at_20_max": 0.205802,
+        "nauc_mrr_at_20_std": 0.394312,
+        "nauc_mrr_at_20_diff1": 0.186942,
+        "nauc_mrr_at_100_max": 0.203607,
+        "nauc_mrr_at_100_std": 0.392265,
+        "nauc_mrr_at_100_diff1": 0.186042,
+        "nauc_mrr_at_1000_max": 0.203607,
+        "nauc_mrr_at_1000_std": 0.392265,
+        "nauc_mrr_at_1000_diff1": 0.186042,
+        "hit_rate_at_1": 0.58621,
+        "hit_rate_at_3": 0.7931,
+        "hit_rate_at_5": 0.87931,
+        "hit_rate_at_10": 0.94828,
+        "hit_rate_at_20": 0.96552,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.53425,
+        "hf_subset": "german",
+        "languages": [
+          "deu-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 270.8781750202179,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v3/Vidore3ComputerScienceRetrieval.json

@@ -0,0 +1,942 @@
+{
+  "dataset_revision": "fb7fb69f81f7db62790f40494124b8ad22b424ab",
+  "task_name": "Vidore3ComputerScienceRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.65116,
+        "ndcg_at_3": 0.63606,
+        "ndcg_at_5": 0.63551,
+        "ndcg_at_10": 0.67758,
+        "ndcg_at_20": 0.71973,
+        "ndcg_at_100": 0.75989,
+        "ndcg_at_1000": 0.76843,
+        "map_at_1": 0.26219,
+        "map_at_3": 0.41704,
+        "map_at_5": 0.47299,
+        "map_at_10": 0.54185,
+        "map_at_20": 0.58345,
+        "map_at_100": 0.60244,
+        "map_at_1000": 0.60388,
+        "recall_at_1": 0.26219,
+        "recall_at_3": 0.47138,
+        "recall_at_5": 0.56503,
+        "recall_at_10": 0.71862,
+        "recall_at_20": 0.83514,
+        "recall_at_100": 0.96288,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.26219,
+        "precision_at_1": 0.71628,
+        "precision_at_3": 0.51163,
+        "precision_at_5": 0.4,
+        "precision_at_10": 0.29349,
+        "precision_at_20": 0.18674,
+        "precision_at_100": 0.04605,
+        "precision_at_1000": 0.00488,
+        "mrr_at_1": 0.716279,
+        "mrr_at_3": 0.806977,
+        "mrr_at_5": 0.815116,
+        "mrr_at_10": 0.821632,
+        "mrr_at_20": 0.821632,
+        "mrr_at_100": 0.821768,
+        "mrr_at_1000": 0.821768,
+        "nauc_ndcg_at_1_max": -0.027424,
+        "nauc_ndcg_at_1_std": 0.003162,
+        "nauc_ndcg_at_1_diff1": 0.371685,
+        "nauc_ndcg_at_3_max": 0.005107,
+        "nauc_ndcg_at_3_std": 0.015013,
+        "nauc_ndcg_at_3_diff1": 0.263436,
+        "nauc_ndcg_at_5_max": -0.007649,
+        "nauc_ndcg_at_5_std": 0.00738,
+        "nauc_ndcg_at_5_diff1": 0.278142,
+        "nauc_ndcg_at_10_max": 0.035267,
+        "nauc_ndcg_at_10_std": 0.028668,
+        "nauc_ndcg_at_10_diff1": 0.284778,
+        "nauc_ndcg_at_20_max": 0.092505,
+        "nauc_ndcg_at_20_std": 0.109016,
+        "nauc_ndcg_at_20_diff1": 0.305571,
+        "nauc_ndcg_at_100_max": 0.077709,
+        "nauc_ndcg_at_100_std": 0.100231,
+        "nauc_ndcg_at_100_diff1": 0.325113,
+        "nauc_ndcg_at_1000_max": 0.059288,
+        "nauc_ndcg_at_1000_std": 0.085263,
+        "nauc_ndcg_at_1000_diff1": 0.315323,
+        "nauc_map_at_1_max": -0.012671,
+        "nauc_map_at_1_std": -0.027968,
+        "nauc_map_at_1_diff1": 0.436846,
+        "nauc_map_at_3_max": 0.008234,
+        "nauc_map_at_3_std": -0.026231,
+        "nauc_map_at_3_diff1": 0.31555,
+        "nauc_map_at_5_max": 0.011445,
+        "nauc_map_at_5_std": -0.010158,
+        "nauc_map_at_5_diff1": 0.287485,
+        "nauc_map_at_10_max": 0.046883,
+        "nauc_map_at_10_std": 0.028244,
+        "nauc_map_at_10_diff1": 0.258773,
+        "nauc_map_at_20_max": 0.080787,
+        "nauc_map_at_20_std": 0.081403,
+        "nauc_map_at_20_diff1": 0.250115,
+        "nauc_map_at_100_max": 0.078324,
+        "nauc_map_at_100_std": 0.081273,
+        "nauc_map_at_100_diff1": 0.252684,
+        "nauc_map_at_1000_max": 0.076403,
+        "nauc_map_at_1000_std": 0.079955,
+        "nauc_map_at_1000_diff1": 0.251107,
+        "nauc_recall_at_1_max": -0.012671,
+        "nauc_recall_at_1_std": -0.027968,
+        "nauc_recall_at_1_diff1": 0.436846,
+        "nauc_recall_at_3_max": 0.013287,
+        "nauc_recall_at_3_std": -0.039918,
+        "nauc_recall_at_3_diff1": 0.277227,
+        "nauc_recall_at_5_max": -0.001887,
+        "nauc_recall_at_5_std": -0.036226,
+        "nauc_recall_at_5_diff1": 0.25127,
+        "nauc_recall_at_10_max": 0.085525,
+        "nauc_recall_at_10_std": 0.019808,
+        "nauc_recall_at_10_diff1": 0.182275,
+        "nauc_recall_at_20_max": 0.21812,
+        "nauc_recall_at_20_std": 0.22456,
+        "nauc_recall_at_20_diff1": 0.165326,
+        "nauc_recall_at_100_max": 0.373491,
+        "nauc_recall_at_100_std": 0.38802,
+        "nauc_recall_at_100_diff1": 0.396281,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": -0.052821,
+        "nauc_precision_at_1_std": 0.008944,
+        "nauc_precision_at_1_diff1": 0.324785,
+        "nauc_precision_at_3_max": 0.046466,
+        "nauc_precision_at_3_std": 0.105513,
+        "nauc_precision_at_3_diff1": -0.102123,
+        "nauc_precision_at_5_max": 0.022612,
+        "nauc_precision_at_5_std": 0.105734,
+        "nauc_precision_at_5_diff1": -0.166007,
+        "nauc_precision_at_10_max": 0.107612,
+        "nauc_precision_at_10_std": 0.171033,
+        "nauc_precision_at_10_diff1": -0.202337,
+        "nauc_precision_at_20_max": 0.13025,
+        "nauc_precision_at_20_std": 0.212892,
+        "nauc_precision_at_20_diff1": -0.192453,
+        "nauc_precision_at_100_max": 0.065336,
+        "nauc_precision_at_100_std": 0.14236,
+        "nauc_precision_at_100_diff1": -0.195502,
+        "nauc_precision_at_1000_max": 0.033326,
+        "nauc_precision_at_1000_std": 0.1126,
+        "nauc_precision_at_1000_diff1": -0.216291,
+        "nauc_mrr_at_1_max": -0.052821,
+        "nauc_mrr_at_1_std": 0.008944,
+        "nauc_mrr_at_1_diff1": 0.324785,
+        "nauc_mrr_at_3_max": -0.035785,
+        "nauc_mrr_at_3_std": 0.041646,
+        "nauc_mrr_at_3_diff1": 0.359025,
+        "nauc_mrr_at_5_max": -0.048264,
+        "nauc_mrr_at_5_std": 0.031774,
+        "nauc_mrr_at_5_diff1": 0.351899,
+        "nauc_mrr_at_10_max": -0.051036,
+        "nauc_mrr_at_10_std": 0.022714,
+        "nauc_mrr_at_10_diff1": 0.34452,
+        "nauc_mrr_at_20_max": -0.051036,
+        "nauc_mrr_at_20_std": 0.022714,
+        "nauc_mrr_at_20_diff1": 0.34452,
+        "nauc_mrr_at_100_max": -0.0517,
+        "nauc_mrr_at_100_std": 0.021988,
+        "nauc_mrr_at_100_diff1": 0.343958,
+        "nauc_mrr_at_1000_max": -0.0517,
+        "nauc_mrr_at_1000_std": 0.021988,
+        "nauc_mrr_at_1000_diff1": 0.343958,
+        "hit_rate_at_1": 0.71628,
+        "hit_rate_at_3": 0.91628,
+        "hit_rate_at_5": 0.94884,
+        "hit_rate_at_10": 0.99535,
+        "hit_rate_at_20": 0.99535,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.67758,
+        "hf_subset": "french",
+        "languages": [
+          "fra-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.66047,
+        "ndcg_at_3": 0.65393,
+        "ndcg_at_5": 0.65713,
+        "ndcg_at_10": 0.68557,
+        "ndcg_at_20": 0.72423,
+        "ndcg_at_100": 0.76794,
+        "ndcg_at_1000": 0.77768,
+        "map_at_1": 0.28119,
+        "map_at_3": 0.43723,
+        "map_at_5": 0.49588,
+        "map_at_10": 0.55663,
+        "map_at_20": 0.59306,
+        "map_at_100": 0.61389,
+        "map_at_1000": 0.61546,
+        "recall_at_1": 0.28119,
+        "recall_at_3": 0.4916,
+        "recall_at_5": 0.58898,
+        "recall_at_10": 0.71449,
+        "recall_at_20": 0.82138,
+        "recall_at_100": 0.95895,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.28119,
+        "precision_at_1": 0.72558,
+        "precision_at_3": 0.52093,
+        "precision_at_5": 0.41023,
+        "precision_at_10": 0.28512,
+        "precision_at_20": 0.17953,
+        "precision_at_100": 0.04544,
+        "precision_at_1000": 0.00488,
+        "mrr_at_1": 0.725581,
+        "mrr_at_3": 0.818605,
+        "mrr_at_5": 0.825814,
+        "mrr_at_10": 0.827571,
+        "mrr_at_20": 0.828561,
+        "mrr_at_100": 0.828675,
+        "mrr_at_1000": 0.828675,
+        "nauc_ndcg_at_1_max": 0.061447,
+        "nauc_ndcg_at_1_std": 0.049911,
+        "nauc_ndcg_at_1_diff1": 0.423607,
+        "nauc_ndcg_at_3_max": -0.006943,
+        "nauc_ndcg_at_3_std": -0.04621,
+        "nauc_ndcg_at_3_diff1": 0.252328,
+        "nauc_ndcg_at_5_max": 0.016568,
+        "nauc_ndcg_at_5_std": -0.011751,
+        "nauc_ndcg_at_5_diff1": 0.270607,
+        "nauc_ndcg_at_10_max": 0.057457,
+        "nauc_ndcg_at_10_std": 0.034551,
+        "nauc_ndcg_at_10_diff1": 0.278585,
+        "nauc_ndcg_at_20_max": 0.082334,
+        "nauc_ndcg_at_20_std": 0.076435,
+        "nauc_ndcg_at_20_diff1": 0.278692,
+        "nauc_ndcg_at_100_max": 0.072214,
+        "nauc_ndcg_at_100_std": 0.072992,
+        "nauc_ndcg_at_100_diff1": 0.304568,
+        "nauc_ndcg_at_1000_max": 0.064164,
+        "nauc_ndcg_at_1000_std": 0.063242,
+        "nauc_ndcg_at_1000_diff1": 0.304957,
+        "nauc_map_at_1_max": 0.055195,
+        "nauc_map_at_1_std": -0.013398,
+        "nauc_map_at_1_diff1": 0.393073,
+        "nauc_map_at_3_max": 0.025666,
+        "nauc_map_at_3_std": -0.056122,
+        "nauc_map_at_3_diff1": 0.31049,
+        "nauc_map_at_5_max": 0.032806,
+        "nauc_map_at_5_std": -0.025222,
+        "nauc_map_at_5_diff1": 0.294317,
+        "nauc_map_at_10_max": 0.060961,
+        "nauc_map_at_10_std": 0.020535,
+        "nauc_map_at_10_diff1": 0.250811,
+        "nauc_map_at_20_max": 0.073831,
+        "nauc_map_at_20_std": 0.045293,
+        "nauc_map_at_20_diff1": 0.230752,
+        "nauc_map_at_100_max": 0.072879,
+        "nauc_map_at_100_std": 0.050249,
+        "nauc_map_at_100_diff1": 0.232162,
+        "nauc_map_at_1000_max": 0.07233,
+        "nauc_map_at_1000_std": 0.049451,
+        "nauc_map_at_1000_diff1": 0.232181,
+        "nauc_recall_at_1_max": 0.055195,
+        "nauc_recall_at_1_std": -0.013398,
+        "nauc_recall_at_1_diff1": 0.393073,
+        "nauc_recall_at_3_max": -0.00358,
+        "nauc_recall_at_3_std": -0.094443,
+        "nauc_recall_at_3_diff1": 0.269103,
+        "nauc_recall_at_5_max": 0.019274,
+        "nauc_recall_at_5_std": -0.043416,
+        "nauc_recall_at_5_diff1": 0.252529,
+        "nauc_recall_at_10_max": 0.099401,
+        "nauc_recall_at_10_std": 0.073396,
+        "nauc_recall_at_10_diff1": 0.195727,
+        "nauc_recall_at_20_max": 0.14917,
+        "nauc_recall_at_20_std": 0.161702,
+        "nauc_recall_at_20_diff1": 0.141719,
+        "nauc_recall_at_100_max": 0.166479,
+        "nauc_recall_at_100_std": 0.235296,
+        "nauc_recall_at_100_diff1": 0.221742,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": -0.010081,
+        "nauc_precision_at_1_std": 0.000161,
+        "nauc_precision_at_1_diff1": 0.367962,
+        "nauc_precision_at_3_max": -0.057492,
+        "nauc_precision_at_3_std": -0.02281,
+        "nauc_precision_at_3_diff1": -0.124451,
+        "nauc_precision_at_5_max": -0.020003,
+        "nauc_precision_at_5_std": 0.061642,
+        "nauc_precision_at_5_diff1": -0.187592,
+        "nauc_precision_at_10_max": 0.049584,
+        "nauc_precision_at_10_std": 0.142238,
+        "nauc_precision_at_10_diff1": -0.249171,
+        "nauc_precision_at_20_max": 0.042946,
+        "nauc_precision_at_20_std": 0.141704,
+        "nauc_precision_at_20_diff1": -0.26065,
+        "nauc_precision_at_100_max": -0.006662,
+        "nauc_precision_at_100_std": 0.08632,
+        "nauc_precision_at_100_diff1": -0.243804,
+        "nauc_precision_at_1000_max": -0.026161,
+        "nauc_precision_at_1000_std": 0.057893,
+        "nauc_precision_at_1000_diff1": -0.249944,
+        "nauc_mrr_at_1_max": -0.010081,
+        "nauc_mrr_at_1_std": 0.000161,
+        "nauc_mrr_at_1_diff1": 0.367962,
+        "nauc_mrr_at_3_max": -0.095663,
+        "nauc_mrr_at_3_std": -0.06454,
+        "nauc_mrr_at_3_diff1": 0.334448,
+        "nauc_mrr_at_5_max": -0.069525,
+        "nauc_mrr_at_5_std": -0.044567,
+        "nauc_mrr_at_5_diff1": 0.342886,
+        "nauc_mrr_at_10_max": -0.070343,
+        "nauc_mrr_at_10_std": -0.044612,
+        "nauc_mrr_at_10_diff1": 0.349643,
+        "nauc_mrr_at_20_max": -0.068134,
+        "nauc_mrr_at_20_std": -0.045158,
+        "nauc_mrr_at_20_diff1": 0.346829,
+        "nauc_mrr_at_100_max": -0.068716,
+        "nauc_mrr_at_100_std": -0.045832,
+        "nauc_mrr_at_100_diff1": 0.346677,
+        "nauc_mrr_at_1000_max": -0.068716,
+        "nauc_mrr_at_1000_std": -0.045832,
+        "nauc_mrr_at_1000_diff1": 0.346677,
+        "hit_rate_at_1": 0.72558,
+        "hit_rate_at_3": 0.93488,
+        "hit_rate_at_5": 0.96744,
+        "hit_rate_at_10": 0.9814,
+        "hit_rate_at_20": 0.99535,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.68557,
+        "hf_subset": "spanish",
+        "languages": [
+          "spa-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.73953,
+        "ndcg_at_3": 0.67338,
+        "ndcg_at_5": 0.67981,
+        "ndcg_at_10": 0.71585,
+        "ndcg_at_20": 0.75425,
+        "ndcg_at_100": 0.79478,
+        "ndcg_at_1000": 0.8015,
+        "map_at_1": 0.29796,
+        "map_at_3": 0.44948,
+        "map_at_5": 0.51284,
+        "map_at_10": 0.58241,
+        "map_at_20": 0.62145,
+        "map_at_100": 0.64169,
+        "map_at_1000": 0.643,
+        "recall_at_1": 0.29796,
+        "recall_at_3": 0.49165,
+        "recall_at_5": 0.59588,
+        "recall_at_10": 0.73969,
+        "recall_at_20": 0.84963,
+        "recall_at_100": 0.97124,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.29796,
+        "precision_at_1": 0.79535,
+        "precision_at_3": 0.51938,
+        "precision_at_5": 0.41953,
+        "precision_at_10": 0.2986,
+        "precision_at_20": 0.18744,
+        "precision_at_100": 0.04637,
+        "precision_at_1000": 0.00488,
+        "mrr_at_1": 0.795349,
+        "mrr_at_3": 0.858915,
+        "mrr_at_5": 0.866822,
+        "mrr_at_10": 0.869779,
+        "mrr_at_20": 0.869779,
+        "mrr_at_100": 0.869965,
+        "mrr_at_1000": 0.869965,
+        "nauc_ndcg_at_1_max": -0.115662,
+        "nauc_ndcg_at_1_std": -0.167787,
+        "nauc_ndcg_at_1_diff1": 0.362045,
+        "nauc_ndcg_at_3_max": -0.117524,
+        "nauc_ndcg_at_3_std": -0.161198,
+        "nauc_ndcg_at_3_diff1": 0.167078,
+        "nauc_ndcg_at_5_max": -0.071103,
+        "nauc_ndcg_at_5_std": -0.12959,
+        "nauc_ndcg_at_5_diff1": 0.193337,
+        "nauc_ndcg_at_10_max": -0.082137,
+        "nauc_ndcg_at_10_std": -0.135079,
+        "nauc_ndcg_at_10_diff1": 0.186099,
+        "nauc_ndcg_at_20_max": -0.035497,
+        "nauc_ndcg_at_20_std": -0.080702,
+        "nauc_ndcg_at_20_diff1": 0.206651,
+        "nauc_ndcg_at_100_max": -0.040346,
+        "nauc_ndcg_at_100_std": -0.08971,
+        "nauc_ndcg_at_100_diff1": 0.230856,
+        "nauc_ndcg_at_1000_max": -0.054865,
+        "nauc_ndcg_at_1000_std": -0.09987,
+        "nauc_ndcg_at_1000_diff1": 0.21969,
+        "nauc_map_at_1_max": -0.015388,
+        "nauc_map_at_1_std": -0.105118,
+        "nauc_map_at_1_diff1": 0.389702,
+        "nauc_map_at_3_max": -0.045817,
+        "nauc_map_at_3_std": -0.129935,
+        "nauc_map_at_3_diff1": 0.258085,
+        "nauc_map_at_5_max": -0.050222,
+        "nauc_map_at_5_std": -0.123207,
+        "nauc_map_at_5_diff1": 0.215711,
+        "nauc_map_at_10_max": -0.054087,
+        "nauc_map_at_10_std": -0.105899,
+        "nauc_map_at_10_diff1": 0.166862,
+        "nauc_map_at_20_max": -0.02252,
+        "nauc_map_at_20_std": -0.063177,
+        "nauc_map_at_20_diff1": 0.147036,
+        "nauc_map_at_100_max": -0.020378,
+        "nauc_map_at_100_std": -0.059288,
+        "nauc_map_at_100_diff1": 0.146944,
+        "nauc_map_at_1000_max": -0.021694,
+        "nauc_map_at_1000_std": -0.060196,
+        "nauc_map_at_1000_diff1": 0.145204,
+        "nauc_recall_at_1_max": -0.015388,
+        "nauc_recall_at_1_std": -0.105118,
+        "nauc_recall_at_1_diff1": 0.389702,
+        "nauc_recall_at_3_max": -0.037166,
+        "nauc_recall_at_3_std": -0.127801,
+        "nauc_recall_at_3_diff1": 0.226087,
+        "nauc_recall_at_5_max": -0.038643,
+        "nauc_recall_at_5_std": -0.119509,
+        "nauc_recall_at_5_diff1": 0.180375,
+        "nauc_recall_at_10_max": -0.031914,
+        "nauc_recall_at_10_std": -0.087159,
+        "nauc_recall_at_10_diff1": 0.114994,
+        "nauc_recall_at_20_max": 0.089393,
+        "nauc_recall_at_20_std": 0.061104,
+        "nauc_recall_at_20_diff1": 0.101652,
+        "nauc_recall_at_100_max": 0.348623,
+        "nauc_recall_at_100_std": 0.230872,
+        "nauc_recall_at_100_diff1": 0.325729,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": -0.220993,
+        "nauc_precision_at_1_std": -0.224923,
+        "nauc_precision_at_1_diff1": 0.301659,
+        "nauc_precision_at_3_max": -0.116534,
+        "nauc_precision_at_3_std": -0.036204,
+        "nauc_precision_at_3_diff1": -0.221333,
+        "nauc_precision_at_5_max": -0.041425,
+        "nauc_precision_at_5_std": 0.053767,
+        "nauc_precision_at_5_diff1": -0.265765,
+        "nauc_precision_at_10_max": -0.001132,
+        "nauc_precision_at_10_std": 0.101526,
+        "nauc_precision_at_10_diff1": -0.304887,
+        "nauc_precision_at_20_max": 0.069504,
+        "nauc_precision_at_20_std": 0.172748,
+        "nauc_precision_at_20_diff1": -0.286789,
+        "nauc_precision_at_100_max": 0.044017,
+        "nauc_precision_at_100_std": 0.137646,
+        "nauc_precision_at_100_diff1": -0.254905,
+        "nauc_precision_at_1000_max": 0.030394,
+        "nauc_precision_at_1000_std": 0.124935,
+        "nauc_precision_at_1000_diff1": -0.266511,
+        "nauc_mrr_at_1_max": -0.220993,
+        "nauc_mrr_at_1_std": -0.224923,
+        "nauc_mrr_at_1_diff1": 0.301659,
+        "nauc_mrr_at_3_max": -0.275167,
+        "nauc_mrr_at_3_std": -0.278976,
+        "nauc_mrr_at_3_diff1": 0.297716,
+        "nauc_mrr_at_5_max": -0.251192,
+        "nauc_mrr_at_5_std": -0.252318,
+        "nauc_mrr_at_5_diff1": 0.30352,
+        "nauc_mrr_at_10_max": -0.246277,
+        "nauc_mrr_at_10_std": -0.250663,
+        "nauc_mrr_at_10_diff1": 0.303292,
+        "nauc_mrr_at_20_max": -0.246277,
+        "nauc_mrr_at_20_std": -0.250663,
+        "nauc_mrr_at_20_diff1": 0.303292,
+        "nauc_mrr_at_100_max": -0.248162,
+        "nauc_mrr_at_100_std": -0.252555,
+        "nauc_mrr_at_100_diff1": 0.302659,
+        "nauc_mrr_at_1000_max": -0.248162,
+        "nauc_mrr_at_1000_std": -0.252555,
+        "nauc_mrr_at_1000_diff1": 0.302659,
+        "hit_rate_at_1": 0.79535,
+        "hit_rate_at_3": 0.93488,
+        "hit_rate_at_5": 0.97209,
+        "hit_rate_at_10": 0.99535,
+        "hit_rate_at_20": 0.99535,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.71585,
+        "hf_subset": "english",
+        "languages": [
+          "eng-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.6814,
+        "ndcg_at_3": 0.65182,
+        "ndcg_at_5": 0.66617,
+        "ndcg_at_10": 0.69909,
+        "ndcg_at_20": 0.73521,
+        "ndcg_at_100": 0.77557,
+        "ndcg_at_1000": 0.78314,
+        "map_at_1": 0.2799,
+        "map_at_3": 0.43076,
+        "map_at_5": 0.50057,
+        "map_at_10": 0.56887,
+        "map_at_20": 0.60392,
+        "map_at_100": 0.62414,
+        "map_at_1000": 0.62545,
+        "recall_at_1": 0.2799,
+        "recall_at_3": 0.47964,
+        "recall_at_5": 0.59788,
+        "recall_at_10": 0.73972,
+        "recall_at_20": 0.84535,
+        "recall_at_100": 0.9672,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.2799,
+        "precision_at_1": 0.74884,
+        "precision_at_3": 0.51628,
+        "precision_at_5": 0.42605,
+        "precision_at_10": 0.3014,
+        "precision_at_20": 0.18605,
+        "precision_at_100": 0.04637,
+        "precision_at_1000": 0.00488,
+        "mrr_at_1": 0.748837,
+        "mrr_at_3": 0.824031,
+        "mrr_at_5": 0.832636,
+        "mrr_at_10": 0.836866,
+        "mrr_at_20": 0.83797,
+        "mrr_at_100": 0.838192,
+        "mrr_at_1000": 0.838192,
+        "nauc_ndcg_at_1_max": -0.155662,
+        "nauc_ndcg_at_1_std": -0.104821,
+        "nauc_ndcg_at_1_diff1": 0.381537,
+        "nauc_ndcg_at_3_max": -0.141901,
+        "nauc_ndcg_at_3_std": -0.110669,
+        "nauc_ndcg_at_3_diff1": 0.217106,
+        "nauc_ndcg_at_5_max": -0.098198,
+        "nauc_ndcg_at_5_std": -0.071426,
+        "nauc_ndcg_at_5_diff1": 0.246917,
+        "nauc_ndcg_at_10_max": -0.101548,
+        "nauc_ndcg_at_10_std": -0.069702,
+        "nauc_ndcg_at_10_diff1": 0.208953,
+        "nauc_ndcg_at_20_max": -0.05806,
+        "nauc_ndcg_at_20_std": -0.019523,
+        "nauc_ndcg_at_20_diff1": 0.234125,
+        "nauc_ndcg_at_100_max": -0.094182,
+        "nauc_ndcg_at_100_std": -0.033425,
+        "nauc_ndcg_at_100_diff1": 0.252994,
+        "nauc_ndcg_at_1000_max": -0.089524,
+        "nauc_ndcg_at_1000_std": -0.036889,
+        "nauc_ndcg_at_1000_diff1": 0.248427,
+        "nauc_map_at_1_max": -0.048852,
+        "nauc_map_at_1_std": -0.093571,
+        "nauc_map_at_1_diff1": 0.324749,
+        "nauc_map_at_3_max": -0.076831,
+        "nauc_map_at_3_std": -0.113086,
+        "nauc_map_at_3_diff1": 0.239419,
+        "nauc_map_at_5_max": -0.058636,
+        "nauc_map_at_5_std": -0.074713,
+        "nauc_map_at_5_diff1": 0.215374,
+        "nauc_map_at_10_max": -0.060737,
+        "nauc_map_at_10_std": -0.049104,
+        "nauc_map_at_10_diff1": 0.17452,
+        "nauc_map_at_20_max": -0.039178,
+        "nauc_map_at_20_std": -0.016188,
+        "nauc_map_at_20_diff1": 0.168551,
+        "nauc_map_at_100_max": -0.043586,
+        "nauc_map_at_100_std": -0.011182,
+        "nauc_map_at_100_diff1": 0.164385,
+        "nauc_map_at_1000_max": -0.04334,
+        "nauc_map_at_1000_std": -0.011499,
+        "nauc_map_at_1000_diff1": 0.163442,
+        "nauc_recall_at_1_max": -0.048852,
+        "nauc_recall_at_1_std": -0.093571,
+        "nauc_recall_at_1_diff1": 0.324749,
+        "nauc_recall_at_3_max": -0.085356,
+        "nauc_recall_at_3_std": -0.125375,
+        "nauc_recall_at_3_diff1": 0.191968,
+        "nauc_recall_at_5_max": -0.03641,
+        "nauc_recall_at_5_std": -0.074507,
+        "nauc_recall_at_5_diff1": 0.185985,
+        "nauc_recall_at_10_max": -0.037543,
+        "nauc_recall_at_10_std": -0.037708,
+        "nauc_recall_at_10_diff1": 0.109478,
+        "nauc_recall_at_20_max": 0.078341,
+        "nauc_recall_at_20_std": 0.105678,
+        "nauc_recall_at_20_diff1": 0.102833,
+        "nauc_recall_at_100_max": -0.12066,
+        "nauc_recall_at_100_std": 0.100308,
+        "nauc_recall_at_100_diff1": 0.318343,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": -0.247319,
+        "nauc_precision_at_1_std": -0.113328,
+        "nauc_precision_at_1_diff1": 0.308434,
+        "nauc_precision_at_3_max": -0.098018,
+        "nauc_precision_at_3_std": 0.014397,
+        "nauc_precision_at_3_diff1": -0.114594,
+        "nauc_precision_at_5_max": -0.023877,
+        "nauc_precision_at_5_std": 0.111653,
+        "nauc_precision_at_5_diff1": -0.132215,
+        "nauc_precision_at_10_max": 0.034092,
+        "nauc_precision_at_10_std": 0.153166,
+        "nauc_precision_at_10_diff1": -0.198253,
+        "nauc_precision_at_20_max": 0.083691,
+        "nauc_precision_at_20_std": 0.197968,
+        "nauc_precision_at_20_diff1": -0.191633,
+        "nauc_precision_at_100_max": 0.030538,
+        "nauc_precision_at_100_std": 0.138059,
+        "nauc_precision_at_100_diff1": -0.181278,
+        "nauc_precision_at_1000_max": 0.033818,
+        "nauc_precision_at_1000_std": 0.126514,
+        "nauc_precision_at_1000_diff1": -0.189758,
+        "nauc_mrr_at_1_max": -0.247319,
+        "nauc_mrr_at_1_std": -0.113328,
+        "nauc_mrr_at_1_diff1": 0.308434,
+        "nauc_mrr_at_3_max": -0.316947,
+        "nauc_mrr_at_3_std": -0.133339,
+        "nauc_mrr_at_3_diff1": 0.265084,
+        "nauc_mrr_at_5_max": -0.29825,
+        "nauc_mrr_at_5_std": -0.122847,
+        "nauc_mrr_at_5_diff1": 0.287472,
+        "nauc_mrr_at_10_max": -0.297346,
+        "nauc_mrr_at_10_std": -0.124386,
+        "nauc_mrr_at_10_diff1": 0.283489,
+        "nauc_mrr_at_20_max": -0.295422,
+        "nauc_mrr_at_20_std": -0.123768,
+        "nauc_mrr_at_20_diff1": 0.281514,
+        "nauc_mrr_at_100_max": -0.296949,
+        "nauc_mrr_at_100_std": -0.125257,
+        "nauc_mrr_at_100_diff1": 0.2814,
+        "nauc_mrr_at_1000_max": -0.296949,
+        "nauc_mrr_at_1000_std": -0.125257,
+        "nauc_mrr_at_1000_diff1": 0.2814,
+        "hit_rate_at_1": 0.74884,
+        "hit_rate_at_3": 0.91628,
+        "hit_rate_at_5": 0.95349,
+        "hit_rate_at_10": 0.9814,
+        "hit_rate_at_20": 0.99535,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.69909,
+        "hf_subset": "german",
+        "languages": [
+          "deu-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.65581,
+        "ndcg_at_3": 0.63115,
+        "ndcg_at_5": 0.64213,
+        "ndcg_at_10": 0.67708,
+        "ndcg_at_20": 0.71542,
+        "ndcg_at_100": 0.75842,
+        "ndcg_at_1000": 0.76894,
+        "map_at_1": 0.28416,
+        "map_at_3": 0.42352,
+        "map_at_5": 0.48214,
+        "map_at_10": 0.54652,
+        "map_at_20": 0.58309,
+        "map_at_100": 0.60368,
+        "map_at_1000": 0.60553,
+        "recall_at_1": 0.28416,
+        "recall_at_3": 0.463,
+        "recall_at_5": 0.57027,
+        "recall_at_10": 0.7111,
+        "recall_at_20": 0.81917,
+        "recall_at_100": 0.95194,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.28416,
+        "precision_at_1": 0.72093,
+        "precision_at_3": 0.49767,
+        "precision_at_5": 0.40465,
+        "precision_at_10": 0.28512,
+        "precision_at_20": 0.18,
+        "precision_at_100": 0.0454,
+        "precision_at_1000": 0.00488,
+        "mrr_at_1": 0.72093,
+        "mrr_at_3": 0.796124,
+        "mrr_at_5": 0.808915,
+        "mrr_at_10": 0.812292,
+        "mrr_at_20": 0.812551,
+        "mrr_at_100": 0.812955,
+        "mrr_at_1000": 0.812955,
+        "nauc_ndcg_at_1_max": -0.046132,
+        "nauc_ndcg_at_1_std": -0.056867,
+        "nauc_ndcg_at_1_diff1": 0.362306,
+        "nauc_ndcg_at_3_max": -0.042932,
+        "nauc_ndcg_at_3_std": -0.077074,
+        "nauc_ndcg_at_3_diff1": 0.246835,
+        "nauc_ndcg_at_5_max": -0.067885,
+        "nauc_ndcg_at_5_std": -0.098499,
+        "nauc_ndcg_at_5_diff1": 0.228796,
+        "nauc_ndcg_at_10_max": -0.033233,
+        "nauc_ndcg_at_10_std": -0.054846,
+        "nauc_ndcg_at_10_diff1": 0.218109,
+        "nauc_ndcg_at_20_max": -0.016276,
+        "nauc_ndcg_at_20_std": -0.026955,
+        "nauc_ndcg_at_20_diff1": 0.215911,
+        "nauc_ndcg_at_100_max": -0.007864,
+        "nauc_ndcg_at_100_std": -0.012143,
+        "nauc_ndcg_at_100_diff1": 0.244506,
+        "nauc_ndcg_at_1000_max": -0.023451,
+        "nauc_ndcg_at_1000_std": -0.026435,
+        "nauc_ndcg_at_1000_diff1": 0.236541,
+        "nauc_map_at_1_max": -0.023027,
+        "nauc_map_at_1_std": -0.096957,
+        "nauc_map_at_1_diff1": 0.336948,
+        "nauc_map_at_3_max": -0.030855,
+        "nauc_map_at_3_std": -0.102331,
+        "nauc_map_at_3_diff1": 0.288117,
+        "nauc_map_at_5_max": -0.058538,
+        "nauc_map_at_5_std": -0.107305,
+        "nauc_map_at_5_diff1": 0.246637,
+        "nauc_map_at_10_max": -0.020047,
+        "nauc_map_at_10_std": -0.052847,
+        "nauc_map_at_10_diff1": 0.213094,
+        "nauc_map_at_20_max": -0.011967,
+        "nauc_map_at_20_std": -0.031592,
+        "nauc_map_at_20_diff1": 0.186031,
+        "nauc_map_at_100_max": -0.008342,
+        "nauc_map_at_100_std": -0.020462,
+        "nauc_map_at_100_diff1": 0.184828,
+        "nauc_map_at_1000_max": -0.010032,
+        "nauc_map_at_1000_std": -0.021743,
+        "nauc_map_at_1000_diff1": 0.183162,
+        "nauc_recall_at_1_max": -0.023027,
+        "nauc_recall_at_1_std": -0.096957,
+        "nauc_recall_at_1_diff1": 0.336948,
+        "nauc_recall_at_3_max": -0.028199,
+        "nauc_recall_at_3_std": -0.119936,
+        "nauc_recall_at_3_diff1": 0.28795,
+        "nauc_recall_at_5_max": -0.091556,
+        "nauc_recall_at_5_std": -0.155803,
+        "nauc_recall_at_5_diff1": 0.21108,
+        "nauc_recall_at_10_max": 0.036971,
+        "nauc_recall_at_10_std": -0.002475,
+        "nauc_recall_at_10_diff1": 0.162908,
+        "nauc_recall_at_20_max": 0.065984,
+        "nauc_recall_at_20_std": 0.059345,
+        "nauc_recall_at_20_diff1": 0.069385,
+        "nauc_recall_at_100_max": 0.275571,
+        "nauc_recall_at_100_std": 0.29203,
+        "nauc_recall_at_100_diff1": 0.232343,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": -0.102181,
+        "nauc_precision_at_1_std": -0.053594,
+        "nauc_precision_at_1_diff1": 0.297008,
+        "nauc_precision_at_3_max": -0.016414,
+        "nauc_precision_at_3_std": 0.041457,
+        "nauc_precision_at_3_diff1": -0.057753,
+        "nauc_precision_at_5_max": -0.03112,
+        "nauc_precision_at_5_std": 0.064324,
+        "nauc_precision_at_5_diff1": -0.202177,
+        "nauc_precision_at_10_max": 0.063056,
+        "nauc_precision_at_10_std": 0.17576,
+        "nauc_precision_at_10_diff1": -0.261728,
+        "nauc_precision_at_20_max": 0.068062,
+        "nauc_precision_at_20_std": 0.182567,
+        "nauc_precision_at_20_diff1": -0.281462,
+        "nauc_precision_at_100_max": 0.055665,
+        "nauc_precision_at_100_std": 0.169373,
+        "nauc_precision_at_100_diff1": -0.260794,
+        "nauc_precision_at_1000_max": 0.032138,
+        "nauc_precision_at_1000_std": 0.14495,
+        "nauc_precision_at_1000_diff1": -0.274454,
+        "nauc_mrr_at_1_max": -0.102181,
+        "nauc_mrr_at_1_std": -0.053594,
+        "nauc_mrr_at_1_diff1": 0.297008,
+        "nauc_mrr_at_3_max": -0.143801,
+        "nauc_mrr_at_3_std": -0.087266,
+        "nauc_mrr_at_3_diff1": 0.298314,
+        "nauc_mrr_at_5_max": -0.132636,
+        "nauc_mrr_at_5_std": -0.080501,
+        "nauc_mrr_at_5_diff1": 0.294615,
+        "nauc_mrr_at_10_max": -0.135292,
+        "nauc_mrr_at_10_std": -0.082018,
+        "nauc_mrr_at_10_diff1": 0.289799,
+        "nauc_mrr_at_20_max": -0.133724,
+        "nauc_mrr_at_20_std": -0.080368,
+        "nauc_mrr_at_20_diff1": 0.290059,
+        "nauc_mrr_at_100_max": -0.133876,
+        "nauc_mrr_at_100_std": -0.080444,
+        "nauc_mrr_at_100_diff1": 0.290957,
+        "nauc_mrr_at_1000_max": -0.133876,
+        "nauc_mrr_at_1000_std": -0.080444,
+        "nauc_mrr_at_1000_diff1": 0.290957,
+        "hit_rate_at_1": 0.72093,
+        "hit_rate_at_3": 0.89767,
+        "hit_rate_at_5": 0.95814,
+        "hit_rate_at_10": 0.9814,
+        "hit_rate_at_20": 0.98605,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.67708,
+        "hf_subset": "italian",
+        "languages": [
+          "ita-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.66977,
+        "ndcg_at_3": 0.65298,
+        "ndcg_at_5": 0.6626,
+        "ndcg_at_10": 0.68775,
+        "ndcg_at_20": 0.73229,
+        "ndcg_at_100": 0.77244,
+        "ndcg_at_1000": 0.78182,
+        "map_at_1": 0.28297,
+        "map_at_3": 0.44032,
+        "map_at_5": 0.5009,
+        "map_at_10": 0.5615,
+        "map_at_20": 0.60219,
+        "map_at_100": 0.6229,
+        "map_at_1000": 0.62445,
+        "recall_at_1": 0.28297,
+        "recall_at_3": 0.48937,
+        "recall_at_5": 0.58727,
+        "recall_at_10": 0.71256,
+        "recall_at_20": 0.83683,
+        "recall_at_100": 0.95562,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.28297,
+        "precision_at_1": 0.73023,
+        "precision_at_3": 0.51938,
+        "precision_at_5": 0.41767,
+        "precision_at_10": 0.28977,
+        "precision_at_20": 0.18535,
+        "precision_at_100": 0.04586,
+        "precision_at_1000": 0.00488,
+        "mrr_at_1": 0.730233,
+        "mrr_at_3": 0.810853,
+        "mrr_at_5": 0.820155,
+        "mrr_at_10": 0.824068,
+        "mrr_at_20": 0.825511,
+        "mrr_at_100": 0.825511,
+        "mrr_at_1000": 0.825511,
+        "nauc_ndcg_at_1_max": -0.130183,
+        "nauc_ndcg_at_1_std": -0.063454,
+        "nauc_ndcg_at_1_diff1": 0.383095,
+        "nauc_ndcg_at_3_max": -0.05207,
+        "nauc_ndcg_at_3_std": -0.049197,
+        "nauc_ndcg_at_3_diff1": 0.262666,
+        "nauc_ndcg_at_5_max": -0.072071,
+        "nauc_ndcg_at_5_std": -0.067015,
+        "nauc_ndcg_at_5_diff1": 0.262757,
+        "nauc_ndcg_at_10_max": -0.061935,
+        "nauc_ndcg_at_10_std": -0.067882,
+        "nauc_ndcg_at_10_diff1": 0.257938,
+        "nauc_ndcg_at_20_max": -0.023436,
+        "nauc_ndcg_at_20_std": -0.003652,
+        "nauc_ndcg_at_20_diff1": 0.267037,
+        "nauc_ndcg_at_100_max": -0.036819,
+        "nauc_ndcg_at_100_std": -0.000404,
+        "nauc_ndcg_at_100_diff1": 0.296472,
+        "nauc_ndcg_at_1000_max": -0.052265,
+        "nauc_ndcg_at_1000_std": -0.015205,
+        "nauc_ndcg_at_1000_diff1": 0.290564,
+        "nauc_map_at_1_max": -0.066728,
+        "nauc_map_at_1_std": -0.1009,
+        "nauc_map_at_1_diff1": 0.390773,
+        "nauc_map_at_3_max": -0.048193,
+        "nauc_map_at_3_std": -0.089334,
+        "nauc_map_at_3_diff1": 0.309042,
+        "nauc_map_at_5_max": -0.055801,
+        "nauc_map_at_5_std": -0.076553,
+        "nauc_map_at_5_diff1": 0.279385,
+        "nauc_map_at_10_max": -0.048105,
+        "nauc_map_at_10_std": -0.060456,
+        "nauc_map_at_10_diff1": 0.246509,
+        "nauc_map_at_20_max": -0.031276,
+        "nauc_map_at_20_std": -0.02597,
+        "nauc_map_at_20_diff1": 0.229253,
+        "nauc_map_at_100_max": -0.035681,
+        "nauc_map_at_100_std": -0.024801,
+        "nauc_map_at_100_diff1": 0.232638,
+        "nauc_map_at_1000_max": -0.037289,
+        "nauc_map_at_1000_std": -0.026428,
+        "nauc_map_at_1000_diff1": 0.231614,
+        "nauc_recall_at_1_max": -0.066728,
+        "nauc_recall_at_1_std": -0.1009,
+        "nauc_recall_at_1_diff1": 0.390773,
+        "nauc_recall_at_3_max": -0.01552,
+        "nauc_recall_at_3_std": -0.092032,
+        "nauc_recall_at_3_diff1": 0.261897,
+        "nauc_recall_at_5_max": -0.030304,
+        "nauc_recall_at_5_std": -0.083833,
+        "nauc_recall_at_5_diff1": 0.232041,
+        "nauc_recall_at_10_max": 0.018378,
+        "nauc_recall_at_10_std": -0.051766,
+        "nauc_recall_at_10_diff1": 0.169645,
+        "nauc_recall_at_20_max": 0.111311,
+        "nauc_recall_at_20_std": 0.083112,
+        "nauc_recall_at_20_diff1": 0.136655,
+        "nauc_recall_at_100_max": 0.273894,
+        "nauc_recall_at_100_std": 0.306476,
+        "nauc_recall_at_100_diff1": 0.307849,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": -0.224696,
+        "nauc_precision_at_1_std": -0.117432,
+        "nauc_precision_at_1_diff1": 0.351994,
+        "nauc_precision_at_3_max": -0.007818,
+        "nauc_precision_at_3_std": 0.048649,
+        "nauc_precision_at_3_diff1": -0.086214,
+        "nauc_precision_at_5_max": -0.021192,
+        "nauc_precision_at_5_std": 0.069292,
+        "nauc_precision_at_5_diff1": -0.182779,
+        "nauc_precision_at_10_max": 0.020934,
+        "nauc_precision_at_10_std": 0.096545,
+        "nauc_precision_at_10_diff1": -0.236621,
+        "nauc_precision_at_20_max": 0.060726,
+        "nauc_precision_at_20_std": 0.153175,
+        "nauc_precision_at_20_diff1": -0.251038,
+        "nauc_precision_at_100_max": 0.034836,
+        "nauc_precision_at_100_std": 0.127515,
+        "nauc_precision_at_100_diff1": -0.229078,
+        "nauc_precision_at_1000_max": 0.014868,
+        "nauc_precision_at_1000_std": 0.104576,
+        "nauc_precision_at_1000_diff1": -0.251462,
+        "nauc_mrr_at_1_max": -0.224696,
+        "nauc_mrr_at_1_std": -0.117432,
+        "nauc_mrr_at_1_diff1": 0.351994,
+        "nauc_mrr_at_3_max": -0.191756,
+        "nauc_mrr_at_3_std": -0.094934,
+        "nauc_mrr_at_3_diff1": 0.351978,
+        "nauc_mrr_at_5_max": -0.205507,
+        "nauc_mrr_at_5_std": -0.106025,
+        "nauc_mrr_at_5_diff1": 0.364231,
+        "nauc_mrr_at_10_max": -0.194943,
+        "nauc_mrr_at_10_std": -0.099746,
+        "nauc_mrr_at_10_diff1": 0.360979,
+        "nauc_mrr_at_20_max": -0.195922,
+        "nauc_mrr_at_20_std": -0.097561,
+        "nauc_mrr_at_20_diff1": 0.361664,
+        "nauc_mrr_at_100_max": -0.195922,
+        "nauc_mrr_at_100_std": -0.097561,
+        "nauc_mrr_at_100_diff1": 0.361664,
+        "nauc_mrr_at_1000_max": -0.195922,
+        "nauc_mrr_at_1000_std": -0.097561,
+        "nauc_mrr_at_1000_diff1": 0.361664,
+        "hit_rate_at_1": 0.73023,
+        "hit_rate_at_3": 0.91163,
+        "hit_rate_at_5": 0.95349,
+        "hit_rate_at_10": 0.9814,
+        "hit_rate_at_20": 1.0,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.68775,
+        "hf_subset": "portuguese",
+        "languages": [
+          "por-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 1400.72980260849,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v3/Vidore3EnergyRetrieval.json

@@ -0,0 +1,942 @@
+{
+  "dataset_revision": "84fca99e5978604bae30f2436eacb6dbaa0532e9",
+  "task_name": "Vidore3EnergyRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.54545,
+        "ndcg_at_3": 0.58457,
+        "ndcg_at_5": 0.5964,
+        "ndcg_at_10": 0.62552,
+        "ndcg_at_20": 0.66045,
+        "ndcg_at_100": 0.69792,
+        "ndcg_at_1000": 0.71039,
+        "map_at_1": 0.342,
+        "map_at_3": 0.46751,
+        "map_at_5": 0.49485,
+        "map_at_10": 0.52448,
+        "map_at_20": 0.54686,
+        "map_at_100": 0.56262,
+        "map_at_1000": 0.56444,
+        "recall_at_1": 0.342,
+        "recall_at_3": 0.54223,
+        "recall_at_5": 0.60337,
+        "recall_at_10": 0.70168,
+        "recall_at_20": 0.80835,
+        "recall_at_100": 0.9386,
+        "recall_at_1000": 0.99779,
+        "accuracy": 0.342,
+        "precision_at_1": 0.57792,
+        "precision_at_3": 0.35173,
+        "precision_at_5": 0.25779,
+        "precision_at_10": 0.17175,
+        "precision_at_20": 0.11299,
+        "precision_at_100": 0.03107,
+        "precision_at_1000": 0.00356,
+        "mrr_at_1": 0.577922,
+        "mrr_at_3": 0.676407,
+        "mrr_at_5": 0.687608,
+        "mrr_at_10": 0.697043,
+        "mrr_at_20": 0.700519,
+        "mrr_at_100": 0.701613,
+        "mrr_at_1000": 0.701635,
+        "nauc_ndcg_at_1_max": 0.103047,
+        "nauc_ndcg_at_1_std": -0.039499,
+        "nauc_ndcg_at_1_diff1": 0.459632,
+        "nauc_ndcg_at_3_max": 0.064959,
+        "nauc_ndcg_at_3_std": -0.09443,
+        "nauc_ndcg_at_3_diff1": 0.403802,
+        "nauc_ndcg_at_5_max": 0.046218,
+        "nauc_ndcg_at_5_std": -0.119386,
+        "nauc_ndcg_at_5_diff1": 0.395607,
+        "nauc_ndcg_at_10_max": 0.075158,
+        "nauc_ndcg_at_10_std": -0.101884,
+        "nauc_ndcg_at_10_diff1": 0.383102,
+        "nauc_ndcg_at_20_max": 0.062031,
+        "nauc_ndcg_at_20_std": -0.099086,
+        "nauc_ndcg_at_20_diff1": 0.375463,
+        "nauc_ndcg_at_100_max": 0.063706,
+        "nauc_ndcg_at_100_std": -0.080098,
+        "nauc_ndcg_at_100_diff1": 0.383757,
+        "nauc_ndcg_at_1000_max": 0.070256,
+        "nauc_ndcg_at_1000_std": -0.070229,
+        "nauc_ndcg_at_1000_diff1": 0.388893,
+        "nauc_map_at_1_max": 0.093558,
+        "nauc_map_at_1_std": -0.035791,
+        "nauc_map_at_1_diff1": 0.462571,
+        "nauc_map_at_3_max": 0.058932,
+        "nauc_map_at_3_std": -0.081437,
+        "nauc_map_at_3_diff1": 0.410603,
+        "nauc_map_at_5_max": 0.042638,
+        "nauc_map_at_5_std": -0.102126,
+        "nauc_map_at_5_diff1": 0.40013,
+        "nauc_map_at_10_max": 0.039643,
+        "nauc_map_at_10_std": -0.10798,
+        "nauc_map_at_10_diff1": 0.3833,
+        "nauc_map_at_20_max": 0.03739,
+        "nauc_map_at_20_std": -0.106219,
+        "nauc_map_at_20_diff1": 0.376144,
+        "nauc_map_at_100_max": 0.042806,
+        "nauc_map_at_100_std": -0.092895,
+        "nauc_map_at_100_diff1": 0.376339,
+        "nauc_map_at_1000_max": 0.043394,
+        "nauc_map_at_1000_std": -0.091644,
+        "nauc_map_at_1000_diff1": 0.377581,
+        "nauc_recall_at_1_max": 0.093558,
+        "nauc_recall_at_1_std": -0.035791,
+        "nauc_recall_at_1_diff1": 0.462571,
+        "nauc_recall_at_3_max": 0.032666,
+        "nauc_recall_at_3_std": -0.109425,
+        "nauc_recall_at_3_diff1": 0.355741,
+        "nauc_recall_at_5_max": -0.003683,
+        "nauc_recall_at_5_std": -0.16275,
+        "nauc_recall_at_5_diff1": 0.331769,
+        "nauc_recall_at_10_max": 0.069116,
+        "nauc_recall_at_10_std": -0.126149,
+        "nauc_recall_at_10_diff1": 0.281483,
+        "nauc_recall_at_20_max": 0.025756,
+        "nauc_recall_at_20_std": -0.14773,
+        "nauc_recall_at_20_diff1": 0.230977,
+        "nauc_recall_at_100_max": -0.043468,
+        "nauc_recall_at_100_std": -0.17323,
+        "nauc_recall_at_100_diff1": 0.198436,
+        "nauc_recall_at_1000_max": -0.583819,
+        "nauc_recall_at_1000_std": -0.366112,
+        "nauc_recall_at_1000_diff1": -0.506612,
+        "nauc_precision_at_1_max": 0.079605,
+        "nauc_precision_at_1_std": -0.049272,
+        "nauc_precision_at_1_diff1": 0.454674,
+        "nauc_precision_at_3_max": -0.06437,
+        "nauc_precision_at_3_std": -0.122542,
+        "nauc_precision_at_3_diff1": 0.049303,
+        "nauc_precision_at_5_max": -0.119759,
+        "nauc_precision_at_5_std": -0.143959,
+        "nauc_precision_at_5_diff1": -0.063629,
+        "nauc_precision_at_10_max": -0.056355,
+        "nauc_precision_at_10_std": -0.030992,
+        "nauc_precision_at_10_diff1": -0.171511,
+        "nauc_precision_at_20_max": -0.038412,
+        "nauc_precision_at_20_std": 0.045105,
+        "nauc_precision_at_20_diff1": -0.216384,
+        "nauc_precision_at_100_max": -0.004669,
+        "nauc_precision_at_100_std": 0.139583,
+        "nauc_precision_at_100_diff1": -0.194562,
+        "nauc_precision_at_1000_max": 0.010104,
+        "nauc_precision_at_1000_std": 0.146183,
+        "nauc_precision_at_1000_diff1": -0.172256,
+        "nauc_mrr_at_1_max": 0.079605,
+        "nauc_mrr_at_1_std": -0.049272,
+        "nauc_mrr_at_1_diff1": 0.454674,
+        "nauc_mrr_at_3_max": 0.066453,
+        "nauc_mrr_at_3_std": -0.083242,
+        "nauc_mrr_at_3_diff1": 0.412049,
+        "nauc_mrr_at_5_max": 0.054898,
+        "nauc_mrr_at_5_std": -0.094026,
+        "nauc_mrr_at_5_diff1": 0.407434,
+        "nauc_mrr_at_10_max": 0.074971,
+        "nauc_mrr_at_10_std": -0.070252,
+        "nauc_mrr_at_10_diff1": 0.405814,
+        "nauc_mrr_at_20_max": 0.071551,
+        "nauc_mrr_at_20_std": -0.071514,
+        "nauc_mrr_at_20_diff1": 0.409517,
+        "nauc_mrr_at_100_max": 0.069764,
+        "nauc_mrr_at_100_std": -0.073761,
+        "nauc_mrr_at_100_diff1": 0.409846,
+        "nauc_mrr_at_1000_max": 0.069786,
+        "nauc_mrr_at_1000_std": -0.073752,
+        "nauc_mrr_at_1000_diff1": 0.409833,
+        "hit_rate_at_1": 0.57792,
+        "hit_rate_at_3": 0.79545,
+        "hit_rate_at_5": 0.84416,
+        "hit_rate_at_10": 0.91558,
+        "hit_rate_at_20": 0.96429,
+        "hit_rate_at_100": 0.99675,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.62552,
+        "hf_subset": "french",
+        "languages": [
+          "fra-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.5276,
+        "ndcg_at_3": 0.55875,
+        "ndcg_at_5": 0.57182,
+        "ndcg_at_10": 0.60548,
+        "ndcg_at_20": 0.63424,
+        "ndcg_at_100": 0.67596,
+        "ndcg_at_1000": 0.68984,
+        "map_at_1": 0.32597,
+        "map_at_3": 0.44511,
+        "map_at_5": 0.47243,
+        "map_at_10": 0.50277,
+        "map_at_20": 0.52248,
+        "map_at_100": 0.5387,
+        "map_at_1000": 0.54074,
+        "recall_at_1": 0.32597,
+        "recall_at_3": 0.51642,
+        "recall_at_5": 0.57777,
+        "recall_at_10": 0.68364,
+        "recall_at_20": 0.77647,
+        "recall_at_100": 0.92998,
+        "recall_at_1000": 0.99755,
+        "accuracy": 0.32597,
+        "precision_at_1": 0.55844,
+        "precision_at_3": 0.34199,
+        "precision_at_5": 0.25455,
+        "precision_at_10": 0.17175,
+        "precision_at_20": 0.10942,
+        "precision_at_100": 0.03042,
+        "precision_at_1000": 0.00356,
+        "mrr_at_1": 0.558442,
+        "mrr_at_3": 0.652597,
+        "mrr_at_5": 0.664123,
+        "mrr_at_10": 0.673749,
+        "mrr_at_20": 0.677063,
+        "mrr_at_100": 0.678536,
+        "mrr_at_1000": 0.678576,
+        "nauc_ndcg_at_1_max": 0.0507,
+        "nauc_ndcg_at_1_std": -0.046781,
+        "nauc_ndcg_at_1_diff1": 0.448069,
+        "nauc_ndcg_at_3_max": 0.051676,
+        "nauc_ndcg_at_3_std": -0.038092,
+        "nauc_ndcg_at_3_diff1": 0.416546,
+        "nauc_ndcg_at_5_max": 0.0521,
+        "nauc_ndcg_at_5_std": -0.04762,
+        "nauc_ndcg_at_5_diff1": 0.408956,
+        "nauc_ndcg_at_10_max": 0.058693,
+        "nauc_ndcg_at_10_std": -0.042252,
+        "nauc_ndcg_at_10_diff1": 0.412067,
+        "nauc_ndcg_at_20_max": 0.063264,
+        "nauc_ndcg_at_20_std": -0.034748,
+        "nauc_ndcg_at_20_diff1": 0.404887,
+        "nauc_ndcg_at_100_max": 0.064179,
+        "nauc_ndcg_at_100_std": -0.023877,
+        "nauc_ndcg_at_100_diff1": 0.397043,
+        "nauc_ndcg_at_1000_max": 0.068003,
+        "nauc_ndcg_at_1000_std": -0.015056,
+        "nauc_ndcg_at_1000_diff1": 0.411339,
+        "nauc_map_at_1_max": 0.091078,
+        "nauc_map_at_1_std": -0.023617,
+        "nauc_map_at_1_diff1": 0.44829,
+        "nauc_map_at_3_max": 0.05747,
+        "nauc_map_at_3_std": -0.053203,
+        "nauc_map_at_3_diff1": 0.408435,
+        "nauc_map_at_5_max": 0.049538,
+        "nauc_map_at_5_std": -0.061865,
+        "nauc_map_at_5_diff1": 0.409337,
+        "nauc_map_at_10_max": 0.043801,
+        "nauc_map_at_10_std": -0.06526,
+        "nauc_map_at_10_diff1": 0.400544,
+        "nauc_map_at_20_max": 0.041648,
+        "nauc_map_at_20_std": -0.063041,
+        "nauc_map_at_20_diff1": 0.391837,
+        "nauc_map_at_100_max": 0.04881,
+        "nauc_map_at_100_std": -0.050755,
+        "nauc_map_at_100_diff1": 0.38867,
+        "nauc_map_at_1000_max": 0.049694,
+        "nauc_map_at_1000_std": -0.048843,
+        "nauc_map_at_1000_diff1": 0.390105,
+        "nauc_recall_at_1_max": 0.091078,
+        "nauc_recall_at_1_std": -0.023617,
+        "nauc_recall_at_1_diff1": 0.44829,
+        "nauc_recall_at_3_max": 0.043599,
+        "nauc_recall_at_3_std": -0.035519,
+        "nauc_recall_at_3_diff1": 0.339508,
+        "nauc_recall_at_5_max": 0.03812,
+        "nauc_recall_at_5_std": -0.049224,
+        "nauc_recall_at_5_diff1": 0.322174,
+        "nauc_recall_at_10_max": 0.026828,
+        "nauc_recall_at_10_std": -0.045444,
+        "nauc_recall_at_10_diff1": 0.312384,
+        "nauc_recall_at_20_max": 0.055632,
+        "nauc_recall_at_20_std": -0.024577,
+        "nauc_recall_at_20_diff1": 0.29129,
+        "nauc_recall_at_100_max": 0.008542,
+        "nauc_recall_at_100_std": -0.050721,
+        "nauc_recall_at_100_diff1": 0.032664,
+        "nauc_recall_at_1000_max": -0.520883,
+        "nauc_recall_at_1000_std": 0.128419,
+        "nauc_recall_at_1000_diff1": -1.02825,
+        "nauc_precision_at_1_max": 0.042081,
+        "nauc_precision_at_1_std": -0.053528,
+        "nauc_precision_at_1_diff1": 0.457297,
+        "nauc_precision_at_3_max": -0.053137,
+        "nauc_precision_at_3_std": -0.068778,
+        "nauc_precision_at_3_diff1": 0.112644,
+        "nauc_precision_at_5_max": -0.071457,
+        "nauc_precision_at_5_std": -0.071595,
+        "nauc_precision_at_5_diff1": 0.010884,
+        "nauc_precision_at_10_max": -0.02841,
+        "nauc_precision_at_10_std": 0.006775,
+        "nauc_precision_at_10_diff1": -0.096185,
+        "nauc_precision_at_20_max": -0.015321,
+        "nauc_precision_at_20_std": 0.059059,
+        "nauc_precision_at_20_diff1": -0.165114,
+        "nauc_precision_at_100_max": 0.022652,
+        "nauc_precision_at_100_std": 0.133847,
+        "nauc_precision_at_100_diff1": -0.193549,
+        "nauc_precision_at_1000_max": 0.02783,
+        "nauc_precision_at_1000_std": 0.143156,
+        "nauc_precision_at_1000_diff1": -0.15051,
+        "nauc_mrr_at_1_max": 0.042081,
+        "nauc_mrr_at_1_std": -0.053528,
+        "nauc_mrr_at_1_diff1": 0.457297,
+        "nauc_mrr_at_3_max": 0.050276,
+        "nauc_mrr_at_3_std": -0.037792,
+        "nauc_mrr_at_3_diff1": 0.447378,
+        "nauc_mrr_at_5_max": 0.049349,
+        "nauc_mrr_at_5_std": -0.037192,
+        "nauc_mrr_at_5_diff1": 0.434493,
+        "nauc_mrr_at_10_max": 0.053003,
+        "nauc_mrr_at_10_std": -0.03072,
+        "nauc_mrr_at_10_diff1": 0.444393,
+        "nauc_mrr_at_20_max": 0.053894,
+        "nauc_mrr_at_20_std": -0.031547,
+        "nauc_mrr_at_20_diff1": 0.447557,
+        "nauc_mrr_at_100_max": 0.05237,
+        "nauc_mrr_at_100_std": -0.033817,
+        "nauc_mrr_at_100_diff1": 0.445695,
+        "nauc_mrr_at_1000_max": 0.05238,
+        "nauc_mrr_at_1000_std": -0.033841,
+        "nauc_mrr_at_1000_diff1": 0.445731,
+        "hit_rate_at_1": 0.55844,
+        "hit_rate_at_3": 0.76948,
+        "hit_rate_at_5": 0.82468,
+        "hit_rate_at_10": 0.8961,
+        "hit_rate_at_20": 0.94481,
+        "hit_rate_at_100": 0.99351,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.60548,
+        "hf_subset": "spanish",
+        "languages": [
+          "spa-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.51623,
+        "ndcg_at_3": 0.5358,
+        "ndcg_at_5": 0.54363,
+        "ndcg_at_10": 0.57345,
+        "ndcg_at_20": 0.61109,
+        "ndcg_at_100": 0.65323,
+        "ndcg_at_1000": 0.67022,
+        "map_at_1": 0.32626,
+        "map_at_3": 0.42988,
+        "map_at_5": 0.4502,
+        "map_at_10": 0.47728,
+        "map_at_20": 0.50044,
+        "map_at_100": 0.51558,
+        "map_at_1000": 0.51777,
+        "recall_at_1": 0.32626,
+        "recall_at_3": 0.49423,
+        "recall_at_5": 0.54627,
+        "recall_at_10": 0.63761,
+        "recall_at_20": 0.75669,
+        "recall_at_100": 0.9098,
+        "recall_at_1000": 0.99655,
+        "accuracy": 0.32626,
+        "precision_at_1": 0.5487,
+        "precision_at_3": 0.32576,
+        "precision_at_5": 0.23247,
+        "precision_at_10": 0.15714,
+        "precision_at_20": 0.10568,
+        "precision_at_100": 0.02945,
+        "precision_at_1000": 0.00355,
+        "mrr_at_1": 0.548701,
+        "mrr_at_3": 0.630952,
+        "mrr_at_5": 0.644913,
+        "mrr_at_10": 0.654551,
+        "mrr_at_20": 0.658928,
+        "mrr_at_100": 0.660981,
+        "mrr_at_1000": 0.661033,
+        "nauc_ndcg_at_1_max": 0.074233,
+        "nauc_ndcg_at_1_std": 0.046895,
+        "nauc_ndcg_at_1_diff1": 0.370016,
+        "nauc_ndcg_at_3_max": 0.141547,
+        "nauc_ndcg_at_3_std": 0.040224,
+        "nauc_ndcg_at_3_diff1": 0.379251,
+        "nauc_ndcg_at_5_max": 0.147011,
+        "nauc_ndcg_at_5_std": 0.0407,
+        "nauc_ndcg_at_5_diff1": 0.364715,
+        "nauc_ndcg_at_10_max": 0.138733,
+        "nauc_ndcg_at_10_std": 0.053853,
+        "nauc_ndcg_at_10_diff1": 0.373897,
+        "nauc_ndcg_at_20_max": 0.154358,
+        "nauc_ndcg_at_20_std": 0.07599,
+        "nauc_ndcg_at_20_diff1": 0.358227,
+        "nauc_ndcg_at_100_max": 0.150333,
+        "nauc_ndcg_at_100_std": 0.090909,
+        "nauc_ndcg_at_100_diff1": 0.367425,
+        "nauc_ndcg_at_1000_max": 0.149977,
+        "nauc_ndcg_at_1000_std": 0.093917,
+        "nauc_ndcg_at_1000_diff1": 0.379847,
+        "nauc_map_at_1_max": 0.122209,
+        "nauc_map_at_1_std": 0.04455,
+        "nauc_map_at_1_diff1": 0.393986,
+        "nauc_map_at_3_max": 0.137286,
+        "nauc_map_at_3_std": 0.019874,
+        "nauc_map_at_3_diff1": 0.379585,
+        "nauc_map_at_5_max": 0.136672,
+        "nauc_map_at_5_std": 0.017289,
+        "nauc_map_at_5_diff1": 0.375823,
+        "nauc_map_at_10_max": 0.125714,
+        "nauc_map_at_10_std": 0.022933,
+        "nauc_map_at_10_diff1": 0.375024,
+        "nauc_map_at_20_max": 0.1234,
+        "nauc_map_at_20_std": 0.033734,
+        "nauc_map_at_20_diff1": 0.365438,
+        "nauc_map_at_100_max": 0.128793,
+        "nauc_map_at_100_std": 0.047762,
+        "nauc_map_at_100_diff1": 0.367185,
+        "nauc_map_at_1000_max": 0.128936,
+        "nauc_map_at_1000_std": 0.04926,
+        "nauc_map_at_1000_diff1": 0.368366,
+        "nauc_recall_at_1_max": 0.122209,
+        "nauc_recall_at_1_std": 0.04455,
+        "nauc_recall_at_1_diff1": 0.393986,
+        "nauc_recall_at_3_max": 0.166995,
+        "nauc_recall_at_3_std": 0.006699,
+        "nauc_recall_at_3_diff1": 0.333291,
+        "nauc_recall_at_5_max": 0.162019,
+        "nauc_recall_at_5_std": -0.005549,
+        "nauc_recall_at_5_diff1": 0.317907,
+        "nauc_recall_at_10_max": 0.131346,
+        "nauc_recall_at_10_std": 0.024906,
+        "nauc_recall_at_10_diff1": 0.308227,
+        "nauc_recall_at_20_max": 0.178379,
+        "nauc_recall_at_20_std": 0.077027,
+        "nauc_recall_at_20_diff1": 0.225377,
+        "nauc_recall_at_100_max": 0.162403,
+        "nauc_recall_at_100_std": 0.135541,
+        "nauc_recall_at_100_diff1": 0.195053,
+        "nauc_recall_at_1000_max": -0.064221,
+        "nauc_recall_at_1000_std": 0.096336,
+        "nauc_recall_at_1000_diff1": 0.028497,
+        "nauc_precision_at_1_max": 0.054046,
+        "nauc_precision_at_1_std": 0.041538,
+        "nauc_precision_at_1_diff1": 0.407462,
+        "nauc_precision_at_3_max": 0.001147,
+        "nauc_precision_at_3_std": -0.036675,
+        "nauc_precision_at_3_diff1": 0.138619,
+        "nauc_precision_at_5_max": -0.02923,
+        "nauc_precision_at_5_std": -0.027322,
+        "nauc_precision_at_5_diff1": 0.060339,
+        "nauc_precision_at_10_max": -0.062563,
+        "nauc_precision_at_10_std": 0.049615,
+        "nauc_precision_at_10_diff1": -0.029253,
+        "nauc_precision_at_20_max": -0.040382,
+        "nauc_precision_at_20_std": 0.116627,
+        "nauc_precision_at_20_diff1": -0.124255,
+        "nauc_precision_at_100_max": -0.017995,
+        "nauc_precision_at_100_std": 0.166471,
+        "nauc_precision_at_100_diff1": -0.132283,
+        "nauc_precision_at_1000_max": -0.021358,
+        "nauc_precision_at_1000_std": 0.150162,
+        "nauc_precision_at_1000_diff1": -0.117198,
+        "nauc_mrr_at_1_max": 0.054046,
+        "nauc_mrr_at_1_std": 0.041538,
+        "nauc_mrr_at_1_diff1": 0.407462,
+        "nauc_mrr_at_3_max": 0.10029,
+        "nauc_mrr_at_3_std": 0.051778,
+        "nauc_mrr_at_3_diff1": 0.403596,
+        "nauc_mrr_at_5_max": 0.095173,
+        "nauc_mrr_at_5_std": 0.052989,
+        "nauc_mrr_at_5_diff1": 0.396443,
+        "nauc_mrr_at_10_max": 0.097238,
+        "nauc_mrr_at_10_std": 0.066919,
+        "nauc_mrr_at_10_diff1": 0.400336,
+        "nauc_mrr_at_20_max": 0.10072,
+        "nauc_mrr_at_20_std": 0.068697,
+        "nauc_mrr_at_20_diff1": 0.39811,
+        "nauc_mrr_at_100_max": 0.09835,
+        "nauc_mrr_at_100_std": 0.066034,
+        "nauc_mrr_at_100_diff1": 0.400042,
+        "nauc_mrr_at_1000_max": 0.098281,
+        "nauc_mrr_at_1000_std": 0.065911,
+        "nauc_mrr_at_1000_diff1": 0.399986,
+        "hit_rate_at_1": 0.5487,
+        "hit_rate_at_3": 0.73377,
+        "hit_rate_at_5": 0.79545,
+        "hit_rate_at_10": 0.86688,
+        "hit_rate_at_20": 0.92532,
+        "hit_rate_at_100": 0.98701,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.57345,
+        "hf_subset": "english",
+        "languages": [
+          "eng-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.49026,
+        "ndcg_at_3": 0.53465,
+        "ndcg_at_5": 0.55369,
+        "ndcg_at_10": 0.58341,
+        "ndcg_at_20": 0.61862,
+        "ndcg_at_100": 0.6627,
+        "ndcg_at_1000": 0.67549,
+        "map_at_1": 0.31064,
+        "map_at_3": 0.42675,
+        "map_at_5": 0.45454,
+        "map_at_10": 0.48241,
+        "map_at_20": 0.50399,
+        "map_at_100": 0.52075,
+        "map_at_1000": 0.52271,
+        "recall_at_1": 0.31064,
+        "recall_at_3": 0.50611,
+        "recall_at_5": 0.57385,
+        "recall_at_10": 0.66421,
+        "recall_at_20": 0.77667,
+        "recall_at_100": 0.93443,
+        "recall_at_1000": 0.99667,
+        "accuracy": 0.31064,
+        "precision_at_1": 0.51948,
+        "precision_at_3": 0.32359,
+        "precision_at_5": 0.24416,
+        "precision_at_10": 0.16331,
+        "precision_at_20": 0.10779,
+        "precision_at_100": 0.03075,
+        "precision_at_1000": 0.00356,
+        "mrr_at_1": 0.519481,
+        "mrr_at_3": 0.619048,
+        "mrr_at_5": 0.63447,
+        "mrr_at_10": 0.645147,
+        "mrr_at_20": 0.649652,
+        "mrr_at_100": 0.650926,
+        "mrr_at_1000": 0.650953,
+        "nauc_ndcg_at_1_max": 0.06172,
+        "nauc_ndcg_at_1_std": 0.015877,
+        "nauc_ndcg_at_1_diff1": 0.450203,
+        "nauc_ndcg_at_3_max": 0.067473,
+        "nauc_ndcg_at_3_std": -0.036032,
+        "nauc_ndcg_at_3_diff1": 0.385259,
+        "nauc_ndcg_at_5_max": 0.065811,
+        "nauc_ndcg_at_5_std": -0.036402,
+        "nauc_ndcg_at_5_diff1": 0.375189,
+        "nauc_ndcg_at_10_max": 0.063364,
+        "nauc_ndcg_at_10_std": -0.018584,
+        "nauc_ndcg_at_10_diff1": 0.36343,
+        "nauc_ndcg_at_20_max": 0.0661,
+        "nauc_ndcg_at_20_std": -0.013505,
+        "nauc_ndcg_at_20_diff1": 0.364127,
+        "nauc_ndcg_at_100_max": 0.059494,
+        "nauc_ndcg_at_100_std": -0.006556,
+        "nauc_ndcg_at_100_diff1": 0.369111,
+        "nauc_ndcg_at_1000_max": 0.071317,
+        "nauc_ndcg_at_1000_std": 0.007506,
+        "nauc_ndcg_at_1000_diff1": 0.376692,
+        "nauc_map_at_1_max": 0.056971,
+        "nauc_map_at_1_std": 0.000643,
+        "nauc_map_at_1_diff1": 0.386732,
+        "nauc_map_at_3_max": 0.045929,
+        "nauc_map_at_3_std": -0.050284,
+        "nauc_map_at_3_diff1": 0.354967,
+        "nauc_map_at_5_max": 0.042705,
+        "nauc_map_at_5_std": -0.052507,
+        "nauc_map_at_5_diff1": 0.35941,
+        "nauc_map_at_10_max": 0.040457,
+        "nauc_map_at_10_std": -0.044311,
+        "nauc_map_at_10_diff1": 0.349557,
+        "nauc_map_at_20_max": 0.039452,
+        "nauc_map_at_20_std": -0.045167,
+        "nauc_map_at_20_diff1": 0.342594,
+        "nauc_map_at_100_max": 0.039067,
+        "nauc_map_at_100_std": -0.040424,
+        "nauc_map_at_100_diff1": 0.340806,
+        "nauc_map_at_1000_max": 0.040976,
+        "nauc_map_at_1000_std": -0.037712,
+        "nauc_map_at_1000_diff1": 0.341793,
+        "nauc_recall_at_1_max": 0.056971,
+        "nauc_recall_at_1_std": 0.000643,
+        "nauc_recall_at_1_diff1": 0.386732,
+        "nauc_recall_at_3_max": 0.049262,
+        "nauc_recall_at_3_std": -0.075719,
+        "nauc_recall_at_3_diff1": 0.292435,
+        "nauc_recall_at_5_max": 0.055569,
+        "nauc_recall_at_5_std": -0.061855,
+        "nauc_recall_at_5_diff1": 0.283105,
+        "nauc_recall_at_10_max": 0.043712,
+        "nauc_recall_at_10_std": -0.036436,
+        "nauc_recall_at_10_diff1": 0.239885,
+        "nauc_recall_at_20_max": 0.049107,
+        "nauc_recall_at_20_std": -0.055726,
+        "nauc_recall_at_20_diff1": 0.224521,
+        "nauc_recall_at_100_max": -0.077079,
+        "nauc_recall_at_100_std": -0.1181,
+        "nauc_recall_at_100_diff1": 0.178245,
+        "nauc_recall_at_1000_max": 0.421473,
+        "nauc_recall_at_1000_std": 0.465915,
+        "nauc_recall_at_1000_diff1": 0.13377,
+        "nauc_precision_at_1_max": 0.045504,
+        "nauc_precision_at_1_std": -0.000671,
+        "nauc_precision_at_1_diff1": 0.466446,
+        "nauc_precision_at_3_max": 0.005905,
+        "nauc_precision_at_3_std": -0.061619,
+        "nauc_precision_at_3_diff1": 0.155487,
+        "nauc_precision_at_5_max": -0.014217,
+        "nauc_precision_at_5_std": -0.04285,
+        "nauc_precision_at_5_diff1": 0.058747,
+        "nauc_precision_at_10_max": -0.022499,
+        "nauc_precision_at_10_std": 0.025492,
+        "nauc_precision_at_10_diff1": -0.07763,
+        "nauc_precision_at_20_max": -0.011828,
+        "nauc_precision_at_20_std": 0.047547,
+        "nauc_precision_at_20_diff1": -0.162993,
+        "nauc_precision_at_100_max": 0.012785,
+        "nauc_precision_at_100_std": 0.100789,
+        "nauc_precision_at_100_diff1": -0.157138,
+        "nauc_precision_at_1000_max": 0.047913,
+        "nauc_precision_at_1000_std": 0.129557,
+        "nauc_precision_at_1000_diff1": -0.138907,
+        "nauc_mrr_at_1_max": 0.045504,
+        "nauc_mrr_at_1_std": -0.000671,
+        "nauc_mrr_at_1_diff1": 0.466446,
+        "nauc_mrr_at_3_max": 0.074244,
+        "nauc_mrr_at_3_std": -0.004762,
+        "nauc_mrr_at_3_diff1": 0.454762,
+        "nauc_mrr_at_5_max": 0.076784,
+        "nauc_mrr_at_5_std": 0.001227,
+        "nauc_mrr_at_5_diff1": 0.445012,
+        "nauc_mrr_at_10_max": 0.072624,
+        "nauc_mrr_at_10_std": 0.0134,
+        "nauc_mrr_at_10_diff1": 0.444856,
+        "nauc_mrr_at_20_max": 0.071778,
+        "nauc_mrr_at_20_std": 0.010638,
+        "nauc_mrr_at_20_diff1": 0.448886,
+        "nauc_mrr_at_100_max": 0.071225,
+        "nauc_mrr_at_100_std": 0.008854,
+        "nauc_mrr_at_100_diff1": 0.448842,
+        "nauc_mrr_at_1000_max": 0.071224,
+        "nauc_mrr_at_1000_std": 0.008809,
+        "nauc_mrr_at_1000_diff1": 0.448882,
+        "hit_rate_at_1": 0.51948,
+        "hit_rate_at_3": 0.74351,
+        "hit_rate_at_5": 0.81169,
+        "hit_rate_at_10": 0.88961,
+        "hit_rate_at_20": 0.9513,
+        "hit_rate_at_100": 0.99351,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.58341,
+        "hf_subset": "german",
+        "languages": [
+          "deu-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.5487,
+        "ndcg_at_3": 0.5577,
+        "ndcg_at_5": 0.58675,
+        "ndcg_at_10": 0.61171,
+        "ndcg_at_20": 0.64739,
+        "ndcg_at_100": 0.68553,
+        "ndcg_at_1000": 0.69901,
+        "map_at_1": 0.33775,
+        "map_at_3": 0.44313,
+        "map_at_5": 0.47949,
+        "map_at_10": 0.50643,
+        "map_at_20": 0.52992,
+        "map_at_100": 0.54555,
+        "map_at_1000": 0.54751,
+        "recall_at_1": 0.33775,
+        "recall_at_3": 0.50133,
+        "recall_at_5": 0.5961,
+        "recall_at_10": 0.68681,
+        "recall_at_20": 0.8,
+        "recall_at_100": 0.93266,
+        "recall_at_1000": 0.99779,
+        "accuracy": 0.33775,
+        "precision_at_1": 0.58117,
+        "precision_at_3": 0.33874,
+        "precision_at_5": 0.26104,
+        "precision_at_10": 0.17045,
+        "precision_at_20": 0.11136,
+        "precision_at_100": 0.03075,
+        "precision_at_1000": 0.00356,
+        "mrr_at_1": 0.581169,
+        "mrr_at_3": 0.66342,
+        "mrr_at_5": 0.682089,
+        "mrr_at_10": 0.690191,
+        "mrr_at_20": 0.693871,
+        "mrr_at_100": 0.695036,
+        "mrr_at_1000": 0.695049,
+        "nauc_ndcg_at_1_max": -0.002686,
+        "nauc_ndcg_at_1_std": -0.036149,
+        "nauc_ndcg_at_1_diff1": 0.406771,
+        "nauc_ndcg_at_3_max": 0.031663,
+        "nauc_ndcg_at_3_std": -0.032924,
+        "nauc_ndcg_at_3_diff1": 0.37702,
+        "nauc_ndcg_at_5_max": 0.023401,
+        "nauc_ndcg_at_5_std": -0.062435,
+        "nauc_ndcg_at_5_diff1": 0.354268,
+        "nauc_ndcg_at_10_max": 0.025562,
+        "nauc_ndcg_at_10_std": -0.047173,
+        "nauc_ndcg_at_10_diff1": 0.343786,
+        "nauc_ndcg_at_20_max": 0.013677,
+        "nauc_ndcg_at_20_std": -0.045943,
+        "nauc_ndcg_at_20_diff1": 0.335802,
+        "nauc_ndcg_at_100_max": 0.015101,
+        "nauc_ndcg_at_100_std": -0.025785,
+        "nauc_ndcg_at_100_diff1": 0.347987,
+        "nauc_ndcg_at_1000_max": 0.023603,
+        "nauc_ndcg_at_1000_std": -0.016936,
+        "nauc_ndcg_at_1000_diff1": 0.358176,
+        "nauc_map_at_1_max": 0.016781,
+        "nauc_map_at_1_std": -0.021539,
+        "nauc_map_at_1_diff1": 0.39507,
+        "nauc_map_at_3_max": 0.017544,
+        "nauc_map_at_3_std": -0.050771,
+        "nauc_map_at_3_diff1": 0.361375,
+        "nauc_map_at_5_max": 0.00686,
+        "nauc_map_at_5_std": -0.068111,
+        "nauc_map_at_5_diff1": 0.344103,
+        "nauc_map_at_10_max": 0.001723,
+        "nauc_map_at_10_std": -0.063781,
+        "nauc_map_at_10_diff1": 0.338479,
+        "nauc_map_at_20_max": -0.00124,
+        "nauc_map_at_20_std": -0.059222,
+        "nauc_map_at_20_diff1": 0.329961,
+        "nauc_map_at_100_max": 0.00356,
+        "nauc_map_at_100_std": -0.045945,
+        "nauc_map_at_100_diff1": 0.332019,
+        "nauc_map_at_1000_max": 0.004633,
+        "nauc_map_at_1000_std": -0.044341,
+        "nauc_map_at_1000_diff1": 0.333608,
+        "nauc_recall_at_1_max": 0.016781,
+        "nauc_recall_at_1_std": -0.021539,
+        "nauc_recall_at_1_diff1": 0.39507,
+        "nauc_recall_at_3_max": 0.025431,
+        "nauc_recall_at_3_std": -0.063857,
+        "nauc_recall_at_3_diff1": 0.324058,
+        "nauc_recall_at_5_max": 0.015917,
+        "nauc_recall_at_5_std": -0.110943,
+        "nauc_recall_at_5_diff1": 0.264188,
+        "nauc_recall_at_10_max": 0.018185,
+        "nauc_recall_at_10_std": -0.092216,
+        "nauc_recall_at_10_diff1": 0.22013,
+        "nauc_recall_at_20_max": -0.018934,
+        "nauc_recall_at_20_std": -0.115871,
+        "nauc_recall_at_20_diff1": 0.158788,
+        "nauc_recall_at_100_max": -0.091724,
+        "nauc_recall_at_100_std": -0.117258,
+        "nauc_recall_at_100_diff1": 0.116852,
+        "nauc_recall_at_1000_max": -0.558767,
+        "nauc_recall_at_1000_std": -0.224974,
+        "nauc_recall_at_1000_diff1": -0.836098,
+        "nauc_precision_at_1_max": -0.016365,
+        "nauc_precision_at_1_std": -0.035168,
+        "nauc_precision_at_1_diff1": 0.399218,
+        "nauc_precision_at_3_max": -0.014328,
+        "nauc_precision_at_3_std": -0.05275,
+        "nauc_precision_at_3_diff1": 0.075815,
+        "nauc_precision_at_5_max": -0.056764,
+        "nauc_precision_at_5_std": -0.084665,
+        "nauc_precision_at_5_diff1": -0.046374,
+        "nauc_precision_at_10_max": -0.025253,
+        "nauc_precision_at_10_std": 0.028463,
+        "nauc_precision_at_10_diff1": -0.102639,
+        "nauc_precision_at_20_max": -0.010297,
+        "nauc_precision_at_20_std": 0.08363,
+        "nauc_precision_at_20_diff1": -0.160303,
+        "nauc_precision_at_100_max": 0.033021,
+        "nauc_precision_at_100_std": 0.157783,
+        "nauc_precision_at_100_diff1": -0.1231,
+        "nauc_precision_at_1000_max": 0.05564,
+        "nauc_precision_at_1000_std": 0.158308,
+        "nauc_precision_at_1000_diff1": -0.09497,
+        "nauc_mrr_at_1_max": -0.016365,
+        "nauc_mrr_at_1_std": -0.035168,
+        "nauc_mrr_at_1_diff1": 0.399218,
+        "nauc_mrr_at_3_max": 0.011336,
+        "nauc_mrr_at_3_std": -0.027225,
+        "nauc_mrr_at_3_diff1": 0.390752,
+        "nauc_mrr_at_5_max": 0.012569,
+        "nauc_mrr_at_5_std": -0.036009,
+        "nauc_mrr_at_5_diff1": 0.37986,
+        "nauc_mrr_at_10_max": 0.010653,
+        "nauc_mrr_at_10_std": -0.029453,
+        "nauc_mrr_at_10_diff1": 0.383839,
+        "nauc_mrr_at_20_max": 0.009407,
+        "nauc_mrr_at_20_std": -0.029387,
+        "nauc_mrr_at_20_diff1": 0.385654,
+        "nauc_mrr_at_100_max": 0.008998,
+        "nauc_mrr_at_100_std": -0.030401,
+        "nauc_mrr_at_100_diff1": 0.385991,
+        "nauc_mrr_at_1000_max": 0.009029,
+        "nauc_mrr_at_1000_std": -0.030372,
+        "nauc_mrr_at_1000_diff1": 0.385974,
+        "hit_rate_at_1": 0.58117,
+        "hit_rate_at_3": 0.76623,
+        "hit_rate_at_5": 0.8474,
+        "hit_rate_at_10": 0.90909,
+        "hit_rate_at_20": 0.95779,
+        "hit_rate_at_100": 0.99675,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.61171,
+        "hf_subset": "italian",
+        "languages": [
+          "ita-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.56006,
+        "ndcg_at_3": 0.56144,
+        "ndcg_at_5": 0.58208,
+        "ndcg_at_10": 0.60359,
+        "ndcg_at_20": 0.64266,
+        "ndcg_at_100": 0.68289,
+        "ndcg_at_1000": 0.69632,
+        "map_at_1": 0.34144,
+        "map_at_3": 0.44675,
+        "map_at_5": 0.47867,
+        "map_at_10": 0.50411,
+        "map_at_20": 0.52811,
+        "map_at_100": 0.54455,
+        "map_at_1000": 0.54641,
+        "recall_at_1": 0.34144,
+        "recall_at_3": 0.50264,
+        "recall_at_5": 0.57938,
+        "recall_at_10": 0.66041,
+        "recall_at_20": 0.78821,
+        "recall_at_100": 0.93339,
+        "recall_at_1000": 0.99725,
+        "accuracy": 0.34144,
+        "precision_at_1": 0.58442,
+        "precision_at_3": 0.34091,
+        "precision_at_5": 0.25909,
+        "precision_at_10": 0.16688,
+        "precision_at_20": 0.11104,
+        "precision_at_100": 0.03075,
+        "precision_at_1000": 0.00355,
+        "mrr_at_1": 0.584416,
+        "mrr_at_3": 0.661797,
+        "mrr_at_5": 0.675758,
+        "mrr_at_10": 0.68233,
+        "mrr_at_20": 0.687565,
+        "mrr_at_100": 0.689053,
+        "mrr_at_1000": 0.689078,
+        "nauc_ndcg_at_1_max": 0.022304,
+        "nauc_ndcg_at_1_std": -0.064391,
+        "nauc_ndcg_at_1_diff1": 0.436261,
+        "nauc_ndcg_at_3_max": 0.079473,
+        "nauc_ndcg_at_3_std": -0.023965,
+        "nauc_ndcg_at_3_diff1": 0.408226,
+        "nauc_ndcg_at_5_max": 0.057613,
+        "nauc_ndcg_at_5_std": -0.052091,
+        "nauc_ndcg_at_5_diff1": 0.386083,
+        "nauc_ndcg_at_10_max": 0.058646,
+        "nauc_ndcg_at_10_std": -0.045293,
+        "nauc_ndcg_at_10_diff1": 0.408787,
+        "nauc_ndcg_at_20_max": 0.066563,
+        "nauc_ndcg_at_20_std": -0.032537,
+        "nauc_ndcg_at_20_diff1": 0.403535,
+        "nauc_ndcg_at_100_max": 0.056071,
+        "nauc_ndcg_at_100_std": -0.030351,
+        "nauc_ndcg_at_100_diff1": 0.397122,
+        "nauc_ndcg_at_1000_max": 0.062422,
+        "nauc_ndcg_at_1000_std": -0.019308,
+        "nauc_ndcg_at_1000_diff1": 0.399314,
+        "nauc_map_at_1_max": 0.059861,
+        "nauc_map_at_1_std": -0.022497,
+        "nauc_map_at_1_diff1": 0.433832,
+        "nauc_map_at_3_max": 0.053735,
+        "nauc_map_at_3_std": -0.043326,
+        "nauc_map_at_3_diff1": 0.425146,
+        "nauc_map_at_5_max": 0.036751,
+        "nauc_map_at_5_std": -0.064259,
+        "nauc_map_at_5_diff1": 0.403951,
+        "nauc_map_at_10_max": 0.036154,
+        "nauc_map_at_10_std": -0.062299,
+        "nauc_map_at_10_diff1": 0.406063,
+        "nauc_map_at_20_max": 0.036886,
+        "nauc_map_at_20_std": -0.057225,
+        "nauc_map_at_20_diff1": 0.39695,
+        "nauc_map_at_100_max": 0.041823,
+        "nauc_map_at_100_std": -0.047111,
+        "nauc_map_at_100_diff1": 0.391108,
+        "nauc_map_at_1000_max": 0.042931,
+        "nauc_map_at_1000_std": -0.044781,
+        "nauc_map_at_1000_diff1": 0.391531,
+        "nauc_recall_at_1_max": 0.059861,
+        "nauc_recall_at_1_std": -0.022497,
+        "nauc_recall_at_1_diff1": 0.433832,
+        "nauc_recall_at_3_max": 0.087916,
+        "nauc_recall_at_3_std": -0.016491,
+        "nauc_recall_at_3_diff1": 0.384876,
+        "nauc_recall_at_5_max": 0.036399,
+        "nauc_recall_at_5_std": -0.077508,
+        "nauc_recall_at_5_diff1": 0.324225,
+        "nauc_recall_at_10_max": 0.043804,
+        "nauc_recall_at_10_std": -0.071253,
+        "nauc_recall_at_10_diff1": 0.365685,
+        "nauc_recall_at_20_max": 0.10447,
+        "nauc_recall_at_20_std": -0.011256,
+        "nauc_recall_at_20_diff1": 0.329082,
+        "nauc_recall_at_100_max": -0.033923,
+        "nauc_recall_at_100_std": -0.107127,
+        "nauc_recall_at_100_diff1": 0.2481,
+        "nauc_recall_at_1000_max": -0.671186,
+        "nauc_recall_at_1000_std": -0.493415,
+        "nauc_recall_at_1000_diff1": -0.406751,
+        "nauc_precision_at_1_max": 0.033202,
+        "nauc_precision_at_1_std": -0.050153,
+        "nauc_precision_at_1_diff1": 0.446997,
+        "nauc_precision_at_3_max": 0.016725,
+        "nauc_precision_at_3_std": -0.03229,
+        "nauc_precision_at_3_diff1": 0.098048,
+        "nauc_precision_at_5_max": -0.024848,
+        "nauc_precision_at_5_std": -0.049155,
+        "nauc_precision_at_5_diff1": -0.050928,
+        "nauc_precision_at_10_max": -0.001104,
+        "nauc_precision_at_10_std": 0.022601,
+        "nauc_precision_at_10_diff1": -0.114156,
+        "nauc_precision_at_20_max": 0.019664,
+        "nauc_precision_at_20_std": 0.087237,
+        "nauc_precision_at_20_diff1": -0.194779,
+        "nauc_precision_at_100_max": 0.039977,
+        "nauc_precision_at_100_std": 0.156828,
+        "nauc_precision_at_100_diff1": -0.214296,
+        "nauc_precision_at_1000_max": 0.049861,
+        "nauc_precision_at_1000_std": 0.16883,
+        "nauc_precision_at_1000_diff1": -0.199905,
+        "nauc_mrr_at_1_max": 0.033202,
+        "nauc_mrr_at_1_std": -0.050153,
+        "nauc_mrr_at_1_diff1": 0.446997,
+        "nauc_mrr_at_3_max": 0.074199,
+        "nauc_mrr_at_3_std": -0.01903,
+        "nauc_mrr_at_3_diff1": 0.422359,
+        "nauc_mrr_at_5_max": 0.063082,
+        "nauc_mrr_at_5_std": -0.022576,
+        "nauc_mrr_at_5_diff1": 0.412235,
+        "nauc_mrr_at_10_max": 0.064697,
+        "nauc_mrr_at_10_std": -0.01869,
+        "nauc_mrr_at_10_diff1": 0.424888,
+        "nauc_mrr_at_20_max": 0.066631,
+        "nauc_mrr_at_20_std": -0.020059,
+        "nauc_mrr_at_20_diff1": 0.42565,
+        "nauc_mrr_at_100_max": 0.063656,
+        "nauc_mrr_at_100_std": -0.022367,
+        "nauc_mrr_at_100_diff1": 0.424415,
+        "nauc_mrr_at_1000_max": 0.06365,
+        "nauc_mrr_at_1000_std": -0.022396,
+        "nauc_mrr_at_1000_diff1": 0.424379,
+        "hit_rate_at_1": 0.58442,
+        "hit_rate_at_3": 0.76299,
+        "hit_rate_at_5": 0.82468,
+        "hit_rate_at_10": 0.87338,
+        "hit_rate_at_20": 0.94805,
+        "hit_rate_at_100": 0.99351,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.60359,
+        "hf_subset": "portuguese",
+        "languages": [
+          "por-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 2237.6925604343414,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v3/Vidore3FinanceEnRetrieval.json

@@ -0,0 +1,942 @@
+{
+  "dataset_revision": "fa78cb14152b3dde8c5defdc4e3ddf50de69dfeb",
+  "task_name": "Vidore3FinanceEnRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.49515,
+        "ndcg_at_3": 0.49829,
+        "ndcg_at_5": 0.51055,
+        "ndcg_at_10": 0.53963,
+        "ndcg_at_20": 0.57576,
+        "ndcg_at_100": 0.63321,
+        "ndcg_at_1000": 0.65999,
+        "map_at_1": 0.25574,
+        "map_at_3": 0.35949,
+        "map_at_5": 0.39505,
+        "map_at_10": 0.42886,
+        "map_at_20": 0.45256,
+        "map_at_100": 0.47308,
+        "map_at_1000": 0.47666,
+        "recall_at_1": 0.25574,
+        "recall_at_3": 0.41701,
+        "recall_at_5": 0.49389,
+        "recall_at_10": 0.59317,
+        "recall_at_20": 0.69473,
+        "recall_at_100": 0.87809,
+        "recall_at_1000": 0.99253,
+        "accuracy": 0.25574,
+        "precision_at_1": 0.52104,
+        "precision_at_3": 0.34736,
+        "precision_at_5": 0.27443,
+        "precision_at_10": 0.19126,
+        "precision_at_20": 0.12476,
+        "precision_at_100": 0.03735,
+        "precision_at_1000": 0.00468,
+        "mrr_at_1": 0.521036,
+        "mrr_at_3": 0.62028,
+        "mrr_at_5": 0.638242,
+        "mrr_at_10": 0.648477,
+        "mrr_at_20": 0.652392,
+        "mrr_at_100": 0.653597,
+        "mrr_at_1000": 0.653607,
+        "nauc_ndcg_at_1_max": 0.047092,
+        "nauc_ndcg_at_1_std": -0.01927,
+        "nauc_ndcg_at_1_diff1": 0.423861,
+        "nauc_ndcg_at_3_max": 0.046597,
+        "nauc_ndcg_at_3_std": -0.032475,
+        "nauc_ndcg_at_3_diff1": 0.389884,
+        "nauc_ndcg_at_5_max": 0.037669,
+        "nauc_ndcg_at_5_std": -0.047648,
+        "nauc_ndcg_at_5_diff1": 0.411808,
+        "nauc_ndcg_at_10_max": 0.031906,
+        "nauc_ndcg_at_10_std": -0.04733,
+        "nauc_ndcg_at_10_diff1": 0.40503,
+        "nauc_ndcg_at_20_max": 0.034623,
+        "nauc_ndcg_at_20_std": -0.034248,
+        "nauc_ndcg_at_20_diff1": 0.405793,
+        "nauc_ndcg_at_100_max": 0.055769,
+        "nauc_ndcg_at_100_std": 0.001458,
+        "nauc_ndcg_at_100_diff1": 0.395924,
+        "nauc_ndcg_at_1000_max": 0.048575,
+        "nauc_ndcg_at_1000_std": -0.010237,
+        "nauc_ndcg_at_1000_diff1": 0.392592,
+        "nauc_map_at_1_max": 0.049715,
+        "nauc_map_at_1_std": -0.062799,
+        "nauc_map_at_1_diff1": 0.440773,
+        "nauc_map_at_3_max": 0.043935,
+        "nauc_map_at_3_std": -0.058226,
+        "nauc_map_at_3_diff1": 0.404193,
+        "nauc_map_at_5_max": 0.025121,
+        "nauc_map_at_5_std": -0.074445,
+        "nauc_map_at_5_diff1": 0.407776,
+        "nauc_map_at_10_max": 0.017918,
+        "nauc_map_at_10_std": -0.073579,
+        "nauc_map_at_10_diff1": 0.398462,
+        "nauc_map_at_20_max": 0.021318,
+        "nauc_map_at_20_std": -0.064322,
+        "nauc_map_at_20_diff1": 0.395253,
+        "nauc_map_at_100_max": 0.030282,
+        "nauc_map_at_100_std": -0.048998,
+        "nauc_map_at_100_diff1": 0.391045,
+        "nauc_map_at_1000_max": 0.029251,
+        "nauc_map_at_1000_std": -0.049981,
+        "nauc_map_at_1000_diff1": 0.390027,
+        "nauc_recall_at_1_max": 0.049715,
+        "nauc_recall_at_1_std": -0.062799,
+        "nauc_recall_at_1_diff1": 0.440773,
+        "nauc_recall_at_3_max": 0.051499,
+        "nauc_recall_at_3_std": -0.042652,
+        "nauc_recall_at_3_diff1": 0.340848,
+        "nauc_recall_at_5_max": 0.033565,
+        "nauc_recall_at_5_std": -0.064427,
+        "nauc_recall_at_5_diff1": 0.363772,
+        "nauc_recall_at_10_max": 0.008822,
+        "nauc_recall_at_10_std": -0.068794,
+        "nauc_recall_at_10_diff1": 0.338424,
+        "nauc_recall_at_20_max": 0.02378,
+        "nauc_recall_at_20_std": -0.026366,
+        "nauc_recall_at_20_diff1": 0.325951,
+        "nauc_recall_at_100_max": 0.129044,
+        "nauc_recall_at_100_std": 0.159531,
+        "nauc_recall_at_100_diff1": 0.253826,
+        "nauc_recall_at_1000_max": 0.21977,
+        "nauc_recall_at_1000_std": 0.569874,
+        "nauc_recall_at_1000_diff1": -0.050056,
+        "nauc_precision_at_1_max": 0.02159,
+        "nauc_precision_at_1_std": -0.034771,
+        "nauc_precision_at_1_diff1": 0.407455,
+        "nauc_precision_at_3_max": -0.01787,
+        "nauc_precision_at_3_std": -0.020965,
+        "nauc_precision_at_3_diff1": 0.131273,
+        "nauc_precision_at_5_max": -0.061087,
+        "nauc_precision_at_5_std": -0.032302,
+        "nauc_precision_at_5_diff1": 0.047196,
+        "nauc_precision_at_10_max": -0.038928,
+        "nauc_precision_at_10_std": 0.018437,
+        "nauc_precision_at_10_diff1": -0.065134,
+        "nauc_precision_at_20_max": -0.017887,
+        "nauc_precision_at_20_std": 0.067182,
+        "nauc_precision_at_20_diff1": -0.124565,
+        "nauc_precision_at_100_max": 0.029661,
+        "nauc_precision_at_100_std": 0.141092,
+        "nauc_precision_at_100_diff1": -0.209028,
+        "nauc_precision_at_1000_max": -0.009578,
+        "nauc_precision_at_1000_std": 0.080216,
+        "nauc_precision_at_1000_diff1": -0.245271,
+        "nauc_mrr_at_1_max": 0.02159,
+        "nauc_mrr_at_1_std": -0.034771,
+        "nauc_mrr_at_1_diff1": 0.407455,
+        "nauc_mrr_at_3_max": 0.029405,
+        "nauc_mrr_at_3_std": -0.02635,
+        "nauc_mrr_at_3_diff1": 0.381291,
+        "nauc_mrr_at_5_max": 0.023184,
+        "nauc_mrr_at_5_std": -0.030193,
+        "nauc_mrr_at_5_diff1": 0.386327,
+        "nauc_mrr_at_10_max": 0.024073,
+        "nauc_mrr_at_10_std": -0.030253,
+        "nauc_mrr_at_10_diff1": 0.384476,
+        "nauc_mrr_at_20_max": 0.024827,
+        "nauc_mrr_at_20_std": -0.028425,
+        "nauc_mrr_at_20_diff1": 0.386819,
+        "nauc_mrr_at_100_max": 0.02379,
+        "nauc_mrr_at_100_std": -0.029986,
+        "nauc_mrr_at_100_diff1": 0.386244,
+        "nauc_mrr_at_1000_max": 0.023777,
+        "nauc_mrr_at_1000_std": -0.030024,
+        "nauc_mrr_at_1000_diff1": 0.3863,
+        "hit_rate_at_1": 0.52104,
+        "hit_rate_at_3": 0.74434,
+        "hit_rate_at_5": 0.82201,
+        "hit_rate_at_10": 0.90291,
+        "hit_rate_at_20": 0.95469,
+        "hit_rate_at_100": 0.99676,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.53963,
+        "hf_subset": "french",
+        "languages": [
+          "fra-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.50971,
+        "ndcg_at_3": 0.51387,
+        "ndcg_at_5": 0.52327,
+        "ndcg_at_10": 0.54906,
+        "ndcg_at_20": 0.58756,
+        "ndcg_at_100": 0.64226,
+        "ndcg_at_1000": 0.66843,
+        "map_at_1": 0.27021,
+        "map_at_3": 0.3698,
+        "map_at_5": 0.4053,
+        "map_at_10": 0.4422,
+        "map_at_20": 0.46705,
+        "map_at_100": 0.48662,
+        "map_at_1000": 0.49011,
+        "recall_at_1": 0.27021,
+        "recall_at_3": 0.41932,
+        "recall_at_5": 0.49583,
+        "recall_at_10": 0.59863,
+        "recall_at_20": 0.7024,
+        "recall_at_100": 0.88018,
+        "recall_at_1000": 0.99333,
+        "accuracy": 0.27021,
+        "precision_at_1": 0.55016,
+        "precision_at_3": 0.36138,
+        "precision_at_5": 0.28155,
+        "precision_at_10": 0.19223,
+        "precision_at_20": 0.12816,
+        "precision_at_100": 0.03796,
+        "precision_at_1000": 0.00468,
+        "mrr_at_1": 0.550162,
+        "mrr_at_3": 0.650485,
+        "mrr_at_5": 0.666667,
+        "mrr_at_10": 0.673789,
+        "mrr_at_20": 0.677142,
+        "mrr_at_100": 0.67858,
+        "mrr_at_1000": 0.678639,
+        "nauc_ndcg_at_1_max": 0.075161,
+        "nauc_ndcg_at_1_std": -0.015549,
+        "nauc_ndcg_at_1_diff1": 0.465241,
+        "nauc_ndcg_at_3_max": 0.028685,
+        "nauc_ndcg_at_3_std": -0.096114,
+        "nauc_ndcg_at_3_diff1": 0.414623,
+        "nauc_ndcg_at_5_max": 0.015639,
+        "nauc_ndcg_at_5_std": -0.100893,
+        "nauc_ndcg_at_5_diff1": 0.419019,
+        "nauc_ndcg_at_10_max": 0.002123,
+        "nauc_ndcg_at_10_std": -0.104319,
+        "nauc_ndcg_at_10_diff1": 0.420964,
+        "nauc_ndcg_at_20_max": -0.009663,
+        "nauc_ndcg_at_20_std": -0.102547,
+        "nauc_ndcg_at_20_diff1": 0.405098,
+        "nauc_ndcg_at_100_max": 0.007493,
+        "nauc_ndcg_at_100_std": -0.074446,
+        "nauc_ndcg_at_100_diff1": 0.403207,
+        "nauc_ndcg_at_1000_max": 0.008712,
+        "nauc_ndcg_at_1000_std": -0.080794,
+        "nauc_ndcg_at_1000_diff1": 0.408402,
+        "nauc_map_at_1_max": 0.058834,
+        "nauc_map_at_1_std": -0.072642,
+        "nauc_map_at_1_diff1": 0.477876,
+        "nauc_map_at_3_max": 0.021321,
+        "nauc_map_at_3_std": -0.108043,
+        "nauc_map_at_3_diff1": 0.42206,
+        "nauc_map_at_5_max": 0.002838,
+        "nauc_map_at_5_std": -0.118685,
+        "nauc_map_at_5_diff1": 0.410165,
+        "nauc_map_at_10_max": -0.013011,
+        "nauc_map_at_10_std": -0.124356,
+        "nauc_map_at_10_diff1": 0.404345,
+        "nauc_map_at_20_max": -0.017795,
+        "nauc_map_at_20_std": -0.119898,
+        "nauc_map_at_20_diff1": 0.388808,
+        "nauc_map_at_100_max": -0.015052,
+        "nauc_map_at_100_std": -0.111114,
+        "nauc_map_at_100_diff1": 0.382656,
+        "nauc_map_at_1000_max": -0.015237,
+        "nauc_map_at_1000_std": -0.111738,
+        "nauc_map_at_1000_diff1": 0.383217,
+        "nauc_recall_at_1_max": 0.058834,
+        "nauc_recall_at_1_std": -0.072642,
+        "nauc_recall_at_1_diff1": 0.477876,
+        "nauc_recall_at_3_max": 0.029812,
+        "nauc_recall_at_3_std": -0.100506,
+        "nauc_recall_at_3_diff1": 0.378966,
+        "nauc_recall_at_5_max": -0.003103,
+        "nauc_recall_at_5_std": -0.110572,
+        "nauc_recall_at_5_diff1": 0.359062,
+        "nauc_recall_at_10_max": -0.02964,
+        "nauc_recall_at_10_std": -0.108033,
+        "nauc_recall_at_10_diff1": 0.36522,
+        "nauc_recall_at_20_max": -0.051886,
+        "nauc_recall_at_20_std": -0.097363,
+        "nauc_recall_at_20_diff1": 0.306788,
+        "nauc_recall_at_100_max": 0.019469,
+        "nauc_recall_at_100_std": 0.07079,
+        "nauc_recall_at_100_diff1": 0.23415,
+        "nauc_recall_at_1000_max": 0.395365,
+        "nauc_recall_at_1000_std": 0.707697,
+        "nauc_recall_at_1000_diff1": 0.107957,
+        "nauc_precision_at_1_max": 0.027222,
+        "nauc_precision_at_1_std": -0.045712,
+        "nauc_precision_at_1_diff1": 0.410994,
+        "nauc_precision_at_3_max": -0.076361,
+        "nauc_precision_at_3_std": -0.11794,
+        "nauc_precision_at_3_diff1": 0.0831,
+        "nauc_precision_at_5_max": -0.098088,
+        "nauc_precision_at_5_std": -0.09418,
+        "nauc_precision_at_5_diff1": -0.020167,
+        "nauc_precision_at_10_max": -0.091142,
+        "nauc_precision_at_10_std": -0.033784,
+        "nauc_precision_at_10_diff1": -0.09798,
+        "nauc_precision_at_20_max": -0.087226,
+        "nauc_precision_at_20_std": 0.015088,
+        "nauc_precision_at_20_diff1": -0.186741,
+        "nauc_precision_at_100_max": -0.035148,
+        "nauc_precision_at_100_std": 0.085689,
+        "nauc_precision_at_100_diff1": -0.234203,
+        "nauc_precision_at_1000_max": -0.026844,
+        "nauc_precision_at_1000_std": 0.068773,
+        "nauc_precision_at_1000_diff1": -0.236382,
+        "nauc_mrr_at_1_max": 0.027222,
+        "nauc_mrr_at_1_std": -0.045712,
+        "nauc_mrr_at_1_diff1": 0.410994,
+        "nauc_mrr_at_3_max": 0.020307,
+        "nauc_mrr_at_3_std": -0.079491,
+        "nauc_mrr_at_3_diff1": 0.392558,
+        "nauc_mrr_at_5_max": 0.019642,
+        "nauc_mrr_at_5_std": -0.073617,
+        "nauc_mrr_at_5_diff1": 0.389716,
+        "nauc_mrr_at_10_max": 0.024431,
+        "nauc_mrr_at_10_std": -0.066392,
+        "nauc_mrr_at_10_diff1": 0.388928,
+        "nauc_mrr_at_20_max": 0.020672,
+        "nauc_mrr_at_20_std": -0.069472,
+        "nauc_mrr_at_20_diff1": 0.389657,
+        "nauc_mrr_at_100_max": 0.020922,
+        "nauc_mrr_at_100_std": -0.069219,
+        "nauc_mrr_at_100_diff1": 0.390291,
+        "nauc_mrr_at_1000_max": 0.020975,
+        "nauc_mrr_at_1000_std": -0.06926,
+        "nauc_mrr_at_1000_diff1": 0.390166,
+        "hit_rate_at_1": 0.55016,
+        "hit_rate_at_3": 0.77023,
+        "hit_rate_at_5": 0.84142,
+        "hit_rate_at_10": 0.89644,
+        "hit_rate_at_20": 0.94175,
+        "hit_rate_at_100": 0.99353,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.54906,
+        "hf_subset": "spanish",
+        "languages": [
+          "spa-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.57605,
+        "ndcg_at_3": 0.57233,
+        "ndcg_at_5": 0.57368,
+        "ndcg_at_10": 0.59899,
+        "ndcg_at_20": 0.63108,
+        "ndcg_at_100": 0.68165,
+        "ndcg_at_1000": 0.70426,
+        "map_at_1": 0.27101,
+        "map_at_3": 0.39638,
+        "map_at_5": 0.43541,
+        "map_at_10": 0.47489,
+        "map_at_20": 0.49939,
+        "map_at_100": 0.51882,
+        "map_at_1000": 0.522,
+        "recall_at_1": 0.27101,
+        "recall_at_3": 0.46393,
+        "recall_at_5": 0.54348,
+        "recall_at_10": 0.65025,
+        "recall_at_20": 0.7446,
+        "recall_at_100": 0.90007,
+        "recall_at_1000": 0.996,
+        "accuracy": 0.27101,
+        "precision_at_1": 0.60841,
+        "precision_at_3": 0.40992,
+        "precision_at_5": 0.31586,
+        "precision_at_10": 0.21359,
+        "precision_at_20": 0.13495,
+        "precision_at_100": 0.0389,
+        "precision_at_1000": 0.0047,
+        "mrr_at_1": 0.608414,
+        "mrr_at_3": 0.722762,
+        "mrr_at_5": 0.732956,
+        "mrr_at_10": 0.741274,
+        "mrr_at_20": 0.741929,
+        "mrr_at_100": 0.74258,
+        "mrr_at_1000": 0.742642,
+        "nauc_ndcg_at_1_max": 0.012259,
+        "nauc_ndcg_at_1_std": -0.15356,
+        "nauc_ndcg_at_1_diff1": 0.451681,
+        "nauc_ndcg_at_3_max": 0.039507,
+        "nauc_ndcg_at_3_std": -0.114967,
+        "nauc_ndcg_at_3_diff1": 0.338655,
+        "nauc_ndcg_at_5_max": 0.046611,
+        "nauc_ndcg_at_5_std": -0.118846,
+        "nauc_ndcg_at_5_diff1": 0.376893,
+        "nauc_ndcg_at_10_max": 0.099118,
+        "nauc_ndcg_at_10_std": -0.086219,
+        "nauc_ndcg_at_10_diff1": 0.414635,
+        "nauc_ndcg_at_20_max": 0.116761,
+        "nauc_ndcg_at_20_std": -0.055264,
+        "nauc_ndcg_at_20_diff1": 0.412925,
+        "nauc_ndcg_at_100_max": 0.113227,
+        "nauc_ndcg_at_100_std": -0.036517,
+        "nauc_ndcg_at_100_diff1": 0.407344,
+        "nauc_ndcg_at_1000_max": 0.087955,
+        "nauc_ndcg_at_1000_std": -0.069014,
+        "nauc_ndcg_at_1000_diff1": 0.401233,
+        "nauc_map_at_1_max": 0.106121,
+        "nauc_map_at_1_std": -0.103416,
+        "nauc_map_at_1_diff1": 0.479509,
+        "nauc_map_at_3_max": 0.08441,
+        "nauc_map_at_3_std": -0.09466,
+        "nauc_map_at_3_diff1": 0.357035,
+        "nauc_map_at_5_max": 0.072,
+        "nauc_map_at_5_std": -0.10766,
+        "nauc_map_at_5_diff1": 0.364092,
+        "nauc_map_at_10_max": 0.086075,
+        "nauc_map_at_10_std": -0.101426,
+        "nauc_map_at_10_diff1": 0.36678,
+        "nauc_map_at_20_max": 0.092851,
+        "nauc_map_at_20_std": -0.085765,
+        "nauc_map_at_20_diff1": 0.359814,
+        "nauc_map_at_100_max": 0.09628,
+        "nauc_map_at_100_std": -0.073984,
+        "nauc_map_at_100_diff1": 0.356461,
+        "nauc_map_at_1000_max": 0.093436,
+        "nauc_map_at_1000_std": -0.076824,
+        "nauc_map_at_1000_diff1": 0.355521,
+        "nauc_recall_at_1_max": 0.106121,
+        "nauc_recall_at_1_std": -0.103416,
+        "nauc_recall_at_1_diff1": 0.479509,
+        "nauc_recall_at_3_max": 0.110632,
+        "nauc_recall_at_3_std": -0.036325,
+        "nauc_recall_at_3_diff1": 0.267988,
+        "nauc_recall_at_5_max": 0.092218,
+        "nauc_recall_at_5_std": -0.054365,
+        "nauc_recall_at_5_diff1": 0.288586,
+        "nauc_recall_at_10_max": 0.154145,
+        "nauc_recall_at_10_std": -0.012301,
+        "nauc_recall_at_10_diff1": 0.327191,
+        "nauc_recall_at_20_max": 0.216786,
+        "nauc_recall_at_20_std": 0.066533,
+        "nauc_recall_at_20_diff1": 0.317631,
+        "nauc_recall_at_100_max": 0.291937,
+        "nauc_recall_at_100_std": 0.267124,
+        "nauc_recall_at_100_diff1": 0.337215,
+        "nauc_recall_at_1000_max": 0.438088,
+        "nauc_recall_at_1000_std": 0.763975,
+        "nauc_recall_at_1000_diff1": 0.115216,
+        "nauc_precision_at_1_max": -0.010299,
+        "nauc_precision_at_1_std": -0.164639,
+        "nauc_precision_at_1_diff1": 0.407675,
+        "nauc_precision_at_3_max": -0.107887,
+        "nauc_precision_at_3_std": -0.109469,
+        "nauc_precision_at_3_diff1": -0.056451,
+        "nauc_precision_at_5_max": -0.125367,
+        "nauc_precision_at_5_std": -0.102067,
+        "nauc_precision_at_5_diff1": -0.084025,
+        "nauc_precision_at_10_max": -0.018479,
+        "nauc_precision_at_10_std": 0.029604,
+        "nauc_precision_at_10_diff1": -0.103107,
+        "nauc_precision_at_20_max": -0.015571,
+        "nauc_precision_at_20_std": 0.095517,
+        "nauc_precision_at_20_diff1": -0.14665,
+        "nauc_precision_at_100_max": -0.04872,
+        "nauc_precision_at_100_std": 0.11412,
+        "nauc_precision_at_100_diff1": -0.207271,
+        "nauc_precision_at_1000_max": -0.107041,
+        "nauc_precision_at_1000_std": 0.037381,
+        "nauc_precision_at_1000_diff1": -0.239877,
+        "nauc_mrr_at_1_max": -0.010299,
+        "nauc_mrr_at_1_std": -0.164639,
+        "nauc_mrr_at_1_diff1": 0.407675,
+        "nauc_mrr_at_3_max": 0.013827,
+        "nauc_mrr_at_3_std": -0.136754,
+        "nauc_mrr_at_3_diff1": 0.363644,
+        "nauc_mrr_at_5_max": -0.00148,
+        "nauc_mrr_at_5_std": -0.146487,
+        "nauc_mrr_at_5_diff1": 0.363629,
+        "nauc_mrr_at_10_max": 0.014809,
+        "nauc_mrr_at_10_std": -0.12506,
+        "nauc_mrr_at_10_diff1": 0.378281,
+        "nauc_mrr_at_20_max": 0.012977,
+        "nauc_mrr_at_20_std": -0.127896,
+        "nauc_mrr_at_20_diff1": 0.379271,
+        "nauc_mrr_at_100_max": 0.012308,
+        "nauc_mrr_at_100_std": -0.129244,
+        "nauc_mrr_at_100_diff1": 0.378255,
+        "nauc_mrr_at_1000_max": 0.012145,
+        "nauc_mrr_at_1000_std": -0.129499,
+        "nauc_mrr_at_1000_diff1": 0.378181,
+        "hit_rate_at_1": 0.60841,
+        "hit_rate_at_3": 0.85761,
+        "hit_rate_at_5": 0.90291,
+        "hit_rate_at_10": 0.96117,
+        "hit_rate_at_20": 0.97087,
+        "hit_rate_at_100": 0.99029,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.59899,
+        "hf_subset": "english",
+        "languages": [
+          "eng-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.48382,
+        "ndcg_at_3": 0.4933,
+        "ndcg_at_5": 0.49877,
+        "ndcg_at_10": 0.52672,
+        "ndcg_at_20": 0.56374,
+        "ndcg_at_100": 0.62137,
+        "ndcg_at_1000": 0.64762,
+        "map_at_1": 0.23235,
+        "map_at_3": 0.34325,
+        "map_at_5": 0.37814,
+        "map_at_10": 0.41193,
+        "map_at_20": 0.43572,
+        "map_at_100": 0.45564,
+        "map_at_1000": 0.45902,
+        "recall_at_1": 0.23235,
+        "recall_at_3": 0.40598,
+        "recall_at_5": 0.48757,
+        "recall_at_10": 0.59089,
+        "recall_at_20": 0.69532,
+        "recall_at_100": 0.88131,
+        "recall_at_1000": 0.99467,
+        "accuracy": 0.23235,
+        "precision_at_1": 0.51456,
+        "precision_at_3": 0.35707,
+        "precision_at_5": 0.27573,
+        "precision_at_10": 0.18706,
+        "precision_at_20": 0.1246,
+        "precision_at_100": 0.03764,
+        "precision_at_1000": 0.0047,
+        "mrr_at_1": 0.514563,
+        "mrr_at_3": 0.624056,
+        "mrr_at_5": 0.642988,
+        "mrr_at_10": 0.651352,
+        "mrr_at_20": 0.653648,
+        "mrr_at_100": 0.65532,
+        "mrr_at_1000": 0.655387,
+        "nauc_ndcg_at_1_max": 0.003749,
+        "nauc_ndcg_at_1_std": -0.088283,
+        "nauc_ndcg_at_1_diff1": 0.478995,
+        "nauc_ndcg_at_3_max": 0.001356,
+        "nauc_ndcg_at_3_std": -0.093979,
+        "nauc_ndcg_at_3_diff1": 0.380385,
+        "nauc_ndcg_at_5_max": -0.009343,
+        "nauc_ndcg_at_5_std": -0.089515,
+        "nauc_ndcg_at_5_diff1": 0.391065,
+        "nauc_ndcg_at_10_max": 0.012287,
+        "nauc_ndcg_at_10_std": -0.080592,
+        "nauc_ndcg_at_10_diff1": 0.40919,
+        "nauc_ndcg_at_20_max": 0.0323,
+        "nauc_ndcg_at_20_std": -0.048908,
+        "nauc_ndcg_at_20_diff1": 0.409649,
+        "nauc_ndcg_at_100_max": 0.032893,
+        "nauc_ndcg_at_100_std": -0.037048,
+        "nauc_ndcg_at_100_diff1": 0.420315,
+        "nauc_ndcg_at_1000_max": 0.014829,
+        "nauc_ndcg_at_1000_std": -0.060933,
+        "nauc_ndcg_at_1000_diff1": 0.4255,
+        "nauc_map_at_1_max": 0.033731,
+        "nauc_map_at_1_std": -0.081097,
+        "nauc_map_at_1_diff1": 0.483929,
+        "nauc_map_at_3_max": 0.014284,
+        "nauc_map_at_3_std": -0.100005,
+        "nauc_map_at_3_diff1": 0.406299,
+        "nauc_map_at_5_max": -0.000968,
+        "nauc_map_at_5_std": -0.103704,
+        "nauc_map_at_5_diff1": 0.399028,
+        "nauc_map_at_10_max": 0.002135,
+        "nauc_map_at_10_std": -0.102564,
+        "nauc_map_at_10_diff1": 0.39844,
+        "nauc_map_at_20_max": 0.011811,
+        "nauc_map_at_20_std": -0.087847,
+        "nauc_map_at_20_diff1": 0.396473,
+        "nauc_map_at_100_max": 0.014414,
+        "nauc_map_at_100_std": -0.081109,
+        "nauc_map_at_100_diff1": 0.400314,
+        "nauc_map_at_1000_max": 0.012166,
+        "nauc_map_at_1000_std": -0.08377,
+        "nauc_map_at_1000_diff1": 0.40064,
+        "nauc_recall_at_1_max": 0.033731,
+        "nauc_recall_at_1_std": -0.081097,
+        "nauc_recall_at_1_diff1": 0.483929,
+        "nauc_recall_at_3_max": 0.022233,
+        "nauc_recall_at_3_std": -0.081896,
+        "nauc_recall_at_3_diff1": 0.325819,
+        "nauc_recall_at_5_max": 0.005746,
+        "nauc_recall_at_5_std": -0.06969,
+        "nauc_recall_at_5_diff1": 0.291322,
+        "nauc_recall_at_10_max": 0.052285,
+        "nauc_recall_at_10_std": -0.038209,
+        "nauc_recall_at_10_diff1": 0.303307,
+        "nauc_recall_at_20_max": 0.101083,
+        "nauc_recall_at_20_std": 0.047521,
+        "nauc_recall_at_20_diff1": 0.271601,
+        "nauc_recall_at_100_max": 0.149664,
+        "nauc_recall_at_100_std": 0.204775,
+        "nauc_recall_at_100_diff1": 0.262307,
+        "nauc_recall_at_1000_max": -0.21999,
+        "nauc_recall_at_1000_std": 0.601119,
+        "nauc_recall_at_1000_diff1": 0.475007,
+        "nauc_precision_at_1_max": -0.030317,
+        "nauc_precision_at_1_std": -0.108299,
+        "nauc_precision_at_1_diff1": 0.463826,
+        "nauc_precision_at_3_max": -0.05627,
+        "nauc_precision_at_3_std": -0.081054,
+        "nauc_precision_at_3_diff1": 0.116119,
+        "nauc_precision_at_5_max": -0.095543,
+        "nauc_precision_at_5_std": -0.075987,
+        "nauc_precision_at_5_diff1": 0.058656,
+        "nauc_precision_at_10_max": -0.050203,
+        "nauc_precision_at_10_std": -0.031191,
+        "nauc_precision_at_10_diff1": -0.012479,
+        "nauc_precision_at_20_max": 0.009834,
+        "nauc_precision_at_20_std": 0.066848,
+        "nauc_precision_at_20_diff1": -0.067068,
+        "nauc_precision_at_100_max": 0.005574,
+        "nauc_precision_at_100_std": 0.083059,
+        "nauc_precision_at_100_diff1": -0.135444,
+        "nauc_precision_at_1000_max": -0.037269,
+        "nauc_precision_at_1000_std": 0.016052,
+        "nauc_precision_at_1000_diff1": -0.166425,
+        "nauc_mrr_at_1_max": -0.030317,
+        "nauc_mrr_at_1_std": -0.108299,
+        "nauc_mrr_at_1_diff1": 0.463826,
+        "nauc_mrr_at_3_max": -0.007385,
+        "nauc_mrr_at_3_std": -0.077706,
+        "nauc_mrr_at_3_diff1": 0.421228,
+        "nauc_mrr_at_5_max": -0.008243,
+        "nauc_mrr_at_5_std": -0.078788,
+        "nauc_mrr_at_5_diff1": 0.42367,
+        "nauc_mrr_at_10_max": -0.004403,
+        "nauc_mrr_at_10_std": -0.076534,
+        "nauc_mrr_at_10_diff1": 0.424834,
+        "nauc_mrr_at_20_max": -0.006131,
+        "nauc_mrr_at_20_std": -0.076882,
+        "nauc_mrr_at_20_diff1": 0.426857,
+        "nauc_mrr_at_100_max": -0.006686,
+        "nauc_mrr_at_100_std": -0.078024,
+        "nauc_mrr_at_100_diff1": 0.426665,
+        "nauc_mrr_at_1000_max": -0.006803,
+        "nauc_mrr_at_1000_std": -0.078159,
+        "nauc_mrr_at_1000_diff1": 0.426666,
+        "hit_rate_at_1": 0.51456,
+        "hit_rate_at_3": 0.75405,
+        "hit_rate_at_5": 0.83819,
+        "hit_rate_at_10": 0.90291,
+        "hit_rate_at_20": 0.93528,
+        "hit_rate_at_100": 0.99029,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.52672,
+        "hf_subset": "german",
+        "languages": [
+          "deu-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.49838,
+        "ndcg_at_3": 0.50495,
+        "ndcg_at_5": 0.5116,
+        "ndcg_at_10": 0.54579,
+        "ndcg_at_20": 0.57671,
+        "ndcg_at_100": 0.63382,
+        "ndcg_at_1000": 0.65988,
+        "map_at_1": 0.2617,
+        "map_at_3": 0.3601,
+        "map_at_5": 0.39392,
+        "map_at_10": 0.43243,
+        "map_at_20": 0.45393,
+        "map_at_100": 0.4736,
+        "map_at_1000": 0.47723,
+        "recall_at_1": 0.2617,
+        "recall_at_3": 0.41725,
+        "recall_at_5": 0.48999,
+        "recall_at_10": 0.60232,
+        "recall_at_20": 0.69153,
+        "recall_at_100": 0.8813,
+        "recall_at_1000": 0.99052,
+        "accuracy": 0.2617,
+        "precision_at_1": 0.53398,
+        "precision_at_3": 0.35922,
+        "precision_at_5": 0.28026,
+        "precision_at_10": 0.19709,
+        "precision_at_20": 0.12557,
+        "precision_at_100": 0.03744,
+        "precision_at_1000": 0.00467,
+        "mrr_at_1": 0.533981,
+        "mrr_at_3": 0.640237,
+        "mrr_at_5": 0.656419,
+        "mrr_at_10": 0.665695,
+        "mrr_at_20": 0.667849,
+        "mrr_at_100": 0.669556,
+        "mrr_at_1000": 0.669556,
+        "nauc_ndcg_at_1_max": 0.077132,
+        "nauc_ndcg_at_1_std": -0.032743,
+        "nauc_ndcg_at_1_diff1": 0.432272,
+        "nauc_ndcg_at_3_max": -0.01682,
+        "nauc_ndcg_at_3_std": -0.097851,
+        "nauc_ndcg_at_3_diff1": 0.348017,
+        "nauc_ndcg_at_5_max": -0.034836,
+        "nauc_ndcg_at_5_std": -0.112499,
+        "nauc_ndcg_at_5_diff1": 0.350294,
+        "nauc_ndcg_at_10_max": -0.016292,
+        "nauc_ndcg_at_10_std": -0.087179,
+        "nauc_ndcg_at_10_diff1": 0.353932,
+        "nauc_ndcg_at_20_max": -0.001787,
+        "nauc_ndcg_at_20_std": -0.067385,
+        "nauc_ndcg_at_20_diff1": 0.355869,
+        "nauc_ndcg_at_100_max": 0.008749,
+        "nauc_ndcg_at_100_std": -0.048147,
+        "nauc_ndcg_at_100_diff1": 0.348493,
+        "nauc_ndcg_at_1000_max": 0.007109,
+        "nauc_ndcg_at_1000_std": -0.056972,
+        "nauc_ndcg_at_1000_diff1": 0.351155,
+        "nauc_map_at_1_max": 0.033248,
+        "nauc_map_at_1_std": -0.108035,
+        "nauc_map_at_1_diff1": 0.39586,
+        "nauc_map_at_3_max": -0.021663,
+        "nauc_map_at_3_std": -0.136816,
+        "nauc_map_at_3_diff1": 0.332186,
+        "nauc_map_at_5_max": -0.040848,
+        "nauc_map_at_5_std": -0.146929,
+        "nauc_map_at_5_diff1": 0.327633,
+        "nauc_map_at_10_max": -0.037524,
+        "nauc_map_at_10_std": -0.131609,
+        "nauc_map_at_10_diff1": 0.325901,
+        "nauc_map_at_20_max": -0.028478,
+        "nauc_map_at_20_std": -0.117929,
+        "nauc_map_at_20_diff1": 0.326167,
+        "nauc_map_at_100_max": -0.024541,
+        "nauc_map_at_100_std": -0.107446,
+        "nauc_map_at_100_diff1": 0.324533,
+        "nauc_map_at_1000_max": -0.025201,
+        "nauc_map_at_1000_std": -0.10854,
+        "nauc_map_at_1000_diff1": 0.323777,
+        "nauc_recall_at_1_max": 0.033248,
+        "nauc_recall_at_1_std": -0.108035,
+        "nauc_recall_at_1_diff1": 0.39586,
+        "nauc_recall_at_3_max": -0.039041,
+        "nauc_recall_at_3_std": -0.122041,
+        "nauc_recall_at_3_diff1": 0.273321,
+        "nauc_recall_at_5_max": -0.063102,
+        "nauc_recall_at_5_std": -0.136654,
+        "nauc_recall_at_5_diff1": 0.269809,
+        "nauc_recall_at_10_max": -0.053747,
+        "nauc_recall_at_10_std": -0.089188,
+        "nauc_recall_at_10_diff1": 0.249786,
+        "nauc_recall_at_20_max": -0.018259,
+        "nauc_recall_at_20_std": -0.045588,
+        "nauc_recall_at_20_diff1": 0.248926,
+        "nauc_recall_at_100_max": 0.040298,
+        "nauc_recall_at_100_std": 0.102433,
+        "nauc_recall_at_100_diff1": 0.15093,
+        "nauc_recall_at_1000_max": -0.255961,
+        "nauc_recall_at_1000_std": 0.275663,
+        "nauc_recall_at_1000_diff1": -0.020561,
+        "nauc_precision_at_1_max": 0.036712,
+        "nauc_precision_at_1_std": -0.071616,
+        "nauc_precision_at_1_diff1": 0.409368,
+        "nauc_precision_at_3_max": -0.094028,
+        "nauc_precision_at_3_std": -0.071684,
+        "nauc_precision_at_3_diff1": 0.079264,
+        "nauc_precision_at_5_max": -0.120617,
+        "nauc_precision_at_5_std": -0.069554,
+        "nauc_precision_at_5_diff1": 0.005514,
+        "nauc_precision_at_10_max": -0.045378,
+        "nauc_precision_at_10_std": 0.038529,
+        "nauc_precision_at_10_diff1": -0.058829,
+        "nauc_precision_at_20_max": 0.012401,
+        "nauc_precision_at_20_std": 0.121531,
+        "nauc_precision_at_20_diff1": -0.091844,
+        "nauc_precision_at_100_max": 0.022586,
+        "nauc_precision_at_100_std": 0.124779,
+        "nauc_precision_at_100_diff1": -0.187945,
+        "nauc_precision_at_1000_max": 0.019195,
+        "nauc_precision_at_1000_std": 0.082603,
+        "nauc_precision_at_1000_diff1": -0.218336,
+        "nauc_mrr_at_1_max": 0.036712,
+        "nauc_mrr_at_1_std": -0.071616,
+        "nauc_mrr_at_1_diff1": 0.409368,
+        "nauc_mrr_at_3_max": 0.009231,
+        "nauc_mrr_at_3_std": -0.060375,
+        "nauc_mrr_at_3_diff1": 0.37239,
+        "nauc_mrr_at_5_max": 0.016807,
+        "nauc_mrr_at_5_std": -0.057219,
+        "nauc_mrr_at_5_diff1": 0.371174,
+        "nauc_mrr_at_10_max": 0.023683,
+        "nauc_mrr_at_10_std": -0.05248,
+        "nauc_mrr_at_10_diff1": 0.373672,
+        "nauc_mrr_at_20_max": 0.02353,
+        "nauc_mrr_at_20_std": -0.053287,
+        "nauc_mrr_at_20_diff1": 0.375682,
+        "nauc_mrr_at_100_max": 0.022297,
+        "nauc_mrr_at_100_std": -0.054638,
+        "nauc_mrr_at_100_diff1": 0.375977,
+        "nauc_mrr_at_1000_max": 0.022297,
+        "nauc_mrr_at_1000_std": -0.054638,
+        "nauc_mrr_at_1000_diff1": 0.375977,
+        "hit_rate_at_1": 0.53398,
+        "hit_rate_at_3": 0.77346,
+        "hit_rate_at_5": 0.84466,
+        "hit_rate_at_10": 0.91262,
+        "hit_rate_at_20": 0.94175,
+        "hit_rate_at_100": 1.0,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.54579,
+        "hf_subset": "italian",
+        "languages": [
+          "ita-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.50485,
+        "ndcg_at_3": 0.51072,
+        "ndcg_at_5": 0.51321,
+        "ndcg_at_10": 0.54238,
+        "ndcg_at_20": 0.57643,
+        "ndcg_at_100": 0.63707,
+        "ndcg_at_1000": 0.66153,
+        "map_at_1": 0.26213,
+        "map_at_3": 0.36348,
+        "map_at_5": 0.39632,
+        "map_at_10": 0.43062,
+        "map_at_20": 0.45309,
+        "map_at_100": 0.47397,
+        "map_at_1000": 0.47725,
+        "recall_at_1": 0.26213,
+        "recall_at_3": 0.42401,
+        "recall_at_5": 0.49127,
+        "recall_at_10": 0.59076,
+        "recall_at_20": 0.68917,
+        "recall_at_100": 0.88609,
+        "recall_at_1000": 0.99158,
+        "accuracy": 0.26213,
+        "precision_at_1": 0.53722,
+        "precision_at_3": 0.35491,
+        "precision_at_5": 0.27508,
+        "precision_at_10": 0.18964,
+        "precision_at_20": 0.12476,
+        "precision_at_100": 0.03803,
+        "precision_at_1000": 0.00467,
+        "mrr_at_1": 0.537217,
+        "mrr_at_3": 0.643474,
+        "mrr_at_5": 0.65658,
+        "mrr_at_10": 0.666039,
+        "mrr_at_20": 0.668593,
+        "mrr_at_100": 0.670015,
+        "mrr_at_1000": 0.670029,
+        "nauc_ndcg_at_1_max": 0.015108,
+        "nauc_ndcg_at_1_std": -0.101911,
+        "nauc_ndcg_at_1_diff1": 0.523499,
+        "nauc_ndcg_at_3_max": -0.02436,
+        "nauc_ndcg_at_3_std": -0.135255,
+        "nauc_ndcg_at_3_diff1": 0.422907,
+        "nauc_ndcg_at_5_max": -0.02743,
+        "nauc_ndcg_at_5_std": -0.129102,
+        "nauc_ndcg_at_5_diff1": 0.414355,
+        "nauc_ndcg_at_10_max": -0.041843,
+        "nauc_ndcg_at_10_std": -0.123531,
+        "nauc_ndcg_at_10_diff1": 0.41765,
+        "nauc_ndcg_at_20_max": -0.037636,
+        "nauc_ndcg_at_20_std": -0.106817,
+        "nauc_ndcg_at_20_diff1": 0.418016,
+        "nauc_ndcg_at_100_max": -0.015827,
+        "nauc_ndcg_at_100_std": -0.080167,
+        "nauc_ndcg_at_100_diff1": 0.423472,
+        "nauc_ndcg_at_1000_max": -0.024177,
+        "nauc_ndcg_at_1000_std": -0.094027,
+        "nauc_ndcg_at_1000_diff1": 0.428173,
+        "nauc_map_at_1_max": 0.002545,
+        "nauc_map_at_1_std": -0.111775,
+        "nauc_map_at_1_diff1": 0.484678,
+        "nauc_map_at_3_max": -0.021956,
+        "nauc_map_at_3_std": -0.141265,
+        "nauc_map_at_3_diff1": 0.414882,
+        "nauc_map_at_5_max": -0.034713,
+        "nauc_map_at_5_std": -0.147646,
+        "nauc_map_at_5_diff1": 0.401244,
+        "nauc_map_at_10_max": -0.055051,
+        "nauc_map_at_10_std": -0.155044,
+        "nauc_map_at_10_diff1": 0.395264,
+        "nauc_map_at_20_max": -0.05235,
+        "nauc_map_at_20_std": -0.144985,
+        "nauc_map_at_20_diff1": 0.391378,
+        "nauc_map_at_100_max": -0.044782,
+        "nauc_map_at_100_std": -0.131903,
+        "nauc_map_at_100_diff1": 0.393286,
+        "nauc_map_at_1000_max": -0.04632,
+        "nauc_map_at_1000_std": -0.133825,
+        "nauc_map_at_1000_diff1": 0.393532,
+        "nauc_recall_at_1_max": 0.002545,
+        "nauc_recall_at_1_std": -0.111775,
+        "nauc_recall_at_1_diff1": 0.484678,
+        "nauc_recall_at_3_max": -0.002007,
+        "nauc_recall_at_3_std": -0.111999,
+        "nauc_recall_at_3_diff1": 0.346429,
+        "nauc_recall_at_5_max": -0.016403,
+        "nauc_recall_at_5_std": -0.113528,
+        "nauc_recall_at_5_diff1": 0.311658,
+        "nauc_recall_at_10_max": -0.048638,
+        "nauc_recall_at_10_std": -0.101769,
+        "nauc_recall_at_10_diff1": 0.318591,
+        "nauc_recall_at_20_max": -0.046607,
+        "nauc_recall_at_20_std": -0.058007,
+        "nauc_recall_at_20_diff1": 0.298176,
+        "nauc_recall_at_100_max": 0.074931,
+        "nauc_recall_at_100_std": 0.135345,
+        "nauc_recall_at_100_diff1": 0.223869,
+        "nauc_recall_at_1000_max": 0.137059,
+        "nauc_recall_at_1000_std": 0.350043,
+        "nauc_recall_at_1000_diff1": 0.246415,
+        "nauc_precision_at_1_max": -0.017182,
+        "nauc_precision_at_1_std": -0.131261,
+        "nauc_precision_at_1_diff1": 0.511978,
+        "nauc_precision_at_3_max": -0.101765,
+        "nauc_precision_at_3_std": -0.146254,
+        "nauc_precision_at_3_diff1": 0.144195,
+        "nauc_precision_at_5_max": -0.09751,
+        "nauc_precision_at_5_std": -0.085895,
+        "nauc_precision_at_5_diff1": 0.016997,
+        "nauc_precision_at_10_max": -0.108627,
+        "nauc_precision_at_10_std": -0.026055,
+        "nauc_precision_at_10_diff1": -0.071065,
+        "nauc_precision_at_20_max": -0.053213,
+        "nauc_precision_at_20_std": 0.058187,
+        "nauc_precision_at_20_diff1": -0.130071,
+        "nauc_precision_at_100_max": 0.014155,
+        "nauc_precision_at_100_std": 0.131652,
+        "nauc_precision_at_100_diff1": -0.186068,
+        "nauc_precision_at_1000_max": -0.001835,
+        "nauc_precision_at_1000_std": 0.090033,
+        "nauc_precision_at_1000_diff1": -0.209094,
+        "nauc_mrr_at_1_max": -0.017182,
+        "nauc_mrr_at_1_std": -0.131261,
+        "nauc_mrr_at_1_diff1": 0.511978,
+        "nauc_mrr_at_3_max": -0.032016,
+        "nauc_mrr_at_3_std": -0.130728,
+        "nauc_mrr_at_3_diff1": 0.471207,
+        "nauc_mrr_at_5_max": -0.034297,
+        "nauc_mrr_at_5_std": -0.127137,
+        "nauc_mrr_at_5_diff1": 0.461543,
+        "nauc_mrr_at_10_max": -0.035533,
+        "nauc_mrr_at_10_std": -0.129564,
+        "nauc_mrr_at_10_diff1": 0.470592,
+        "nauc_mrr_at_20_max": -0.033164,
+        "nauc_mrr_at_20_std": -0.127439,
+        "nauc_mrr_at_20_diff1": 0.472928,
+        "nauc_mrr_at_100_max": -0.033566,
+        "nauc_mrr_at_100_std": -0.128578,
+        "nauc_mrr_at_100_diff1": 0.472738,
+        "nauc_mrr_at_1000_max": -0.033615,
+        "nauc_mrr_at_1000_std": -0.128632,
+        "nauc_mrr_at_1000_diff1": 0.472744,
+        "hit_rate_at_1": 0.53722,
+        "hit_rate_at_3": 0.77994,
+        "hit_rate_at_5": 0.83819,
+        "hit_rate_at_10": 0.90939,
+        "hit_rate_at_20": 0.94498,
+        "hit_rate_at_100": 0.99676,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.54238,
+        "hf_subset": "portuguese",
+        "languages": [
+          "por-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 2998.846420764923,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v3/Vidore3FinanceFrRetrieval.json

@@ -0,0 +1,942 @@
+{
+  "dataset_revision": "8a2adfda85a7967c7252129703d9b3c7c9f038a9",
+  "task_name": "Vidore3FinanceFrRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.37656,
+        "ndcg_at_3": 0.39627,
+        "ndcg_at_5": 0.41045,
+        "ndcg_at_10": 0.44643,
+        "ndcg_at_20": 0.48079,
+        "ndcg_at_100": 0.54213,
+        "ndcg_at_1000": 0.57426,
+        "map_at_1": 0.18426,
+        "map_at_3": 0.27766,
+        "map_at_5": 0.3052,
+        "map_at_10": 0.33867,
+        "map_at_20": 0.35745,
+        "map_at_100": 0.37689,
+        "map_at_1000": 0.38059,
+        "recall_at_1": 0.18426,
+        "recall_at_3": 0.34801,
+        "recall_at_5": 0.41555,
+        "recall_at_10": 0.53072,
+        "recall_at_20": 0.62322,
+        "recall_at_100": 0.83181,
+        "recall_at_1000": 0.99197,
+        "accuracy": 0.18426,
+        "precision_at_1": 0.39687,
+        "precision_at_3": 0.27917,
+        "precision_at_5": 0.22313,
+        "precision_at_10": 0.16031,
+        "precision_at_20": 0.10625,
+        "precision_at_100": 0.03391,
+        "precision_at_1000": 0.00447,
+        "mrr_at_1": 0.396875,
+        "mrr_at_3": 0.501042,
+        "mrr_at_5": 0.51901,
+        "mrr_at_10": 0.533493,
+        "mrr_at_20": 0.538105,
+        "mrr_at_100": 0.539995,
+        "mrr_at_1000": 0.540188,
+        "nauc_ndcg_at_1_max": 0.055324,
+        "nauc_ndcg_at_1_std": -0.080847,
+        "nauc_ndcg_at_1_diff1": 0.252714,
+        "nauc_ndcg_at_3_max": 0.03132,
+        "nauc_ndcg_at_3_std": -0.116388,
+        "nauc_ndcg_at_3_diff1": 0.240088,
+        "nauc_ndcg_at_5_max": 0.016673,
+        "nauc_ndcg_at_5_std": -0.133126,
+        "nauc_ndcg_at_5_diff1": 0.250577,
+        "nauc_ndcg_at_10_max": -0.001913,
+        "nauc_ndcg_at_10_std": -0.146789,
+        "nauc_ndcg_at_10_diff1": 0.225811,
+        "nauc_ndcg_at_20_max": -0.002119,
+        "nauc_ndcg_at_20_std": -0.141267,
+        "nauc_ndcg_at_20_diff1": 0.217564,
+        "nauc_ndcg_at_100_max": 0.034792,
+        "nauc_ndcg_at_100_std": -0.082654,
+        "nauc_ndcg_at_100_diff1": 0.241523,
+        "nauc_ndcg_at_1000_max": 0.041649,
+        "nauc_ndcg_at_1000_std": -0.086414,
+        "nauc_ndcg_at_1000_diff1": 0.244351,
+        "nauc_map_at_1_max": 0.050183,
+        "nauc_map_at_1_std": -0.096548,
+        "nauc_map_at_1_diff1": 0.366184,
+        "nauc_map_at_3_max": 0.035437,
+        "nauc_map_at_3_std": -0.114515,
+        "nauc_map_at_3_diff1": 0.275015,
+        "nauc_map_at_5_max": 0.015628,
+        "nauc_map_at_5_std": -0.132677,
+        "nauc_map_at_5_diff1": 0.270835,
+        "nauc_map_at_10_max": -0.003125,
+        "nauc_map_at_10_std": -0.145752,
+        "nauc_map_at_10_diff1": 0.239701,
+        "nauc_map_at_20_max": -0.007425,
+        "nauc_map_at_20_std": -0.142111,
+        "nauc_map_at_20_diff1": 0.232848,
+        "nauc_map_at_100_max": 0.002639,
+        "nauc_map_at_100_std": -0.125183,
+        "nauc_map_at_100_diff1": 0.236667,
+        "nauc_map_at_1000_max": 0.004157,
+        "nauc_map_at_1000_std": -0.124164,
+        "nauc_map_at_1000_diff1": 0.237785,
+        "nauc_recall_at_1_max": 0.050183,
+        "nauc_recall_at_1_std": -0.096548,
+        "nauc_recall_at_1_diff1": 0.366184,
+        "nauc_recall_at_3_max": 0.025626,
+        "nauc_recall_at_3_std": -0.119337,
+        "nauc_recall_at_3_diff1": 0.205634,
+        "nauc_recall_at_5_max": -0.016545,
+        "nauc_recall_at_5_std": -0.158854,
+        "nauc_recall_at_5_diff1": 0.211497,
+        "nauc_recall_at_10_max": -0.061017,
+        "nauc_recall_at_10_std": -0.189294,
+        "nauc_recall_at_10_diff1": 0.140473,
+        "nauc_recall_at_20_max": -0.048473,
+        "nauc_recall_at_20_std": -0.169315,
+        "nauc_recall_at_20_diff1": 0.107545,
+        "nauc_recall_at_100_max": 0.029193,
+        "nauc_recall_at_100_std": 0.028704,
+        "nauc_recall_at_100_diff1": 0.173317,
+        "nauc_recall_at_1000_max": 0.104732,
+        "nauc_recall_at_1000_std": 0.147248,
+        "nauc_recall_at_1000_diff1": 0.301781,
+        "nauc_precision_at_1_max": 0.054768,
+        "nauc_precision_at_1_std": -0.066875,
+        "nauc_precision_at_1_diff1": 0.240725,
+        "nauc_precision_at_3_max": -0.01113,
+        "nauc_precision_at_3_std": -0.092918,
+        "nauc_precision_at_3_diff1": 0.065754,
+        "nauc_precision_at_5_max": -0.035781,
+        "nauc_precision_at_5_std": -0.08545,
+        "nauc_precision_at_5_diff1": 0.040694,
+        "nauc_precision_at_10_max": -0.048972,
+        "nauc_precision_at_10_std": -0.046535,
+        "nauc_precision_at_10_diff1": -0.06019,
+        "nauc_precision_at_20_max": -0.044629,
+        "nauc_precision_at_20_std": 0.011264,
+        "nauc_precision_at_20_diff1": -0.07566,
+        "nauc_precision_at_100_max": 0.073492,
+        "nauc_precision_at_100_std": 0.179412,
+        "nauc_precision_at_100_diff1": -0.049724,
+        "nauc_precision_at_1000_max": 0.08488,
+        "nauc_precision_at_1000_std": 0.147651,
+        "nauc_precision_at_1000_diff1": -0.068874,
+        "nauc_mrr_at_1_max": 0.054768,
+        "nauc_mrr_at_1_std": -0.066875,
+        "nauc_mrr_at_1_diff1": 0.240725,
+        "nauc_mrr_at_3_max": 0.047401,
+        "nauc_mrr_at_3_std": -0.080735,
+        "nauc_mrr_at_3_diff1": 0.227052,
+        "nauc_mrr_at_5_max": 0.049633,
+        "nauc_mrr_at_5_std": -0.076235,
+        "nauc_mrr_at_5_diff1": 0.233203,
+        "nauc_mrr_at_10_max": 0.046118,
+        "nauc_mrr_at_10_std": -0.078822,
+        "nauc_mrr_at_10_diff1": 0.238053,
+        "nauc_mrr_at_20_max": 0.051453,
+        "nauc_mrr_at_20_std": -0.075591,
+        "nauc_mrr_at_20_diff1": 0.239102,
+        "nauc_mrr_at_100_max": 0.051686,
+        "nauc_mrr_at_100_std": -0.074425,
+        "nauc_mrr_at_100_diff1": 0.238387,
+        "nauc_mrr_at_1000_max": 0.051487,
+        "nauc_mrr_at_1000_std": -0.074632,
+        "nauc_mrr_at_1000_diff1": 0.238281,
+        "hit_rate_at_1": 0.39687,
+        "hit_rate_at_3": 0.63125,
+        "hit_rate_at_5": 0.70937,
+        "hit_rate_at_10": 0.81563,
+        "hit_rate_at_20": 0.88438,
+        "hit_rate_at_100": 0.95937,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.44643,
+        "hf_subset": "french",
+        "languages": [
+          "fra-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.34687,
+        "ndcg_at_3": 0.37057,
+        "ndcg_at_5": 0.39044,
+        "ndcg_at_10": 0.42819,
+        "ndcg_at_20": 0.46032,
+        "ndcg_at_100": 0.52699,
+        "ndcg_at_1000": 0.56007,
+        "map_at_1": 0.18366,
+        "map_at_3": 0.26505,
+        "map_at_5": 0.29265,
+        "map_at_10": 0.32564,
+        "map_at_20": 0.34264,
+        "map_at_100": 0.36281,
+        "map_at_1000": 0.36671,
+        "recall_at_1": 0.18366,
+        "recall_at_3": 0.32444,
+        "recall_at_5": 0.39714,
+        "recall_at_10": 0.5136,
+        "recall_at_20": 0.60439,
+        "recall_at_100": 0.83212,
+        "recall_at_1000": 0.99243,
+        "accuracy": 0.18366,
+        "precision_at_1": 0.36875,
+        "precision_at_3": 0.26042,
+        "precision_at_5": 0.2125,
+        "precision_at_10": 0.15531,
+        "precision_at_20": 0.10109,
+        "precision_at_100": 0.03353,
+        "precision_at_1000": 0.00448,
+        "mrr_at_1": 0.36875,
+        "mrr_at_3": 0.465625,
+        "mrr_at_5": 0.488125,
+        "mrr_at_10": 0.500404,
+        "mrr_at_20": 0.50617,
+        "mrr_at_100": 0.509584,
+        "mrr_at_1000": 0.509714,
+        "nauc_ndcg_at_1_max": -0.001541,
+        "nauc_ndcg_at_1_std": -0.08417,
+        "nauc_ndcg_at_1_diff1": 0.262337,
+        "nauc_ndcg_at_3_max": 0.055207,
+        "nauc_ndcg_at_3_std": -0.081491,
+        "nauc_ndcg_at_3_diff1": 0.233697,
+        "nauc_ndcg_at_5_max": 0.017058,
+        "nauc_ndcg_at_5_std": -0.116742,
+        "nauc_ndcg_at_5_diff1": 0.237788,
+        "nauc_ndcg_at_10_max": -0.021621,
+        "nauc_ndcg_at_10_std": -0.148734,
+        "nauc_ndcg_at_10_diff1": 0.210202,
+        "nauc_ndcg_at_20_max": -0.018895,
+        "nauc_ndcg_at_20_std": -0.145476,
+        "nauc_ndcg_at_20_diff1": 0.192709,
+        "nauc_ndcg_at_100_max": 0.011384,
+        "nauc_ndcg_at_100_std": -0.094266,
+        "nauc_ndcg_at_100_diff1": 0.218119,
+        "nauc_ndcg_at_1000_max": 0.022631,
+        "nauc_ndcg_at_1000_std": -0.087479,
+        "nauc_ndcg_at_1000_diff1": 0.220117,
+        "nauc_map_at_1_max": 0.012195,
+        "nauc_map_at_1_std": -0.078148,
+        "nauc_map_at_1_diff1": 0.306585,
+        "nauc_map_at_3_max": 0.04013,
+        "nauc_map_at_3_std": -0.09553,
+        "nauc_map_at_3_diff1": 0.25256,
+        "nauc_map_at_5_max": 0.014978,
+        "nauc_map_at_5_std": -0.116325,
+        "nauc_map_at_5_diff1": 0.235867,
+        "nauc_map_at_10_max": -0.010372,
+        "nauc_map_at_10_std": -0.134303,
+        "nauc_map_at_10_diff1": 0.213974,
+        "nauc_map_at_20_max": -0.010807,
+        "nauc_map_at_20_std": -0.1301,
+        "nauc_map_at_20_diff1": 0.207277,
+        "nauc_map_at_100_max": -0.003013,
+        "nauc_map_at_100_std": -0.115076,
+        "nauc_map_at_100_diff1": 0.21279,
+        "nauc_map_at_1000_max": -0.001585,
+        "nauc_map_at_1000_std": -0.11307,
+        "nauc_map_at_1000_diff1": 0.213678,
+        "nauc_recall_at_1_max": 0.012195,
+        "nauc_recall_at_1_std": -0.078148,
+        "nauc_recall_at_1_diff1": 0.306585,
+        "nauc_recall_at_3_max": 0.071789,
+        "nauc_recall_at_3_std": -0.102762,
+        "nauc_recall_at_3_diff1": 0.21685,
+        "nauc_recall_at_5_max": 0.004652,
+        "nauc_recall_at_5_std": -0.159867,
+        "nauc_recall_at_5_diff1": 0.199967,
+        "nauc_recall_at_10_max": -0.075779,
+        "nauc_recall_at_10_std": -0.216702,
+        "nauc_recall_at_10_diff1": 0.139971,
+        "nauc_recall_at_20_max": -0.074363,
+        "nauc_recall_at_20_std": -0.218342,
+        "nauc_recall_at_20_diff1": 0.086015,
+        "nauc_recall_at_100_max": -0.030492,
+        "nauc_recall_at_100_std": -0.07925,
+        "nauc_recall_at_100_diff1": 0.134229,
+        "nauc_recall_at_1000_max": -0.014419,
+        "nauc_recall_at_1000_std": -0.043228,
+        "nauc_recall_at_1000_diff1": 0.012361,
+        "nauc_precision_at_1_max": -0.005386,
+        "nauc_precision_at_1_std": -0.07558,
+        "nauc_precision_at_1_diff1": 0.2556,
+        "nauc_precision_at_3_max": 0.072296,
+        "nauc_precision_at_3_std": -0.023462,
+        "nauc_precision_at_3_diff1": 0.09472,
+        "nauc_precision_at_5_max": -0.009938,
+        "nauc_precision_at_5_std": -0.064182,
+        "nauc_precision_at_5_diff1": 0.052173,
+        "nauc_precision_at_10_max": -0.065603,
+        "nauc_precision_at_10_std": -0.064011,
+        "nauc_precision_at_10_diff1": -0.020978,
+        "nauc_precision_at_20_max": -0.02427,
+        "nauc_precision_at_20_std": 0.017471,
+        "nauc_precision_at_20_diff1": -0.033994,
+        "nauc_precision_at_100_max": 0.073502,
+        "nauc_precision_at_100_std": 0.184939,
+        "nauc_precision_at_100_diff1": -0.0137,
+        "nauc_precision_at_1000_max": 0.091069,
+        "nauc_precision_at_1000_std": 0.172164,
+        "nauc_precision_at_1000_diff1": -0.045364,
+        "nauc_mrr_at_1_max": -0.005386,
+        "nauc_mrr_at_1_std": -0.07558,
+        "nauc_mrr_at_1_diff1": 0.2556,
+        "nauc_mrr_at_3_max": 0.03717,
+        "nauc_mrr_at_3_std": -0.070142,
+        "nauc_mrr_at_3_diff1": 0.254323,
+        "nauc_mrr_at_5_max": 0.016321,
+        "nauc_mrr_at_5_std": -0.082697,
+        "nauc_mrr_at_5_diff1": 0.265545,
+        "nauc_mrr_at_10_max": 0.015548,
+        "nauc_mrr_at_10_std": -0.081212,
+        "nauc_mrr_at_10_diff1": 0.256193,
+        "nauc_mrr_at_20_max": 0.018956,
+        "nauc_mrr_at_20_std": -0.079934,
+        "nauc_mrr_at_20_diff1": 0.254653,
+        "nauc_mrr_at_100_max": 0.019546,
+        "nauc_mrr_at_100_std": -0.078745,
+        "nauc_mrr_at_100_diff1": 0.257046,
+        "nauc_mrr_at_1000_max": 0.019376,
+        "nauc_mrr_at_1000_std": -0.078905,
+        "nauc_mrr_at_1000_diff1": 0.257009,
+        "hit_rate_at_1": 0.36875,
+        "hit_rate_at_3": 0.5875,
+        "hit_rate_at_5": 0.68437,
+        "hit_rate_at_10": 0.77812,
+        "hit_rate_at_20": 0.85938,
+        "hit_rate_at_100": 0.96875,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.42819,
+        "hf_subset": "spanish",
+        "languages": [
+          "spa-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.29219,
+        "ndcg_at_3": 0.34722,
+        "ndcg_at_5": 0.3601,
+        "ndcg_at_10": 0.39194,
+        "ndcg_at_20": 0.43203,
+        "ndcg_at_100": 0.49246,
+        "ndcg_at_1000": 0.532,
+        "map_at_1": 0.15209,
+        "map_at_3": 0.24479,
+        "map_at_5": 0.26946,
+        "map_at_10": 0.29668,
+        "map_at_20": 0.31629,
+        "map_at_100": 0.33431,
+        "map_at_1000": 0.33855,
+        "recall_at_1": 0.15209,
+        "recall_at_3": 0.31973,
+        "recall_at_5": 0.381,
+        "recall_at_10": 0.47284,
+        "recall_at_20": 0.58817,
+        "recall_at_100": 0.79035,
+        "recall_at_1000": 0.98578,
+        "accuracy": 0.15209,
+        "precision_at_1": 0.30625,
+        "precision_at_3": 0.25312,
+        "precision_at_5": 0.19625,
+        "precision_at_10": 0.14125,
+        "precision_at_20": 0.09719,
+        "precision_at_100": 0.03163,
+        "precision_at_1000": 0.00444,
+        "mrr_at_1": 0.30625,
+        "mrr_at_3": 0.427083,
+        "mrr_at_5": 0.443333,
+        "mrr_at_10": 0.454448,
+        "mrr_at_20": 0.46192,
+        "mrr_at_100": 0.464818,
+        "mrr_at_1000": 0.46518,
+        "nauc_ndcg_at_1_max": 0.088143,
+        "nauc_ndcg_at_1_std": 0.02476,
+        "nauc_ndcg_at_1_diff1": 0.278387,
+        "nauc_ndcg_at_3_max": 0.107843,
+        "nauc_ndcg_at_3_std": 0.021114,
+        "nauc_ndcg_at_3_diff1": 0.321915,
+        "nauc_ndcg_at_5_max": 0.097108,
+        "nauc_ndcg_at_5_std": -0.008564,
+        "nauc_ndcg_at_5_diff1": 0.301623,
+        "nauc_ndcg_at_10_max": 0.080372,
+        "nauc_ndcg_at_10_std": -0.019043,
+        "nauc_ndcg_at_10_diff1": 0.277223,
+        "nauc_ndcg_at_20_max": 0.077031,
+        "nauc_ndcg_at_20_std": -0.032031,
+        "nauc_ndcg_at_20_diff1": 0.26302,
+        "nauc_ndcg_at_100_max": 0.108862,
+        "nauc_ndcg_at_100_std": 0.028743,
+        "nauc_ndcg_at_100_diff1": 0.29135,
+        "nauc_ndcg_at_1000_max": 0.10661,
+        "nauc_ndcg_at_1000_std": 0.016832,
+        "nauc_ndcg_at_1000_diff1": 0.303782,
+        "nauc_map_at_1_max": 0.118867,
+        "nauc_map_at_1_std": -0.022112,
+        "nauc_map_at_1_diff1": 0.334893,
+        "nauc_map_at_3_max": 0.099734,
+        "nauc_map_at_3_std": -0.027215,
+        "nauc_map_at_3_diff1": 0.304526,
+        "nauc_map_at_5_max": 0.077968,
+        "nauc_map_at_5_std": -0.048553,
+        "nauc_map_at_5_diff1": 0.2797,
+        "nauc_map_at_10_max": 0.068846,
+        "nauc_map_at_10_std": -0.043697,
+        "nauc_map_at_10_diff1": 0.259997,
+        "nauc_map_at_20_max": 0.069797,
+        "nauc_map_at_20_std": -0.041398,
+        "nauc_map_at_20_diff1": 0.253193,
+        "nauc_map_at_100_max": 0.075753,
+        "nauc_map_at_100_std": -0.024687,
+        "nauc_map_at_100_diff1": 0.265245,
+        "nauc_map_at_1000_max": 0.075454,
+        "nauc_map_at_1000_std": -0.025176,
+        "nauc_map_at_1000_diff1": 0.268264,
+        "nauc_recall_at_1_max": 0.118867,
+        "nauc_recall_at_1_std": -0.022112,
+        "nauc_recall_at_1_diff1": 0.334893,
+        "nauc_recall_at_3_max": 0.087838,
+        "nauc_recall_at_3_std": -0.029633,
+        "nauc_recall_at_3_diff1": 0.284443,
+        "nauc_recall_at_5_max": 0.048791,
+        "nauc_recall_at_5_std": -0.076426,
+        "nauc_recall_at_5_diff1": 0.242885,
+        "nauc_recall_at_10_max": 0.029231,
+        "nauc_recall_at_10_std": -0.062344,
+        "nauc_recall_at_10_diff1": 0.185556,
+        "nauc_recall_at_20_max": 0.008167,
+        "nauc_recall_at_20_std": -0.103474,
+        "nauc_recall_at_20_diff1": 0.137103,
+        "nauc_recall_at_100_max": 0.107354,
+        "nauc_recall_at_100_std": 0.113396,
+        "nauc_recall_at_100_diff1": 0.159467,
+        "nauc_recall_at_1000_max": 0.187245,
+        "nauc_recall_at_1000_std": -0.118239,
+        "nauc_recall_at_1000_diff1": -0.051356,
+        "nauc_precision_at_1_max": 0.074985,
+        "nauc_precision_at_1_std": 0.030956,
+        "nauc_precision_at_1_diff1": 0.278125,
+        "nauc_precision_at_3_max": 0.078998,
+        "nauc_precision_at_3_std": 0.087318,
+        "nauc_precision_at_3_diff1": 0.197003,
+        "nauc_precision_at_5_max": 0.051237,
+        "nauc_precision_at_5_std": 0.061112,
+        "nauc_precision_at_5_diff1": 0.114713,
+        "nauc_precision_at_10_max": 0.008195,
+        "nauc_precision_at_10_std": 0.076024,
+        "nauc_precision_at_10_diff1": 0.057222,
+        "nauc_precision_at_20_max": 0.017573,
+        "nauc_precision_at_20_std": 0.088015,
+        "nauc_precision_at_20_diff1": 0.029229,
+        "nauc_precision_at_100_max": 0.057613,
+        "nauc_precision_at_100_std": 0.194099,
+        "nauc_precision_at_100_diff1": 0.086385,
+        "nauc_precision_at_1000_max": 0.018399,
+        "nauc_precision_at_1000_std": 0.121411,
+        "nauc_precision_at_1000_diff1": 0.048369,
+        "nauc_mrr_at_1_max": 0.074985,
+        "nauc_mrr_at_1_std": 0.030956,
+        "nauc_mrr_at_1_diff1": 0.278125,
+        "nauc_mrr_at_3_max": 0.101818,
+        "nauc_mrr_at_3_std": 0.054834,
+        "nauc_mrr_at_3_diff1": 0.313417,
+        "nauc_mrr_at_5_max": 0.102915,
+        "nauc_mrr_at_5_std": 0.04995,
+        "nauc_mrr_at_5_diff1": 0.314891,
+        "nauc_mrr_at_10_max": 0.100863,
+        "nauc_mrr_at_10_std": 0.05226,
+        "nauc_mrr_at_10_diff1": 0.314508,
+        "nauc_mrr_at_20_max": 0.096182,
+        "nauc_mrr_at_20_std": 0.045021,
+        "nauc_mrr_at_20_diff1": 0.314456,
+        "nauc_mrr_at_100_max": 0.098258,
+        "nauc_mrr_at_100_std": 0.048097,
+        "nauc_mrr_at_100_diff1": 0.314372,
+        "nauc_mrr_at_1000_max": 0.097694,
+        "nauc_mrr_at_1000_std": 0.047443,
+        "nauc_mrr_at_1000_diff1": 0.314088,
+        "hit_rate_at_1": 0.30625,
+        "hit_rate_at_3": 0.58437,
+        "hit_rate_at_5": 0.65312,
+        "hit_rate_at_10": 0.73438,
+        "hit_rate_at_20": 0.83437,
+        "hit_rate_at_100": 0.9375,
+        "hit_rate_at_1000": 0.99687,
+        "main_score": 0.39194,
+        "hf_subset": "english",
+        "languages": [
+          "eng-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.31562,
+        "ndcg_at_3": 0.3513,
+        "ndcg_at_5": 0.37719,
+        "ndcg_at_10": 0.41202,
+        "ndcg_at_20": 0.4492,
+        "ndcg_at_100": 0.50851,
+        "ndcg_at_1000": 0.54295,
+        "map_at_1": 0.16426,
+        "map_at_3": 0.248,
+        "map_at_5": 0.27968,
+        "map_at_10": 0.30982,
+        "map_at_20": 0.32955,
+        "map_at_100": 0.34646,
+        "map_at_1000": 0.35028,
+        "recall_at_1": 0.16426,
+        "recall_at_3": 0.31352,
+        "recall_at_5": 0.40003,
+        "recall_at_10": 0.50894,
+        "recall_at_20": 0.61154,
+        "recall_at_100": 0.81682,
+        "recall_at_1000": 0.98233,
+        "accuracy": 0.16426,
+        "precision_at_1": 0.33125,
+        "precision_at_3": 0.25312,
+        "precision_at_5": 0.20688,
+        "precision_at_10": 0.14906,
+        "precision_at_20": 0.10063,
+        "precision_at_100": 0.03213,
+        "precision_at_1000": 0.0044,
+        "mrr_at_1": 0.33125,
+        "mrr_at_3": 0.434896,
+        "mrr_at_5": 0.460521,
+        "mrr_at_10": 0.473616,
+        "mrr_at_20": 0.479409,
+        "mrr_at_100": 0.482342,
+        "mrr_at_1000": 0.482534,
+        "nauc_ndcg_at_1_max": -0.022888,
+        "nauc_ndcg_at_1_std": -0.149554,
+        "nauc_ndcg_at_1_diff1": 0.143924,
+        "nauc_ndcg_at_3_max": 0.029515,
+        "nauc_ndcg_at_3_std": -0.080052,
+        "nauc_ndcg_at_3_diff1": 0.179854,
+        "nauc_ndcg_at_5_max": 0.019574,
+        "nauc_ndcg_at_5_std": -0.086991,
+        "nauc_ndcg_at_5_diff1": 0.158108,
+        "nauc_ndcg_at_10_max": -0.010189,
+        "nauc_ndcg_at_10_std": -0.101409,
+        "nauc_ndcg_at_10_diff1": 0.12364,
+        "nauc_ndcg_at_20_max": -0.008653,
+        "nauc_ndcg_at_20_std": -0.093004,
+        "nauc_ndcg_at_20_diff1": 0.114681,
+        "nauc_ndcg_at_100_max": 0.024278,
+        "nauc_ndcg_at_100_std": -0.050688,
+        "nauc_ndcg_at_100_diff1": 0.138734,
+        "nauc_ndcg_at_1000_max": 0.034727,
+        "nauc_ndcg_at_1000_std": -0.059236,
+        "nauc_ndcg_at_1000_diff1": 0.153128,
+        "nauc_map_at_1_max": 0.028951,
+        "nauc_map_at_1_std": -0.091598,
+        "nauc_map_at_1_diff1": 0.213911,
+        "nauc_map_at_3_max": 0.033706,
+        "nauc_map_at_3_std": -0.072661,
+        "nauc_map_at_3_diff1": 0.193707,
+        "nauc_map_at_5_max": 0.018602,
+        "nauc_map_at_5_std": -0.086324,
+        "nauc_map_at_5_diff1": 0.168438,
+        "nauc_map_at_10_max": 0.005823,
+        "nauc_map_at_10_std": -0.091621,
+        "nauc_map_at_10_diff1": 0.146105,
+        "nauc_map_at_20_max": 0.000689,
+        "nauc_map_at_20_std": -0.090436,
+        "nauc_map_at_20_diff1": 0.13776,
+        "nauc_map_at_100_max": 0.007065,
+        "nauc_map_at_100_std": -0.079498,
+        "nauc_map_at_100_diff1": 0.141189,
+        "nauc_map_at_1000_max": 0.008089,
+        "nauc_map_at_1000_std": -0.079443,
+        "nauc_map_at_1000_diff1": 0.143244,
+        "nauc_recall_at_1_max": 0.028951,
+        "nauc_recall_at_1_std": -0.091598,
+        "nauc_recall_at_1_diff1": 0.213911,
+        "nauc_recall_at_3_max": 0.038691,
+        "nauc_recall_at_3_std": -0.042685,
+        "nauc_recall_at_3_diff1": 0.188678,
+        "nauc_recall_at_5_max": 0.002362,
+        "nauc_recall_at_5_std": -0.072525,
+        "nauc_recall_at_5_diff1": 0.137799,
+        "nauc_recall_at_10_max": -0.066806,
+        "nauc_recall_at_10_std": -0.107998,
+        "nauc_recall_at_10_diff1": 0.073232,
+        "nauc_recall_at_20_max": -0.064177,
+        "nauc_recall_at_20_std": -0.074683,
+        "nauc_recall_at_20_diff1": 0.045916,
+        "nauc_recall_at_100_max": 0.014043,
+        "nauc_recall_at_100_std": 0.097465,
+        "nauc_recall_at_100_diff1": 0.051847,
+        "nauc_recall_at_1000_max": 0.396666,
+        "nauc_recall_at_1000_std": 0.436381,
+        "nauc_recall_at_1000_diff1": 0.270389,
+        "nauc_precision_at_1_max": -0.016333,
+        "nauc_precision_at_1_std": -0.133591,
+        "nauc_precision_at_1_diff1": 0.150111,
+        "nauc_precision_at_3_max": 0.042914,
+        "nauc_precision_at_3_std": -0.023305,
+        "nauc_precision_at_3_diff1": 0.094622,
+        "nauc_precision_at_5_max": 0.020684,
+        "nauc_precision_at_5_std": -0.022964,
+        "nauc_precision_at_5_diff1": 0.019564,
+        "nauc_precision_at_10_max": -0.033965,
+        "nauc_precision_at_10_std": -0.025258,
+        "nauc_precision_at_10_diff1": -0.064218,
+        "nauc_precision_at_20_max": -0.027457,
+        "nauc_precision_at_20_std": 0.009482,
+        "nauc_precision_at_20_diff1": -0.075764,
+        "nauc_precision_at_100_max": 0.04436,
+        "nauc_precision_at_100_std": 0.120667,
+        "nauc_precision_at_100_diff1": -0.00824,
+        "nauc_precision_at_1000_max": 0.050678,
+        "nauc_precision_at_1000_std": 0.074066,
+        "nauc_precision_at_1000_diff1": 0.011119,
+        "nauc_mrr_at_1_max": -0.016333,
+        "nauc_mrr_at_1_std": -0.133591,
+        "nauc_mrr_at_1_diff1": 0.150111,
+        "nauc_mrr_at_3_max": 0.03401,
+        "nauc_mrr_at_3_std": -0.074038,
+        "nauc_mrr_at_3_diff1": 0.170476,
+        "nauc_mrr_at_5_max": 0.027715,
+        "nauc_mrr_at_5_std": -0.077702,
+        "nauc_mrr_at_5_diff1": 0.166254,
+        "nauc_mrr_at_10_max": 0.016823,
+        "nauc_mrr_at_10_std": -0.08307,
+        "nauc_mrr_at_10_diff1": 0.159707,
+        "nauc_mrr_at_20_max": 0.019003,
+        "nauc_mrr_at_20_std": -0.082444,
+        "nauc_mrr_at_20_diff1": 0.158622,
+        "nauc_mrr_at_100_max": 0.021234,
+        "nauc_mrr_at_100_std": -0.081744,
+        "nauc_mrr_at_100_diff1": 0.161517,
+        "nauc_mrr_at_1000_max": 0.020927,
+        "nauc_mrr_at_1000_std": -0.082098,
+        "nauc_mrr_at_1000_diff1": 0.161333,
+        "hit_rate_at_1": 0.33125,
+        "hit_rate_at_3": 0.56875,
+        "hit_rate_at_5": 0.67812,
+        "hit_rate_at_10": 0.775,
+        "hit_rate_at_20": 0.85625,
+        "hit_rate_at_100": 0.95625,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.41202,
+        "hf_subset": "german",
+        "languages": [
+          "deu-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.34531,
+        "ndcg_at_3": 0.3744,
+        "ndcg_at_5": 0.39021,
+        "ndcg_at_10": 0.42669,
+        "ndcg_at_20": 0.4644,
+        "ndcg_at_100": 0.52514,
+        "ndcg_at_1000": 0.55851,
+        "map_at_1": 0.17527,
+        "map_at_3": 0.26348,
+        "map_at_5": 0.28968,
+        "map_at_10": 0.32167,
+        "map_at_20": 0.34167,
+        "map_at_100": 0.36011,
+        "map_at_1000": 0.36384,
+        "recall_at_1": 0.17527,
+        "recall_at_3": 0.3258,
+        "recall_at_5": 0.39529,
+        "recall_at_10": 0.51676,
+        "recall_at_20": 0.6181,
+        "recall_at_100": 0.82384,
+        "recall_at_1000": 0.98962,
+        "accuracy": 0.17527,
+        "precision_at_1": 0.36875,
+        "precision_at_3": 0.26875,
+        "precision_at_5": 0.215,
+        "precision_at_10": 0.1525,
+        "precision_at_20": 0.10375,
+        "precision_at_100": 0.03353,
+        "precision_at_1000": 0.00447,
+        "mrr_at_1": 0.36875,
+        "mrr_at_3": 0.476562,
+        "mrr_at_5": 0.494375,
+        "mrr_at_10": 0.509328,
+        "mrr_at_20": 0.51515,
+        "mrr_at_100": 0.517062,
+        "mrr_at_1000": 0.51735,
+        "nauc_ndcg_at_1_max": -0.003405,
+        "nauc_ndcg_at_1_std": -0.056644,
+        "nauc_ndcg_at_1_diff1": 0.206567,
+        "nauc_ndcg_at_3_max": -0.032675,
+        "nauc_ndcg_at_3_std": -0.120336,
+        "nauc_ndcg_at_3_diff1": 0.19073,
+        "nauc_ndcg_at_5_max": -0.044256,
+        "nauc_ndcg_at_5_std": -0.131019,
+        "nauc_ndcg_at_5_diff1": 0.20455,
+        "nauc_ndcg_at_10_max": -0.046933,
+        "nauc_ndcg_at_10_std": -0.142762,
+        "nauc_ndcg_at_10_diff1": 0.19261,
+        "nauc_ndcg_at_20_max": -0.046898,
+        "nauc_ndcg_at_20_std": -0.137938,
+        "nauc_ndcg_at_20_diff1": 0.179037,
+        "nauc_ndcg_at_100_max": -0.015036,
+        "nauc_ndcg_at_100_std": -0.086049,
+        "nauc_ndcg_at_100_diff1": 0.195711,
+        "nauc_ndcg_at_1000_max": -0.009876,
+        "nauc_ndcg_at_1000_std": -0.089105,
+        "nauc_ndcg_at_1000_diff1": 0.216971,
+        "nauc_map_at_1_max": 0.035173,
+        "nauc_map_at_1_std": -0.063147,
+        "nauc_map_at_1_diff1": 0.332048,
+        "nauc_map_at_3_max": -0.016007,
+        "nauc_map_at_3_std": -0.125236,
+        "nauc_map_at_3_diff1": 0.230577,
+        "nauc_map_at_5_max": -0.037628,
+        "nauc_map_at_5_std": -0.13848,
+        "nauc_map_at_5_diff1": 0.218663,
+        "nauc_map_at_10_max": -0.041272,
+        "nauc_map_at_10_std": -0.140231,
+        "nauc_map_at_10_diff1": 0.208394,
+        "nauc_map_at_20_max": -0.043149,
+        "nauc_map_at_20_std": -0.136004,
+        "nauc_map_at_20_diff1": 0.201636,
+        "nauc_map_at_100_max": -0.038428,
+        "nauc_map_at_100_std": -0.124581,
+        "nauc_map_at_100_diff1": 0.20564,
+        "nauc_map_at_1000_max": -0.037279,
+        "nauc_map_at_1000_std": -0.123747,
+        "nauc_map_at_1000_diff1": 0.208167,
+        "nauc_recall_at_1_max": 0.035173,
+        "nauc_recall_at_1_std": -0.063147,
+        "nauc_recall_at_1_diff1": 0.332048,
+        "nauc_recall_at_3_max": -0.040168,
+        "nauc_recall_at_3_std": -0.150107,
+        "nauc_recall_at_3_diff1": 0.169052,
+        "nauc_recall_at_5_max": -0.095523,
+        "nauc_recall_at_5_std": -0.185724,
+        "nauc_recall_at_5_diff1": 0.146005,
+        "nauc_recall_at_10_max": -0.086363,
+        "nauc_recall_at_10_std": -0.18276,
+        "nauc_recall_at_10_diff1": 0.08846,
+        "nauc_recall_at_20_max": -0.07572,
+        "nauc_recall_at_20_std": -0.169645,
+        "nauc_recall_at_20_diff1": 0.051789,
+        "nauc_recall_at_100_max": 0.029636,
+        "nauc_recall_at_100_std": 0.027061,
+        "nauc_recall_at_100_diff1": 0.013695,
+        "nauc_recall_at_1000_max": 0.259012,
+        "nauc_recall_at_1000_std": 0.339147,
+        "nauc_recall_at_1000_diff1": 0.193157,
+        "nauc_precision_at_1_max": 0.006905,
+        "nauc_precision_at_1_std": -0.039427,
+        "nauc_precision_at_1_diff1": 0.196332,
+        "nauc_precision_at_3_max": -0.077108,
+        "nauc_precision_at_3_std": -0.113012,
+        "nauc_precision_at_3_diff1": 0.031405,
+        "nauc_precision_at_5_max": -0.074324,
+        "nauc_precision_at_5_std": -0.070758,
+        "nauc_precision_at_5_diff1": 0.021792,
+        "nauc_precision_at_10_max": -0.064549,
+        "nauc_precision_at_10_std": -0.051913,
+        "nauc_precision_at_10_diff1": 0.013804,
+        "nauc_precision_at_20_max": -0.037557,
+        "nauc_precision_at_20_std": 0.012564,
+        "nauc_precision_at_20_diff1": -0.01052,
+        "nauc_precision_at_100_max": 0.064561,
+        "nauc_precision_at_100_std": 0.156233,
+        "nauc_precision_at_100_diff1": 0.010874,
+        "nauc_precision_at_1000_max": 0.085326,
+        "nauc_precision_at_1000_std": 0.137427,
+        "nauc_precision_at_1000_diff1": 0.025244,
+        "nauc_mrr_at_1_max": 0.006905,
+        "nauc_mrr_at_1_std": -0.039427,
+        "nauc_mrr_at_1_diff1": 0.196332,
+        "nauc_mrr_at_3_max": -0.005604,
+        "nauc_mrr_at_3_std": -0.06094,
+        "nauc_mrr_at_3_diff1": 0.188167,
+        "nauc_mrr_at_5_max": -0.010322,
+        "nauc_mrr_at_5_std": -0.062468,
+        "nauc_mrr_at_5_diff1": 0.199979,
+        "nauc_mrr_at_10_max": -0.006197,
+        "nauc_mrr_at_10_std": -0.063725,
+        "nauc_mrr_at_10_diff1": 0.196262,
+        "nauc_mrr_at_20_max": -0.002495,
+        "nauc_mrr_at_20_std": -0.06239,
+        "nauc_mrr_at_20_diff1": 0.196665,
+        "nauc_mrr_at_100_max": -0.000721,
+        "nauc_mrr_at_100_std": -0.059235,
+        "nauc_mrr_at_100_diff1": 0.197357,
+        "nauc_mrr_at_1000_max": -0.001266,
+        "nauc_mrr_at_1000_std": -0.059686,
+        "nauc_mrr_at_1000_diff1": 0.197508,
+        "hit_rate_at_1": 0.36875,
+        "hit_rate_at_3": 0.60625,
+        "hit_rate_at_5": 0.68437,
+        "hit_rate_at_10": 0.79375,
+        "hit_rate_at_20": 0.87813,
+        "hit_rate_at_100": 0.94688,
+        "hit_rate_at_1000": 0.99687,
+        "main_score": 0.42669,
+        "hf_subset": "italian",
+        "languages": [
+          "ita-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.33125,
+        "ndcg_at_3": 0.36749,
+        "ndcg_at_5": 0.38777,
+        "ndcg_at_10": 0.42372,
+        "ndcg_at_20": 0.45806,
+        "ndcg_at_100": 0.5215,
+        "ndcg_at_1000": 0.55367,
+        "map_at_1": 0.16307,
+        "map_at_3": 0.25516,
+        "map_at_5": 0.28388,
+        "map_at_10": 0.31601,
+        "map_at_20": 0.33576,
+        "map_at_100": 0.3547,
+        "map_at_1000": 0.35834,
+        "recall_at_1": 0.16307,
+        "recall_at_3": 0.32487,
+        "recall_at_5": 0.39983,
+        "recall_at_10": 0.51825,
+        "recall_at_20": 0.61276,
+        "recall_at_100": 0.83376,
+        "recall_at_1000": 0.98881,
+        "accuracy": 0.16307,
+        "precision_at_1": 0.34687,
+        "precision_at_3": 0.26354,
+        "precision_at_5": 0.21938,
+        "precision_at_10": 0.15625,
+        "precision_at_20": 0.10328,
+        "precision_at_100": 0.03325,
+        "precision_at_1000": 0.00445,
+        "mrr_at_1": 0.346875,
+        "mrr_at_3": 0.456771,
+        "mrr_at_5": 0.479115,
+        "mrr_at_10": 0.493328,
+        "mrr_at_20": 0.497957,
+        "mrr_at_100": 0.500592,
+        "mrr_at_1000": 0.500773,
+        "nauc_ndcg_at_1_max": 0.050717,
+        "nauc_ndcg_at_1_std": -0.041867,
+        "nauc_ndcg_at_1_diff1": 0.222986,
+        "nauc_ndcg_at_3_max": 0.025257,
+        "nauc_ndcg_at_3_std": -0.091812,
+        "nauc_ndcg_at_3_diff1": 0.226686,
+        "nauc_ndcg_at_5_max": 0.005473,
+        "nauc_ndcg_at_5_std": -0.118018,
+        "nauc_ndcg_at_5_diff1": 0.188812,
+        "nauc_ndcg_at_10_max": -0.022775,
+        "nauc_ndcg_at_10_std": -0.144085,
+        "nauc_ndcg_at_10_diff1": 0.149266,
+        "nauc_ndcg_at_20_max": -0.030733,
+        "nauc_ndcg_at_20_std": -0.143395,
+        "nauc_ndcg_at_20_diff1": 0.125794,
+        "nauc_ndcg_at_100_max": 0.011471,
+        "nauc_ndcg_at_100_std": -0.086874,
+        "nauc_ndcg_at_100_diff1": 0.162644,
+        "nauc_ndcg_at_1000_max": 0.019979,
+        "nauc_ndcg_at_1000_std": -0.081888,
+        "nauc_ndcg_at_1000_diff1": 0.173145,
+        "nauc_map_at_1_max": 0.049228,
+        "nauc_map_at_1_std": -0.064385,
+        "nauc_map_at_1_diff1": 0.324519,
+        "nauc_map_at_3_max": 0.019123,
+        "nauc_map_at_3_std": -0.109328,
+        "nauc_map_at_3_diff1": 0.239726,
+        "nauc_map_at_5_max": 0.005623,
+        "nauc_map_at_5_std": -0.122962,
+        "nauc_map_at_5_diff1": 0.202444,
+        "nauc_map_at_10_max": -0.015927,
+        "nauc_map_at_10_std": -0.138707,
+        "nauc_map_at_10_diff1": 0.176311,
+        "nauc_map_at_20_max": -0.020373,
+        "nauc_map_at_20_std": -0.137068,
+        "nauc_map_at_20_diff1": 0.161163,
+        "nauc_map_at_100_max": -0.010521,
+        "nauc_map_at_100_std": -0.120467,
+        "nauc_map_at_100_diff1": 0.168166,
+        "nauc_map_at_1000_max": -0.008994,
+        "nauc_map_at_1000_std": -0.118793,
+        "nauc_map_at_1000_diff1": 0.170276,
+        "nauc_recall_at_1_max": 0.049228,
+        "nauc_recall_at_1_std": -0.064385,
+        "nauc_recall_at_1_diff1": 0.324519,
+        "nauc_recall_at_3_max": 0.010793,
+        "nauc_recall_at_3_std": -0.118794,
+        "nauc_recall_at_3_diff1": 0.203148,
+        "nauc_recall_at_5_max": -0.028337,
+        "nauc_recall_at_5_std": -0.157512,
+        "nauc_recall_at_5_diff1": 0.128938,
+        "nauc_recall_at_10_max": -0.087701,
+        "nauc_recall_at_10_std": -0.201326,
+        "nauc_recall_at_10_diff1": 0.027663,
+        "nauc_recall_at_20_max": -0.107702,
+        "nauc_recall_at_20_std": -0.204836,
+        "nauc_recall_at_20_diff1": -0.044153,
+        "nauc_recall_at_100_max": 0.028365,
+        "nauc_recall_at_100_std": -0.017519,
+        "nauc_recall_at_100_diff1": 0.064179,
+        "nauc_recall_at_1000_max": 0.33066,
+        "nauc_recall_at_1000_std": 0.361364,
+        "nauc_recall_at_1000_diff1": 0.307197,
+        "nauc_precision_at_1_max": 0.064175,
+        "nauc_precision_at_1_std": -0.018949,
+        "nauc_precision_at_1_diff1": 0.227023,
+        "nauc_precision_at_3_max": 0.000684,
+        "nauc_precision_at_3_std": -0.069477,
+        "nauc_precision_at_3_diff1": 0.077611,
+        "nauc_precision_at_5_max": -0.03218,
+        "nauc_precision_at_5_std": -0.075606,
+        "nauc_precision_at_5_diff1": -0.038872,
+        "nauc_precision_at_10_max": -0.051723,
+        "nauc_precision_at_10_std": -0.056753,
+        "nauc_precision_at_10_diff1": -0.088099,
+        "nauc_precision_at_20_max": -0.035667,
+        "nauc_precision_at_20_std": 0.005778,
+        "nauc_precision_at_20_diff1": -0.112085,
+        "nauc_precision_at_100_max": 0.071119,
+        "nauc_precision_at_100_std": 0.167805,
+        "nauc_precision_at_100_diff1": -0.054195,
+        "nauc_precision_at_1000_max": 0.081621,
+        "nauc_precision_at_1000_std": 0.15762,
+        "nauc_precision_at_1000_diff1": -0.041662,
+        "nauc_mrr_at_1_max": 0.064175,
+        "nauc_mrr_at_1_std": -0.018949,
+        "nauc_mrr_at_1_diff1": 0.227023,
+        "nauc_mrr_at_3_max": 0.050543,
+        "nauc_mrr_at_3_std": -0.037521,
+        "nauc_mrr_at_3_diff1": 0.213175,
+        "nauc_mrr_at_5_max": 0.039836,
+        "nauc_mrr_at_5_std": -0.049212,
+        "nauc_mrr_at_5_diff1": 0.205917,
+        "nauc_mrr_at_10_max": 0.042616,
+        "nauc_mrr_at_10_std": -0.04534,
+        "nauc_mrr_at_10_diff1": 0.197729,
+        "nauc_mrr_at_20_max": 0.043669,
+        "nauc_mrr_at_20_std": -0.043528,
+        "nauc_mrr_at_20_diff1": 0.199675,
+        "nauc_mrr_at_100_max": 0.045515,
+        "nauc_mrr_at_100_std": -0.041714,
+        "nauc_mrr_at_100_diff1": 0.202098,
+        "nauc_mrr_at_1000_max": 0.045227,
+        "nauc_mrr_at_1000_std": -0.041979,
+        "nauc_mrr_at_1000_diff1": 0.202028,
+        "hit_rate_at_1": 0.34687,
+        "hit_rate_at_3": 0.59688,
+        "hit_rate_at_5": 0.69375,
+        "hit_rate_at_10": 0.8,
+        "hit_rate_at_20": 0.86562,
+        "hit_rate_at_100": 0.9625,
+        "hit_rate_at_1000": 0.99687,
+        "main_score": 0.42372,
+        "hf_subset": "portuguese",
+        "languages": [
+          "por-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 2323.102525472641,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v3/Vidore3HrRetrieval.json

@@ -0,0 +1,942 @@
+{
+  "dataset_revision": "bc7d43d64815ed30f664168c8052106484aba7fd",
+  "task_name": "Vidore3HrRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.49843,
+        "ndcg_at_3": 0.51062,
+        "ndcg_at_5": 0.52598,
+        "ndcg_at_10": 0.55172,
+        "ndcg_at_20": 0.58309,
+        "ndcg_at_100": 0.64192,
+        "ndcg_at_1000": 0.66408,
+        "map_at_1": 0.20409,
+        "map_at_3": 0.31327,
+        "map_at_5": 0.36152,
+        "map_at_10": 0.40845,
+        "map_at_20": 0.43919,
+        "map_at_100": 0.46327,
+        "map_at_1000": 0.46702,
+        "recall_at_1": 0.20409,
+        "recall_at_3": 0.38211,
+        "recall_at_5": 0.48599,
+        "recall_at_10": 0.61072,
+        "recall_at_20": 0.72678,
+        "recall_at_100": 0.91145,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.20409,
+        "precision_at_1": 0.53145,
+        "precision_at_3": 0.39413,
+        "precision_at_5": 0.32704,
+        "precision_at_10": 0.23553,
+        "precision_at_20": 0.15519,
+        "precision_at_100": 0.04594,
+        "precision_at_1000": 0.00544,
+        "mrr_at_1": 0.531447,
+        "mrr_at_3": 0.646226,
+        "mrr_at_5": 0.662579,
+        "mrr_at_10": 0.66864,
+        "mrr_at_20": 0.670619,
+        "mrr_at_100": 0.671638,
+        "mrr_at_1000": 0.671727,
+        "nauc_ndcg_at_1_max": 0.086954,
+        "nauc_ndcg_at_1_std": 0.02922,
+        "nauc_ndcg_at_1_diff1": 0.330762,
+        "nauc_ndcg_at_3_max": 0.040488,
+        "nauc_ndcg_at_3_std": -0.019044,
+        "nauc_ndcg_at_3_diff1": 0.240912,
+        "nauc_ndcg_at_5_max": 0.067084,
+        "nauc_ndcg_at_5_std": 0.006029,
+        "nauc_ndcg_at_5_diff1": 0.199992,
+        "nauc_ndcg_at_10_max": 0.115765,
+        "nauc_ndcg_at_10_std": 0.020336,
+        "nauc_ndcg_at_10_diff1": 0.220699,
+        "nauc_ndcg_at_20_max": 0.122037,
+        "nauc_ndcg_at_20_std": 0.016847,
+        "nauc_ndcg_at_20_diff1": 0.211915,
+        "nauc_ndcg_at_100_max": 0.142235,
+        "nauc_ndcg_at_100_std": 0.043068,
+        "nauc_ndcg_at_100_diff1": 0.267279,
+        "nauc_ndcg_at_1000_max": 0.118503,
+        "nauc_ndcg_at_1000_std": 0.02948,
+        "nauc_ndcg_at_1000_diff1": 0.277939,
+        "nauc_map_at_1_max": -0.022412,
+        "nauc_map_at_1_std": -0.067367,
+        "nauc_map_at_1_diff1": 0.263104,
+        "nauc_map_at_3_max": 0.012083,
+        "nauc_map_at_3_std": -0.05032,
+        "nauc_map_at_3_diff1": 0.2077,
+        "nauc_map_at_5_max": 0.035765,
+        "nauc_map_at_5_std": -0.023646,
+        "nauc_map_at_5_diff1": 0.181738,
+        "nauc_map_at_10_max": 0.064454,
+        "nauc_map_at_10_std": -0.012976,
+        "nauc_map_at_10_diff1": 0.184181,
+        "nauc_map_at_20_max": 0.070835,
+        "nauc_map_at_20_std": -0.014854,
+        "nauc_map_at_20_diff1": 0.181761,
+        "nauc_map_at_100_max": 0.086126,
+        "nauc_map_at_100_std": -9.7e-05,
+        "nauc_map_at_100_diff1": 0.205283,
+        "nauc_map_at_1000_max": 0.084635,
+        "nauc_map_at_1000_std": -0.000487,
+        "nauc_map_at_1000_diff1": 0.207299,
+        "nauc_recall_at_1_max": -0.022412,
+        "nauc_recall_at_1_std": -0.067367,
+        "nauc_recall_at_1_diff1": 0.263104,
+        "nauc_recall_at_3_max": -0.002254,
+        "nauc_recall_at_3_std": -0.060627,
+        "nauc_recall_at_3_diff1": 0.108879,
+        "nauc_recall_at_5_max": 0.063966,
+        "nauc_recall_at_5_std": 0.011042,
+        "nauc_recall_at_5_diff1": 0.040978,
+        "nauc_recall_at_10_max": 0.155248,
+        "nauc_recall_at_10_std": 0.049224,
+        "nauc_recall_at_10_diff1": 0.060149,
+        "nauc_recall_at_20_max": 0.169232,
+        "nauc_recall_at_20_std": 0.034977,
+        "nauc_recall_at_20_diff1": 0.012479,
+        "nauc_recall_at_100_max": 0.355687,
+        "nauc_recall_at_100_std": 0.192458,
+        "nauc_recall_at_100_diff1": 0.116844,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.109829,
+        "nauc_precision_at_1_std": 0.054386,
+        "nauc_precision_at_1_diff1": 0.321722,
+        "nauc_precision_at_3_max": 0.045443,
+        "nauc_precision_at_3_std": -0.00684,
+        "nauc_precision_at_3_diff1": 0.118583,
+        "nauc_precision_at_5_max": 0.08929,
+        "nauc_precision_at_5_std": 0.06057,
+        "nauc_precision_at_5_diff1": 0.024793,
+        "nauc_precision_at_10_max": 0.13245,
+        "nauc_precision_at_10_std": 0.08226,
+        "nauc_precision_at_10_diff1": 0.035132,
+        "nauc_precision_at_20_max": 0.104435,
+        "nauc_precision_at_20_std": 0.059872,
+        "nauc_precision_at_20_diff1": 0.025546,
+        "nauc_precision_at_100_max": 0.096498,
+        "nauc_precision_at_100_std": 0.095135,
+        "nauc_precision_at_100_diff1": 0.082624,
+        "nauc_precision_at_1000_max": 0.028438,
+        "nauc_precision_at_1000_std": 0.054466,
+        "nauc_precision_at_1000_diff1": 0.061556,
+        "nauc_mrr_at_1_max": 0.109829,
+        "nauc_mrr_at_1_std": 0.054386,
+        "nauc_mrr_at_1_diff1": 0.321722,
+        "nauc_mrr_at_3_max": 0.10244,
+        "nauc_mrr_at_3_std": 0.05158,
+        "nauc_mrr_at_3_diff1": 0.305955,
+        "nauc_mrr_at_5_max": 0.128027,
+        "nauc_mrr_at_5_std": 0.07218,
+        "nauc_mrr_at_5_diff1": 0.295617,
+        "nauc_mrr_at_10_max": 0.134407,
+        "nauc_mrr_at_10_std": 0.074668,
+        "nauc_mrr_at_10_diff1": 0.304394,
+        "nauc_mrr_at_20_max": 0.133196,
+        "nauc_mrr_at_20_std": 0.073922,
+        "nauc_mrr_at_20_diff1": 0.303999,
+        "nauc_mrr_at_100_max": 0.131438,
+        "nauc_mrr_at_100_std": 0.073228,
+        "nauc_mrr_at_100_diff1": 0.303935,
+        "nauc_mrr_at_1000_max": 0.131184,
+        "nauc_mrr_at_1000_std": 0.072992,
+        "nauc_mrr_at_1000_diff1": 0.303929,
+        "hit_rate_at_1": 0.53145,
+        "hit_rate_at_3": 0.7956,
+        "hit_rate_at_5": 0.87107,
+        "hit_rate_at_10": 0.91509,
+        "hit_rate_at_20": 0.9434,
+        "hit_rate_at_100": 0.98742,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.55172,
+        "hf_subset": "french",
+        "languages": [
+          "fra-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.47484,
+        "ndcg_at_3": 0.48755,
+        "ndcg_at_5": 0.50061,
+        "ndcg_at_10": 0.53196,
+        "ndcg_at_20": 0.56488,
+        "ndcg_at_100": 0.63112,
+        "ndcg_at_1000": 0.65356,
+        "map_at_1": 0.20273,
+        "map_at_3": 0.30991,
+        "map_at_5": 0.35076,
+        "map_at_10": 0.39629,
+        "map_at_20": 0.42503,
+        "map_at_100": 0.45339,
+        "map_at_1000": 0.45696,
+        "recall_at_1": 0.20273,
+        "recall_at_3": 0.37421,
+        "recall_at_5": 0.4601,
+        "recall_at_10": 0.59062,
+        "recall_at_20": 0.70579,
+        "recall_at_100": 0.90811,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.20273,
+        "precision_at_1": 0.50629,
+        "precision_at_3": 0.36897,
+        "precision_at_5": 0.3044,
+        "precision_at_10": 0.22233,
+        "precision_at_20": 0.14811,
+        "precision_at_100": 0.04601,
+        "precision_at_1000": 0.00544,
+        "mrr_at_1": 0.506289,
+        "mrr_at_3": 0.611111,
+        "mrr_at_5": 0.630451,
+        "mrr_at_10": 0.641548,
+        "mrr_at_20": 0.643625,
+        "mrr_at_100": 0.645172,
+        "mrr_at_1000": 0.645295,
+        "nauc_ndcg_at_1_max": 0.135232,
+        "nauc_ndcg_at_1_std": 0.075007,
+        "nauc_ndcg_at_1_diff1": 0.315274,
+        "nauc_ndcg_at_3_max": 0.131531,
+        "nauc_ndcg_at_3_std": 0.057206,
+        "nauc_ndcg_at_3_diff1": 0.23287,
+        "nauc_ndcg_at_5_max": 0.135593,
+        "nauc_ndcg_at_5_std": 0.049501,
+        "nauc_ndcg_at_5_diff1": 0.209576,
+        "nauc_ndcg_at_10_max": 0.164936,
+        "nauc_ndcg_at_10_std": 0.075434,
+        "nauc_ndcg_at_10_diff1": 0.218606,
+        "nauc_ndcg_at_20_max": 0.165978,
+        "nauc_ndcg_at_20_std": 0.066654,
+        "nauc_ndcg_at_20_diff1": 0.227851,
+        "nauc_ndcg_at_100_max": 0.199159,
+        "nauc_ndcg_at_100_std": 0.093315,
+        "nauc_ndcg_at_100_diff1": 0.244699,
+        "nauc_ndcg_at_1000_max": 0.178157,
+        "nauc_ndcg_at_1000_std": 0.084324,
+        "nauc_ndcg_at_1000_diff1": 0.244495,
+        "nauc_map_at_1_max": 0.009095,
+        "nauc_map_at_1_std": -0.046818,
+        "nauc_map_at_1_diff1": 0.233114,
+        "nauc_map_at_3_max": 0.063918,
+        "nauc_map_at_3_std": -0.000843,
+        "nauc_map_at_3_diff1": 0.196188,
+        "nauc_map_at_5_max": 0.085225,
+        "nauc_map_at_5_std": 0.008355,
+        "nauc_map_at_5_diff1": 0.178269,
+        "nauc_map_at_10_max": 0.108186,
+        "nauc_map_at_10_std": 0.031837,
+        "nauc_map_at_10_diff1": 0.173432,
+        "nauc_map_at_20_max": 0.114539,
+        "nauc_map_at_20_std": 0.0314,
+        "nauc_map_at_20_diff1": 0.175847,
+        "nauc_map_at_100_max": 0.13075,
+        "nauc_map_at_100_std": 0.045327,
+        "nauc_map_at_100_diff1": 0.178533,
+        "nauc_map_at_1000_max": 0.129774,
+        "nauc_map_at_1000_std": 0.045707,
+        "nauc_map_at_1000_diff1": 0.178628,
+        "nauc_recall_at_1_max": 0.009095,
+        "nauc_recall_at_1_std": -0.046818,
+        "nauc_recall_at_1_diff1": 0.233114,
+        "nauc_recall_at_3_max": 0.060215,
+        "nauc_recall_at_3_std": -0.007546,
+        "nauc_recall_at_3_diff1": 0.137054,
+        "nauc_recall_at_5_max": 0.086922,
+        "nauc_recall_at_5_std": -0.001132,
+        "nauc_recall_at_5_diff1": 0.104324,
+        "nauc_recall_at_10_max": 0.147587,
+        "nauc_recall_at_10_std": 0.066156,
+        "nauc_recall_at_10_diff1": 0.116541,
+        "nauc_recall_at_20_max": 0.135124,
+        "nauc_recall_at_20_std": 0.040416,
+        "nauc_recall_at_20_diff1": 0.138092,
+        "nauc_recall_at_100_max": 0.382459,
+        "nauc_recall_at_100_std": 0.206127,
+        "nauc_recall_at_100_diff1": 0.217092,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.16699,
+        "nauc_precision_at_1_std": 0.098575,
+        "nauc_precision_at_1_diff1": 0.305316,
+        "nauc_precision_at_3_max": 0.168434,
+        "nauc_precision_at_3_std": 0.103705,
+        "nauc_precision_at_3_diff1": 0.09746,
+        "nauc_precision_at_5_max": 0.182065,
+        "nauc_precision_at_5_std": 0.135823,
+        "nauc_precision_at_5_diff1": 0.019704,
+        "nauc_precision_at_10_max": 0.166493,
+        "nauc_precision_at_10_std": 0.14494,
+        "nauc_precision_at_10_diff1": -0.012649,
+        "nauc_precision_at_20_max": 0.110654,
+        "nauc_precision_at_20_std": 0.097222,
+        "nauc_precision_at_20_diff1": -0.031051,
+        "nauc_precision_at_100_max": 0.09779,
+        "nauc_precision_at_100_std": 0.111965,
+        "nauc_precision_at_100_diff1": -0.041216,
+        "nauc_precision_at_1000_max": 0.03501,
+        "nauc_precision_at_1000_std": 0.077881,
+        "nauc_precision_at_1000_diff1": -0.056829,
+        "nauc_mrr_at_1_max": 0.16699,
+        "nauc_mrr_at_1_std": 0.098575,
+        "nauc_mrr_at_1_diff1": 0.305316,
+        "nauc_mrr_at_3_max": 0.194494,
+        "nauc_mrr_at_3_std": 0.095587,
+        "nauc_mrr_at_3_diff1": 0.307221,
+        "nauc_mrr_at_5_max": 0.216271,
+        "nauc_mrr_at_5_std": 0.114539,
+        "nauc_mrr_at_5_diff1": 0.311474,
+        "nauc_mrr_at_10_max": 0.220094,
+        "nauc_mrr_at_10_std": 0.120589,
+        "nauc_mrr_at_10_diff1": 0.31435,
+        "nauc_mrr_at_20_max": 0.216053,
+        "nauc_mrr_at_20_std": 0.11744,
+        "nauc_mrr_at_20_diff1": 0.313224,
+        "nauc_mrr_at_100_max": 0.214285,
+        "nauc_mrr_at_100_std": 0.116005,
+        "nauc_mrr_at_100_diff1": 0.313374,
+        "nauc_mrr_at_1000_max": 0.213995,
+        "nauc_mrr_at_1000_std": 0.115728,
+        "nauc_mrr_at_1000_diff1": 0.313119,
+        "hit_rate_at_1": 0.50629,
+        "hit_rate_at_3": 0.74214,
+        "hit_rate_at_5": 0.82704,
+        "hit_rate_at_10": 0.90881,
+        "hit_rate_at_20": 0.93711,
+        "hit_rate_at_100": 0.98428,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.53196,
+        "hf_subset": "spanish",
+        "languages": [
+          "spa-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.53145,
+        "ndcg_at_3": 0.5378,
+        "ndcg_at_5": 0.55892,
+        "ndcg_at_10": 0.57872,
+        "ndcg_at_20": 0.61419,
+        "ndcg_at_100": 0.67329,
+        "ndcg_at_1000": 0.69136,
+        "map_at_1": 0.22921,
+        "map_at_3": 0.34063,
+        "map_at_5": 0.3921,
+        "map_at_10": 0.43523,
+        "map_at_20": 0.46886,
+        "map_at_100": 0.49612,
+        "map_at_1000": 0.49924,
+        "recall_at_1": 0.22921,
+        "recall_at_3": 0.40238,
+        "recall_at_5": 0.51208,
+        "recall_at_10": 0.61881,
+        "recall_at_20": 0.74893,
+        "recall_at_100": 0.92888,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.22921,
+        "precision_at_1": 0.56604,
+        "precision_at_3": 0.40671,
+        "precision_at_5": 0.34151,
+        "precision_at_10": 0.23553,
+        "precision_at_20": 0.16022,
+        "precision_at_100": 0.04758,
+        "precision_at_1000": 0.00544,
+        "mrr_at_1": 0.566038,
+        "mrr_at_3": 0.677673,
+        "mrr_at_5": 0.697327,
+        "mrr_at_10": 0.700668,
+        "mrr_at_20": 0.702969,
+        "mrr_at_100": 0.70382,
+        "mrr_at_1000": 0.70385,
+        "nauc_ndcg_at_1_max": -0.035711,
+        "nauc_ndcg_at_1_std": -0.090556,
+        "nauc_ndcg_at_1_diff1": 0.451603,
+        "nauc_ndcg_at_3_max": 0.011923,
+        "nauc_ndcg_at_3_std": -0.080622,
+        "nauc_ndcg_at_3_diff1": 0.365012,
+        "nauc_ndcg_at_5_max": 0.032428,
+        "nauc_ndcg_at_5_std": -0.06159,
+        "nauc_ndcg_at_5_diff1": 0.368926,
+        "nauc_ndcg_at_10_max": 0.061568,
+        "nauc_ndcg_at_10_std": -0.032383,
+        "nauc_ndcg_at_10_diff1": 0.352923,
+        "nauc_ndcg_at_20_max": 0.093354,
+        "nauc_ndcg_at_20_std": -0.021325,
+        "nauc_ndcg_at_20_diff1": 0.381718,
+        "nauc_ndcg_at_100_max": 0.074467,
+        "nauc_ndcg_at_100_std": -0.048135,
+        "nauc_ndcg_at_100_diff1": 0.392106,
+        "nauc_ndcg_at_1000_max": 0.045833,
+        "nauc_ndcg_at_1000_std": -0.059413,
+        "nauc_ndcg_at_1000_diff1": 0.393698,
+        "nauc_map_at_1_max": -0.051897,
+        "nauc_map_at_1_std": -0.095386,
+        "nauc_map_at_1_diff1": 0.378687,
+        "nauc_map_at_3_max": 0.020527,
+        "nauc_map_at_3_std": -0.068231,
+        "nauc_map_at_3_diff1": 0.308941,
+        "nauc_map_at_5_max": 0.023761,
+        "nauc_map_at_5_std": -0.064562,
+        "nauc_map_at_5_diff1": 0.299429,
+        "nauc_map_at_10_max": 0.038681,
+        "nauc_map_at_10_std": -0.04957,
+        "nauc_map_at_10_diff1": 0.294206,
+        "nauc_map_at_20_max": 0.050479,
+        "nauc_map_at_20_std": -0.051145,
+        "nauc_map_at_20_diff1": 0.317087,
+        "nauc_map_at_100_max": 0.051555,
+        "nauc_map_at_100_std": -0.055378,
+        "nauc_map_at_100_diff1": 0.325207,
+        "nauc_map_at_1000_max": 0.04854,
+        "nauc_map_at_1000_std": -0.056629,
+        "nauc_map_at_1000_diff1": 0.325748,
+        "nauc_recall_at_1_max": -0.051897,
+        "nauc_recall_at_1_std": -0.095386,
+        "nauc_recall_at_1_diff1": 0.378687,
+        "nauc_recall_at_3_max": 0.063828,
+        "nauc_recall_at_3_std": -0.029858,
+        "nauc_recall_at_3_diff1": 0.23147,
+        "nauc_recall_at_5_max": 0.106212,
+        "nauc_recall_at_5_std": 0.008167,
+        "nauc_recall_at_5_diff1": 0.201306,
+        "nauc_recall_at_10_max": 0.141471,
+        "nauc_recall_at_10_std": 0.074998,
+        "nauc_recall_at_10_diff1": 0.154277,
+        "nauc_recall_at_20_max": 0.228511,
+        "nauc_recall_at_20_std": 0.105171,
+        "nauc_recall_at_20_diff1": 0.240059,
+        "nauc_recall_at_100_max": 0.365634,
+        "nauc_recall_at_100_std": 0.083204,
+        "nauc_recall_at_100_diff1": 0.24509,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": -0.035591,
+        "nauc_precision_at_1_std": -0.093836,
+        "nauc_precision_at_1_diff1": 0.44849,
+        "nauc_precision_at_3_max": 0.059836,
+        "nauc_precision_at_3_std": -0.019025,
+        "nauc_precision_at_3_diff1": 0.121388,
+        "nauc_precision_at_5_max": 0.050097,
+        "nauc_precision_at_5_std": 0.010276,
+        "nauc_precision_at_5_diff1": 0.057051,
+        "nauc_precision_at_10_max": 0.039252,
+        "nauc_precision_at_10_std": 0.026237,
+        "nauc_precision_at_10_diff1": 0.007748,
+        "nauc_precision_at_20_max": 0.047732,
+        "nauc_precision_at_20_std": 0.019741,
+        "nauc_precision_at_20_diff1": 0.019111,
+        "nauc_precision_at_100_max": -0.009584,
+        "nauc_precision_at_100_std": -0.006186,
+        "nauc_precision_at_100_diff1": -0.039453,
+        "nauc_precision_at_1000_max": -0.057335,
+        "nauc_precision_at_1000_std": -0.022688,
+        "nauc_precision_at_1000_diff1": -0.068202,
+        "nauc_mrr_at_1_max": -0.035591,
+        "nauc_mrr_at_1_std": -0.093836,
+        "nauc_mrr_at_1_diff1": 0.44849,
+        "nauc_mrr_at_3_max": -0.010874,
+        "nauc_mrr_at_3_std": -0.085422,
+        "nauc_mrr_at_3_diff1": 0.436772,
+        "nauc_mrr_at_5_max": 0.030963,
+        "nauc_mrr_at_5_std": -0.054217,
+        "nauc_mrr_at_5_diff1": 0.452821,
+        "nauc_mrr_at_10_max": 0.0265,
+        "nauc_mrr_at_10_std": -0.053579,
+        "nauc_mrr_at_10_diff1": 0.450761,
+        "nauc_mrr_at_20_max": 0.024364,
+        "nauc_mrr_at_20_std": -0.054616,
+        "nauc_mrr_at_20_diff1": 0.450231,
+        "nauc_mrr_at_100_max": 0.021691,
+        "nauc_mrr_at_100_std": -0.057067,
+        "nauc_mrr_at_100_diff1": 0.449778,
+        "nauc_mrr_at_1000_max": 0.021625,
+        "nauc_mrr_at_1000_std": -0.057118,
+        "nauc_mrr_at_1000_diff1": 0.449766,
+        "hit_rate_at_1": 0.56604,
+        "hit_rate_at_3": 0.81447,
+        "hit_rate_at_5": 0.89937,
+        "hit_rate_at_10": 0.92453,
+        "hit_rate_at_20": 0.95597,
+        "hit_rate_at_100": 0.99686,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.57872,
+        "hf_subset": "english",
+        "languages": [
+          "eng-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.47956,
+        "ndcg_at_3": 0.48534,
+        "ndcg_at_5": 0.50205,
+        "ndcg_at_10": 0.53072,
+        "ndcg_at_20": 0.56616,
+        "ndcg_at_100": 0.62639,
+        "ndcg_at_1000": 0.64997,
+        "map_at_1": 0.19424,
+        "map_at_3": 0.29987,
+        "map_at_5": 0.34672,
+        "map_at_10": 0.39011,
+        "map_at_20": 0.42283,
+        "map_at_100": 0.44875,
+        "map_at_1000": 0.45247,
+        "recall_at_1": 0.19424,
+        "recall_at_3": 0.35795,
+        "recall_at_5": 0.45862,
+        "recall_at_10": 0.59447,
+        "recall_at_20": 0.71716,
+        "recall_at_100": 0.90392,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.19424,
+        "precision_at_1": 0.50943,
+        "precision_at_3": 0.37526,
+        "precision_at_5": 0.31447,
+        "precision_at_10": 0.2239,
+        "precision_at_20": 0.15142,
+        "precision_at_100": 0.04566,
+        "precision_at_1000": 0.00544,
+        "mrr_at_1": 0.509434,
+        "mrr_at_3": 0.612159,
+        "mrr_at_5": 0.631971,
+        "mrr_at_10": 0.644059,
+        "mrr_at_20": 0.646407,
+        "mrr_at_100": 0.647261,
+        "mrr_at_1000": 0.647362,
+        "nauc_ndcg_at_1_max": 0.122497,
+        "nauc_ndcg_at_1_std": 0.04162,
+        "nauc_ndcg_at_1_diff1": 0.509654,
+        "nauc_ndcg_at_3_max": 0.056424,
+        "nauc_ndcg_at_3_std": -0.003144,
+        "nauc_ndcg_at_3_diff1": 0.379321,
+        "nauc_ndcg_at_5_max": 0.053377,
+        "nauc_ndcg_at_5_std": -0.013802,
+        "nauc_ndcg_at_5_diff1": 0.37195,
+        "nauc_ndcg_at_10_max": 0.102979,
+        "nauc_ndcg_at_10_std": 0.020373,
+        "nauc_ndcg_at_10_diff1": 0.383367,
+        "nauc_ndcg_at_20_max": 0.118924,
+        "nauc_ndcg_at_20_std": 0.033941,
+        "nauc_ndcg_at_20_diff1": 0.381299,
+        "nauc_ndcg_at_100_max": 0.130254,
+        "nauc_ndcg_at_100_std": 0.04229,
+        "nauc_ndcg_at_100_diff1": 0.418466,
+        "nauc_ndcg_at_1000_max": 0.113018,
+        "nauc_ndcg_at_1000_std": 0.031653,
+        "nauc_ndcg_at_1000_diff1": 0.438923,
+        "nauc_map_at_1_max": -0.05153,
+        "nauc_map_at_1_std": -0.114219,
+        "nauc_map_at_1_diff1": 0.378076,
+        "nauc_map_at_3_max": -0.007333,
+        "nauc_map_at_3_std": -0.075841,
+        "nauc_map_at_3_diff1": 0.299051,
+        "nauc_map_at_5_max": -0.010419,
+        "nauc_map_at_5_std": -0.081546,
+        "nauc_map_at_5_diff1": 0.285559,
+        "nauc_map_at_10_max": 0.029044,
+        "nauc_map_at_10_std": -0.048735,
+        "nauc_map_at_10_diff1": 0.307979,
+        "nauc_map_at_20_max": 0.047584,
+        "nauc_map_at_20_std": -0.031958,
+        "nauc_map_at_20_diff1": 0.324882,
+        "nauc_map_at_100_max": 0.057638,
+        "nauc_map_at_100_std": -0.024953,
+        "nauc_map_at_100_diff1": 0.349052,
+        "nauc_map_at_1000_max": 0.057138,
+        "nauc_map_at_1000_std": -0.024371,
+        "nauc_map_at_1000_diff1": 0.352862,
+        "nauc_recall_at_1_max": -0.05153,
+        "nauc_recall_at_1_std": -0.114219,
+        "nauc_recall_at_1_diff1": 0.378076,
+        "nauc_recall_at_3_max": -0.007206,
+        "nauc_recall_at_3_std": -0.054096,
+        "nauc_recall_at_3_diff1": 0.193589,
+        "nauc_recall_at_5_max": -0.007006,
+        "nauc_recall_at_5_std": -0.057731,
+        "nauc_recall_at_5_diff1": 0.144767,
+        "nauc_recall_at_10_max": 0.113575,
+        "nauc_recall_at_10_std": 0.043686,
+        "nauc_recall_at_10_diff1": 0.16707,
+        "nauc_recall_at_20_max": 0.157465,
+        "nauc_recall_at_20_std": 0.084625,
+        "nauc_recall_at_20_diff1": 0.168161,
+        "nauc_recall_at_100_max": 0.341013,
+        "nauc_recall_at_100_std": 0.236315,
+        "nauc_recall_at_100_diff1": 0.174826,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.135086,
+        "nauc_precision_at_1_std": 0.050291,
+        "nauc_precision_at_1_diff1": 0.495543,
+        "nauc_precision_at_3_max": 0.104674,
+        "nauc_precision_at_3_std": 0.049476,
+        "nauc_precision_at_3_diff1": 0.207782,
+        "nauc_precision_at_5_max": 0.117035,
+        "nauc_precision_at_5_std": 0.086499,
+        "nauc_precision_at_5_diff1": 0.165437,
+        "nauc_precision_at_10_max": 0.177767,
+        "nauc_precision_at_10_std": 0.155861,
+        "nauc_precision_at_10_diff1": 0.164288,
+        "nauc_precision_at_20_max": 0.167896,
+        "nauc_precision_at_20_std": 0.151299,
+        "nauc_precision_at_20_diff1": 0.167085,
+        "nauc_precision_at_100_max": 0.124335,
+        "nauc_precision_at_100_std": 0.124043,
+        "nauc_precision_at_100_diff1": 0.134389,
+        "nauc_precision_at_1000_max": 0.071961,
+        "nauc_precision_at_1000_std": 0.091345,
+        "nauc_precision_at_1000_diff1": 0.106953,
+        "nauc_mrr_at_1_max": 0.135086,
+        "nauc_mrr_at_1_std": 0.050291,
+        "nauc_mrr_at_1_diff1": 0.495543,
+        "nauc_mrr_at_3_max": 0.134283,
+        "nauc_mrr_at_3_std": 0.057701,
+        "nauc_mrr_at_3_diff1": 0.45405,
+        "nauc_mrr_at_5_max": 0.160491,
+        "nauc_mrr_at_5_std": 0.084442,
+        "nauc_mrr_at_5_diff1": 0.45499,
+        "nauc_mrr_at_10_max": 0.169875,
+        "nauc_mrr_at_10_std": 0.089966,
+        "nauc_mrr_at_10_diff1": 0.465625,
+        "nauc_mrr_at_20_max": 0.164876,
+        "nauc_mrr_at_20_std": 0.085013,
+        "nauc_mrr_at_20_diff1": 0.465706,
+        "nauc_mrr_at_100_max": 0.163478,
+        "nauc_mrr_at_100_std": 0.084061,
+        "nauc_mrr_at_100_diff1": 0.465632,
+        "nauc_mrr_at_1000_max": 0.163204,
+        "nauc_mrr_at_1000_std": 0.083766,
+        "nauc_mrr_at_1000_diff1": 0.465493,
+        "hit_rate_at_1": 0.50943,
+        "hit_rate_at_3": 0.73585,
+        "hit_rate_at_5": 0.8239,
+        "hit_rate_at_10": 0.91195,
+        "hit_rate_at_20": 0.94654,
+        "hit_rate_at_100": 0.98113,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.53072,
+        "hf_subset": "german",
+        "languages": [
+          "deu-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.47956,
+        "ndcg_at_3": 0.49245,
+        "ndcg_at_5": 0.50801,
+        "ndcg_at_10": 0.53341,
+        "ndcg_at_20": 0.56702,
+        "ndcg_at_100": 0.62662,
+        "ndcg_at_1000": 0.65147,
+        "map_at_1": 0.19321,
+        "map_at_3": 0.30174,
+        "map_at_5": 0.34837,
+        "map_at_10": 0.39239,
+        "map_at_20": 0.42211,
+        "map_at_100": 0.44625,
+        "map_at_1000": 0.45045,
+        "recall_at_1": 0.19321,
+        "recall_at_3": 0.36923,
+        "recall_at_5": 0.47465,
+        "recall_at_10": 0.60163,
+        "recall_at_20": 0.71721,
+        "recall_at_100": 0.8987,
+        "recall_at_1000": 0.99976,
+        "accuracy": 0.19321,
+        "precision_at_1": 0.51258,
+        "precision_at_3": 0.38365,
+        "precision_at_5": 0.31824,
+        "precision_at_10": 0.22453,
+        "precision_at_20": 0.14984,
+        "precision_at_100": 0.04484,
+        "precision_at_1000": 0.00544,
+        "mrr_at_1": 0.512579,
+        "mrr_at_3": 0.624738,
+        "mrr_at_5": 0.646593,
+        "mrr_at_10": 0.653774,
+        "mrr_at_20": 0.656361,
+        "mrr_at_100": 0.657175,
+        "mrr_at_1000": 0.657306,
+        "nauc_ndcg_at_1_max": 0.108399,
+        "nauc_ndcg_at_1_std": 0.041704,
+        "nauc_ndcg_at_1_diff1": 0.38859,
+        "nauc_ndcg_at_3_max": 0.098117,
+        "nauc_ndcg_at_3_std": 0.045441,
+        "nauc_ndcg_at_3_diff1": 0.324084,
+        "nauc_ndcg_at_5_max": 0.078959,
+        "nauc_ndcg_at_5_std": 0.011339,
+        "nauc_ndcg_at_5_diff1": 0.311793,
+        "nauc_ndcg_at_10_max": 0.129412,
+        "nauc_ndcg_at_10_std": 0.039876,
+        "nauc_ndcg_at_10_diff1": 0.328971,
+        "nauc_ndcg_at_20_max": 0.135862,
+        "nauc_ndcg_at_20_std": 0.032921,
+        "nauc_ndcg_at_20_diff1": 0.3182,
+        "nauc_ndcg_at_100_max": 0.163296,
+        "nauc_ndcg_at_100_std": 0.065595,
+        "nauc_ndcg_at_100_diff1": 0.341916,
+        "nauc_ndcg_at_1000_max": 0.145092,
+        "nauc_ndcg_at_1000_std": 0.052493,
+        "nauc_ndcg_at_1000_diff1": 0.365539,
+        "nauc_map_at_1_max": -0.01208,
+        "nauc_map_at_1_std": -0.070308,
+        "nauc_map_at_1_diff1": 0.298973,
+        "nauc_map_at_3_max": 0.026384,
+        "nauc_map_at_3_std": -0.042847,
+        "nauc_map_at_3_diff1": 0.239782,
+        "nauc_map_at_5_max": 0.025731,
+        "nauc_map_at_5_std": -0.049471,
+        "nauc_map_at_5_diff1": 0.237562,
+        "nauc_map_at_10_max": 0.059333,
+        "nauc_map_at_10_std": -0.019812,
+        "nauc_map_at_10_diff1": 0.258539,
+        "nauc_map_at_20_max": 0.069331,
+        "nauc_map_at_20_std": -0.016456,
+        "nauc_map_at_20_diff1": 0.261612,
+        "nauc_map_at_100_max": 0.0854,
+        "nauc_map_at_100_std": -0.000174,
+        "nauc_map_at_100_diff1": 0.278291,
+        "nauc_map_at_1000_max": 0.085929,
+        "nauc_map_at_1000_std": 0.00017,
+        "nauc_map_at_1000_diff1": 0.28303,
+        "nauc_recall_at_1_max": -0.01208,
+        "nauc_recall_at_1_std": -0.070308,
+        "nauc_recall_at_1_diff1": 0.298973,
+        "nauc_recall_at_3_max": 0.031218,
+        "nauc_recall_at_3_std": -0.019837,
+        "nauc_recall_at_3_diff1": 0.147779,
+        "nauc_recall_at_5_max": 0.033904,
+        "nauc_recall_at_5_std": -0.032161,
+        "nauc_recall_at_5_diff1": 0.122227,
+        "nauc_recall_at_10_max": 0.117545,
+        "nauc_recall_at_10_std": 0.048988,
+        "nauc_recall_at_10_diff1": 0.154345,
+        "nauc_recall_at_20_max": 0.147233,
+        "nauc_recall_at_20_std": 0.040261,
+        "nauc_recall_at_20_diff1": 0.124507,
+        "nauc_recall_at_100_max": 0.363217,
+        "nauc_recall_at_100_std": 0.239777,
+        "nauc_recall_at_100_diff1": 0.129068,
+        "nauc_recall_at_1000_max": 0.554133,
+        "nauc_recall_at_1000_std": 0.35826,
+        "nauc_recall_at_1000_diff1": 0.554133,
+        "nauc_precision_at_1_max": 0.14657,
+        "nauc_precision_at_1_std": 0.07497,
+        "nauc_precision_at_1_diff1": 0.387556,
+        "nauc_precision_at_3_max": 0.137955,
+        "nauc_precision_at_3_std": 0.107112,
+        "nauc_precision_at_3_diff1": 0.212623,
+        "nauc_precision_at_5_max": 0.104367,
+        "nauc_precision_at_5_std": 0.081777,
+        "nauc_precision_at_5_diff1": 0.162824,
+        "nauc_precision_at_10_max": 0.178722,
+        "nauc_precision_at_10_std": 0.156931,
+        "nauc_precision_at_10_diff1": 0.140238,
+        "nauc_precision_at_20_max": 0.14338,
+        "nauc_precision_at_20_std": 0.126411,
+        "nauc_precision_at_20_diff1": 0.091982,
+        "nauc_precision_at_100_max": 0.141175,
+        "nauc_precision_at_100_std": 0.15437,
+        "nauc_precision_at_100_diff1": 0.0698,
+        "nauc_precision_at_1000_max": 0.084086,
+        "nauc_precision_at_1000_std": 0.106833,
+        "nauc_precision_at_1000_diff1": 0.067696,
+        "nauc_mrr_at_1_max": 0.14657,
+        "nauc_mrr_at_1_std": 0.07497,
+        "nauc_mrr_at_1_diff1": 0.387556,
+        "nauc_mrr_at_3_max": 0.167811,
+        "nauc_mrr_at_3_std": 0.094047,
+        "nauc_mrr_at_3_diff1": 0.386165,
+        "nauc_mrr_at_5_max": 0.185666,
+        "nauc_mrr_at_5_std": 0.102903,
+        "nauc_mrr_at_5_diff1": 0.383563,
+        "nauc_mrr_at_10_max": 0.189969,
+        "nauc_mrr_at_10_std": 0.10422,
+        "nauc_mrr_at_10_diff1": 0.391116,
+        "nauc_mrr_at_20_max": 0.188537,
+        "nauc_mrr_at_20_std": 0.103196,
+        "nauc_mrr_at_20_diff1": 0.387893,
+        "nauc_mrr_at_100_max": 0.186979,
+        "nauc_mrr_at_100_std": 0.102339,
+        "nauc_mrr_at_100_diff1": 0.387566,
+        "nauc_mrr_at_1000_max": 0.186663,
+        "nauc_mrr_at_1000_std": 0.102112,
+        "nauc_mrr_at_1000_diff1": 0.387648,
+        "hit_rate_at_1": 0.51258,
+        "hit_rate_at_3": 0.76415,
+        "hit_rate_at_5": 0.85849,
+        "hit_rate_at_10": 0.91195,
+        "hit_rate_at_20": 0.94654,
+        "hit_rate_at_100": 0.98113,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.53341,
+        "hf_subset": "italian",
+        "languages": [
+          "ita-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.50786,
+        "ndcg_at_3": 0.50997,
+        "ndcg_at_5": 0.51875,
+        "ndcg_at_10": 0.5519,
+        "ndcg_at_20": 0.57851,
+        "ndcg_at_100": 0.64322,
+        "ndcg_at_1000": 0.66504,
+        "map_at_1": 0.20573,
+        "map_at_3": 0.31856,
+        "map_at_5": 0.36075,
+        "map_at_10": 0.40889,
+        "map_at_20": 0.43626,
+        "map_at_100": 0.46343,
+        "map_at_1000": 0.4672,
+        "recall_at_1": 0.20573,
+        "recall_at_3": 0.38207,
+        "recall_at_5": 0.47409,
+        "recall_at_10": 0.60809,
+        "recall_at_20": 0.7131,
+        "recall_at_100": 0.91786,
+        "recall_at_1000": 1.0,
+        "accuracy": 0.20573,
+        "precision_at_1": 0.54088,
+        "precision_at_3": 0.39099,
+        "precision_at_5": 0.31447,
+        "precision_at_10": 0.23145,
+        "precision_at_20": 0.15047,
+        "precision_at_100": 0.04569,
+        "precision_at_1000": 0.00544,
+        "mrr_at_1": 0.540881,
+        "mrr_at_3": 0.645178,
+        "mrr_at_5": 0.663889,
+        "mrr_at_10": 0.673324,
+        "mrr_at_20": 0.675395,
+        "mrr_at_100": 0.676617,
+        "mrr_at_1000": 0.676639,
+        "nauc_ndcg_at_1_max": 0.070758,
+        "nauc_ndcg_at_1_std": -0.040778,
+        "nauc_ndcg_at_1_diff1": 0.337411,
+        "nauc_ndcg_at_3_max": 0.071854,
+        "nauc_ndcg_at_3_std": 0.003989,
+        "nauc_ndcg_at_3_diff1": 0.254488,
+        "nauc_ndcg_at_5_max": 0.082386,
+        "nauc_ndcg_at_5_std": -0.007121,
+        "nauc_ndcg_at_5_diff1": 0.297004,
+        "nauc_ndcg_at_10_max": 0.100326,
+        "nauc_ndcg_at_10_std": 0.000263,
+        "nauc_ndcg_at_10_diff1": 0.291044,
+        "nauc_ndcg_at_20_max": 0.115474,
+        "nauc_ndcg_at_20_std": -1.1e-05,
+        "nauc_ndcg_at_20_diff1": 0.29818,
+        "nauc_ndcg_at_100_max": 0.136427,
+        "nauc_ndcg_at_100_std": 0.02218,
+        "nauc_ndcg_at_100_diff1": 0.309949,
+        "nauc_ndcg_at_1000_max": 0.115276,
+        "nauc_ndcg_at_1000_std": 0.011639,
+        "nauc_ndcg_at_1000_diff1": 0.327396,
+        "nauc_map_at_1_max": -0.038213,
+        "nauc_map_at_1_std": -0.126341,
+        "nauc_map_at_1_diff1": 0.281011,
+        "nauc_map_at_3_max": 0.02544,
+        "nauc_map_at_3_std": -0.046848,
+        "nauc_map_at_3_diff1": 0.211331,
+        "nauc_map_at_5_max": 0.038514,
+        "nauc_map_at_5_std": -0.047209,
+        "nauc_map_at_5_diff1": 0.234988,
+        "nauc_map_at_10_max": 0.051177,
+        "nauc_map_at_10_std": -0.035479,
+        "nauc_map_at_10_diff1": 0.23377,
+        "nauc_map_at_20_max": 0.059034,
+        "nauc_map_at_20_std": -0.03489,
+        "nauc_map_at_20_diff1": 0.250562,
+        "nauc_map_at_100_max": 0.073855,
+        "nauc_map_at_100_std": -0.021253,
+        "nauc_map_at_100_diff1": 0.263648,
+        "nauc_map_at_1000_max": 0.072373,
+        "nauc_map_at_1000_std": -0.021651,
+        "nauc_map_at_1000_diff1": 0.266442,
+        "nauc_recall_at_1_max": -0.038213,
+        "nauc_recall_at_1_std": -0.126341,
+        "nauc_recall_at_1_diff1": 0.281011,
+        "nauc_recall_at_3_max": 0.06556,
+        "nauc_recall_at_3_std": 0.012798,
+        "nauc_recall_at_3_diff1": 0.14339,
+        "nauc_recall_at_5_max": 0.084235,
+        "nauc_recall_at_5_std": 0.002878,
+        "nauc_recall_at_5_diff1": 0.185743,
+        "nauc_recall_at_10_max": 0.109261,
+        "nauc_recall_at_10_std": 0.019748,
+        "nauc_recall_at_10_diff1": 0.141851,
+        "nauc_recall_at_20_max": 0.15624,
+        "nauc_recall_at_20_std": 0.027312,
+        "nauc_recall_at_20_diff1": 0.209031,
+        "nauc_recall_at_100_max": 0.319209,
+        "nauc_recall_at_100_std": 0.132026,
+        "nauc_recall_at_100_diff1": 0.103769,
+        "nauc_recall_at_1000_max": NaN,
+        "nauc_recall_at_1000_std": NaN,
+        "nauc_recall_at_1000_diff1": NaN,
+        "nauc_precision_at_1_max": 0.108275,
+        "nauc_precision_at_1_std": -0.017737,
+        "nauc_precision_at_1_diff1": 0.335313,
+        "nauc_precision_at_3_max": 0.097472,
+        "nauc_precision_at_3_std": 0.067551,
+        "nauc_precision_at_3_diff1": 0.108231,
+        "nauc_precision_at_5_max": 0.120694,
+        "nauc_precision_at_5_std": 0.080463,
+        "nauc_precision_at_5_diff1": 0.144512,
+        "nauc_precision_at_10_max": 0.1114,
+        "nauc_precision_at_10_std": 0.100724,
+        "nauc_precision_at_10_diff1": 0.083558,
+        "nauc_precision_at_20_max": 0.093621,
+        "nauc_precision_at_20_std": 0.074815,
+        "nauc_precision_at_20_diff1": 0.092712,
+        "nauc_precision_at_100_max": 0.08773,
+        "nauc_precision_at_100_std": 0.104973,
+        "nauc_precision_at_100_diff1": 0.061817,
+        "nauc_precision_at_1000_max": 0.029468,
+        "nauc_precision_at_1000_std": 0.067476,
+        "nauc_precision_at_1000_diff1": 0.062249,
+        "nauc_mrr_at_1_max": 0.108275,
+        "nauc_mrr_at_1_std": -0.017737,
+        "nauc_mrr_at_1_diff1": 0.335313,
+        "nauc_mrr_at_3_max": 0.146888,
+        "nauc_mrr_at_3_std": 0.029242,
+        "nauc_mrr_at_3_diff1": 0.330822,
+        "nauc_mrr_at_5_max": 0.151741,
+        "nauc_mrr_at_5_std": 0.030222,
+        "nauc_mrr_at_5_diff1": 0.348482,
+        "nauc_mrr_at_10_max": 0.157185,
+        "nauc_mrr_at_10_std": 0.031895,
+        "nauc_mrr_at_10_diff1": 0.342425,
+        "nauc_mrr_at_20_max": 0.158161,
+        "nauc_mrr_at_20_std": 0.032504,
+        "nauc_mrr_at_20_diff1": 0.341158,
+        "nauc_mrr_at_100_max": 0.155762,
+        "nauc_mrr_at_100_std": 0.030982,
+        "nauc_mrr_at_100_diff1": 0.340792,
+        "nauc_mrr_at_1000_max": 0.155713,
+        "nauc_mrr_at_1000_std": 0.030937,
+        "nauc_mrr_at_1000_diff1": 0.34087,
+        "hit_rate_at_1": 0.54088,
+        "hit_rate_at_3": 0.77044,
+        "hit_rate_at_5": 0.84906,
+        "hit_rate_at_10": 0.91824,
+        "hit_rate_at_20": 0.94654,
+        "hit_rate_at_100": 0.99686,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.5519,
+        "hf_subset": "portuguese",
+        "languages": [
+          "por-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 1144.6522154808044,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v3/Vidore3IndustrialRetrieval.json

@@ -0,0 +1,942 @@
+{
+  "dataset_revision": "f732b725cf4a70803210edfe265a04f8bd5328f6",
+  "task_name": "Vidore3IndustrialRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.40989,
+        "ndcg_at_3": 0.39931,
+        "ndcg_at_5": 0.41524,
+        "ndcg_at_10": 0.42984,
+        "ndcg_at_20": 0.4577,
+        "ndcg_at_100": 0.51531,
+        "ndcg_at_1000": 0.56122,
+        "map_at_1": 0.2259,
+        "map_at_3": 0.2877,
+        "map_at_5": 0.31582,
+        "map_at_10": 0.33901,
+        "map_at_20": 0.35496,
+        "map_at_100": 0.37203,
+        "map_at_1000": 0.37708,
+        "recall_at_1": 0.2259,
+        "recall_at_3": 0.33154,
+        "recall_at_5": 0.39546,
+        "recall_at_10": 0.46503,
+        "recall_at_20": 0.55607,
+        "recall_at_100": 0.74717,
+        "recall_at_1000": 0.94517,
+        "accuracy": 0.2259,
+        "precision_at_1": 0.42403,
+        "precision_at_3": 0.25324,
+        "precision_at_5": 0.20636,
+        "precision_at_10": 0.14064,
+        "precision_at_20": 0.09594,
+        "precision_at_100": 0.03244,
+        "precision_at_1000": 0.0051,
+        "mrr_at_1": 0.424028,
+        "mrr_at_3": 0.487633,
+        "mrr_at_5": 0.507951,
+        "mrr_at_10": 0.518476,
+        "mrr_at_20": 0.524028,
+        "mrr_at_100": 0.527548,
+        "mrr_at_1000": 0.527767,
+        "nauc_ndcg_at_1_max": 0.076378,
+        "nauc_ndcg_at_1_std": 0.036056,
+        "nauc_ndcg_at_1_diff1": 0.448892,
+        "nauc_ndcg_at_3_max": 0.037845,
+        "nauc_ndcg_at_3_std": 0.016397,
+        "nauc_ndcg_at_3_diff1": 0.395934,
+        "nauc_ndcg_at_5_max": 0.041183,
+        "nauc_ndcg_at_5_std": 0.019873,
+        "nauc_ndcg_at_5_diff1": 0.416695,
+        "nauc_ndcg_at_10_max": 0.054897,
+        "nauc_ndcg_at_10_std": 0.042606,
+        "nauc_ndcg_at_10_diff1": 0.418262,
+        "nauc_ndcg_at_20_max": 0.049977,
+        "nauc_ndcg_at_20_std": 0.052496,
+        "nauc_ndcg_at_20_diff1": 0.417687,
+        "nauc_ndcg_at_100_max": 0.081501,
+        "nauc_ndcg_at_100_std": 0.09636,
+        "nauc_ndcg_at_100_diff1": 0.413688,
+        "nauc_ndcg_at_1000_max": 0.087295,
+        "nauc_ndcg_at_1000_std": 0.105638,
+        "nauc_ndcg_at_1000_diff1": 0.417791,
+        "nauc_map_at_1_max": 0.030314,
+        "nauc_map_at_1_std": -0.060977,
+        "nauc_map_at_1_diff1": 0.485999,
+        "nauc_map_at_3_max": 0.023439,
+        "nauc_map_at_3_std": -0.037805,
+        "nauc_map_at_3_diff1": 0.426643,
+        "nauc_map_at_5_max": 0.035401,
+        "nauc_map_at_5_std": -0.015254,
+        "nauc_map_at_5_diff1": 0.427404,
+        "nauc_map_at_10_max": 0.037517,
+        "nauc_map_at_10_std": -0.002839,
+        "nauc_map_at_10_diff1": 0.41551,
+        "nauc_map_at_20_max": 0.035545,
+        "nauc_map_at_20_std": 0.004974,
+        "nauc_map_at_20_diff1": 0.413311,
+        "nauc_map_at_100_max": 0.043019,
+        "nauc_map_at_100_std": 0.019359,
+        "nauc_map_at_100_diff1": 0.409196,
+        "nauc_map_at_1000_max": 0.044695,
+        "nauc_map_at_1000_std": 0.022207,
+        "nauc_map_at_1000_diff1": 0.409475,
+        "nauc_recall_at_1_max": 0.030314,
+        "nauc_recall_at_1_std": -0.060977,
+        "nauc_recall_at_1_diff1": 0.485999,
+        "nauc_recall_at_3_max": -0.006712,
+        "nauc_recall_at_3_std": -0.047413,
+        "nauc_recall_at_3_diff1": 0.376748,
+        "nauc_recall_at_5_max": 0.015154,
+        "nauc_recall_at_5_std": -0.004237,
+        "nauc_recall_at_5_diff1": 0.382528,
+        "nauc_recall_at_10_max": 0.028262,
+        "nauc_recall_at_10_std": 0.04061,
+        "nauc_recall_at_10_diff1": 0.375644,
+        "nauc_recall_at_20_max": 0.002264,
+        "nauc_recall_at_20_std": 0.051816,
+        "nauc_recall_at_20_diff1": 0.357982,
+        "nauc_recall_at_100_max": 0.133815,
+        "nauc_recall_at_100_std": 0.207178,
+        "nauc_recall_at_100_diff1": 0.334837,
+        "nauc_recall_at_1000_max": 0.308799,
+        "nauc_recall_at_1000_std": 0.516872,
+        "nauc_recall_at_1000_diff1": 0.37148,
+        "nauc_precision_at_1_max": 0.084196,
+        "nauc_precision_at_1_std": 0.039535,
+        "nauc_precision_at_1_diff1": 0.454459,
+        "nauc_precision_at_3_max": 0.063924,
+        "nauc_precision_at_3_std": 0.096772,
+        "nauc_precision_at_3_diff1": 0.18037,
+        "nauc_precision_at_5_max": 0.050536,
+        "nauc_precision_at_5_std": 0.121181,
+        "nauc_precision_at_5_diff1": 0.134336,
+        "nauc_precision_at_10_max": 0.068493,
+        "nauc_precision_at_10_std": 0.179976,
+        "nauc_precision_at_10_diff1": 0.041057,
+        "nauc_precision_at_20_max": 0.042432,
+        "nauc_precision_at_20_std": 0.190908,
+        "nauc_precision_at_20_diff1": -0.034148,
+        "nauc_precision_at_100_max": 0.104073,
+        "nauc_precision_at_100_std": 0.244711,
+        "nauc_precision_at_100_diff1": -0.139376,
+        "nauc_precision_at_1000_max": 0.047184,
+        "nauc_precision_at_1000_std": 0.150889,
+        "nauc_precision_at_1000_diff1": -0.167911,
+        "nauc_mrr_at_1_max": 0.084196,
+        "nauc_mrr_at_1_std": 0.039535,
+        "nauc_mrr_at_1_diff1": 0.454459,
+        "nauc_mrr_at_3_max": 0.075898,
+        "nauc_mrr_at_3_std": 0.061067,
+        "nauc_mrr_at_3_diff1": 0.440049,
+        "nauc_mrr_at_5_max": 0.078639,
+        "nauc_mrr_at_5_std": 0.069936,
+        "nauc_mrr_at_5_diff1": 0.439191,
+        "nauc_mrr_at_10_max": 0.084608,
+        "nauc_mrr_at_10_std": 0.087353,
+        "nauc_mrr_at_10_diff1": 0.439074,
+        "nauc_mrr_at_20_max": 0.081971,
+        "nauc_mrr_at_20_std": 0.084032,
+        "nauc_mrr_at_20_diff1": 0.439691,
+        "nauc_mrr_at_100_max": 0.082896,
+        "nauc_mrr_at_100_std": 0.083576,
+        "nauc_mrr_at_100_diff1": 0.439096,
+        "nauc_mrr_at_1000_max": 0.082655,
+        "nauc_mrr_at_1000_std": 0.083242,
+        "nauc_mrr_at_1000_diff1": 0.439122,
+        "hit_rate_at_1": 0.42403,
+        "hit_rate_at_3": 0.57597,
+        "hit_rate_at_5": 0.66431,
+        "hit_rate_at_10": 0.73852,
+        "hit_rate_at_20": 0.81979,
+        "hit_rate_at_100": 0.95053,
+        "hit_rate_at_1000": 0.99647,
+        "main_score": 0.42984,
+        "hf_subset": "french",
+        "languages": [
+          "fra-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.40283,
+        "ndcg_at_3": 0.40699,
+        "ndcg_at_5": 0.41517,
+        "ndcg_at_10": 0.43562,
+        "ndcg_at_20": 0.45991,
+        "ndcg_at_100": 0.51846,
+        "ndcg_at_1000": 0.56201,
+        "map_at_1": 0.21631,
+        "map_at_3": 0.29114,
+        "map_at_5": 0.31722,
+        "map_at_10": 0.34334,
+        "map_at_20": 0.35772,
+        "map_at_100": 0.37556,
+        "map_at_1000": 0.38031,
+        "recall_at_1": 0.21631,
+        "recall_at_3": 0.33595,
+        "recall_at_5": 0.39552,
+        "recall_at_10": 0.4802,
+        "recall_at_20": 0.55942,
+        "recall_at_100": 0.75602,
+        "recall_at_1000": 0.94066,
+        "accuracy": 0.21631,
+        "precision_at_1": 0.42049,
+        "precision_at_3": 0.26502,
+        "precision_at_5": 0.20636,
+        "precision_at_10": 0.14594,
+        "precision_at_20": 0.09647,
+        "precision_at_100": 0.0324,
+        "precision_at_1000": 0.00503,
+        "mrr_at_1": 0.420495,
+        "mrr_at_3": 0.502945,
+        "mrr_at_5": 0.517609,
+        "mrr_at_10": 0.528829,
+        "mrr_at_20": 0.533208,
+        "mrr_at_100": 0.536474,
+        "mrr_at_1000": 0.536801,
+        "nauc_ndcg_at_1_max": 0.124772,
+        "nauc_ndcg_at_1_std": 0.075821,
+        "nauc_ndcg_at_1_diff1": 0.516045,
+        "nauc_ndcg_at_3_max": 0.072505,
+        "nauc_ndcg_at_3_std": 0.085945,
+        "nauc_ndcg_at_3_diff1": 0.415551,
+        "nauc_ndcg_at_5_max": 0.061727,
+        "nauc_ndcg_at_5_std": 0.065586,
+        "nauc_ndcg_at_5_diff1": 0.411368,
+        "nauc_ndcg_at_10_max": 0.058153,
+        "nauc_ndcg_at_10_std": 0.079442,
+        "nauc_ndcg_at_10_diff1": 0.408469,
+        "nauc_ndcg_at_20_max": 0.05389,
+        "nauc_ndcg_at_20_std": 0.094881,
+        "nauc_ndcg_at_20_diff1": 0.40685,
+        "nauc_ndcg_at_100_max": 0.084704,
+        "nauc_ndcg_at_100_std": 0.138239,
+        "nauc_ndcg_at_100_diff1": 0.425305,
+        "nauc_ndcg_at_1000_max": 0.096692,
+        "nauc_ndcg_at_1000_std": 0.153083,
+        "nauc_ndcg_at_1000_diff1": 0.427746,
+        "nauc_map_at_1_max": 0.074193,
+        "nauc_map_at_1_std": 0.003536,
+        "nauc_map_at_1_diff1": 0.488815,
+        "nauc_map_at_3_max": 0.052616,
+        "nauc_map_at_3_std": 0.025033,
+        "nauc_map_at_3_diff1": 0.421747,
+        "nauc_map_at_5_max": 0.044953,
+        "nauc_map_at_5_std": 0.024606,
+        "nauc_map_at_5_diff1": 0.411451,
+        "nauc_map_at_10_max": 0.044246,
+        "nauc_map_at_10_std": 0.043534,
+        "nauc_map_at_10_diff1": 0.40714,
+        "nauc_map_at_20_max": 0.044379,
+        "nauc_map_at_20_std": 0.054779,
+        "nauc_map_at_20_diff1": 0.405372,
+        "nauc_map_at_100_max": 0.050861,
+        "nauc_map_at_100_std": 0.06882,
+        "nauc_map_at_100_diff1": 0.406776,
+        "nauc_map_at_1000_max": 0.05278,
+        "nauc_map_at_1000_std": 0.072354,
+        "nauc_map_at_1000_diff1": 0.406787,
+        "nauc_recall_at_1_max": 0.074193,
+        "nauc_recall_at_1_std": 0.003536,
+        "nauc_recall_at_1_diff1": 0.488815,
+        "nauc_recall_at_3_max": 0.024806,
+        "nauc_recall_at_3_std": 0.032233,
+        "nauc_recall_at_3_diff1": 0.356903,
+        "nauc_recall_at_5_max": 0.01722,
+        "nauc_recall_at_5_std": 0.016802,
+        "nauc_recall_at_5_diff1": 0.338322,
+        "nauc_recall_at_10_max": 0.00762,
+        "nauc_recall_at_10_std": 0.058515,
+        "nauc_recall_at_10_diff1": 0.317612,
+        "nauc_recall_at_20_max": -0.018783,
+        "nauc_recall_at_20_std": 0.0834,
+        "nauc_recall_at_20_diff1": 0.289617,
+        "nauc_recall_at_100_max": 0.088736,
+        "nauc_recall_at_100_std": 0.218298,
+        "nauc_recall_at_100_diff1": 0.338739,
+        "nauc_recall_at_1000_max": 0.27912,
+        "nauc_recall_at_1000_std": 0.569622,
+        "nauc_recall_at_1000_diff1": 0.354238,
+        "nauc_precision_at_1_max": 0.13346,
+        "nauc_precision_at_1_std": 0.0883,
+        "nauc_precision_at_1_diff1": 0.526564,
+        "nauc_precision_at_3_max": 0.044645,
+        "nauc_precision_at_3_std": 0.128165,
+        "nauc_precision_at_3_diff1": 0.237002,
+        "nauc_precision_at_5_max": 0.039779,
+        "nauc_precision_at_5_std": 0.138586,
+        "nauc_precision_at_5_diff1": 0.155282,
+        "nauc_precision_at_10_max": 0.035341,
+        "nauc_precision_at_10_std": 0.191064,
+        "nauc_precision_at_10_diff1": 0.066714,
+        "nauc_precision_at_20_max": 0.021333,
+        "nauc_precision_at_20_std": 0.204886,
+        "nauc_precision_at_20_diff1": -0.001742,
+        "nauc_precision_at_100_max": 0.074511,
+        "nauc_precision_at_100_std": 0.231005,
+        "nauc_precision_at_100_diff1": -0.071227,
+        "nauc_precision_at_1000_max": 0.046337,
+        "nauc_precision_at_1000_std": 0.146019,
+        "nauc_precision_at_1000_diff1": -0.153883,
+        "nauc_mrr_at_1_max": 0.13346,
+        "nauc_mrr_at_1_std": 0.0883,
+        "nauc_mrr_at_1_diff1": 0.526564,
+        "nauc_mrr_at_3_max": 0.115878,
+        "nauc_mrr_at_3_std": 0.123636,
+        "nauc_mrr_at_3_diff1": 0.484279,
+        "nauc_mrr_at_5_max": 0.131164,
+        "nauc_mrr_at_5_std": 0.132085,
+        "nauc_mrr_at_5_diff1": 0.493659,
+        "nauc_mrr_at_10_max": 0.129471,
+        "nauc_mrr_at_10_std": 0.13737,
+        "nauc_mrr_at_10_diff1": 0.49037,
+        "nauc_mrr_at_20_max": 0.12692,
+        "nauc_mrr_at_20_std": 0.13566,
+        "nauc_mrr_at_20_diff1": 0.487985,
+        "nauc_mrr_at_100_max": 0.12804,
+        "nauc_mrr_at_100_std": 0.135589,
+        "nauc_mrr_at_100_diff1": 0.489785,
+        "nauc_mrr_at_1000_max": 0.127723,
+        "nauc_mrr_at_1000_std": 0.135152,
+        "nauc_mrr_at_1000_diff1": 0.48975,
+        "hit_rate_at_1": 0.42049,
+        "hit_rate_at_3": 0.60424,
+        "hit_rate_at_5": 0.66784,
+        "hit_rate_at_10": 0.74912,
+        "hit_rate_at_20": 0.81272,
+        "hit_rate_at_100": 0.9364,
+        "hit_rate_at_1000": 0.99647,
+        "main_score": 0.43562,
+        "hf_subset": "spanish",
+        "languages": [
+          "spa-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.47527,
+        "ndcg_at_3": 0.45819,
+        "ndcg_at_5": 0.46942,
+        "ndcg_at_10": 0.4878,
+        "ndcg_at_20": 0.51809,
+        "ndcg_at_100": 0.57453,
+        "ndcg_at_1000": 0.61284,
+        "map_at_1": 0.26422,
+        "map_at_3": 0.33474,
+        "map_at_5": 0.36121,
+        "map_at_10": 0.38866,
+        "map_at_20": 0.40843,
+        "map_at_100": 0.42611,
+        "map_at_1000": 0.43062,
+        "recall_at_1": 0.26422,
+        "recall_at_3": 0.36904,
+        "recall_at_5": 0.43594,
+        "recall_at_10": 0.5195,
+        "recall_at_20": 0.61469,
+        "recall_at_100": 0.79672,
+        "recall_at_1000": 0.95138,
+        "accuracy": 0.26422,
+        "precision_at_1": 0.48763,
+        "precision_at_3": 0.28622,
+        "precision_at_5": 0.22615,
+        "precision_at_10": 0.15724,
+        "precision_at_20": 0.10583,
+        "precision_at_100": 0.03466,
+        "precision_at_1000": 0.00513,
+        "mrr_at_1": 0.487633,
+        "mrr_at_3": 0.559482,
+        "mrr_at_5": 0.58192,
+        "mrr_at_10": 0.590967,
+        "mrr_at_20": 0.594484,
+        "mrr_at_100": 0.597369,
+        "mrr_at_1000": 0.597512,
+        "nauc_ndcg_at_1_max": 0.13724,
+        "nauc_ndcg_at_1_std": 0.102596,
+        "nauc_ndcg_at_1_diff1": 0.524356,
+        "nauc_ndcg_at_3_max": 0.121761,
+        "nauc_ndcg_at_3_std": 0.076875,
+        "nauc_ndcg_at_3_diff1": 0.455417,
+        "nauc_ndcg_at_5_max": 0.109004,
+        "nauc_ndcg_at_5_std": 0.075203,
+        "nauc_ndcg_at_5_diff1": 0.472242,
+        "nauc_ndcg_at_10_max": 0.10175,
+        "nauc_ndcg_at_10_std": 0.063136,
+        "nauc_ndcg_at_10_diff1": 0.467715,
+        "nauc_ndcg_at_20_max": 0.088908,
+        "nauc_ndcg_at_20_std": 0.072448,
+        "nauc_ndcg_at_20_diff1": 0.461943,
+        "nauc_ndcg_at_100_max": 0.11002,
+        "nauc_ndcg_at_100_std": 0.108369,
+        "nauc_ndcg_at_100_diff1": 0.45975,
+        "nauc_ndcg_at_1000_max": 0.10948,
+        "nauc_ndcg_at_1000_std": 0.109541,
+        "nauc_ndcg_at_1000_diff1": 0.46596,
+        "nauc_map_at_1_max": 0.088745,
+        "nauc_map_at_1_std": 0.010612,
+        "nauc_map_at_1_diff1": 0.526692,
+        "nauc_map_at_3_max": 0.090876,
+        "nauc_map_at_3_std": 0.004924,
+        "nauc_map_at_3_diff1": 0.47897,
+        "nauc_map_at_5_max": 0.092642,
+        "nauc_map_at_5_std": 0.021906,
+        "nauc_map_at_5_diff1": 0.472549,
+        "nauc_map_at_10_max": 0.082829,
+        "nauc_map_at_10_std": 0.023416,
+        "nauc_map_at_10_diff1": 0.456032,
+        "nauc_map_at_20_max": 0.077376,
+        "nauc_map_at_20_std": 0.030981,
+        "nauc_map_at_20_diff1": 0.452294,
+        "nauc_map_at_100_max": 0.084485,
+        "nauc_map_at_100_std": 0.043664,
+        "nauc_map_at_100_diff1": 0.448548,
+        "nauc_map_at_1000_max": 0.085035,
+        "nauc_map_at_1000_std": 0.045484,
+        "nauc_map_at_1000_diff1": 0.448966,
+        "nauc_recall_at_1_max": 0.088745,
+        "nauc_recall_at_1_std": 0.010612,
+        "nauc_recall_at_1_diff1": 0.526692,
+        "nauc_recall_at_3_max": 0.074088,
+        "nauc_recall_at_3_std": -0.001811,
+        "nauc_recall_at_3_diff1": 0.439818,
+        "nauc_recall_at_5_max": 0.081626,
+        "nauc_recall_at_5_std": 0.042531,
+        "nauc_recall_at_5_diff1": 0.412512,
+        "nauc_recall_at_10_max": 0.061756,
+        "nauc_recall_at_10_std": 0.022317,
+        "nauc_recall_at_10_diff1": 0.370703,
+        "nauc_recall_at_20_max": 0.015571,
+        "nauc_recall_at_20_std": 0.040386,
+        "nauc_recall_at_20_diff1": 0.342511,
+        "nauc_recall_at_100_max": 0.12105,
+        "nauc_recall_at_100_std": 0.209097,
+        "nauc_recall_at_100_diff1": 0.34224,
+        "nauc_recall_at_1000_max": 0.212464,
+        "nauc_recall_at_1000_std": 0.511805,
+        "nauc_recall_at_1000_diff1": 0.493647,
+        "nauc_precision_at_1_max": 0.129908,
+        "nauc_precision_at_1_std": 0.102102,
+        "nauc_precision_at_1_diff1": 0.50721,
+        "nauc_precision_at_3_max": 0.114864,
+        "nauc_precision_at_3_std": 0.112771,
+        "nauc_precision_at_3_diff1": 0.176294,
+        "nauc_precision_at_5_max": 0.064433,
+        "nauc_precision_at_5_std": 0.135464,
+        "nauc_precision_at_5_diff1": 0.083097,
+        "nauc_precision_at_10_max": 0.016047,
+        "nauc_precision_at_10_std": 0.100379,
+        "nauc_precision_at_10_diff1": -0.020656,
+        "nauc_precision_at_20_max": -0.017597,
+        "nauc_precision_at_20_std": 0.116308,
+        "nauc_precision_at_20_diff1": -0.092971,
+        "nauc_precision_at_100_max": -0.023413,
+        "nauc_precision_at_100_std": 0.104719,
+        "nauc_precision_at_100_diff1": -0.206841,
+        "nauc_precision_at_1000_max": -0.068508,
+        "nauc_precision_at_1000_std": 0.030329,
+        "nauc_precision_at_1000_diff1": -0.244966,
+        "nauc_mrr_at_1_max": 0.129908,
+        "nauc_mrr_at_1_std": 0.102102,
+        "nauc_mrr_at_1_diff1": 0.50721,
+        "nauc_mrr_at_3_max": 0.141337,
+        "nauc_mrr_at_3_std": 0.115308,
+        "nauc_mrr_at_3_diff1": 0.48312,
+        "nauc_mrr_at_5_max": 0.137976,
+        "nauc_mrr_at_5_std": 0.130139,
+        "nauc_mrr_at_5_diff1": 0.485728,
+        "nauc_mrr_at_10_max": 0.137773,
+        "nauc_mrr_at_10_std": 0.125155,
+        "nauc_mrr_at_10_diff1": 0.487226,
+        "nauc_mrr_at_20_max": 0.135609,
+        "nauc_mrr_at_20_std": 0.12603,
+        "nauc_mrr_at_20_diff1": 0.484742,
+        "nauc_mrr_at_100_max": 0.135393,
+        "nauc_mrr_at_100_std": 0.125932,
+        "nauc_mrr_at_100_diff1": 0.48465,
+        "nauc_mrr_at_1000_max": 0.135449,
+        "nauc_mrr_at_1000_std": 0.125772,
+        "nauc_mrr_at_1000_diff1": 0.484848,
+        "hit_rate_at_1": 0.48763,
+        "hit_rate_at_3": 0.64664,
+        "hit_rate_at_5": 0.74558,
+        "hit_rate_at_10": 0.81625,
+        "hit_rate_at_20": 0.86572,
+        "hit_rate_at_100": 0.9682,
+        "hit_rate_at_1000": 0.99647,
+        "main_score": 0.4878,
+        "hf_subset": "english",
+        "languages": [
+          "eng-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.40283,
+        "ndcg_at_3": 0.40674,
+        "ndcg_at_5": 0.4152,
+        "ndcg_at_10": 0.4355,
+        "ndcg_at_20": 0.46042,
+        "ndcg_at_100": 0.51564,
+        "ndcg_at_1000": 0.56155,
+        "map_at_1": 0.2202,
+        "map_at_3": 0.29004,
+        "map_at_5": 0.31412,
+        "map_at_10": 0.33888,
+        "map_at_20": 0.3538,
+        "map_at_100": 0.37047,
+        "map_at_1000": 0.37538,
+        "recall_at_1": 0.2202,
+        "recall_at_3": 0.33624,
+        "recall_at_5": 0.39287,
+        "recall_at_10": 0.47935,
+        "recall_at_20": 0.56372,
+        "recall_at_100": 0.74324,
+        "recall_at_1000": 0.94327,
+        "accuracy": 0.2202,
+        "precision_at_1": 0.41696,
+        "precision_at_3": 0.26266,
+        "precision_at_5": 0.20495,
+        "precision_at_10": 0.14311,
+        "precision_at_20": 0.09452,
+        "precision_at_100": 0.03184,
+        "precision_at_1000": 0.00507,
+        "mrr_at_1": 0.416961,
+        "mrr_at_3": 0.4947,
+        "mrr_at_5": 0.509717,
+        "mrr_at_10": 0.521339,
+        "mrr_at_20": 0.528168,
+        "mrr_at_100": 0.530697,
+        "mrr_at_1000": 0.531002,
+        "nauc_ndcg_at_1_max": -0.030299,
+        "nauc_ndcg_at_1_std": -0.025701,
+        "nauc_ndcg_at_1_diff1": 0.477773,
+        "nauc_ndcg_at_3_max": -0.044738,
+        "nauc_ndcg_at_3_std": -0.050367,
+        "nauc_ndcg_at_3_diff1": 0.409275,
+        "nauc_ndcg_at_5_max": -0.040162,
+        "nauc_ndcg_at_5_std": -0.016446,
+        "nauc_ndcg_at_5_diff1": 0.405405,
+        "nauc_ndcg_at_10_max": -0.047929,
+        "nauc_ndcg_at_10_std": -0.018649,
+        "nauc_ndcg_at_10_diff1": 0.424839,
+        "nauc_ndcg_at_20_max": -0.031404,
+        "nauc_ndcg_at_20_std": 0.006039,
+        "nauc_ndcg_at_20_diff1": 0.432423,
+        "nauc_ndcg_at_100_max": -0.02863,
+        "nauc_ndcg_at_100_std": 0.026494,
+        "nauc_ndcg_at_100_diff1": 0.435679,
+        "nauc_ndcg_at_1000_max": -0.019948,
+        "nauc_ndcg_at_1000_std": 0.038669,
+        "nauc_ndcg_at_1000_diff1": 0.442405,
+        "nauc_map_at_1_max": -0.028459,
+        "nauc_map_at_1_std": -0.080958,
+        "nauc_map_at_1_diff1": 0.519464,
+        "nauc_map_at_3_max": -0.021067,
+        "nauc_map_at_3_std": -0.059769,
+        "nauc_map_at_3_diff1": 0.447787,
+        "nauc_map_at_5_max": -0.01802,
+        "nauc_map_at_5_std": -0.033971,
+        "nauc_map_at_5_diff1": 0.440806,
+        "nauc_map_at_10_max": -0.021338,
+        "nauc_map_at_10_std": -0.027845,
+        "nauc_map_at_10_diff1": 0.441518,
+        "nauc_map_at_20_max": -0.019047,
+        "nauc_map_at_20_std": -0.018097,
+        "nauc_map_at_20_diff1": 0.440671,
+        "nauc_map_at_100_max": -0.018487,
+        "nauc_map_at_100_std": -0.009776,
+        "nauc_map_at_100_diff1": 0.440081,
+        "nauc_map_at_1000_max": -0.017395,
+        "nauc_map_at_1000_std": -0.007457,
+        "nauc_map_at_1000_diff1": 0.440871,
+        "nauc_recall_at_1_max": -0.028459,
+        "nauc_recall_at_1_std": -0.080958,
+        "nauc_recall_at_1_diff1": 0.519464,
+        "nauc_recall_at_3_max": -0.029107,
+        "nauc_recall_at_3_std": -0.057156,
+        "nauc_recall_at_3_diff1": 0.371203,
+        "nauc_recall_at_5_max": -0.021136,
+        "nauc_recall_at_5_std": 0.013984,
+        "nauc_recall_at_5_diff1": 0.351366,
+        "nauc_recall_at_10_max": -0.064251,
+        "nauc_recall_at_10_std": -0.006124,
+        "nauc_recall_at_10_diff1": 0.335756,
+        "nauc_recall_at_20_max": -0.020352,
+        "nauc_recall_at_20_std": 0.063899,
+        "nauc_recall_at_20_diff1": 0.349943,
+        "nauc_recall_at_100_max": -0.020372,
+        "nauc_recall_at_100_std": 0.133405,
+        "nauc_recall_at_100_diff1": 0.32397,
+        "nauc_recall_at_1000_max": 0.064196,
+        "nauc_recall_at_1000_std": 0.469605,
+        "nauc_recall_at_1000_diff1": 0.383768,
+        "nauc_precision_at_1_max": -0.013549,
+        "nauc_precision_at_1_std": -0.008578,
+        "nauc_precision_at_1_diff1": 0.472549,
+        "nauc_precision_at_3_max": -0.001826,
+        "nauc_precision_at_3_std": 0.048094,
+        "nauc_precision_at_3_diff1": 0.212382,
+        "nauc_precision_at_5_max": -0.00929,
+        "nauc_precision_at_5_std": 0.106985,
+        "nauc_precision_at_5_diff1": 0.154208,
+        "nauc_precision_at_10_max": -0.031407,
+        "nauc_precision_at_10_std": 0.113518,
+        "nauc_precision_at_10_diff1": 0.08543,
+        "nauc_precision_at_20_max": 0.0127,
+        "nauc_precision_at_20_std": 0.170856,
+        "nauc_precision_at_20_diff1": 0.040661,
+        "nauc_precision_at_100_max": 0.028451,
+        "nauc_precision_at_100_std": 0.177076,
+        "nauc_precision_at_100_diff1": -0.075296,
+        "nauc_precision_at_1000_max": 0.040693,
+        "nauc_precision_at_1000_std": 0.13601,
+        "nauc_precision_at_1000_diff1": -0.137818,
+        "nauc_mrr_at_1_max": -0.013549,
+        "nauc_mrr_at_1_std": -0.008578,
+        "nauc_mrr_at_1_diff1": 0.472549,
+        "nauc_mrr_at_3_max": -0.031335,
+        "nauc_mrr_at_3_std": -0.024322,
+        "nauc_mrr_at_3_diff1": 0.425032,
+        "nauc_mrr_at_5_max": -0.024924,
+        "nauc_mrr_at_5_std": -6.8e-05,
+        "nauc_mrr_at_5_diff1": 0.438474,
+        "nauc_mrr_at_10_max": -0.037195,
+        "nauc_mrr_at_10_std": -0.006246,
+        "nauc_mrr_at_10_diff1": 0.434963,
+        "nauc_mrr_at_20_max": -0.030906,
+        "nauc_mrr_at_20_std": -0.003322,
+        "nauc_mrr_at_20_diff1": 0.437637,
+        "nauc_mrr_at_100_max": -0.030892,
+        "nauc_mrr_at_100_std": -0.003878,
+        "nauc_mrr_at_100_diff1": 0.43668,
+        "nauc_mrr_at_1000_max": -0.03102,
+        "nauc_mrr_at_1000_std": -0.004244,
+        "nauc_mrr_at_1000_diff1": 0.436733,
+        "hit_rate_at_1": 0.41696,
+        "hit_rate_at_3": 0.58657,
+        "hit_rate_at_5": 0.65371,
+        "hit_rate_at_10": 0.74205,
+        "hit_rate_at_20": 0.84099,
+        "hit_rate_at_100": 0.9364,
+        "hit_rate_at_1000": 0.99647,
+        "main_score": 0.4355,
+        "hf_subset": "german",
+        "languages": [
+          "deu-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.40636,
+        "ndcg_at_3": 0.40068,
+        "ndcg_at_5": 0.41073,
+        "ndcg_at_10": 0.42919,
+        "ndcg_at_20": 0.45664,
+        "ndcg_at_100": 0.5149,
+        "ndcg_at_1000": 0.55881,
+        "map_at_1": 0.21205,
+        "map_at_3": 0.28675,
+        "map_at_5": 0.30952,
+        "map_at_10": 0.33411,
+        "map_at_20": 0.35063,
+        "map_at_100": 0.3676,
+        "map_at_1000": 0.37235,
+        "recall_at_1": 0.21205,
+        "recall_at_3": 0.33426,
+        "recall_at_5": 0.38989,
+        "recall_at_10": 0.46772,
+        "recall_at_20": 0.55844,
+        "recall_at_100": 0.74988,
+        "recall_at_1000": 0.93883,
+        "accuracy": 0.21205,
+        "precision_at_1": 0.41696,
+        "precision_at_3": 0.25677,
+        "precision_at_5": 0.20495,
+        "precision_at_10": 0.14311,
+        "precision_at_20": 0.09611,
+        "precision_at_100": 0.03212,
+        "precision_at_1000": 0.00501,
+        "mrr_at_1": 0.416961,
+        "mrr_at_3": 0.4947,
+        "mrr_at_5": 0.514664,
+        "mrr_at_10": 0.527367,
+        "mrr_at_20": 0.531348,
+        "mrr_at_100": 0.53478,
+        "mrr_at_1000": 0.534974,
+        "nauc_ndcg_at_1_max": 0.150974,
+        "nauc_ndcg_at_1_std": 0.080511,
+        "nauc_ndcg_at_1_diff1": 0.494744,
+        "nauc_ndcg_at_3_max": 0.088685,
+        "nauc_ndcg_at_3_std": 0.062571,
+        "nauc_ndcg_at_3_diff1": 0.397647,
+        "nauc_ndcg_at_5_max": 0.074752,
+        "nauc_ndcg_at_5_std": 0.045463,
+        "nauc_ndcg_at_5_diff1": 0.388717,
+        "nauc_ndcg_at_10_max": 0.063456,
+        "nauc_ndcg_at_10_std": 0.04347,
+        "nauc_ndcg_at_10_diff1": 0.382332,
+        "nauc_ndcg_at_20_max": 0.072206,
+        "nauc_ndcg_at_20_std": 0.060641,
+        "nauc_ndcg_at_20_diff1": 0.377578,
+        "nauc_ndcg_at_100_max": 0.096329,
+        "nauc_ndcg_at_100_std": 0.102538,
+        "nauc_ndcg_at_100_diff1": 0.37958,
+        "nauc_ndcg_at_1000_max": 0.107283,
+        "nauc_ndcg_at_1000_std": 0.116648,
+        "nauc_ndcg_at_1000_diff1": 0.385983,
+        "nauc_map_at_1_max": 0.071349,
+        "nauc_map_at_1_std": -0.049285,
+        "nauc_map_at_1_diff1": 0.442965,
+        "nauc_map_at_3_max": 0.081828,
+        "nauc_map_at_3_std": 0.007892,
+        "nauc_map_at_3_diff1": 0.381545,
+        "nauc_map_at_5_max": 0.073352,
+        "nauc_map_at_5_std": 0.005857,
+        "nauc_map_at_5_diff1": 0.380142,
+        "nauc_map_at_10_max": 0.063161,
+        "nauc_map_at_10_std": 0.012556,
+        "nauc_map_at_10_diff1": 0.369387,
+        "nauc_map_at_20_max": 0.065949,
+        "nauc_map_at_20_std": 0.021554,
+        "nauc_map_at_20_diff1": 0.367773,
+        "nauc_map_at_100_max": 0.070893,
+        "nauc_map_at_100_std": 0.034739,
+        "nauc_map_at_100_diff1": 0.36557,
+        "nauc_map_at_1000_max": 0.073067,
+        "nauc_map_at_1000_std": 0.037872,
+        "nauc_map_at_1000_diff1": 0.365687,
+        "nauc_recall_at_1_max": 0.071349,
+        "nauc_recall_at_1_std": -0.049285,
+        "nauc_recall_at_1_diff1": 0.442965,
+        "nauc_recall_at_3_max": 0.070356,
+        "nauc_recall_at_3_std": 0.028218,
+        "nauc_recall_at_3_diff1": 0.329918,
+        "nauc_recall_at_5_max": 0.043441,
+        "nauc_recall_at_5_std": 0.017527,
+        "nauc_recall_at_5_diff1": 0.326376,
+        "nauc_recall_at_10_max": 0.002657,
+        "nauc_recall_at_10_std": 0.01518,
+        "nauc_recall_at_10_diff1": 0.301888,
+        "nauc_recall_at_20_max": 0.018689,
+        "nauc_recall_at_20_std": 0.057735,
+        "nauc_recall_at_20_diff1": 0.27529,
+        "nauc_recall_at_100_max": 0.092745,
+        "nauc_recall_at_100_std": 0.187431,
+        "nauc_recall_at_100_diff1": 0.268237,
+        "nauc_recall_at_1000_max": 0.272377,
+        "nauc_recall_at_1000_std": 0.545323,
+        "nauc_recall_at_1000_diff1": 0.257419,
+        "nauc_precision_at_1_max": 0.154437,
+        "nauc_precision_at_1_std": 0.076234,
+        "nauc_precision_at_1_diff1": 0.499042,
+        "nauc_precision_at_3_max": 0.079527,
+        "nauc_precision_at_3_std": 0.14435,
+        "nauc_precision_at_3_diff1": 0.245699,
+        "nauc_precision_at_5_max": 0.048773,
+        "nauc_precision_at_5_std": 0.133814,
+        "nauc_precision_at_5_diff1": 0.156465,
+        "nauc_precision_at_10_max": 0.002751,
+        "nauc_precision_at_10_std": 0.136528,
+        "nauc_precision_at_10_diff1": 0.050961,
+        "nauc_precision_at_20_max": 0.019156,
+        "nauc_precision_at_20_std": 0.155424,
+        "nauc_precision_at_20_diff1": -0.026898,
+        "nauc_precision_at_100_max": 0.065309,
+        "nauc_precision_at_100_std": 0.226351,
+        "nauc_precision_at_100_diff1": -0.146419,
+        "nauc_precision_at_1000_max": 0.032555,
+        "nauc_precision_at_1000_std": 0.136087,
+        "nauc_precision_at_1000_diff1": -0.177217,
+        "nauc_mrr_at_1_max": 0.154437,
+        "nauc_mrr_at_1_std": 0.076234,
+        "nauc_mrr_at_1_diff1": 0.499042,
+        "nauc_mrr_at_3_max": 0.145246,
+        "nauc_mrr_at_3_std": 0.101358,
+        "nauc_mrr_at_3_diff1": 0.481689,
+        "nauc_mrr_at_5_max": 0.140178,
+        "nauc_mrr_at_5_std": 0.1016,
+        "nauc_mrr_at_5_diff1": 0.481331,
+        "nauc_mrr_at_10_max": 0.136557,
+        "nauc_mrr_at_10_std": 0.100021,
+        "nauc_mrr_at_10_diff1": 0.482048,
+        "nauc_mrr_at_20_max": 0.13876,
+        "nauc_mrr_at_20_std": 0.10231,
+        "nauc_mrr_at_20_diff1": 0.479258,
+        "nauc_mrr_at_100_max": 0.139096,
+        "nauc_mrr_at_100_std": 0.101748,
+        "nauc_mrr_at_100_diff1": 0.480077,
+        "nauc_mrr_at_1000_max": 0.139011,
+        "nauc_mrr_at_1000_std": 0.101598,
+        "nauc_mrr_at_1000_diff1": 0.48025,
+        "hit_rate_at_1": 0.41696,
+        "hit_rate_at_3": 0.59011,
+        "hit_rate_at_5": 0.67491,
+        "hit_rate_at_10": 0.76678,
+        "hit_rate_at_20": 0.82332,
+        "hit_rate_at_100": 0.95053,
+        "hit_rate_at_1000": 0.99647,
+        "main_score": 0.42919,
+        "hf_subset": "italian",
+        "languages": [
+          "ita-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.42403,
+        "ndcg_at_3": 0.41844,
+        "ndcg_at_5": 0.42629,
+        "ndcg_at_10": 0.4505,
+        "ndcg_at_20": 0.47462,
+        "ndcg_at_100": 0.53,
+        "ndcg_at_1000": 0.57423,
+        "map_at_1": 0.22898,
+        "map_at_3": 0.29777,
+        "map_at_5": 0.32223,
+        "map_at_10": 0.3514,
+        "map_at_20": 0.36747,
+        "map_at_100": 0.38486,
+        "map_at_1000": 0.3896,
+        "recall_at_1": 0.22898,
+        "recall_at_3": 0.34372,
+        "recall_at_5": 0.39619,
+        "recall_at_10": 0.49113,
+        "recall_at_20": 0.57305,
+        "recall_at_100": 0.74558,
+        "recall_at_1000": 0.93785,
+        "accuracy": 0.22898,
+        "precision_at_1": 0.43816,
+        "precision_at_3": 0.26384,
+        "precision_at_5": 0.20919,
+        "precision_at_10": 0.15371,
+        "precision_at_20": 0.09929,
+        "precision_at_100": 0.03247,
+        "precision_at_1000": 0.00504,
+        "mrr_at_1": 0.438163,
+        "mrr_at_3": 0.517668,
+        "mrr_at_5": 0.531979,
+        "mrr_at_10": 0.545276,
+        "mrr_at_20": 0.548478,
+        "mrr_at_100": 0.551789,
+        "mrr_at_1000": 0.55215,
+        "nauc_ndcg_at_1_max": 0.118847,
+        "nauc_ndcg_at_1_std": 0.090902,
+        "nauc_ndcg_at_1_diff1": 0.469537,
+        "nauc_ndcg_at_3_max": 0.039664,
+        "nauc_ndcg_at_3_std": 0.047502,
+        "nauc_ndcg_at_3_diff1": 0.370432,
+        "nauc_ndcg_at_5_max": 0.043886,
+        "nauc_ndcg_at_5_std": 0.037661,
+        "nauc_ndcg_at_5_diff1": 0.345301,
+        "nauc_ndcg_at_10_max": 0.045221,
+        "nauc_ndcg_at_10_std": 0.051972,
+        "nauc_ndcg_at_10_diff1": 0.347046,
+        "nauc_ndcg_at_20_max": 0.055043,
+        "nauc_ndcg_at_20_std": 0.082232,
+        "nauc_ndcg_at_20_diff1": 0.344155,
+        "nauc_ndcg_at_100_max": 0.072134,
+        "nauc_ndcg_at_100_std": 0.123483,
+        "nauc_ndcg_at_100_diff1": 0.346437,
+        "nauc_ndcg_at_1000_max": 0.08147,
+        "nauc_ndcg_at_1000_std": 0.129107,
+        "nauc_ndcg_at_1000_diff1": 0.359425,
+        "nauc_map_at_1_max": 0.06073,
+        "nauc_map_at_1_std": -0.003989,
+        "nauc_map_at_1_diff1": 0.438098,
+        "nauc_map_at_3_max": 0.031819,
+        "nauc_map_at_3_std": 0.00793,
+        "nauc_map_at_3_diff1": 0.381663,
+        "nauc_map_at_5_max": 0.044304,
+        "nauc_map_at_5_std": 0.015663,
+        "nauc_map_at_5_diff1": 0.360319,
+        "nauc_map_at_10_max": 0.034053,
+        "nauc_map_at_10_std": 0.022382,
+        "nauc_map_at_10_diff1": 0.356665,
+        "nauc_map_at_20_max": 0.041734,
+        "nauc_map_at_20_std": 0.042101,
+        "nauc_map_at_20_diff1": 0.353067,
+        "nauc_map_at_100_max": 0.044658,
+        "nauc_map_at_100_std": 0.056338,
+        "nauc_map_at_100_diff1": 0.352258,
+        "nauc_map_at_1000_max": 0.046414,
+        "nauc_map_at_1000_std": 0.058811,
+        "nauc_map_at_1000_diff1": 0.353094,
+        "nauc_recall_at_1_max": 0.06073,
+        "nauc_recall_at_1_std": -0.003989,
+        "nauc_recall_at_1_diff1": 0.438098,
+        "nauc_recall_at_3_max": -0.004575,
+        "nauc_recall_at_3_std": -0.006182,
+        "nauc_recall_at_3_diff1": 0.314799,
+        "nauc_recall_at_5_max": 0.027249,
+        "nauc_recall_at_5_std": 0.002498,
+        "nauc_recall_at_5_diff1": 0.277709,
+        "nauc_recall_at_10_max": 0.004849,
+        "nauc_recall_at_10_std": 0.014595,
+        "nauc_recall_at_10_diff1": 0.256222,
+        "nauc_recall_at_20_max": 0.026149,
+        "nauc_recall_at_20_std": 0.077149,
+        "nauc_recall_at_20_diff1": 0.226908,
+        "nauc_recall_at_100_max": 0.096183,
+        "nauc_recall_at_100_std": 0.243813,
+        "nauc_recall_at_100_diff1": 0.180189,
+        "nauc_recall_at_1000_max": 0.289551,
+        "nauc_recall_at_1000_std": 0.543832,
+        "nauc_recall_at_1000_diff1": 0.128851,
+        "nauc_precision_at_1_max": 0.12589,
+        "nauc_precision_at_1_std": 0.103853,
+        "nauc_precision_at_1_diff1": 0.477813,
+        "nauc_precision_at_3_max": 0.011503,
+        "nauc_precision_at_3_std": 0.08622,
+        "nauc_precision_at_3_diff1": 0.217582,
+        "nauc_precision_at_5_max": 0.010572,
+        "nauc_precision_at_5_std": 0.082162,
+        "nauc_precision_at_5_diff1": 0.080072,
+        "nauc_precision_at_10_max": 0.007975,
+        "nauc_precision_at_10_std": 0.140047,
+        "nauc_precision_at_10_diff1": 0.013535,
+        "nauc_precision_at_20_max": 0.033739,
+        "nauc_precision_at_20_std": 0.200163,
+        "nauc_precision_at_20_diff1": -0.04052,
+        "nauc_precision_at_100_max": 0.03908,
+        "nauc_precision_at_100_std": 0.206691,
+        "nauc_precision_at_100_diff1": -0.089329,
+        "nauc_precision_at_1000_max": 0.007775,
+        "nauc_precision_at_1000_std": 0.103818,
+        "nauc_precision_at_1000_diff1": -0.112154,
+        "nauc_mrr_at_1_max": 0.12589,
+        "nauc_mrr_at_1_std": 0.103853,
+        "nauc_mrr_at_1_diff1": 0.477813,
+        "nauc_mrr_at_3_max": 0.083589,
+        "nauc_mrr_at_3_std": 0.091031,
+        "nauc_mrr_at_3_diff1": 0.448596,
+        "nauc_mrr_at_5_max": 0.090407,
+        "nauc_mrr_at_5_std": 0.096546,
+        "nauc_mrr_at_5_diff1": 0.445148,
+        "nauc_mrr_at_10_max": 0.099942,
+        "nauc_mrr_at_10_std": 0.113127,
+        "nauc_mrr_at_10_diff1": 0.443501,
+        "nauc_mrr_at_20_max": 0.097525,
+        "nauc_mrr_at_20_std": 0.111333,
+        "nauc_mrr_at_20_diff1": 0.441833,
+        "nauc_mrr_at_100_max": 0.098453,
+        "nauc_mrr_at_100_std": 0.110715,
+        "nauc_mrr_at_100_diff1": 0.442474,
+        "nauc_mrr_at_1000_max": 0.09846,
+        "nauc_mrr_at_1000_std": 0.110512,
+        "nauc_mrr_at_1000_diff1": 0.442773,
+        "hit_rate_at_1": 0.43816,
+        "hit_rate_at_3": 0.61484,
+        "hit_rate_at_5": 0.67491,
+        "hit_rate_at_10": 0.77739,
+        "hit_rate_at_20": 0.82332,
+        "hit_rate_at_100": 0.93286,
+        "hit_rate_at_1000": 0.99293,
+        "main_score": 0.4505,
+        "hf_subset": "portuguese",
+        "languages": [
+          "por-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 5020.151913166046,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v3/Vidore3PharmaceuticalsRetrieval.json

@@ -0,0 +1,942 @@
+{
+  "dataset_revision": "237ed4f43c7fb3c4df07ec4e9dd0a4366be555b0",
+  "task_name": "Vidore3PharmaceuticalsRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.56868,
+        "ndcg_at_3": 0.55799,
+        "ndcg_at_5": 0.55981,
+        "ndcg_at_10": 0.57421,
+        "ndcg_at_20": 0.60609,
+        "ndcg_at_100": 0.66162,
+        "ndcg_at_1000": 0.6863,
+        "map_at_1": 0.29729,
+        "map_at_3": 0.39628,
+        "map_at_5": 0.42772,
+        "map_at_10": 0.46119,
+        "map_at_20": 0.48541,
+        "map_at_100": 0.50559,
+        "map_at_1000": 0.50849,
+        "recall_at_1": 0.29729,
+        "recall_at_3": 0.44331,
+        "recall_at_5": 0.50812,
+        "recall_at_10": 0.59896,
+        "recall_at_20": 0.69816,
+        "recall_at_100": 0.8732,
+        "recall_at_1000": 0.98493,
+        "accuracy": 0.29729,
+        "precision_at_1": 0.59066,
+        "precision_at_3": 0.36905,
+        "precision_at_5": 0.28516,
+        "precision_at_10": 0.19396,
+        "precision_at_20": 0.12734,
+        "precision_at_100": 0.03764,
+        "precision_at_1000": 0.00463,
+        "mrr_at_1": 0.590659,
+        "mrr_at_3": 0.676282,
+        "mrr_at_5": 0.689881,
+        "mrr_at_10": 0.698889,
+        "mrr_at_20": 0.701188,
+        "mrr_at_100": 0.702711,
+        "mrr_at_1000": 0.702766,
+        "nauc_ndcg_at_1_max": 0.035499,
+        "nauc_ndcg_at_1_std": -0.057913,
+        "nauc_ndcg_at_1_diff1": 0.512102,
+        "nauc_ndcg_at_3_max": 0.026745,
+        "nauc_ndcg_at_3_std": -0.073282,
+        "nauc_ndcg_at_3_diff1": 0.432163,
+        "nauc_ndcg_at_5_max": 0.0236,
+        "nauc_ndcg_at_5_std": -0.083677,
+        "nauc_ndcg_at_5_diff1": 0.431293,
+        "nauc_ndcg_at_10_max": 0.01925,
+        "nauc_ndcg_at_10_std": -0.0936,
+        "nauc_ndcg_at_10_diff1": 0.436443,
+        "nauc_ndcg_at_20_max": 0.020553,
+        "nauc_ndcg_at_20_std": -0.079171,
+        "nauc_ndcg_at_20_diff1": 0.438789,
+        "nauc_ndcg_at_100_max": 0.031768,
+        "nauc_ndcg_at_100_std": -0.044067,
+        "nauc_ndcg_at_100_diff1": 0.445162,
+        "nauc_ndcg_at_1000_max": 0.047383,
+        "nauc_ndcg_at_1000_std": -0.046118,
+        "nauc_ndcg_at_1000_diff1": 0.450671,
+        "nauc_map_at_1_max": -0.001848,
+        "nauc_map_at_1_std": -0.120289,
+        "nauc_map_at_1_diff1": 0.529711,
+        "nauc_map_at_3_max": 0.034099,
+        "nauc_map_at_3_std": -0.118383,
+        "nauc_map_at_3_diff1": 0.470562,
+        "nauc_map_at_5_max": 0.034713,
+        "nauc_map_at_5_std": -0.114098,
+        "nauc_map_at_5_diff1": 0.45888,
+        "nauc_map_at_10_max": 0.028927,
+        "nauc_map_at_10_std": -0.109808,
+        "nauc_map_at_10_diff1": 0.437861,
+        "nauc_map_at_20_max": 0.029722,
+        "nauc_map_at_20_std": -0.099322,
+        "nauc_map_at_20_diff1": 0.433655,
+        "nauc_map_at_100_max": 0.032764,
+        "nauc_map_at_100_std": -0.08694,
+        "nauc_map_at_100_diff1": 0.43116,
+        "nauc_map_at_1000_max": 0.034897,
+        "nauc_map_at_1000_std": -0.086149,
+        "nauc_map_at_1000_diff1": 0.431398,
+        "nauc_recall_at_1_max": -0.001848,
+        "nauc_recall_at_1_std": -0.120289,
+        "nauc_recall_at_1_diff1": 0.529711,
+        "nauc_recall_at_3_max": 0.024422,
+        "nauc_recall_at_3_std": -0.119753,
+        "nauc_recall_at_3_diff1": 0.416796,
+        "nauc_recall_at_5_max": 0.016115,
+        "nauc_recall_at_5_std": -0.110148,
+        "nauc_recall_at_5_diff1": 0.38624,
+        "nauc_recall_at_10_max": -0.00025,
+        "nauc_recall_at_10_std": -0.108164,
+        "nauc_recall_at_10_diff1": 0.3346,
+        "nauc_recall_at_20_max": -0.010459,
+        "nauc_recall_at_20_std": -0.068332,
+        "nauc_recall_at_20_diff1": 0.307628,
+        "nauc_recall_at_100_max": -0.043519,
+        "nauc_recall_at_100_std": 0.068637,
+        "nauc_recall_at_100_diff1": 0.291346,
+        "nauc_recall_at_1000_max": 0.099155,
+        "nauc_recall_at_1000_std": 0.137363,
+        "nauc_recall_at_1000_diff1": 0.414869,
+        "nauc_precision_at_1_max": 0.028139,
+        "nauc_precision_at_1_std": -0.08379,
+        "nauc_precision_at_1_diff1": 0.521352,
+        "nauc_precision_at_3_max": 0.062599,
+        "nauc_precision_at_3_std": 0.018259,
+        "nauc_precision_at_3_diff1": 0.049148,
+        "nauc_precision_at_5_max": 0.040039,
+        "nauc_precision_at_5_std": 0.042409,
+        "nauc_precision_at_5_diff1": -0.060971,
+        "nauc_precision_at_10_max": 0.019823,
+        "nauc_precision_at_10_std": 0.071792,
+        "nauc_precision_at_10_diff1": -0.148101,
+        "nauc_precision_at_20_max": 0.030354,
+        "nauc_precision_at_20_std": 0.113512,
+        "nauc_precision_at_20_diff1": -0.181767,
+        "nauc_precision_at_100_max": 0.068555,
+        "nauc_precision_at_100_std": 0.191618,
+        "nauc_precision_at_100_diff1": -0.23055,
+        "nauc_precision_at_1000_max": 0.095492,
+        "nauc_precision_at_1000_std": 0.177014,
+        "nauc_precision_at_1000_diff1": -0.258342,
+        "nauc_mrr_at_1_max": 0.028139,
+        "nauc_mrr_at_1_std": -0.08379,
+        "nauc_mrr_at_1_diff1": 0.521352,
+        "nauc_mrr_at_3_max": 0.023757,
+        "nauc_mrr_at_3_std": -0.09788,
+        "nauc_mrr_at_3_diff1": 0.500733,
+        "nauc_mrr_at_5_max": 0.029172,
+        "nauc_mrr_at_5_std": -0.090798,
+        "nauc_mrr_at_5_diff1": 0.497492,
+        "nauc_mrr_at_10_max": 0.033234,
+        "nauc_mrr_at_10_std": -0.08608,
+        "nauc_mrr_at_10_diff1": 0.500227,
+        "nauc_mrr_at_20_max": 0.033814,
+        "nauc_mrr_at_20_std": -0.084369,
+        "nauc_mrr_at_20_diff1": 0.498279,
+        "nauc_mrr_at_100_max": 0.033646,
+        "nauc_mrr_at_100_std": -0.084398,
+        "nauc_mrr_at_100_diff1": 0.499707,
+        "nauc_mrr_at_1000_max": 0.033451,
+        "nauc_mrr_at_1000_std": -0.084602,
+        "nauc_mrr_at_1000_diff1": 0.499713,
+        "hit_rate_at_1": 0.59066,
+        "hit_rate_at_3": 0.77473,
+        "hit_rate_at_5": 0.83516,
+        "hit_rate_at_10": 0.90385,
+        "hit_rate_at_20": 0.93681,
+        "hit_rate_at_100": 0.98901,
+        "hit_rate_at_1000": 0.99725,
+        "main_score": 0.57421,
+        "hf_subset": "french",
+        "languages": [
+          "fra-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.57418,
+        "ndcg_at_3": 0.5633,
+        "ndcg_at_5": 0.56959,
+        "ndcg_at_10": 0.58513,
+        "ndcg_at_20": 0.62044,
+        "ndcg_at_100": 0.66967,
+        "ndcg_at_1000": 0.69326,
+        "map_at_1": 0.29707,
+        "map_at_3": 0.40188,
+        "map_at_5": 0.43341,
+        "map_at_10": 0.46991,
+        "map_at_20": 0.49779,
+        "map_at_100": 0.51669,
+        "map_at_1000": 0.51947,
+        "recall_at_1": 0.29707,
+        "recall_at_3": 0.4554,
+        "recall_at_5": 0.52519,
+        "recall_at_10": 0.61814,
+        "recall_at_20": 0.72643,
+        "recall_at_100": 0.87733,
+        "recall_at_1000": 0.98282,
+        "accuracy": 0.29707,
+        "precision_at_1": 0.5989,
+        "precision_at_3": 0.37546,
+        "precision_at_5": 0.29396,
+        "precision_at_10": 0.20082,
+        "precision_at_20": 0.1342,
+        "precision_at_100": 0.03805,
+        "precision_at_1000": 0.00462,
+        "mrr_at_1": 0.598901,
+        "mrr_at_3": 0.681777,
+        "mrr_at_5": 0.697161,
+        "mrr_at_10": 0.704649,
+        "mrr_at_20": 0.70726,
+        "mrr_at_100": 0.708331,
+        "mrr_at_1000": 0.70835,
+        "nauc_ndcg_at_1_max": 0.020354,
+        "nauc_ndcg_at_1_std": -0.090268,
+        "nauc_ndcg_at_1_diff1": 0.552602,
+        "nauc_ndcg_at_3_max": -0.012901,
+        "nauc_ndcg_at_3_std": -0.103308,
+        "nauc_ndcg_at_3_diff1": 0.467567,
+        "nauc_ndcg_at_5_max": 0.002578,
+        "nauc_ndcg_at_5_std": -0.102151,
+        "nauc_ndcg_at_5_diff1": 0.449711,
+        "nauc_ndcg_at_10_max": 0.001243,
+        "nauc_ndcg_at_10_std": -0.105507,
+        "nauc_ndcg_at_10_diff1": 0.463956,
+        "nauc_ndcg_at_20_max": 0.008592,
+        "nauc_ndcg_at_20_std": -0.080706,
+        "nauc_ndcg_at_20_diff1": 0.46454,
+        "nauc_ndcg_at_100_max": 0.012482,
+        "nauc_ndcg_at_100_std": -0.060304,
+        "nauc_ndcg_at_100_diff1": 0.45953,
+        "nauc_ndcg_at_1000_max": 0.023207,
+        "nauc_ndcg_at_1000_std": -0.059982,
+        "nauc_ndcg_at_1000_diff1": 0.471152,
+        "nauc_map_at_1_max": -0.005494,
+        "nauc_map_at_1_std": -0.122447,
+        "nauc_map_at_1_diff1": 0.560192,
+        "nauc_map_at_3_max": 0.02228,
+        "nauc_map_at_3_std": -0.124948,
+        "nauc_map_at_3_diff1": 0.502211,
+        "nauc_map_at_5_max": 0.027988,
+        "nauc_map_at_5_std": -0.118556,
+        "nauc_map_at_5_diff1": 0.478168,
+        "nauc_map_at_10_max": 0.018485,
+        "nauc_map_at_10_std": -0.11686,
+        "nauc_map_at_10_diff1": 0.470326,
+        "nauc_map_at_20_max": 0.017924,
+        "nauc_map_at_20_std": -0.10292,
+        "nauc_map_at_20_diff1": 0.460929,
+        "nauc_map_at_100_max": 0.016846,
+        "nauc_map_at_100_std": -0.096843,
+        "nauc_map_at_100_diff1": 0.455179,
+        "nauc_map_at_1000_max": 0.018082,
+        "nauc_map_at_1000_std": -0.095926,
+        "nauc_map_at_1000_diff1": 0.455574,
+        "nauc_recall_at_1_max": -0.005494,
+        "nauc_recall_at_1_std": -0.122447,
+        "nauc_recall_at_1_diff1": 0.560192,
+        "nauc_recall_at_3_max": 0.008645,
+        "nauc_recall_at_3_std": -0.125698,
+        "nauc_recall_at_3_diff1": 0.427579,
+        "nauc_recall_at_5_max": 0.008232,
+        "nauc_recall_at_5_std": -0.125048,
+        "nauc_recall_at_5_diff1": 0.362695,
+        "nauc_recall_at_10_max": -0.008889,
+        "nauc_recall_at_10_std": -0.118072,
+        "nauc_recall_at_10_diff1": 0.360335,
+        "nauc_recall_at_20_max": -0.014718,
+        "nauc_recall_at_20_std": -0.042605,
+        "nauc_recall_at_20_diff1": 0.336689,
+        "nauc_recall_at_100_max": -0.038012,
+        "nauc_recall_at_100_std": 0.057843,
+        "nauc_recall_at_100_diff1": 0.235711,
+        "nauc_recall_at_1000_max": 0.026125,
+        "nauc_recall_at_1000_std": 0.331061,
+        "nauc_recall_at_1000_diff1": 0.422496,
+        "nauc_precision_at_1_max": -0.002668,
+        "nauc_precision_at_1_std": -0.112704,
+        "nauc_precision_at_1_diff1": 0.555473,
+        "nauc_precision_at_3_max": -0.002914,
+        "nauc_precision_at_3_std": -0.016671,
+        "nauc_precision_at_3_diff1": 0.082835,
+        "nauc_precision_at_5_max": 0.018154,
+        "nauc_precision_at_5_std": 0.037395,
+        "nauc_precision_at_5_diff1": -0.089603,
+        "nauc_precision_at_10_max": -0.015528,
+        "nauc_precision_at_10_std": 0.05285,
+        "nauc_precision_at_10_diff1": -0.153013,
+        "nauc_precision_at_20_max": -0.00702,
+        "nauc_precision_at_20_std": 0.093241,
+        "nauc_precision_at_20_diff1": -0.19659,
+        "nauc_precision_at_100_max": 0.026676,
+        "nauc_precision_at_100_std": 0.149542,
+        "nauc_precision_at_100_diff1": -0.256604,
+        "nauc_precision_at_1000_max": 0.042228,
+        "nauc_precision_at_1000_std": 0.139086,
+        "nauc_precision_at_1000_diff1": -0.276989,
+        "nauc_mrr_at_1_max": -0.002668,
+        "nauc_mrr_at_1_std": -0.112704,
+        "nauc_mrr_at_1_diff1": 0.555473,
+        "nauc_mrr_at_3_max": -0.014755,
+        "nauc_mrr_at_3_std": -0.121839,
+        "nauc_mrr_at_3_diff1": 0.514667,
+        "nauc_mrr_at_5_max": -0.014095,
+        "nauc_mrr_at_5_std": -0.125642,
+        "nauc_mrr_at_5_diff1": 0.513881,
+        "nauc_mrr_at_10_max": -0.007489,
+        "nauc_mrr_at_10_std": -0.11447,
+        "nauc_mrr_at_10_diff1": 0.5198,
+        "nauc_mrr_at_20_max": -0.008165,
+        "nauc_mrr_at_20_std": -0.11349,
+        "nauc_mrr_at_20_diff1": 0.520802,
+        "nauc_mrr_at_100_max": -0.008089,
+        "nauc_mrr_at_100_std": -0.114312,
+        "nauc_mrr_at_100_diff1": 0.521617,
+        "nauc_mrr_at_1000_max": -0.008148,
+        "nauc_mrr_at_1000_std": -0.114402,
+        "nauc_mrr_at_1000_diff1": 0.521589,
+        "hit_rate_at_1": 0.5989,
+        "hit_rate_at_3": 0.78297,
+        "hit_rate_at_5": 0.8544,
+        "hit_rate_at_10": 0.91209,
+        "hit_rate_at_20": 0.95055,
+        "hit_rate_at_100": 0.99451,
+        "hit_rate_at_1000": 0.99725,
+        "main_score": 0.58513,
+        "hf_subset": "spanish",
+        "languages": [
+          "spa-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.5989,
+        "ndcg_at_3": 0.5993,
+        "ndcg_at_5": 0.59409,
+        "ndcg_at_10": 0.61691,
+        "ndcg_at_20": 0.64535,
+        "ndcg_at_100": 0.69423,
+        "ndcg_at_1000": 0.71688,
+        "map_at_1": 0.31355,
+        "map_at_3": 0.42503,
+        "map_at_5": 0.45374,
+        "map_at_10": 0.49709,
+        "map_at_20": 0.52181,
+        "map_at_100": 0.54217,
+        "map_at_1000": 0.54492,
+        "recall_at_1": 0.31355,
+        "recall_at_3": 0.48004,
+        "recall_at_5": 0.53981,
+        "recall_at_10": 0.65162,
+        "recall_at_20": 0.73983,
+        "recall_at_100": 0.88963,
+        "recall_at_1000": 0.98795,
+        "accuracy": 0.31355,
+        "precision_at_1": 0.62088,
+        "precision_at_3": 0.40385,
+        "precision_at_5": 0.30495,
+        "precision_at_10": 0.21538,
+        "precision_at_20": 0.13791,
+        "precision_at_100": 0.03901,
+        "precision_at_1000": 0.00466,
+        "mrr_at_1": 0.620879,
+        "mrr_at_3": 0.709249,
+        "mrr_at_5": 0.724084,
+        "mrr_at_10": 0.732495,
+        "mrr_at_20": 0.734588,
+        "mrr_at_100": 0.735219,
+        "mrr_at_1000": 0.735274,
+        "nauc_ndcg_at_1_max": 0.026717,
+        "nauc_ndcg_at_1_std": -0.096244,
+        "nauc_ndcg_at_1_diff1": 0.57043,
+        "nauc_ndcg_at_3_max": 0.026853,
+        "nauc_ndcg_at_3_std": -0.125249,
+        "nauc_ndcg_at_3_diff1": 0.475696,
+        "nauc_ndcg_at_5_max": 0.027089,
+        "nauc_ndcg_at_5_std": -0.12239,
+        "nauc_ndcg_at_5_diff1": 0.494063,
+        "nauc_ndcg_at_10_max": 0.02286,
+        "nauc_ndcg_at_10_std": -0.112754,
+        "nauc_ndcg_at_10_diff1": 0.493689,
+        "nauc_ndcg_at_20_max": 0.027181,
+        "nauc_ndcg_at_20_std": -0.099399,
+        "nauc_ndcg_at_20_diff1": 0.493575,
+        "nauc_ndcg_at_100_max": 0.031849,
+        "nauc_ndcg_at_100_std": -0.085513,
+        "nauc_ndcg_at_100_diff1": 0.481197,
+        "nauc_ndcg_at_1000_max": 0.036263,
+        "nauc_ndcg_at_1000_std": -0.092587,
+        "nauc_ndcg_at_1000_diff1": 0.492879,
+        "nauc_map_at_1_max": 0.034562,
+        "nauc_map_at_1_std": -0.117189,
+        "nauc_map_at_1_diff1": 0.544775,
+        "nauc_map_at_3_max": 0.083085,
+        "nauc_map_at_3_std": -0.098742,
+        "nauc_map_at_3_diff1": 0.498714,
+        "nauc_map_at_5_max": 0.071677,
+        "nauc_map_at_5_std": -0.105858,
+        "nauc_map_at_5_diff1": 0.49327,
+        "nauc_map_at_10_max": 0.055977,
+        "nauc_map_at_10_std": -0.110151,
+        "nauc_map_at_10_diff1": 0.478408,
+        "nauc_map_at_20_max": 0.045505,
+        "nauc_map_at_20_std": -0.111284,
+        "nauc_map_at_20_diff1": 0.468621,
+        "nauc_map_at_100_max": 0.042158,
+        "nauc_map_at_100_std": -0.110338,
+        "nauc_map_at_100_diff1": 0.458215,
+        "nauc_map_at_1000_max": 0.043256,
+        "nauc_map_at_1000_std": -0.110078,
+        "nauc_map_at_1000_diff1": 0.458882,
+        "nauc_recall_at_1_max": 0.034562,
+        "nauc_recall_at_1_std": -0.117189,
+        "nauc_recall_at_1_diff1": 0.544775,
+        "nauc_recall_at_3_max": 0.093491,
+        "nauc_recall_at_3_std": -0.064383,
+        "nauc_recall_at_3_diff1": 0.441584,
+        "nauc_recall_at_5_max": 0.068631,
+        "nauc_recall_at_5_std": -0.073462,
+        "nauc_recall_at_5_diff1": 0.424612,
+        "nauc_recall_at_10_max": 0.039046,
+        "nauc_recall_at_10_std": -0.075176,
+        "nauc_recall_at_10_diff1": 0.388998,
+        "nauc_recall_at_20_max": 0.028535,
+        "nauc_recall_at_20_std": -0.040627,
+        "nauc_recall_at_20_diff1": 0.346008,
+        "nauc_recall_at_100_max": 0.054885,
+        "nauc_recall_at_100_std": 0.075857,
+        "nauc_recall_at_100_diff1": 0.263057,
+        "nauc_recall_at_1000_max": 0.178512,
+        "nauc_recall_at_1000_std": 0.22132,
+        "nauc_recall_at_1000_diff1": 0.361257,
+        "nauc_precision_at_1_max": 0.016504,
+        "nauc_precision_at_1_std": -0.120255,
+        "nauc_precision_at_1_diff1": 0.569927,
+        "nauc_precision_at_3_max": -0.014653,
+        "nauc_precision_at_3_std": -0.082376,
+        "nauc_precision_at_3_diff1": 0.040464,
+        "nauc_precision_at_5_max": -0.058308,
+        "nauc_precision_at_5_std": -0.063488,
+        "nauc_precision_at_5_diff1": -0.062088,
+        "nauc_precision_at_10_max": -0.09151,
+        "nauc_precision_at_10_std": -0.040041,
+        "nauc_precision_at_10_diff1": -0.167668,
+        "nauc_precision_at_20_max": -0.08442,
+        "nauc_precision_at_20_std": -0.006732,
+        "nauc_precision_at_20_diff1": -0.216146,
+        "nauc_precision_at_100_max": -0.037354,
+        "nauc_precision_at_100_std": 0.054682,
+        "nauc_precision_at_100_diff1": -0.28713,
+        "nauc_precision_at_1000_max": -0.0135,
+        "nauc_precision_at_1000_std": 0.059125,
+        "nauc_precision_at_1000_diff1": -0.297039,
+        "nauc_mrr_at_1_max": 0.016504,
+        "nauc_mrr_at_1_std": -0.120255,
+        "nauc_mrr_at_1_diff1": 0.569927,
+        "nauc_mrr_at_3_max": 0.002379,
+        "nauc_mrr_at_3_std": -0.141004,
+        "nauc_mrr_at_3_diff1": 0.559048,
+        "nauc_mrr_at_5_max": 0.005482,
+        "nauc_mrr_at_5_std": -0.133573,
+        "nauc_mrr_at_5_diff1": 0.563591,
+        "nauc_mrr_at_10_max": 0.010487,
+        "nauc_mrr_at_10_std": -0.131973,
+        "nauc_mrr_at_10_diff1": 0.564379,
+        "nauc_mrr_at_20_max": 0.011468,
+        "nauc_mrr_at_20_std": -0.130242,
+        "nauc_mrr_at_20_diff1": 0.56493,
+        "nauc_mrr_at_100_max": 0.010954,
+        "nauc_mrr_at_100_std": -0.13067,
+        "nauc_mrr_at_100_diff1": 0.564621,
+        "nauc_mrr_at_1000_max": 0.011045,
+        "nauc_mrr_at_1000_std": -0.130631,
+        "nauc_mrr_at_1000_diff1": 0.564638,
+        "hit_rate_at_1": 0.62088,
+        "hit_rate_at_3": 0.81593,
+        "hit_rate_at_5": 0.87912,
+        "hit_rate_at_10": 0.93956,
+        "hit_rate_at_20": 0.96703,
+        "hit_rate_at_100": 0.98901,
+        "hit_rate_at_1000": 0.99725,
+        "main_score": 0.61691,
+        "hf_subset": "english",
+        "languages": [
+          "eng-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.5783,
+        "ndcg_at_3": 0.57108,
+        "ndcg_at_5": 0.57332,
+        "ndcg_at_10": 0.58877,
+        "ndcg_at_20": 0.62294,
+        "ndcg_at_100": 0.67278,
+        "ndcg_at_1000": 0.69686,
+        "map_at_1": 0.3026,
+        "map_at_3": 0.40643,
+        "map_at_5": 0.43852,
+        "map_at_10": 0.47574,
+        "map_at_20": 0.5024,
+        "map_at_100": 0.52156,
+        "map_at_1000": 0.52429,
+        "recall_at_1": 0.3026,
+        "recall_at_3": 0.45344,
+        "recall_at_5": 0.52519,
+        "recall_at_10": 0.61416,
+        "recall_at_20": 0.72043,
+        "recall_at_100": 0.87512,
+        "recall_at_1000": 0.98332,
+        "accuracy": 0.3026,
+        "precision_at_1": 0.60165,
+        "precision_at_3": 0.38462,
+        "precision_at_5": 0.29505,
+        "precision_at_10": 0.20247,
+        "precision_at_20": 0.1331,
+        "precision_at_100": 0.03805,
+        "precision_at_1000": 0.00463,
+        "mrr_at_1": 0.601648,
+        "mrr_at_3": 0.684524,
+        "mrr_at_5": 0.700183,
+        "mrr_at_10": 0.705843,
+        "mrr_at_20": 0.710163,
+        "mrr_at_100": 0.711122,
+        "mrr_at_1000": 0.711195,
+        "nauc_ndcg_at_1_max": -0.050006,
+        "nauc_ndcg_at_1_std": -0.067584,
+        "nauc_ndcg_at_1_diff1": 0.504761,
+        "nauc_ndcg_at_3_max": -0.048884,
+        "nauc_ndcg_at_3_std": -0.095871,
+        "nauc_ndcg_at_3_diff1": 0.43122,
+        "nauc_ndcg_at_5_max": -0.034478,
+        "nauc_ndcg_at_5_std": -0.096466,
+        "nauc_ndcg_at_5_diff1": 0.458037,
+        "nauc_ndcg_at_10_max": -0.020674,
+        "nauc_ndcg_at_10_std": -0.085787,
+        "nauc_ndcg_at_10_diff1": 0.464692,
+        "nauc_ndcg_at_20_max": -0.034059,
+        "nauc_ndcg_at_20_std": -0.075072,
+        "nauc_ndcg_at_20_diff1": 0.462498,
+        "nauc_ndcg_at_100_max": -0.034656,
+        "nauc_ndcg_at_100_std": -0.051712,
+        "nauc_ndcg_at_100_diff1": 0.467814,
+        "nauc_ndcg_at_1000_max": -0.019348,
+        "nauc_ndcg_at_1000_std": -0.05165,
+        "nauc_ndcg_at_1000_diff1": 0.462428,
+        "nauc_map_at_1_max": -0.01227,
+        "nauc_map_at_1_std": -0.098176,
+        "nauc_map_at_1_diff1": 0.511578,
+        "nauc_map_at_3_max": 0.008973,
+        "nauc_map_at_3_std": -0.097136,
+        "nauc_map_at_3_diff1": 0.468666,
+        "nauc_map_at_5_max": 0.014066,
+        "nauc_map_at_5_std": -0.091921,
+        "nauc_map_at_5_diff1": 0.47323,
+        "nauc_map_at_10_max": 0.006277,
+        "nauc_map_at_10_std": -0.084782,
+        "nauc_map_at_10_diff1": 0.45398,
+        "nauc_map_at_20_max": -0.00631,
+        "nauc_map_at_20_std": -0.079754,
+        "nauc_map_at_20_diff1": 0.442106,
+        "nauc_map_at_100_max": -0.011654,
+        "nauc_map_at_100_std": -0.076704,
+        "nauc_map_at_100_diff1": 0.442903,
+        "nauc_map_at_1000_max": -0.0098,
+        "nauc_map_at_1000_std": -0.075575,
+        "nauc_map_at_1000_diff1": 0.442202,
+        "nauc_recall_at_1_max": -0.01227,
+        "nauc_recall_at_1_std": -0.098176,
+        "nauc_recall_at_1_diff1": 0.511578,
+        "nauc_recall_at_3_max": 0.010047,
+        "nauc_recall_at_3_std": -0.102226,
+        "nauc_recall_at_3_diff1": 0.420932,
+        "nauc_recall_at_5_max": 0.026493,
+        "nauc_recall_at_5_std": -0.094514,
+        "nauc_recall_at_5_diff1": 0.430937,
+        "nauc_recall_at_10_max": 0.025561,
+        "nauc_recall_at_10_std": -0.06416,
+        "nauc_recall_at_10_diff1": 0.40079,
+        "nauc_recall_at_20_max": -0.056333,
+        "nauc_recall_at_20_std": -0.06775,
+        "nauc_recall_at_20_diff1": 0.362427,
+        "nauc_recall_at_100_max": -0.099085,
+        "nauc_recall_at_100_std": 0.060719,
+        "nauc_recall_at_100_diff1": 0.396107,
+        "nauc_recall_at_1000_max": -0.035932,
+        "nauc_recall_at_1000_std": 0.261097,
+        "nauc_recall_at_1000_diff1": 0.484025,
+        "nauc_precision_at_1_max": -0.05482,
+        "nauc_precision_at_1_std": -0.076814,
+        "nauc_precision_at_1_diff1": 0.496567,
+        "nauc_precision_at_3_max": -0.030787,
+        "nauc_precision_at_3_std": -0.022635,
+        "nauc_precision_at_3_diff1": 0.062838,
+        "nauc_precision_at_5_max": -0.038448,
+        "nauc_precision_at_5_std": -0.0007,
+        "nauc_precision_at_5_diff1": -0.014393,
+        "nauc_precision_at_10_max": -0.051955,
+        "nauc_precision_at_10_std": 0.025474,
+        "nauc_precision_at_10_diff1": -0.121171,
+        "nauc_precision_at_20_max": -0.071797,
+        "nauc_precision_at_20_std": 0.042555,
+        "nauc_precision_at_20_diff1": -0.178238,
+        "nauc_precision_at_100_max": -0.019213,
+        "nauc_precision_at_100_std": 0.101436,
+        "nauc_precision_at_100_diff1": -0.223364,
+        "nauc_precision_at_1000_max": 0.029746,
+        "nauc_precision_at_1000_std": 0.104205,
+        "nauc_precision_at_1000_diff1": -0.272254,
+        "nauc_mrr_at_1_max": -0.05482,
+        "nauc_mrr_at_1_std": -0.076814,
+        "nauc_mrr_at_1_diff1": 0.496567,
+        "nauc_mrr_at_3_max": -0.041582,
+        "nauc_mrr_at_3_std": -0.079893,
+        "nauc_mrr_at_3_diff1": 0.490521,
+        "nauc_mrr_at_5_max": -0.037356,
+        "nauc_mrr_at_5_std": -0.077925,
+        "nauc_mrr_at_5_diff1": 0.497293,
+        "nauc_mrr_at_10_max": -0.028695,
+        "nauc_mrr_at_10_std": -0.071347,
+        "nauc_mrr_at_10_diff1": 0.497736,
+        "nauc_mrr_at_20_max": -0.03379,
+        "nauc_mrr_at_20_std": -0.071897,
+        "nauc_mrr_at_20_diff1": 0.497574,
+        "nauc_mrr_at_100_max": -0.034157,
+        "nauc_mrr_at_100_std": -0.071603,
+        "nauc_mrr_at_100_diff1": 0.497781,
+        "nauc_mrr_at_1000_max": -0.034027,
+        "nauc_mrr_at_1000_std": -0.071695,
+        "nauc_mrr_at_1000_diff1": 0.497781,
+        "hit_rate_at_1": 0.60165,
+        "hit_rate_at_3": 0.78846,
+        "hit_rate_at_5": 0.8544,
+        "hit_rate_at_10": 0.89286,
+        "hit_rate_at_20": 0.9533,
+        "hit_rate_at_100": 0.98901,
+        "hit_rate_at_1000": 0.99725,
+        "main_score": 0.58877,
+        "hf_subset": "german",
+        "languages": [
+          "deu-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.56868,
+        "ndcg_at_3": 0.56256,
+        "ndcg_at_5": 0.56421,
+        "ndcg_at_10": 0.58434,
+        "ndcg_at_20": 0.61301,
+        "ndcg_at_100": 0.66377,
+        "ndcg_at_1000": 0.68943,
+        "map_at_1": 0.30161,
+        "map_at_3": 0.40086,
+        "map_at_5": 0.43138,
+        "map_at_10": 0.46989,
+        "map_at_20": 0.49443,
+        "map_at_100": 0.51347,
+        "map_at_1000": 0.51629,
+        "recall_at_1": 0.30161,
+        "recall_at_3": 0.4496,
+        "recall_at_5": 0.51076,
+        "recall_at_10": 0.61402,
+        "recall_at_20": 0.70373,
+        "recall_at_100": 0.86715,
+        "recall_at_1000": 0.9818,
+        "accuracy": 0.30161,
+        "precision_at_1": 0.59341,
+        "precision_at_3": 0.36813,
+        "precision_at_5": 0.28791,
+        "precision_at_10": 0.20302,
+        "precision_at_20": 0.13036,
+        "precision_at_100": 0.03725,
+        "precision_at_1000": 0.00462,
+        "mrr_at_1": 0.593407,
+        "mrr_at_3": 0.676282,
+        "mrr_at_5": 0.687408,
+        "mrr_at_10": 0.697648,
+        "mrr_at_20": 0.700782,
+        "mrr_at_100": 0.701974,
+        "mrr_at_1000": 0.702034,
+        "nauc_ndcg_at_1_max": 0.042486,
+        "nauc_ndcg_at_1_std": 0.001501,
+        "nauc_ndcg_at_1_diff1": 0.559659,
+        "nauc_ndcg_at_3_max": -0.00051,
+        "nauc_ndcg_at_3_std": -0.056847,
+        "nauc_ndcg_at_3_diff1": 0.464614,
+        "nauc_ndcg_at_5_max": -0.019919,
+        "nauc_ndcg_at_5_std": -0.078679,
+        "nauc_ndcg_at_5_diff1": 0.453755,
+        "nauc_ndcg_at_10_max": -0.036796,
+        "nauc_ndcg_at_10_std": -0.091583,
+        "nauc_ndcg_at_10_diff1": 0.453026,
+        "nauc_ndcg_at_20_max": -0.036766,
+        "nauc_ndcg_at_20_std": -0.069246,
+        "nauc_ndcg_at_20_diff1": 0.455774,
+        "nauc_ndcg_at_100_max": -0.022302,
+        "nauc_ndcg_at_100_std": -0.037256,
+        "nauc_ndcg_at_100_diff1": 0.453312,
+        "nauc_ndcg_at_1000_max": -0.00449,
+        "nauc_ndcg_at_1000_std": -0.034792,
+        "nauc_ndcg_at_1000_diff1": 0.467696,
+        "nauc_map_at_1_max": -0.016479,
+        "nauc_map_at_1_std": -0.098385,
+        "nauc_map_at_1_diff1": 0.511696,
+        "nauc_map_at_3_max": 0.009162,
+        "nauc_map_at_3_std": -0.108181,
+        "nauc_map_at_3_diff1": 0.462674,
+        "nauc_map_at_5_max": -0.00376,
+        "nauc_map_at_5_std": -0.112252,
+        "nauc_map_at_5_diff1": 0.456047,
+        "nauc_map_at_10_max": -0.011474,
+        "nauc_map_at_10_std": -0.112614,
+        "nauc_map_at_10_diff1": 0.447309,
+        "nauc_map_at_20_max": -0.018588,
+        "nauc_map_at_20_std": -0.099104,
+        "nauc_map_at_20_diff1": 0.438647,
+        "nauc_map_at_100_max": -0.019155,
+        "nauc_map_at_100_std": -0.090606,
+        "nauc_map_at_100_diff1": 0.435092,
+        "nauc_map_at_1000_max": -0.017073,
+        "nauc_map_at_1000_std": -0.089572,
+        "nauc_map_at_1000_diff1": 0.435237,
+        "nauc_recall_at_1_max": -0.016479,
+        "nauc_recall_at_1_std": -0.098385,
+        "nauc_recall_at_1_diff1": 0.511696,
+        "nauc_recall_at_3_max": 0.003292,
+        "nauc_recall_at_3_std": -0.111517,
+        "nauc_recall_at_3_diff1": 0.398875,
+        "nauc_recall_at_5_max": -0.025242,
+        "nauc_recall_at_5_std": -0.123411,
+        "nauc_recall_at_5_diff1": 0.376335,
+        "nauc_recall_at_10_max": -0.075063,
+        "nauc_recall_at_10_std": -0.1339,
+        "nauc_recall_at_10_diff1": 0.343082,
+        "nauc_recall_at_20_max": -0.086139,
+        "nauc_recall_at_20_std": -0.061127,
+        "nauc_recall_at_20_diff1": 0.298806,
+        "nauc_recall_at_100_max": -0.106811,
+        "nauc_recall_at_100_std": 0.041161,
+        "nauc_recall_at_100_diff1": 0.230455,
+        "nauc_recall_at_1000_max": -0.02143,
+        "nauc_recall_at_1000_std": 0.274679,
+        "nauc_recall_at_1000_diff1": 0.21914,
+        "nauc_precision_at_1_max": 0.036136,
+        "nauc_precision_at_1_std": -0.021218,
+        "nauc_precision_at_1_diff1": 0.56425,
+        "nauc_precision_at_3_max": 0.022984,
+        "nauc_precision_at_3_std": 0.005304,
+        "nauc_precision_at_3_diff1": 0.104515,
+        "nauc_precision_at_5_max": -0.015513,
+        "nauc_precision_at_5_std": 0.016653,
+        "nauc_precision_at_5_diff1": -0.010107,
+        "nauc_precision_at_10_max": -0.03299,
+        "nauc_precision_at_10_std": 0.030745,
+        "nauc_precision_at_10_diff1": -0.10355,
+        "nauc_precision_at_20_max": -0.032361,
+        "nauc_precision_at_20_std": 0.075068,
+        "nauc_precision_at_20_diff1": -0.141259,
+        "nauc_precision_at_100_max": 0.047462,
+        "nauc_precision_at_100_std": 0.152066,
+        "nauc_precision_at_100_diff1": -0.204818,
+        "nauc_precision_at_1000_max": 0.087119,
+        "nauc_precision_at_1000_std": 0.141741,
+        "nauc_precision_at_1000_diff1": -0.228843,
+        "nauc_mrr_at_1_max": 0.036136,
+        "nauc_mrr_at_1_std": -0.021218,
+        "nauc_mrr_at_1_diff1": 0.56425,
+        "nauc_mrr_at_3_max": 0.013324,
+        "nauc_mrr_at_3_std": -0.043495,
+        "nauc_mrr_at_3_diff1": 0.549516,
+        "nauc_mrr_at_5_max": 0.018483,
+        "nauc_mrr_at_5_std": -0.03884,
+        "nauc_mrr_at_5_diff1": 0.541774,
+        "nauc_mrr_at_10_max": 0.018035,
+        "nauc_mrr_at_10_std": -0.035515,
+        "nauc_mrr_at_10_diff1": 0.545988,
+        "nauc_mrr_at_20_max": 0.022547,
+        "nauc_mrr_at_20_std": -0.034283,
+        "nauc_mrr_at_20_diff1": 0.546527,
+        "nauc_mrr_at_100_max": 0.021385,
+        "nauc_mrr_at_100_std": -0.034878,
+        "nauc_mrr_at_100_diff1": 0.545999,
+        "nauc_mrr_at_1000_max": 0.021257,
+        "nauc_mrr_at_1000_std": -0.034962,
+        "nauc_mrr_at_1000_diff1": 0.545971,
+        "hit_rate_at_1": 0.59341,
+        "hit_rate_at_3": 0.77747,
+        "hit_rate_at_5": 0.82692,
+        "hit_rate_at_10": 0.9011,
+        "hit_rate_at_20": 0.94231,
+        "hit_rate_at_100": 0.98901,
+        "hit_rate_at_1000": 0.99725,
+        "main_score": 0.58434,
+        "hf_subset": "italian",
+        "languages": [
+          "ita-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.58929,
+        "ndcg_at_3": 0.56829,
+        "ndcg_at_5": 0.5692,
+        "ndcg_at_10": 0.58453,
+        "ndcg_at_20": 0.6201,
+        "ndcg_at_100": 0.66997,
+        "ndcg_at_1000": 0.6936,
+        "map_at_1": 0.29745,
+        "map_at_3": 0.39813,
+        "map_at_5": 0.43144,
+        "map_at_10": 0.46755,
+        "map_at_20": 0.49445,
+        "map_at_100": 0.5146,
+        "map_at_1000": 0.5173,
+        "recall_at_1": 0.29745,
+        "recall_at_3": 0.44879,
+        "recall_at_5": 0.518,
+        "recall_at_10": 0.61159,
+        "recall_at_20": 0.7247,
+        "recall_at_100": 0.87997,
+        "recall_at_1000": 0.9845,
+        "accuracy": 0.29745,
+        "precision_at_1": 0.61264,
+        "precision_at_3": 0.37546,
+        "precision_at_5": 0.29396,
+        "precision_at_10": 0.20192,
+        "precision_at_20": 0.13365,
+        "precision_at_100": 0.03838,
+        "precision_at_1000": 0.00463,
+        "mrr_at_1": 0.612637,
+        "mrr_at_3": 0.688645,
+        "mrr_at_5": 0.70348,
+        "mrr_at_10": 0.712617,
+        "mrr_at_20": 0.714881,
+        "mrr_at_100": 0.716077,
+        "mrr_at_1000": 0.716145,
+        "nauc_ndcg_at_1_max": 0.040708,
+        "nauc_ndcg_at_1_std": -0.064989,
+        "nauc_ndcg_at_1_diff1": 0.523708,
+        "nauc_ndcg_at_3_max": 0.021095,
+        "nauc_ndcg_at_3_std": -0.04804,
+        "nauc_ndcg_at_3_diff1": 0.461836,
+        "nauc_ndcg_at_5_max": 0.023212,
+        "nauc_ndcg_at_5_std": -0.069533,
+        "nauc_ndcg_at_5_diff1": 0.470306,
+        "nauc_ndcg_at_10_max": 0.022564,
+        "nauc_ndcg_at_10_std": -0.084007,
+        "nauc_ndcg_at_10_diff1": 0.478729,
+        "nauc_ndcg_at_20_max": 0.02133,
+        "nauc_ndcg_at_20_std": -0.053355,
+        "nauc_ndcg_at_20_diff1": 0.47473,
+        "nauc_ndcg_at_100_max": 0.041895,
+        "nauc_ndcg_at_100_std": -0.02192,
+        "nauc_ndcg_at_100_diff1": 0.474121,
+        "nauc_ndcg_at_1000_max": 0.050931,
+        "nauc_ndcg_at_1000_std": -0.029783,
+        "nauc_ndcg_at_1000_diff1": 0.487825,
+        "nauc_map_at_1_max": 0.028737,
+        "nauc_map_at_1_std": -0.099225,
+        "nauc_map_at_1_diff1": 0.564026,
+        "nauc_map_at_3_max": 0.050286,
+        "nauc_map_at_3_std": -0.0939,
+        "nauc_map_at_3_diff1": 0.494958,
+        "nauc_map_at_5_max": 0.045906,
+        "nauc_map_at_5_std": -0.094896,
+        "nauc_map_at_5_diff1": 0.488664,
+        "nauc_map_at_10_max": 0.04342,
+        "nauc_map_at_10_std": -0.09113,
+        "nauc_map_at_10_diff1": 0.482944,
+        "nauc_map_at_20_max": 0.039898,
+        "nauc_map_at_20_std": -0.072374,
+        "nauc_map_at_20_diff1": 0.470049,
+        "nauc_map_at_100_max": 0.042045,
+        "nauc_map_at_100_std": -0.065125,
+        "nauc_map_at_100_diff1": 0.466078,
+        "nauc_map_at_1000_max": 0.043666,
+        "nauc_map_at_1000_std": -0.064372,
+        "nauc_map_at_1000_diff1": 0.466997,
+        "nauc_recall_at_1_max": 0.028737,
+        "nauc_recall_at_1_std": -0.099225,
+        "nauc_recall_at_1_diff1": 0.564026,
+        "nauc_recall_at_3_max": 0.049585,
+        "nauc_recall_at_3_std": -0.079617,
+        "nauc_recall_at_3_diff1": 0.420399,
+        "nauc_recall_at_5_max": 0.045871,
+        "nauc_recall_at_5_std": -0.084529,
+        "nauc_recall_at_5_diff1": 0.402472,
+        "nauc_recall_at_10_max": 0.029557,
+        "nauc_recall_at_10_std": -0.085028,
+        "nauc_recall_at_10_diff1": 0.384268,
+        "nauc_recall_at_20_max": -0.034467,
+        "nauc_recall_at_20_std": -0.015984,
+        "nauc_recall_at_20_diff1": 0.318303,
+        "nauc_recall_at_100_max": 0.011896,
+        "nauc_recall_at_100_std": 0.14493,
+        "nauc_recall_at_100_diff1": 0.255871,
+        "nauc_recall_at_1000_max": 0.06315,
+        "nauc_recall_at_1000_std": 0.28497,
+        "nauc_recall_at_1000_diff1": 0.448137,
+        "nauc_precision_at_1_max": 0.031826,
+        "nauc_precision_at_1_std": -0.082555,
+        "nauc_precision_at_1_diff1": 0.530822,
+        "nauc_precision_at_3_max": -0.002071,
+        "nauc_precision_at_3_std": 0.021957,
+        "nauc_precision_at_3_diff1": 0.069678,
+        "nauc_precision_at_5_max": -0.008449,
+        "nauc_precision_at_5_std": 0.027842,
+        "nauc_precision_at_5_diff1": -0.045667,
+        "nauc_precision_at_10_max": -0.026846,
+        "nauc_precision_at_10_std": 0.038534,
+        "nauc_precision_at_10_diff1": -0.122996,
+        "nauc_precision_at_20_max": -0.00678,
+        "nauc_precision_at_20_std": 0.113699,
+        "nauc_precision_at_20_diff1": -0.180699,
+        "nauc_precision_at_100_max": 0.036338,
+        "nauc_precision_at_100_std": 0.155724,
+        "nauc_precision_at_100_diff1": -0.223279,
+        "nauc_precision_at_1000_max": 0.052201,
+        "nauc_precision_at_1000_std": 0.136129,
+        "nauc_precision_at_1000_diff1": -0.240337,
+        "nauc_mrr_at_1_max": 0.031826,
+        "nauc_mrr_at_1_std": -0.082555,
+        "nauc_mrr_at_1_diff1": 0.530822,
+        "nauc_mrr_at_3_max": 0.026035,
+        "nauc_mrr_at_3_std": -0.073774,
+        "nauc_mrr_at_3_diff1": 0.519036,
+        "nauc_mrr_at_5_max": 0.028707,
+        "nauc_mrr_at_5_std": -0.084862,
+        "nauc_mrr_at_5_diff1": 0.524133,
+        "nauc_mrr_at_10_max": 0.031876,
+        "nauc_mrr_at_10_std": -0.081661,
+        "nauc_mrr_at_10_diff1": 0.525147,
+        "nauc_mrr_at_20_max": 0.031259,
+        "nauc_mrr_at_20_std": -0.079198,
+        "nauc_mrr_at_20_diff1": 0.525622,
+        "nauc_mrr_at_100_max": 0.031706,
+        "nauc_mrr_at_100_std": -0.079452,
+        "nauc_mrr_at_100_diff1": 0.525176,
+        "nauc_mrr_at_1000_max": 0.031504,
+        "nauc_mrr_at_1000_std": -0.079674,
+        "nauc_mrr_at_1000_diff1": 0.525136,
+        "hit_rate_at_1": 0.61264,
+        "hit_rate_at_3": 0.78022,
+        "hit_rate_at_5": 0.84615,
+        "hit_rate_at_10": 0.91209,
+        "hit_rate_at_20": 0.9478,
+        "hit_rate_at_100": 0.98901,
+        "hit_rate_at_1000": 0.99725,
+        "main_score": 0.58453,
+        "hf_subset": "portuguese",
+        "languages": [
+          "por-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 2151.097337245941,
+  "kg_co2_emissions": null,
+  "date": null
+}

results/v3/Vidore3PhysicsRetrieval.json

@@ -0,0 +1,942 @@
+{
+  "dataset_revision": "2c18ef90ab3ef93a9d86ecc6521cdae2a29f8300",
+  "task_name": "Vidore3PhysicsRetrieval",
+  "mteb_version": "2.12.15",
+  "scores": {
+    "test": [
+      {
+        "ndcg_at_1": 0.37748,
+        "ndcg_at_3": 0.41436,
+        "ndcg_at_5": 0.43374,
+        "ndcg_at_10": 0.46106,
+        "ndcg_at_20": 0.50395,
+        "ndcg_at_100": 0.58136,
+        "ndcg_at_1000": 0.61284,
+        "map_at_1": 0.1431,
+        "map_at_3": 0.22657,
+        "map_at_5": 0.26631,
+        "map_at_10": 0.318,
+        "map_at_20": 0.35645,
+        "map_at_100": 0.3916,
+        "map_at_1000": 0.39682,
+        "recall_at_1": 0.1431,
+        "recall_at_3": 0.28533,
+        "recall_at_5": 0.37349,
+        "recall_at_10": 0.49392,
+        "recall_at_20": 0.62619,
+        "recall_at_100": 0.85261,
+        "recall_at_1000": 0.99321,
+        "accuracy": 0.1431,
+        "precision_at_1": 0.41391,
+        "precision_at_3": 0.33885,
+        "precision_at_5": 0.30265,
+        "precision_at_10": 0.24205,
+        "precision_at_20": 0.17583,
+        "precision_at_100": 0.05732,
+        "precision_at_1000": 0.00715,
+        "mrr_at_1": 0.413907,
+        "mrr_at_3": 0.548565,
+        "mrr_at_5": 0.570751,
+        "mrr_at_10": 0.582336,
+        "mrr_at_20": 0.587163,
+        "mrr_at_100": 0.588221,
+        "mrr_at_1000": 0.588369,
+        "nauc_ndcg_at_1_max": 0.038151,
+        "nauc_ndcg_at_1_std": 0.001688,
+        "nauc_ndcg_at_1_diff1": 0.23758,
+        "nauc_ndcg_at_3_max": 0.096744,
+        "nauc_ndcg_at_3_std": 0.036693,
+        "nauc_ndcg_at_3_diff1": 0.240744,
+        "nauc_ndcg_at_5_max": 0.101861,
+        "nauc_ndcg_at_5_std": 0.044306,
+        "nauc_ndcg_at_5_diff1": 0.199667,
+        "nauc_ndcg_at_10_max": 0.101312,
+        "nauc_ndcg_at_10_std": 0.034201,
+        "nauc_ndcg_at_10_diff1": 0.191038,
+        "nauc_ndcg_at_20_max": 0.117219,
+        "nauc_ndcg_at_20_std": 0.052901,
+        "nauc_ndcg_at_20_diff1": 0.173224,
+        "nauc_ndcg_at_100_max": 0.122254,
+        "nauc_ndcg_at_100_std": 0.086783,
+        "nauc_ndcg_at_100_diff1": 0.18029,
+        "nauc_ndcg_at_1000_max": 0.123841,
+        "nauc_ndcg_at_1000_std": 0.08353,
+        "nauc_ndcg_at_1000_diff1": 0.197904,
+        "nauc_map_at_1_max": 0.063667,
+        "nauc_map_at_1_std": -0.095273,
+        "nauc_map_at_1_diff1": 0.405486,
+        "nauc_map_at_3_max": 0.070051,
+        "nauc_map_at_3_std": -0.084352,
+        "nauc_map_at_3_diff1": 0.295317,
+        "nauc_map_at_5_max": 0.066841,
+        "nauc_map_at_5_std": -0.067222,
+        "nauc_map_at_5_diff1": 0.25209,
+        "nauc_map_at_10_max": 0.075037,
+        "nauc_map_at_10_std": -0.036368,
+        "nauc_map_at_10_diff1": 0.221279,
+        "nauc_map_at_20_max": 0.091734,
+        "nauc_map_at_20_std": -0.001625,
+        "nauc_map_at_20_diff1": 0.203196,
+        "nauc_map_at_100_max": 0.101539,
+        "nauc_map_at_100_std": 0.023309,
+        "nauc_map_at_100_diff1": 0.199228,
+        "nauc_map_at_1000_max": 0.102508,
+        "nauc_map_at_1000_std": 0.025619,
+        "nauc_map_at_1000_diff1": 0.20155,
+        "nauc_recall_at_1_max": 0.063667,
+        "nauc_recall_at_1_std": -0.095273,
+        "nauc_recall_at_1_diff1": 0.405486,
+        "nauc_recall_at_3_max": 0.069648,
+        "nauc_recall_at_3_std": -0.085502,
+        "nauc_recall_at_3_diff1": 0.238562,
+        "nauc_recall_at_5_max": 0.055634,
+        "nauc_recall_at_5_std": -0.061343,
+        "nauc_recall_at_5_diff1": 0.147529,
+        "nauc_recall_at_10_max": 0.072092,
+        "nauc_recall_at_10_std": -0.015986,
+        "nauc_recall_at_10_diff1": 0.105826,
+        "nauc_recall_at_20_max": 0.103113,
+        "nauc_recall_at_20_std": 0.049226,
+        "nauc_recall_at_20_diff1": 0.039898,
+        "nauc_recall_at_100_max": 0.107607,
+        "nauc_recall_at_100_std": 0.16609,
+        "nauc_recall_at_100_diff1": -0.024008,
+        "nauc_recall_at_1000_max": 0.398319,
+        "nauc_recall_at_1000_std": 0.593247,
+        "nauc_recall_at_1000_diff1": 0.156018,
+        "nauc_precision_at_1_max": 0.051429,
+        "nauc_precision_at_1_std": 0.015178,
+        "nauc_precision_at_1_diff1": 0.237081,
+        "nauc_precision_at_3_max": 0.091523,
+        "nauc_precision_at_3_std": 0.137428,
+        "nauc_precision_at_3_diff1": 0.065129,
+        "nauc_precision_at_5_max": 0.076653,
+        "nauc_precision_at_5_std": 0.16847,
+        "nauc_precision_at_5_diff1": -0.055667,
+        "nauc_precision_at_10_max": 0.084657,
+        "nauc_precision_at_10_std": 0.191723,
+        "nauc_precision_at_10_diff1": -0.085801,
+        "nauc_precision_at_20_max": 0.102731,
+        "nauc_precision_at_20_std": 0.226983,
+        "nauc_precision_at_20_diff1": -0.094439,
+        "nauc_precision_at_100_max": 0.070998,
+        "nauc_precision_at_100_std": 0.219767,
+        "nauc_precision_at_100_diff1": -0.106894,
+        "nauc_precision_at_1000_max": 0.050306,
+        "nauc_precision_at_1000_std": 0.183655,
+        "nauc_precision_at_1000_diff1": -0.094048,
+        "nauc_mrr_at_1_max": 0.051429,
+        "nauc_mrr_at_1_std": 0.015178,
+        "nauc_mrr_at_1_diff1": 0.237081,
+        "nauc_mrr_at_3_max": 0.092537,
+        "nauc_mrr_at_3_std": 0.04498,
+        "nauc_mrr_at_3_diff1": 0.227897,
+        "nauc_mrr_at_5_max": 0.089558,
+        "nauc_mrr_at_5_std": 0.046116,
+        "nauc_mrr_at_5_diff1": 0.213452,
+        "nauc_mrr_at_10_max": 0.095139,
+        "nauc_mrr_at_10_std": 0.053584,
+        "nauc_mrr_at_10_diff1": 0.216559,
+        "nauc_mrr_at_20_max": 0.091932,
+        "nauc_mrr_at_20_std": 0.050724,
+        "nauc_mrr_at_20_diff1": 0.21575,
+        "nauc_mrr_at_100_max": 0.091152,
+        "nauc_mrr_at_100_std": 0.050492,
+        "nauc_mrr_at_100_diff1": 0.217133,
+        "nauc_mrr_at_1000_max": 0.090963,
+        "nauc_mrr_at_1000_std": 0.050184,
+        "nauc_mrr_at_1000_diff1": 0.217224,
+        "hit_rate_at_1": 0.41391,
+        "hit_rate_at_3": 0.70199,
+        "hit_rate_at_5": 0.79801,
+        "hit_rate_at_10": 0.87748,
+        "hit_rate_at_20": 0.94371,
+        "hit_rate_at_100": 0.97351,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.46106,
+        "hf_subset": "french",
+        "languages": [
+          "fra-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.38079,
+        "ndcg_at_3": 0.40621,
+        "ndcg_at_5": 0.42043,
+        "ndcg_at_10": 0.44759,
+        "ndcg_at_20": 0.49185,
+        "ndcg_at_100": 0.57122,
+        "ndcg_at_1000": 0.60333,
+        "map_at_1": 0.14476,
+        "map_at_3": 0.22492,
+        "map_at_5": 0.26061,
+        "map_at_10": 0.30871,
+        "map_at_20": 0.34589,
+        "map_at_100": 0.38098,
+        "map_at_1000": 0.38614,
+        "recall_at_1": 0.14476,
+        "recall_at_3": 0.28572,
+        "recall_at_5": 0.36053,
+        "recall_at_10": 0.47824,
+        "recall_at_20": 0.61248,
+        "recall_at_100": 0.84606,
+        "recall_at_1000": 0.99092,
+        "accuracy": 0.14476,
+        "precision_at_1": 0.40728,
+        "precision_at_3": 0.33113,
+        "precision_at_5": 0.29205,
+        "precision_at_10": 0.2351,
+        "precision_at_20": 0.16937,
+        "precision_at_100": 0.05685,
+        "precision_at_1000": 0.00712,
+        "mrr_at_1": 0.407285,
+        "mrr_at_3": 0.532561,
+        "mrr_at_5": 0.553422,
+        "mrr_at_10": 0.564246,
+        "mrr_at_20": 0.569664,
+        "mrr_at_100": 0.570497,
+        "mrr_at_1000": 0.570607,
+        "nauc_ndcg_at_1_max": -0.009872,
+        "nauc_ndcg_at_1_std": -0.060567,
+        "nauc_ndcg_at_1_diff1": 0.269345,
+        "nauc_ndcg_at_3_max": 0.038372,
+        "nauc_ndcg_at_3_std": -0.056052,
+        "nauc_ndcg_at_3_diff1": 0.219382,
+        "nauc_ndcg_at_5_max": 0.071374,
+        "nauc_ndcg_at_5_std": -0.030921,
+        "nauc_ndcg_at_5_diff1": 0.184505,
+        "nauc_ndcg_at_10_max": 0.076178,
+        "nauc_ndcg_at_10_std": -0.028355,
+        "nauc_ndcg_at_10_diff1": 0.176941,
+        "nauc_ndcg_at_20_max": 0.073703,
+        "nauc_ndcg_at_20_std": -0.016006,
+        "nauc_ndcg_at_20_diff1": 0.181784,
+        "nauc_ndcg_at_100_max": 0.089238,
+        "nauc_ndcg_at_100_std": 0.022926,
+        "nauc_ndcg_at_100_diff1": 0.201873,
+        "nauc_ndcg_at_1000_max": 0.078401,
+        "nauc_ndcg_at_1000_std": 0.008285,
+        "nauc_ndcg_at_1000_diff1": 0.209384,
+        "nauc_map_at_1_max": 0.020993,
+        "nauc_map_at_1_std": -0.166767,
+        "nauc_map_at_1_diff1": 0.35723,
+        "nauc_map_at_3_max": 0.019873,
+        "nauc_map_at_3_std": -0.157348,
+        "nauc_map_at_3_diff1": 0.258108,
+        "nauc_map_at_5_max": 0.033299,
+        "nauc_map_at_5_std": -0.130911,
+        "nauc_map_at_5_diff1": 0.218716,
+        "nauc_map_at_10_max": 0.043474,
+        "nauc_map_at_10_std": -0.098496,
+        "nauc_map_at_10_diff1": 0.197115,
+        "nauc_map_at_20_max": 0.053599,
+        "nauc_map_at_20_std": -0.067417,
+        "nauc_map_at_20_diff1": 0.192395,
+        "nauc_map_at_100_max": 0.063301,
+        "nauc_map_at_100_std": -0.043927,
+        "nauc_map_at_100_diff1": 0.194341,
+        "nauc_map_at_1000_max": 0.062705,
+        "nauc_map_at_1000_std": -0.04352,
+        "nauc_map_at_1000_diff1": 0.195678,
+        "nauc_recall_at_1_max": 0.020993,
+        "nauc_recall_at_1_std": -0.166767,
+        "nauc_recall_at_1_diff1": 0.35723,
+        "nauc_recall_at_3_max": 0.037923,
+        "nauc_recall_at_3_std": -0.134303,
+        "nauc_recall_at_3_diff1": 0.195688,
+        "nauc_recall_at_5_max": 0.070747,
+        "nauc_recall_at_5_std": -0.080207,
+        "nauc_recall_at_5_diff1": 0.115583,
+        "nauc_recall_at_10_max": 0.090098,
+        "nauc_recall_at_10_std": -0.024563,
+        "nauc_recall_at_10_diff1": 0.069122,
+        "nauc_recall_at_20_max": 0.080725,
+        "nauc_recall_at_20_std": 0.014443,
+        "nauc_recall_at_20_diff1": 0.064214,
+        "nauc_recall_at_100_max": 0.156411,
+        "nauc_recall_at_100_std": 0.180651,
+        "nauc_recall_at_100_diff1": 0.102852,
+        "nauc_recall_at_1000_max": 0.331438,
+        "nauc_recall_at_1000_std": 0.600386,
+        "nauc_recall_at_1000_diff1": 0.196898,
+        "nauc_precision_at_1_max": -0.018192,
+        "nauc_precision_at_1_std": -0.067809,
+        "nauc_precision_at_1_diff1": 0.269193,
+        "nauc_precision_at_3_max": 0.022478,
+        "nauc_precision_at_3_std": 0.027697,
+        "nauc_precision_at_3_diff1": 0.037429,
+        "nauc_precision_at_5_max": 0.064991,
+        "nauc_precision_at_5_std": 0.113289,
+        "nauc_precision_at_5_diff1": -0.05075,
+        "nauc_precision_at_10_max": 0.066867,
+        "nauc_precision_at_10_std": 0.143898,
+        "nauc_precision_at_10_diff1": -0.045024,
+        "nauc_precision_at_20_max": 0.07254,
+        "nauc_precision_at_20_std": 0.19413,
+        "nauc_precision_at_20_diff1": -0.037984,
+        "nauc_precision_at_100_max": 0.062051,
+        "nauc_precision_at_100_std": 0.208322,
+        "nauc_precision_at_100_diff1": -0.049645,
+        "nauc_precision_at_1000_max": 0.037167,
+        "nauc_precision_at_1000_std": 0.163449,
+        "nauc_precision_at_1000_diff1": -0.050117,
+        "nauc_mrr_at_1_max": -0.018192,
+        "nauc_mrr_at_1_std": -0.067809,
+        "nauc_mrr_at_1_diff1": 0.269193,
+        "nauc_mrr_at_3_max": 0.0113,
+        "nauc_mrr_at_3_std": -0.054373,
+        "nauc_mrr_at_3_diff1": 0.254862,
+        "nauc_mrr_at_5_max": 0.023073,
+        "nauc_mrr_at_5_std": -0.038645,
+        "nauc_mrr_at_5_diff1": 0.251749,
+        "nauc_mrr_at_10_max": 0.026037,
+        "nauc_mrr_at_10_std": -0.035978,
+        "nauc_mrr_at_10_diff1": 0.250341,
+        "nauc_mrr_at_20_max": 0.021227,
+        "nauc_mrr_at_20_std": -0.039277,
+        "nauc_mrr_at_20_diff1": 0.252075,
+        "nauc_mrr_at_100_max": 0.020919,
+        "nauc_mrr_at_100_std": -0.03921,
+        "nauc_mrr_at_100_diff1": 0.252765,
+        "nauc_mrr_at_1000_max": 0.020663,
+        "nauc_mrr_at_1000_std": -0.03951,
+        "nauc_mrr_at_1000_diff1": 0.252779,
+        "hit_rate_at_1": 0.40728,
+        "hit_rate_at_3": 0.69536,
+        "hit_rate_at_5": 0.78808,
+        "hit_rate_at_10": 0.86755,
+        "hit_rate_at_20": 0.94371,
+        "hit_rate_at_100": 0.97351,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.44759,
+        "hf_subset": "spanish",
+        "languages": [
+          "spa-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.39073,
+        "ndcg_at_3": 0.40187,
+        "ndcg_at_5": 0.41172,
+        "ndcg_at_10": 0.44982,
+        "ndcg_at_20": 0.49261,
+        "ndcg_at_100": 0.56663,
+        "ndcg_at_1000": 0.60296,
+        "map_at_1": 0.14212,
+        "map_at_3": 0.22252,
+        "map_at_5": 0.25574,
+        "map_at_10": 0.30932,
+        "map_at_20": 0.34723,
+        "map_at_100": 0.37969,
+        "map_at_1000": 0.38558,
+        "recall_at_1": 0.14212,
+        "recall_at_3": 0.27614,
+        "recall_at_5": 0.34216,
+        "recall_at_10": 0.47978,
+        "recall_at_20": 0.61393,
+        "recall_at_100": 0.83025,
+        "recall_at_1000": 0.99196,
+        "accuracy": 0.14212,
+        "precision_at_1": 0.42384,
+        "precision_at_3": 0.32671,
+        "precision_at_5": 0.28411,
+        "precision_at_10": 0.23841,
+        "precision_at_20": 0.17152,
+        "precision_at_100": 0.0549,
+        "precision_at_1000": 0.00711,
+        "mrr_at_1": 0.423841,
+        "mrr_at_3": 0.539183,
+        "mrr_at_5": 0.558554,
+        "mrr_at_10": 0.573712,
+        "mrr_at_20": 0.57838,
+        "mrr_at_100": 0.579944,
+        "mrr_at_1000": 0.580074,
+        "nauc_ndcg_at_1_max": 0.105982,
+        "nauc_ndcg_at_1_std": 0.00653,
+        "nauc_ndcg_at_1_diff1": 0.280737,
+        "nauc_ndcg_at_3_max": 0.134403,
+        "nauc_ndcg_at_3_std": 0.006174,
+        "nauc_ndcg_at_3_diff1": 0.220993,
+        "nauc_ndcg_at_5_max": 0.146812,
+        "nauc_ndcg_at_5_std": 0.013702,
+        "nauc_ndcg_at_5_diff1": 0.233072,
+        "nauc_ndcg_at_10_max": 0.15355,
+        "nauc_ndcg_at_10_std": 0.0191,
+        "nauc_ndcg_at_10_diff1": 0.203549,
+        "nauc_ndcg_at_20_max": 0.145169,
+        "nauc_ndcg_at_20_std": 0.033168,
+        "nauc_ndcg_at_20_diff1": 0.186313,
+        "nauc_ndcg_at_100_max": 0.16387,
+        "nauc_ndcg_at_100_std": 0.068923,
+        "nauc_ndcg_at_100_diff1": 0.193289,
+        "nauc_ndcg_at_1000_max": 0.15561,
+        "nauc_ndcg_at_1000_std": 0.059892,
+        "nauc_ndcg_at_1000_diff1": 0.195759,
+        "nauc_map_at_1_max": 0.113272,
+        "nauc_map_at_1_std": -0.079262,
+        "nauc_map_at_1_diff1": 0.392153,
+        "nauc_map_at_3_max": 0.108189,
+        "nauc_map_at_3_std": -0.08781,
+        "nauc_map_at_3_diff1": 0.30305,
+        "nauc_map_at_5_max": 0.124189,
+        "nauc_map_at_5_std": -0.056385,
+        "nauc_map_at_5_diff1": 0.275042,
+        "nauc_map_at_10_max": 0.133332,
+        "nauc_map_at_10_std": -0.034442,
+        "nauc_map_at_10_diff1": 0.225646,
+        "nauc_map_at_20_max": 0.129928,
+        "nauc_map_at_20_std": -0.015797,
+        "nauc_map_at_20_diff1": 0.204345,
+        "nauc_map_at_100_max": 0.142448,
+        "nauc_map_at_100_std": 0.007318,
+        "nauc_map_at_100_diff1": 0.197712,
+        "nauc_map_at_1000_max": 0.141196,
+        "nauc_map_at_1000_std": 0.00784,
+        "nauc_map_at_1000_diff1": 0.196876,
+        "nauc_recall_at_1_max": 0.113272,
+        "nauc_recall_at_1_std": -0.079262,
+        "nauc_recall_at_1_diff1": 0.392153,
+        "nauc_recall_at_3_max": 0.093116,
+        "nauc_recall_at_3_std": -0.098265,
+        "nauc_recall_at_3_diff1": 0.258598,
+        "nauc_recall_at_5_max": 0.127379,
+        "nauc_recall_at_5_std": -0.044542,
+        "nauc_recall_at_5_diff1": 0.242024,
+        "nauc_recall_at_10_max": 0.128992,
+        "nauc_recall_at_10_std": -0.011095,
+        "nauc_recall_at_10_diff1": 0.131602,
+        "nauc_recall_at_20_max": 0.092113,
+        "nauc_recall_at_20_std": 0.014887,
+        "nauc_recall_at_20_diff1": 0.068995,
+        "nauc_recall_at_100_max": 0.151499,
+        "nauc_recall_at_100_std": 0.143136,
+        "nauc_recall_at_100_diff1": 0.102095,
+        "nauc_recall_at_1000_max": 0.224418,
+        "nauc_recall_at_1000_std": 0.381629,
+        "nauc_recall_at_1000_diff1": 0.123288,
+        "nauc_precision_at_1_max": 0.130883,
+        "nauc_precision_at_1_std": 0.028568,
+        "nauc_precision_at_1_diff1": 0.264936,
+        "nauc_precision_at_3_max": 0.111988,
+        "nauc_precision_at_3_std": 0.066566,
+        "nauc_precision_at_3_diff1": 0.022228,
+        "nauc_precision_at_5_max": 0.097262,
+        "nauc_precision_at_5_std": 0.108055,
+        "nauc_precision_at_5_diff1": -0.039509,
+        "nauc_precision_at_10_max": 0.073627,
+        "nauc_precision_at_10_std": 0.133599,
+        "nauc_precision_at_10_diff1": -0.120898,
+        "nauc_precision_at_20_max": 0.044676,
+        "nauc_precision_at_20_std": 0.156183,
+        "nauc_precision_at_20_diff1": -0.136494,
+        "nauc_precision_at_100_max": 0.041886,
+        "nauc_precision_at_100_std": 0.169207,
+        "nauc_precision_at_100_diff1": -0.131003,
+        "nauc_precision_at_1000_max": 0.003444,
+        "nauc_precision_at_1000_std": 0.1302,
+        "nauc_precision_at_1000_diff1": -0.148155,
+        "nauc_mrr_at_1_max": 0.130883,
+        "nauc_mrr_at_1_std": 0.028568,
+        "nauc_mrr_at_1_diff1": 0.264936,
+        "nauc_mrr_at_3_max": 0.161566,
+        "nauc_mrr_at_3_std": 0.051424,
+        "nauc_mrr_at_3_diff1": 0.253169,
+        "nauc_mrr_at_5_max": 0.165499,
+        "nauc_mrr_at_5_std": 0.052268,
+        "nauc_mrr_at_5_diff1": 0.262682,
+        "nauc_mrr_at_10_max": 0.165563,
+        "nauc_mrr_at_10_std": 0.060193,
+        "nauc_mrr_at_10_diff1": 0.252029,
+        "nauc_mrr_at_20_max": 0.16442,
+        "nauc_mrr_at_20_std": 0.059469,
+        "nauc_mrr_at_20_diff1": 0.252389,
+        "nauc_mrr_at_100_max": 0.163364,
+        "nauc_mrr_at_100_std": 0.058266,
+        "nauc_mrr_at_100_diff1": 0.253477,
+        "nauc_mrr_at_1000_max": 0.163357,
+        "nauc_mrr_at_1000_std": 0.058148,
+        "nauc_mrr_at_1000_diff1": 0.253323,
+        "hit_rate_at_1": 0.42384,
+        "hit_rate_at_3": 0.67219,
+        "hit_rate_at_5": 0.75828,
+        "hit_rate_at_10": 0.86755,
+        "hit_rate_at_20": 0.93046,
+        "hit_rate_at_100": 0.97682,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.44982,
+        "hf_subset": "english",
+        "languages": [
+          "eng-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.40397,
+        "ndcg_at_3": 0.42195,
+        "ndcg_at_5": 0.43529,
+        "ndcg_at_10": 0.45997,
+        "ndcg_at_20": 0.50182,
+        "ndcg_at_100": 0.58289,
+        "ndcg_at_1000": 0.61334,
+        "map_at_1": 0.14655,
+        "map_at_3": 0.22903,
+        "map_at_5": 0.26416,
+        "map_at_10": 0.31768,
+        "map_at_20": 0.35509,
+        "map_at_100": 0.39134,
+        "map_at_1000": 0.3965,
+        "recall_at_1": 0.14655,
+        "recall_at_3": 0.28782,
+        "recall_at_5": 0.35941,
+        "recall_at_10": 0.48002,
+        "recall_at_20": 0.6179,
+        "recall_at_100": 0.85767,
+        "recall_at_1000": 0.99032,
+        "accuracy": 0.14655,
+        "precision_at_1": 0.4404,
+        "precision_at_3": 0.34437,
+        "precision_at_5": 0.30331,
+        "precision_at_10": 0.2447,
+        "precision_at_20": 0.17434,
+        "precision_at_100": 0.05748,
+        "precision_at_1000": 0.00714,
+        "mrr_at_1": 0.440397,
+        "mrr_at_3": 0.562362,
+        "mrr_at_5": 0.582892,
+        "mrr_at_10": 0.591158,
+        "mrr_at_20": 0.596029,
+        "mrr_at_100": 0.597734,
+        "mrr_at_1000": 0.59778,
+        "nauc_ndcg_at_1_max": 0.014546,
+        "nauc_ndcg_at_1_std": -0.064463,
+        "nauc_ndcg_at_1_diff1": 0.229203,
+        "nauc_ndcg_at_3_max": 0.000539,
+        "nauc_ndcg_at_3_std": -0.076947,
+        "nauc_ndcg_at_3_diff1": 0.153389,
+        "nauc_ndcg_at_5_max": 0.003177,
+        "nauc_ndcg_at_5_std": -0.089058,
+        "nauc_ndcg_at_5_diff1": 0.154648,
+        "nauc_ndcg_at_10_max": 0.043994,
+        "nauc_ndcg_at_10_std": -0.057321,
+        "nauc_ndcg_at_10_diff1": 0.14361,
+        "nauc_ndcg_at_20_max": 0.05076,
+        "nauc_ndcg_at_20_std": -0.036375,
+        "nauc_ndcg_at_20_diff1": 0.153051,
+        "nauc_ndcg_at_100_max": 0.0463,
+        "nauc_ndcg_at_100_std": -0.014309,
+        "nauc_ndcg_at_100_diff1": 0.139075,
+        "nauc_ndcg_at_1000_max": 0.042781,
+        "nauc_ndcg_at_1000_std": -0.025213,
+        "nauc_ndcg_at_1000_diff1": 0.152384,
+        "nauc_map_at_1_max": 0.045207,
+        "nauc_map_at_1_std": -0.151774,
+        "nauc_map_at_1_diff1": 0.414472,
+        "nauc_map_at_3_max": 0.018473,
+        "nauc_map_at_3_std": -0.137647,
+        "nauc_map_at_3_diff1": 0.262616,
+        "nauc_map_at_5_max": 0.013197,
+        "nauc_map_at_5_std": -0.137315,
+        "nauc_map_at_5_diff1": 0.237288,
+        "nauc_map_at_10_max": 0.034694,
+        "nauc_map_at_10_std": -0.103334,
+        "nauc_map_at_10_diff1": 0.188739,
+        "nauc_map_at_20_max": 0.045866,
+        "nauc_map_at_20_std": -0.075155,
+        "nauc_map_at_20_diff1": 0.178852,
+        "nauc_map_at_100_max": 0.047024,
+        "nauc_map_at_100_std": -0.060396,
+        "nauc_map_at_100_diff1": 0.169224,
+        "nauc_map_at_1000_max": 0.046457,
+        "nauc_map_at_1000_std": -0.060714,
+        "nauc_map_at_1000_diff1": 0.170714,
+        "nauc_recall_at_1_max": 0.045207,
+        "nauc_recall_at_1_std": -0.151774,
+        "nauc_recall_at_1_diff1": 0.414472,
+        "nauc_recall_at_3_max": 0.002105,
+        "nauc_recall_at_3_std": -0.122924,
+        "nauc_recall_at_3_diff1": 0.165117,
+        "nauc_recall_at_5_max": -0.002077,
+        "nauc_recall_at_5_std": -0.122429,
+        "nauc_recall_at_5_diff1": 0.145148,
+        "nauc_recall_at_10_max": 0.069516,
+        "nauc_recall_at_10_std": -0.033464,
+        "nauc_recall_at_10_diff1": 0.059958,
+        "nauc_recall_at_20_max": 0.067696,
+        "nauc_recall_at_20_std": 0.017278,
+        "nauc_recall_at_20_diff1": 0.063603,
+        "nauc_recall_at_100_max": 0.047322,
+        "nauc_recall_at_100_std": 0.120301,
+        "nauc_recall_at_100_diff1": -0.014162,
+        "nauc_recall_at_1000_max": 0.057756,
+        "nauc_recall_at_1000_std": 0.507177,
+        "nauc_recall_at_1000_diff1": 0.111664,
+        "nauc_precision_at_1_max": 0.002998,
+        "nauc_precision_at_1_std": -0.084902,
+        "nauc_precision_at_1_diff1": 0.240616,
+        "nauc_precision_at_3_max": -0.030328,
+        "nauc_precision_at_3_std": -0.021786,
+        "nauc_precision_at_3_diff1": -0.05511,
+        "nauc_precision_at_5_max": -0.018019,
+        "nauc_precision_at_5_std": 0.017642,
+        "nauc_precision_at_5_diff1": -0.10247,
+        "nauc_precision_at_10_max": 0.028579,
+        "nauc_precision_at_10_std": 0.081201,
+        "nauc_precision_at_10_diff1": -0.126248,
+        "nauc_precision_at_20_max": 0.034872,
+        "nauc_precision_at_20_std": 0.119951,
+        "nauc_precision_at_20_diff1": -0.112329,
+        "nauc_precision_at_100_max": 0.016335,
+        "nauc_precision_at_100_std": 0.119889,
+        "nauc_precision_at_100_diff1": -0.125356,
+        "nauc_precision_at_1000_max": 0.007263,
+        "nauc_precision_at_1000_std": 0.095035,
+        "nauc_precision_at_1000_diff1": -0.103425,
+        "nauc_mrr_at_1_max": 0.002998,
+        "nauc_mrr_at_1_std": -0.084902,
+        "nauc_mrr_at_1_diff1": 0.240616,
+        "nauc_mrr_at_3_max": -0.021865,
+        "nauc_mrr_at_3_std": -0.091438,
+        "nauc_mrr_at_3_diff1": 0.1542,
+        "nauc_mrr_at_5_max": -0.012893,
+        "nauc_mrr_at_5_std": -0.082822,
+        "nauc_mrr_at_5_diff1": 0.164424,
+        "nauc_mrr_at_10_max": -0.001425,
+        "nauc_mrr_at_10_std": -0.073778,
+        "nauc_mrr_at_10_diff1": 0.167651,
+        "nauc_mrr_at_20_max": -0.005603,
+        "nauc_mrr_at_20_std": -0.076294,
+        "nauc_mrr_at_20_diff1": 0.169607,
+        "nauc_mrr_at_100_max": -0.007328,
+        "nauc_mrr_at_100_std": -0.077772,
+        "nauc_mrr_at_100_diff1": 0.169478,
+        "nauc_mrr_at_1000_max": -0.007338,
+        "nauc_mrr_at_1000_std": -0.077877,
+        "nauc_mrr_at_1000_diff1": 0.169429,
+        "hit_rate_at_1": 0.4404,
+        "hit_rate_at_3": 0.70861,
+        "hit_rate_at_5": 0.79801,
+        "hit_rate_at_10": 0.86093,
+        "hit_rate_at_20": 0.92715,
+        "hit_rate_at_100": 0.98675,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.45997,
+        "hf_subset": "german",
+        "languages": [
+          "deu-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.38411,
+        "ndcg_at_3": 0.40778,
+        "ndcg_at_5": 0.41683,
+        "ndcg_at_10": 0.45142,
+        "ndcg_at_20": 0.49107,
+        "ndcg_at_100": 0.57228,
+        "ndcg_at_1000": 0.60562,
+        "map_at_1": 0.14498,
+        "map_at_3": 0.2224,
+        "map_at_5": 0.25663,
+        "map_at_10": 0.30971,
+        "map_at_20": 0.34558,
+        "map_at_100": 0.38203,
+        "map_at_1000": 0.38764,
+        "recall_at_1": 0.14498,
+        "recall_at_3": 0.27444,
+        "recall_at_5": 0.34799,
+        "recall_at_10": 0.48427,
+        "recall_at_20": 0.6115,
+        "recall_at_100": 0.84286,
+        "recall_at_1000": 0.99279,
+        "accuracy": 0.14498,
+        "precision_at_1": 0.41391,
+        "precision_at_3": 0.33444,
+        "precision_at_5": 0.28742,
+        "precision_at_10": 0.23775,
+        "precision_at_20": 0.16887,
+        "precision_at_100": 0.05679,
+        "precision_at_1000": 0.00713,
+        "mrr_at_1": 0.413907,
+        "mrr_at_3": 0.532009,
+        "mrr_at_5": 0.552042,
+        "mrr_at_10": 0.566215,
+        "mrr_at_20": 0.57119,
+        "mrr_at_100": 0.572689,
+        "mrr_at_1000": 0.572811,
+        "nauc_ndcg_at_1_max": -0.004285,
+        "nauc_ndcg_at_1_std": -0.064431,
+        "nauc_ndcg_at_1_diff1": 0.227089,
+        "nauc_ndcg_at_3_max": 0.046069,
+        "nauc_ndcg_at_3_std": -0.017066,
+        "nauc_ndcg_at_3_diff1": 0.207588,
+        "nauc_ndcg_at_5_max": 0.054012,
+        "nauc_ndcg_at_5_std": -0.018591,
+        "nauc_ndcg_at_5_diff1": 0.180942,
+        "nauc_ndcg_at_10_max": 0.04062,
+        "nauc_ndcg_at_10_std": -0.026213,
+        "nauc_ndcg_at_10_diff1": 0.163499,
+        "nauc_ndcg_at_20_max": 0.045317,
+        "nauc_ndcg_at_20_std": -0.010668,
+        "nauc_ndcg_at_20_diff1": 0.152064,
+        "nauc_ndcg_at_100_max": 0.056125,
+        "nauc_ndcg_at_100_std": 0.018109,
+        "nauc_ndcg_at_100_diff1": 0.173219,
+        "nauc_ndcg_at_1000_max": 0.05691,
+        "nauc_ndcg_at_1000_std": 0.011402,
+        "nauc_ndcg_at_1000_diff1": 0.170822,
+        "nauc_map_at_1_max": 0.021634,
+        "nauc_map_at_1_std": -0.166289,
+        "nauc_map_at_1_diff1": 0.402974,
+        "nauc_map_at_3_max": 0.015939,
+        "nauc_map_at_3_std": -0.137621,
+        "nauc_map_at_3_diff1": 0.310226,
+        "nauc_map_at_5_max": 0.019866,
+        "nauc_map_at_5_std": -0.118186,
+        "nauc_map_at_5_diff1": 0.259395,
+        "nauc_map_at_10_max": 0.016161,
+        "nauc_map_at_10_std": -0.091456,
+        "nauc_map_at_10_diff1": 0.214239,
+        "nauc_map_at_20_max": 0.028943,
+        "nauc_map_at_20_std": -0.062595,
+        "nauc_map_at_20_diff1": 0.190446,
+        "nauc_map_at_100_max": 0.034771,
+        "nauc_map_at_100_std": -0.043028,
+        "nauc_map_at_100_diff1": 0.190576,
+        "nauc_map_at_1000_max": 0.03561,
+        "nauc_map_at_1000_std": -0.041387,
+        "nauc_map_at_1000_diff1": 0.190808,
+        "nauc_recall_at_1_max": 0.021634,
+        "nauc_recall_at_1_std": -0.166289,
+        "nauc_recall_at_1_diff1": 0.402974,
+        "nauc_recall_at_3_max": 0.027145,
+        "nauc_recall_at_3_std": -0.111907,
+        "nauc_recall_at_3_diff1": 0.265604,
+        "nauc_recall_at_5_max": 0.040515,
+        "nauc_recall_at_5_std": -0.081116,
+        "nauc_recall_at_5_diff1": 0.174196,
+        "nauc_recall_at_10_max": 0.035096,
+        "nauc_recall_at_10_std": -0.035547,
+        "nauc_recall_at_10_diff1": 0.104621,
+        "nauc_recall_at_20_max": 0.037018,
+        "nauc_recall_at_20_std": 0.009488,
+        "nauc_recall_at_20_diff1": 0.070533,
+        "nauc_recall_at_100_max": 0.065351,
+        "nauc_recall_at_100_std": 0.125696,
+        "nauc_recall_at_100_diff1": 0.119167,
+        "nauc_recall_at_1000_max": 0.369729,
+        "nauc_recall_at_1000_std": 0.613228,
+        "nauc_recall_at_1000_diff1": 0.197288,
+        "nauc_precision_at_1_max": -0.008666,
+        "nauc_precision_at_1_std": -0.070464,
+        "nauc_precision_at_1_diff1": 0.233971,
+        "nauc_precision_at_3_max": 0.043071,
+        "nauc_precision_at_3_std": 0.073328,
+        "nauc_precision_at_3_diff1": 0.015074,
+        "nauc_precision_at_5_max": 0.044734,
+        "nauc_precision_at_5_std": 0.116308,
+        "nauc_precision_at_5_diff1": -0.097607,
+        "nauc_precision_at_10_max": 0.021753,
+        "nauc_precision_at_10_std": 0.131164,
+        "nauc_precision_at_10_diff1": -0.155062,
+        "nauc_precision_at_20_max": 0.047726,
+        "nauc_precision_at_20_std": 0.17438,
+        "nauc_precision_at_20_diff1": -0.157851,
+        "nauc_precision_at_100_max": 0.047351,
+        "nauc_precision_at_100_std": 0.178341,
+        "nauc_precision_at_100_diff1": -0.10894,
+        "nauc_precision_at_1000_max": 0.040992,
+        "nauc_precision_at_1000_std": 0.149998,
+        "nauc_precision_at_1000_diff1": -0.120856,
+        "nauc_mrr_at_1_max": -0.008666,
+        "nauc_mrr_at_1_std": -0.070464,
+        "nauc_mrr_at_1_diff1": 0.233971,
+        "nauc_mrr_at_3_max": 0.030276,
+        "nauc_mrr_at_3_std": -0.026138,
+        "nauc_mrr_at_3_diff1": 0.223088,
+        "nauc_mrr_at_5_max": 0.03054,
+        "nauc_mrr_at_5_std": -0.026897,
+        "nauc_mrr_at_5_diff1": 0.214519,
+        "nauc_mrr_at_10_max": 0.035842,
+        "nauc_mrr_at_10_std": -0.019015,
+        "nauc_mrr_at_10_diff1": 0.210393,
+        "nauc_mrr_at_20_max": 0.029967,
+        "nauc_mrr_at_20_std": -0.022446,
+        "nauc_mrr_at_20_diff1": 0.210746,
+        "nauc_mrr_at_100_max": 0.03051,
+        "nauc_mrr_at_100_std": -0.022637,
+        "nauc_mrr_at_100_diff1": 0.211907,
+        "nauc_mrr_at_1000_max": 0.030395,
+        "nauc_mrr_at_1000_std": -0.022794,
+        "nauc_mrr_at_1000_diff1": 0.21199,
+        "hit_rate_at_1": 0.41391,
+        "hit_rate_at_3": 0.6755,
+        "hit_rate_at_5": 0.76159,
+        "hit_rate_at_10": 0.86424,
+        "hit_rate_at_20": 0.93046,
+        "hit_rate_at_100": 0.97682,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.45142,
+        "hf_subset": "italian",
+        "languages": [
+          "ita-Latn"
+        ]
+      },
+      {
+        "ndcg_at_1": 0.39735,
+        "ndcg_at_3": 0.41332,
+        "ndcg_at_5": 0.42865,
+        "ndcg_at_10": 0.45679,
+        "ndcg_at_20": 0.50164,
+        "ndcg_at_100": 0.5804,
+        "ndcg_at_1000": 0.61094,
+        "map_at_1": 0.1537,
+        "map_at_3": 0.22809,
+        "map_at_5": 0.26684,
+        "map_at_10": 0.31552,
+        "map_at_20": 0.35486,
+        "map_at_100": 0.38937,
+        "map_at_1000": 0.39443,
+        "recall_at_1": 0.1537,
+        "recall_at_3": 0.2843,
+        "recall_at_5": 0.37126,
+        "recall_at_10": 0.49009,
+        "recall_at_20": 0.62544,
+        "recall_at_100": 0.85655,
+        "recall_at_1000": 0.99204,
+        "accuracy": 0.1537,
+        "precision_at_1": 0.42384,
+        "precision_at_3": 0.33775,
+        "precision_at_5": 0.29536,
+        "precision_at_10": 0.23742,
+        "precision_at_20": 0.17351,
+        "precision_at_100": 0.05725,
+        "precision_at_1000": 0.00713,
+        "mrr_at_1": 0.423841,
+        "mrr_at_3": 0.544702,
+        "mrr_at_5": 0.565066,
+        "mrr_at_10": 0.577794,
+        "mrr_at_20": 0.582185,
+        "mrr_at_100": 0.583129,
+        "mrr_at_1000": 0.583232,
+        "nauc_ndcg_at_1_max": -0.054376,
+        "nauc_ndcg_at_1_std": -0.092107,
+        "nauc_ndcg_at_1_diff1": 0.224344,
+        "nauc_ndcg_at_3_max": 0.014208,
+        "nauc_ndcg_at_3_std": -0.054572,
+        "nauc_ndcg_at_3_diff1": 0.199808,
+        "nauc_ndcg_at_5_max": 0.004174,
+        "nauc_ndcg_at_5_std": -0.06655,
+        "nauc_ndcg_at_5_diff1": 0.16845,
+        "nauc_ndcg_at_10_max": 0.011868,
+        "nauc_ndcg_at_10_std": -0.059768,
+        "nauc_ndcg_at_10_diff1": 0.165756,
+        "nauc_ndcg_at_20_max": 0.013211,
+        "nauc_ndcg_at_20_std": -0.049409,
+        "nauc_ndcg_at_20_diff1": 0.158997,
+        "nauc_ndcg_at_100_max": 0.027959,
+        "nauc_ndcg_at_100_std": -0.010053,
+        "nauc_ndcg_at_100_diff1": 0.183309,
+        "nauc_ndcg_at_1000_max": 0.022635,
+        "nauc_ndcg_at_1000_std": -0.017947,
+        "nauc_ndcg_at_1000_diff1": 0.182953,
+        "nauc_map_at_1_max": -0.031391,
+        "nauc_map_at_1_std": -0.168142,
+        "nauc_map_at_1_diff1": 0.297563,
+        "nauc_map_at_3_max": -0.0196,
+        "nauc_map_at_3_std": -0.166546,
+        "nauc_map_at_3_diff1": 0.247893,
+        "nauc_map_at_5_max": -0.028659,
+        "nauc_map_at_5_std": -0.160161,
+        "nauc_map_at_5_diff1": 0.215908,
+        "nauc_map_at_10_max": -0.020981,
+        "nauc_map_at_10_std": -0.125848,
+        "nauc_map_at_10_diff1": 0.184726,
+        "nauc_map_at_20_max": -0.008453,
+        "nauc_map_at_20_std": -0.096422,
+        "nauc_map_at_20_diff1": 0.169251,
+        "nauc_map_at_100_max": -0.00295,
+        "nauc_map_at_100_std": -0.075644,
+        "nauc_map_at_100_diff1": 0.168494,
+        "nauc_map_at_1000_max": -0.002732,
+        "nauc_map_at_1000_std": -0.074191,
+        "nauc_map_at_1000_diff1": 0.169031,
+        "nauc_recall_at_1_max": -0.031391,
+        "nauc_recall_at_1_std": -0.168142,
+        "nauc_recall_at_1_diff1": 0.297563,
+        "nauc_recall_at_3_max": 0.019681,
+        "nauc_recall_at_3_std": -0.146245,
+        "nauc_recall_at_3_diff1": 0.209447,
+        "nauc_recall_at_5_max": -0.010695,
+        "nauc_recall_at_5_std": -0.147334,
+        "nauc_recall_at_5_diff1": 0.151765,
+        "nauc_recall_at_10_max": 0.022547,
+        "nauc_recall_at_10_std": -0.070958,
+        "nauc_recall_at_10_diff1": 0.117001,
+        "nauc_recall_at_20_max": 0.010161,
+        "nauc_recall_at_20_std": -0.040602,
+        "nauc_recall_at_20_diff1": 0.071172,
+        "nauc_recall_at_100_max": 0.099626,
+        "nauc_recall_at_100_std": 0.142626,
+        "nauc_recall_at_100_diff1": 0.12898,
+        "nauc_recall_at_1000_max": 0.288406,
+        "nauc_recall_at_1000_std": 0.516977,
+        "nauc_recall_at_1000_diff1": 0.238679,
+        "nauc_precision_at_1_max": -0.069052,
+        "nauc_precision_at_1_std": -0.09767,
+        "nauc_precision_at_1_diff1": 0.229013,
+        "nauc_precision_at_3_max": 0.02031,
+        "nauc_precision_at_3_std": 0.038267,
+        "nauc_precision_at_3_diff1": 0.034972,
+        "nauc_precision_at_5_max": 0.014313,
+        "nauc_precision_at_5_std": 0.079875,
+        "nauc_precision_at_5_diff1": -0.061682,
+        "nauc_precision_at_10_max": 0.035214,
+        "nauc_precision_at_10_std": 0.134009,
+        "nauc_precision_at_10_diff1": -0.096527,
+        "nauc_precision_at_20_max": 0.043098,
+        "nauc_precision_at_20_std": 0.166149,
+        "nauc_precision_at_20_diff1": -0.108159,
+        "nauc_precision_at_100_max": 0.032815,
+        "nauc_precision_at_100_std": 0.175851,
+        "nauc_precision_at_100_diff1": -0.072528,
+        "nauc_precision_at_1000_max": 0.02267,
+        "nauc_precision_at_1000_std": 0.151667,
+        "nauc_precision_at_1000_diff1": -0.080468,
+        "nauc_mrr_at_1_max": -0.069052,
+        "nauc_mrr_at_1_std": -0.09767,
+        "nauc_mrr_at_1_diff1": 0.229013,
+        "nauc_mrr_at_3_max": 0.008765,
+        "nauc_mrr_at_3_std": -0.045873,
+        "nauc_mrr_at_3_diff1": 0.222825,
+        "nauc_mrr_at_5_max": -0.001701,
+        "nauc_mrr_at_5_std": -0.050352,
+        "nauc_mrr_at_5_diff1": 0.222003,
+        "nauc_mrr_at_10_max": 0.001838,
+        "nauc_mrr_at_10_std": -0.045308,
+        "nauc_mrr_at_10_diff1": 0.225602,
+        "nauc_mrr_at_20_max": -0.005576,
+        "nauc_mrr_at_20_std": -0.049632,
+        "nauc_mrr_at_20_diff1": 0.222597,
+        "nauc_mrr_at_100_max": -0.004591,
+        "nauc_mrr_at_100_std": -0.049133,
+        "nauc_mrr_at_100_diff1": 0.223861,
+        "nauc_mrr_at_1000_max": -0.004792,
+        "nauc_mrr_at_1000_std": -0.049414,
+        "nauc_mrr_at_1000_diff1": 0.223815,
+        "hit_rate_at_1": 0.42384,
+        "hit_rate_at_3": 0.69868,
+        "hit_rate_at_5": 0.79139,
+        "hit_rate_at_10": 0.88411,
+        "hit_rate_at_20": 0.94371,
+        "hit_rate_at_100": 0.97682,
+        "hit_rate_at_1000": 1.0,
+        "main_score": 0.45679,
+        "hf_subset": "portuguese",
+        "languages": [
+          "por-Latn"
+        ]
+      }
+    ]
+  },
+  "evaluation_time": 1623.4848849773407,
+  "kg_co2_emissions": null,
+  "date": null
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc8d3a0ce36466ccc1278bf987df5f71db1719b9ca6b4118264f45cb627bfe0f
+size 32169626

tokenizer_config.json

@@ -0,0 +1,95 @@
+{
+  "audio_token": "<|audio|>",
+  "backend": "tokenizers",
+  "boa_token": "<|audio>",
+  "boi_token": "<|image>",
+  "bos_token": "<bos>",
+  "eoa_token": "<audio|>",
+  "eoc_token": "<channel|>",
+  "eoi_token": "<image|>",
+  "eos_token": "<eos>",
+  "eot_token": "<turn|>",
+  "escape_token": "<|\"|>",
+  "etc_token": "<tool_call|>",
+  "etd_token": "<tool|>",
+  "etr_token": "<tool_response|>",
+  "extra_special_tokens": [
+    "<|video|>"
+  ],
+  "image_token": "<|image|>",
+  "is_local": false,
+  "mask_token": "<mask>",
+  "model_max_length": 1000000000000000019884624838656,
+  "model_specific_special_tokens": {
+    "audio_token": "<|audio|>",
+    "boa_token": "<|audio>",
+    "boi_token": "<|image>",
+    "eoa_token": "<audio|>",
+    "eoc_token": "<channel|>",
+    "eoi_token": "<image|>",
+    "eot_token": "<turn|>",
+    "escape_token": "<|\"|>",
+    "etc_token": "<tool_call|>",
+    "etd_token": "<tool|>",
+    "etr_token": "<tool_response|>",
+    "image_token": "<|image|>",
+    "soc_token": "<|channel>",
+    "sot_token": "<|turn>",
+    "stc_token": "<|tool_call>",
+    "std_token": "<|tool>",
+    "str_token": "<|tool_response>",
+    "think_token": "<|think|>"
+  },
+  "pad_token": "<pad>",
+  "padding_side": "left",
+  "processor_class": "ColGemma4Processor",
+  "response_schema": {
+    "properties": {
+      "content": {
+        "type": "string"
+      },
+      "role": {
+        "const": "assistant"
+      },
+      "thinking": {
+        "type": "string"
+      },
+      "tool_calls": {
+        "items": {
+          "properties": {
+            "function": {
+              "properties": {
+                "arguments": {
+                  "additionalProperties": {},
+                  "type": "object",
+                  "x-parser": "gemma4-tool-call"
+                },
+                "name": {
+                  "type": "string"
+                }
+              },
+              "type": "object",
+              "x-regex": "call\\:(?P<name>\\w+)(?P<arguments>\\{.*\\})"
+            },
+            "type": {
+              "const": "function"
+            }
+          },
+          "type": "object"
+        },
+        "type": "array",
+        "x-regex-iterator": "<\\|tool_call>(.*?)<tool_call\\|>"
+      }
+    },
+    "type": "object",
+    "x-regex": "(\\<\\|channel\\>thought\\n(?P<thinking>.*?)\\<channel\\|\\>)?(?P<tool_calls>\\<\\|tool_call\\>.*\\<tool_call\\|\\>)?(?P<content>(?:(?!\\<turn\\|\\>)(?!\\<\\|tool_response\\>).)+)?(?:\\<turn\\|\\>|\\<\\|tool_response\\>)?"
+  },
+  "soc_token": "<|channel>",
+  "sot_token": "<|turn>",
+  "stc_token": "<|tool_call>",
+  "std_token": "<|tool>",
+  "str_token": "<|tool_response>",
+  "think_token": "<|think|>",
+  "tokenizer_class": "GemmaTokenizer",
+  "unk_token": "<unk>"
+}