first batch of gguf files

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,52 @@
----
-license: cc-by-nc-4.0
----
+---
+pipeline_tag: feature-extraction
+tags:
+- gguf
+- embedding
+- eurobert
+- llama-cpp
+- jina-embeddings-v5
+language:
+- multilingual
+base_model: jinaai/jina-embeddings-v5-text-nano
+base_model_relation: quantized
+inference: false
+license: cc-by-nc-4.0
+library_name: llama.cpp
+---
+
+# jina-embeddings-v5-text-nano-clustering-GGUF
+
+GGUF quantizations of [jina-embeddings-v5-text-nano-clustering](https://huggingface.co/jinaai/jina-embeddings-v5-text-nano) using llama.cpp. A 239M parameter multilingual embedding model quantized for efficient inference.
+
+> [!IMPORTANT]
+> We highly recommend to first read [this blog post for more technical details and customized llama.cpp build](https://jina.ai/news/optimizing-ggufs-for-decoder-only-embedding-models).
+
+## Overview
+
+`jina-embeddings-v5-text-nano-clustering` is a task-specific embedding model for **clustering**, part of the [jina-embeddings-v5-text](https://huggingface.co/jinaai/jina-embeddings-v5-text-nano) model family.
+
+| Feature | Value |
+| --- | --- |
+| Parameters | 239M |
+| Task | `clustering` |
+| Embedding Dimension | 768 |
+| Matryoshka Dimensions | 32, 64, 128, 256, 512, 768 |
+| Pooling Strategy | Last-token pooling |
+| Base Model | [jina-embeddings-v5-text-nano](https://huggingface.co/jinaai/jina-embeddings-v5-text-nano) |
+
+## Usage with llama.cpp
+
+```bash
+# Build llama.cpp (upstream)
+git clone https://github.com/ggml-org/llama.cpp
+cd llama.cpp && cmake -B build && cmake --build build --config Release
+
+# Run embedding
+./build/bin/llama-embedding -m jina-embeddings-v5-text-nano-clustering-Q8_0.gguf \
+  --pooling last -p "Your text here"
+```
+
+## License
+
+CC-BY-NC-4.0. For commercial use, please [contact us](https://jina.ai/contact-sales).

v5-nano-clustering-F16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:49cab26e1e155550bdfcc875ca6e92ccdeaf888afb6eb28eff9f81976407732c
+size 431395968