Instructions to use jinaai/jina-embeddings-v4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jinaai/jina-embeddings-v4 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("jinaai/jina-embeddings-v4", trust_remote_code=True, device_map="auto") - ColPali
How to use jinaai/jina-embeddings-v4 with ColPali:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- sentence-transformers
How to use jinaai/jina-embeddings-v4 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("jinaai/jina-embeddings-v4", trust_remote_code=True) sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Notebooks
- Google Colab
- Kaggle
GGUF version
Could we please have access to a GGUF version of Jina V4 to be used with Ollama ?
V3 never got converted 😞
SSS
Hi @sqliteai, my colleague is working on it along with some other tasks, so I’m not sure exactly when it will be done. Probably this week or next.
any update ?
+1 for GGUF version
sorry may I ask why jina-embedding-v4-gguf cut visual model out ?
is that gguf format not support ?
I have interest in jina-embedding-v4 , since it state that "multimodal and multilingual retrieval" support, but now gguf format seems not support ?
image will be back, we just need more test there. image is treated a bit different in gguf.
also we aim to figure out the smallest minimum working unit so that people can deploy it at scale without any redundancy.
thanks, I really no idea on the format issue.
since using LM Studio for gguf format .... thanks for work and I think I will wait you the full function ready before test
Thank you !
Tried it a bit on multilingual documents, mostly French.
Sadly, BGE-M3 is still giving better results for me.
But Jina V4 gave good results. Just not as much complete and accurate than BGE-M3.