Feature Extraction
MLX
Safetensors
multilingual
embedding_gemma2
mlx-vlm
embedding
sentence-similarity
multimodal
image-feature-extraction
audio-feature-extraction
video-feature-extraction
5-bit
Instructions to use nativ-community/embeddinggemma-2-5bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use nativ-community/embeddinggemma-2-5bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download nativ-community/embeddinggemma-2-5bit --local-dir embeddinggemma-2-5bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Download chat_template.jinja from nativ-community/embeddinggemma-2-5bit: direct link, hf CLI and curl.
- Browser
- Download file 1.02 kB
-
https://huggingface.co/nativ-community/embeddinggemma-2-5bit/resolve/main/chat_template.jinja
- Command line
-
hf download hf://nativ-community/embeddinggemma-2-5bit/chat_template.jinja
-
curl -L -o chat_template.jinja https://huggingface.co/nativ-community/embeddinggemma-2-5bit/resolve/main/chat_template.jinja
1.02 kB
| {%- for msg in messages if msg.get('role') == 'system' -%}{%- if msg.get('content') is string -%}{{ msg['content'] }}{%- else -%}{%- for item in msg['content'] if item.get('type') == 'text' -%}{{ item['text'] }}{%- endfor -%}{%- endif -%}{%- endfor -%}{%- for msg in messages if msg.get('role') != 'system' -%}{%- if msg.get('content') is string -%}{{ msg['content'] }}{%- else -%}{%- set existing_text = msg['content'] | selectattr('type', 'equalto', 'text') | map(attribute='text') | join -%}{%- set has_manual_placeholders = ('<|image|>' in existing_text) or ('<|video|>' in existing_text) or ('<|audio|>' in existing_text) -%}{%- for item in msg['content'] -%}{%- if item.get('type') == 'text' -%}{{ item['text'] }}{%- elif not has_manual_placeholders and item.get('type') == 'image' -%}<|image|>{%- elif not has_manual_placeholders and item.get('type') == 'video' -%}<|video|>{%- elif not has_manual_placeholders and item.get('type') == 'audio' -%}<|audio|>{%- endif -%}{%- endfor -%}{%- endif -%}{%- endfor -%} |