Hugging Face's logo

nomic-ai
/
nomic-embed-text-v1.5

Sentence Similarity
sentence-transformers
ONNX
Safetensors
Transformers
Transformers.js
English
nomic_bert
feature-extraction
mteb
custom_code
Eval Results (legacy)
Eval Results
text-embeddings-inference
Model card Files
xet
 Community
61

Standardize config.json for native Transformers integration

#56
by SonnyCoops - opened
base: refs/heads/main
←
from: refs/pr/56
Discussion Files changed
+17
-55
Standardize config.json for native Transformers integrationa15734e8
SonnyCoops

Summary

This PR updates the config.json to support the native NomicBert implementation currently being merged into transformers: PR#43067

Changes

  • Internalization: Removedauto_mapto favor the native library implementation
  • Standardization: Mapped legacy keys to standard Transformer keys for compatibility
  • Cleanup: Added add_pooling_layer: false to eliminate initialization warnings for standard BERT poolers.
Change swiglu to silu to be compatible with native Transformers integration20d1e605
AntonV

Also replied on the PR in transformers but let's rather change to the base native config, i.e. NomicBertConfig().save_pretrained("your_folder") from the PR. The values should match (otherwise we need to fix the values on the config)
AntonV

Superceded by https://huggingface.co/nomic-ai/nomic-embed-text-v1.5/discussions/57
Cannot merge
This branch has merge conflicts in the following files:
  • config.json

Sign up or log in to comment