How to use jhu-clsp/ettin-encoder-1b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="jhu-clsp/ettin-encoder-1b")
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("jhu-clsp/ettin-encoder-1b") model = AutoModelForMaskedLM.from_pretrained("jhu-clsp/ettin-encoder-1b", device_map="auto")
https://huggingface.co/jhu-clsp/ettin-encoder-1b/resolve/77ab8635fea5ca97d2f57212de5feeaaf9a87f3d/tokenizer.json
hf download hf://jhu-clsp/ettin-encoder-1b@77ab8635fea5ca97d2f57212de5feeaaf9a87f3d/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/jhu-clsp/ettin-encoder-1b/resolve/77ab8635fea5ca97d2f57212de5feeaaf9a87f3d/tokenizer.json
