How to use TypicaAI/magbert-lm with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="TypicaAI/magbert-lm")
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("TypicaAI/magbert-lm") model = AutoModelForMaskedLM.from_pretrained("TypicaAI/magbert-lm", device_map="auto")
https://huggingface.co/TypicaAI/magbert-lm/resolve/8346c6bdbb798a69bd877e8aaf7246b5f2a501a3/sentencepiece.bpe.model
hf download hf://TypicaAI/magbert-lm@8346c6bdbb798a69bd877e8aaf7246b5f2a501a3/sentencepiece.bpe.model
curl -L -o sentencepiece.bpe.model https://huggingface.co/TypicaAI/magbert-lm/resolve/8346c6bdbb798a69bd877e8aaf7246b5f2a501a3/sentencepiece.bpe.model
