Instructions to use allegro/herbert-base-cased with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use allegro/herbert-base-cased with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="allegro/herbert-base-cased")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("allegro/herbert-base-cased") model = AutoModel.from_pretrained("allegro/herbert-base-cased", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Download tokenizer_config.json from allegro/herbert-base-cased: direct link, hf CLI and curl.
- Browser
- Download file 229 Bytes
-
https://huggingface.co/allegro/herbert-base-cased/resolve/108138c2ae3ae7cd4d04261c1a3b128e1cf0d3f1/tokenizer_config.json
- Command line
-
hf download hf://allegro/herbert-base-cased@108138c2ae3ae7cd4d04261c1a3b128e1cf0d3f1/tokenizer_config.json
-
curl -L -o tokenizer_config.json https://huggingface.co/allegro/herbert-base-cased/resolve/108138c2ae3ae7cd4d04261c1a3b128e1cf0d3f1/tokenizer_config.json
229 Bytes
| {"do_lowercase_and_remove_accent": false, "unk_token": "<unk>", "bos_token": "<s>", "sep_token": "</s>", "pad_token": "<pad>", "cls_token": "<s>", "mask_token": "<mask>", "additional_special_tokens": [], "model_max_length": 512} | |