How to use openchs/ner_distillbert_v1 with Scikit-learn:
from huggingface_hub import hf_hub_download import joblib model = joblib.load( hf_hub_download("openchs/ner_distillbert_v1", "sklearn_model.joblib") ) # only load pickle files from sources you trust # read more about it here https://skops.readthedocs.io/en/stable/persistence.html
How to use openchs/ner_distillbert_v1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="openchs/ner_distillbert_v1")
# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("openchs/ner_distillbert_v1") model = AutoModelForTokenClassification.from_pretrained("openchs/ner_distillbert_v1", device_map="auto")
What is a pickle import?
