Fill-Mask
Transformers
PyTorch
Safetensors
English
modernbert
masked-lm
long-context
BioClinical-ModernBERT
clinical
biomedical
clinical encoder
clinical modern bert
Instructions to use thomas-sounack/BioClinical-ModernBERT-large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use thomas-sounack/BioClinical-ModernBERT-large with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="thomas-sounack/BioClinical-ModernBERT-large")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("thomas-sounack/BioClinical-ModernBERT-large") model = AutoModelForMaskedLM.from_pretrained("thomas-sounack/BioClinical-ModernBERT-large", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -18,6 +18,8 @@ tags:
|
|
| 18 |
|
| 19 |
*BioClinical ModernBERT is available in two sizes: [base](https://huggingface.co/thomas-sounack/BioClinical-ModernBERT-base) (150M parameters) and [large](https://huggingface.co/thomas-sounack/BioClinical-ModernBERT-large) (396M parameters). The model training checkpoints can be found [here](https://huggingface.co/thomas-sounack/BioClinical-ModernBERT-checkpoints), and our code is available in our [GitHub repository](https://github.com/lindvalllab/BioClinical-ModernBERT).*
|
| 20 |
|
|
|
|
|
|
|
| 21 |
## Table of Contents
|
| 22 |
1. [Model Summary](#model-summary)
|
| 23 |
2. [Usage](#usage)
|
|
|
|
| 18 |
|
| 19 |
*BioClinical ModernBERT is available in two sizes: [base](https://huggingface.co/thomas-sounack/BioClinical-ModernBERT-base) (150M parameters) and [large](https://huggingface.co/thomas-sounack/BioClinical-ModernBERT-large) (396M parameters). The model training checkpoints can be found [here](https://huggingface.co/thomas-sounack/BioClinical-ModernBERT-checkpoints), and our code is available in our [GitHub repository](https://github.com/lindvalllab/BioClinical-ModernBERT).*
|
| 20 |
|
| 21 |
+
**A step-by-step guide for reproducing our model training with your own data is available [here](https://huggingface.co/blog/thomas-sounack/bioclinical-modernbert-tutorial)!**
|
| 22 |
+
|
| 23 |
## Table of Contents
|
| 24 |
1. [Model Summary](#model-summary)
|
| 25 |
2. [Usage](#usage)
|