Fill-Mask
Transformers
Safetensors
molformer
cheminformatics
ChemBERTa-3
masked-lm
c3-MoLFormer
custom_code
Instructions to use DeepChem/MoLFormer-c3-1.1B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use DeepChem/MoLFormer-c3-1.1B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="DeepChem/MoLFormer-c3-1.1B", trust_remote_code=True)# Load model directly from transformers import AutoModelForMaskedLM model = AutoModelForMaskedLM.from_pretrained("DeepChem/MoLFormer-c3-1.1B", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
update readme with journal reference
Browse files
README.md
CHANGED
|
@@ -1,27 +1,27 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
library_name: transformers
|
| 4 |
-
pipeline_tag: fill-mask
|
| 5 |
-
tags:
|
| 6 |
-
- cheminformatics
|
| 7 |
-
- ChemBERTa-3
|
| 8 |
-
- masked-lm
|
| 9 |
-
- c3-MoLFormer
|
| 10 |
-
---
|
| 11 |
-
|
| 12 |
-
# MoLFormer-c3-1.1B
|
| 13 |
-
|
| 14 |
-
MoLFormer-c3-1.1B, as described in the Chemberta-3 paper [1] is pretrained on a combination of 100% ZINC20 (1B) and 100% Pubchem (100M)
|
| 15 |
-
|
| 16 |
-
## Usage
|
| 17 |
-
|
| 18 |
-
```python
|
| 19 |
-
from transformers import AutoTokenizer, AutoModelForMaskedLM
|
| 20 |
-
|
| 21 |
-
tokenizer = AutoTokenizer.from_pretrained("DeepChem/MoLFormer-c3-1.1B")
|
| 22 |
-
model = AutoModelForMaskedLM.from_pretrained("DeepChem/MoLFormer-c3-1.1B")
|
| 23 |
-
```
|
| 24 |
-
|
| 25 |
-
## Reference
|
| 26 |
-
|
| 27 |
-
1. Singh R, Barsainyan AA, Irfan R, Amorin CJ, He S, Davis T, et al. ChemBERTa-3: An Open Source Training Framework for Chemical Foundation Models.
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
library_name: transformers
|
| 4 |
+
pipeline_tag: fill-mask
|
| 5 |
+
tags:
|
| 6 |
+
- cheminformatics
|
| 7 |
+
- ChemBERTa-3
|
| 8 |
+
- masked-lm
|
| 9 |
+
- c3-MoLFormer
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# MoLFormer-c3-1.1B
|
| 13 |
+
|
| 14 |
+
MoLFormer-c3-1.1B, as described in the Chemberta-3 paper [1] is pretrained on a combination of 100% ZINC20 (1B) and 100% Pubchem (100M)
|
| 15 |
+
|
| 16 |
+
## Usage
|
| 17 |
+
|
| 18 |
+
```python
|
| 19 |
+
from transformers import AutoTokenizer, AutoModelForMaskedLM
|
| 20 |
+
|
| 21 |
+
tokenizer = AutoTokenizer.from_pretrained("DeepChem/MoLFormer-c3-1.1B")
|
| 22 |
+
model = AutoModelForMaskedLM.from_pretrained("DeepChem/MoLFormer-c3-1.1B")
|
| 23 |
+
```
|
| 24 |
+
|
| 25 |
+
## Reference
|
| 26 |
+
|
| 27 |
+
1. Singh R, Barsainyan AA, Irfan R, Amorin CJ, He S, Davis T, et al. ChemBERTa-3: An Open Source Training Framework for Chemical Foundation Models. RSC Digital Discovery 2026; doi:10.1039/D5DD00348B
|