---
license: mit
library_name: transformers
pipeline_tag: fill-mask
tags:
- cheminformatics
- ChemBERTa-3
- masked-lm
- c3-MoLFormer
---

# MoLFormer-c3-1.1B

MoLFormer-c3-1.1B, as described in the Chemberta-3 paper [1] is pretrained on a combination of 100% ZINC20 (1B) and 100% Pubchem (100M)

## Usage

```python
from transformers import AutoTokenizer, AutoModelForMaskedLM

tokenizer = AutoTokenizer.from_pretrained("DeepChem/MoLFormer-c3-1.1B")
model = AutoModelForMaskedLM.from_pretrained("DeepChem/MoLFormer-c3-1.1B")
```

## Reference

1. Singh R, Barsainyan AA, Irfan R, Amorin CJ, He S, Davis T, et al. ChemBERTa-3: An Open Source Training Framework for Chemical Foundation Models. RSC Digital Discovery 2026; doi:10.1039/D5DD00348B