update readme with journal reference

9f1b9ea verified 7 months ago

743 Bytes

license: mit
library_name: transformers
pipeline_tag: fill-mask
tags:
  - cheminformatics
  - ChemBERTa-3
  - masked-lm
  - c3-MoLFormer

MoLFormer-c3-1.1B

MoLFormer-c3-1.1B, as described in the Chemberta-3 paper [1] is pretrained on a combination of 100% ZINC20 (1B) and 100% Pubchem (100M)

Usage

from transformers import AutoTokenizer, AutoModelForMaskedLM

tokenizer = AutoTokenizer.from_pretrained("DeepChem/MoLFormer-c3-1.1B")
model = AutoModelForMaskedLM.from_pretrained("DeepChem/MoLFormer-c3-1.1B")

Reference

Singh R, Barsainyan AA, Irfan R, Amorin CJ, He S, Davis T, et al. ChemBERTa-3: An Open Source Training Framework for Chemical Foundation Models. RSC Digital Discovery 2026; doi:10.1039/D5DD00348B