Instructions to use ctheodoris/Geneformer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ctheodoris/Geneformer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="ctheodoris/Geneformer")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("ctheodoris/Geneformer") model = AutoModelForMaskedLM.from_pretrained("ctheodoris/Geneformer", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit History
-
add input size tip to instructions
Verified signature2732369 -
update instructions to include reminder about token dictionary
Verified signaturecb1b0d5
-
precommit formatting
f07bfd7
-
add option for hyperparameter tuning to cc.validate
Christina Theodoris4bddd45
-
update examples for predict_eval and handle roc for 2 cell classes
Christina Theodoriseeba323
-
Add classifier module and examples
Christina Theodoris9e9cca9
-
Add functions for extracting gene embeddings, move state_embs_dict outside isp, fix bugs in isp
Christina Theodoris2f25aea
-
Add option to output embs as tensor
Christina Theodoris624349c
-
anndata_tokenizer (#170)
- Added anndata tokenizer and switched to Dataset.from_generator (b6ca56647a16de97f6f95785eb76cb1a965f9960) - Generalized (5cb733f4fed85e1568ba9671e5b1f9babd7b8491) - Addressed issues for tokenizer, anndata tokenizer now uses a fraction of memory (b24676d0956565ff7b4f8b57d1e936ad17f8740e) - Fixed issues (94e8d231c41a89232a55c064e5c8ea95edd51d2e) - Fixed issue, loom and h5ad now produce same checksums (9c62f4c6e3ab0afd1943079306655bd20eba2246) - Rename loom tokenizer function and modify example notebook for adata. (4fdb85061180ccf022ab761c2557be6ba67d848e) Co-authored-by: Rico Meinl <ricomnl@users.noreply.huggingface.co>4302f48
-
Config head node runtime via IP (#234)
- Config head node runtime via IP (748f48ac03faa90488220eb2f9b5a76e128a6c06) - Update minor formatting (c48e37c67945c09e6593d45c40c4cbe0df7cc757) Co-authored-by: Madhavan Venkatesh <madhavanvenkatesh@users.noreply.huggingface.co>b8fda63
-
Fixed error with perturbing individual genes and updated ways to specify cell_states_to_model (#146)
- Fixed error with perturbing individual genes and updated ways to specify cell_states_to_model (771c8bd01b1754c4387d742680e65c34697a2336) - Fix isp perturb_group dims, reformat cell states dict to keyed, add attn mask (c2679c41d352513a56feb5490c5302c6f25ae7ba) Co-authored-by: David Wen <davidjwen@users.noreply.huggingface.co>9169bfd
-
Rename heatmap legend to be correct label
Christina Theodorisbadcca6 -
Add function to extract and plot cell embeddings
Christina Theodorisd154fee
-
Update isp to allow modeling single perturbation in multiple cells as batches
Christina Theodorisacd253c
-
Change list of individual IDs to set to ensure unique before subsetting into train/valid/test sets
Christina Theodoris45b9d69
-
Add note to recommend tuning hyperparameters for downstream applications
Christina Theodoris98ce6d7
-
Add instructions to convert gene annotations w/ Ensembl Biomart
Christina Theodoris77eb432
-
Remove unused evalset variable from cell classification example
Christina Theodoris879a878
-
Update links including unsorted example lengths file
Christina Theodorisf0b6641
-
Add uniform max len for padding for predictions
Christina Theodoris67f674c
-
Add example code for obtaining non-zero median digests
Christina Theodoris67b7f01
-
Add further explanation regarding input file format for transcriptome tokenizer
Christina Theodorisc34ead6
-
Update instructions in tokenizing example to clarify requirement for Ensembl ID
Christina Theodorisd468697 -
Update instructions in tokenizing example to clarify requirement for Ensembl ID
Christina Theodorise606e1c
-
Add further explanation to tokenizer example script and updated tokenizer to match loompy raised error
Christina Theodoris78dd83b
-
Move example input files to dataset repository to include example datasets for fine-tuning
Christina Theodoris875ef33 -
Add example for tokenizing .loom dataset
Christina Theodorisf89f796 -
Update gene classification example to create directory after training arguments are defined
Christina Theodorisebe5ee8 -
Subclass collator for cell classification
Christina Theodoris402ba9b
-
Update pretrainer for transformers==4.28.0
Christina Theodorisb925dcc
-
Add example input labels for distinguishing bivalent promoters.
Christina Theodoris996d3e5 -
Add in silico perturbation example notebook.
Christina Theodoris1c2f864
-
Add example input files for gene classification of TF dosage sensitivity
Christina Theodoris0710c44
-
Add example for hyperparameter optimization for disease classifier
Christina Theodoris79a0c41
-
Add data collator for gene classification and example for gene classification
Christina Theodorisedacd12
-
Add data collator for cell classification and example for cell classification
Christina Theodoris088ea6e
-
Add Geneformer trainer and pretraining example
Christina Theodorisbcc03e8