add empty tokenized_counts for loom to pass until keep_counts implemented

tokenizer zarr integration (#561)

add input_identifier to tokenize specific matched files

update with V2 models

Add checks for custom attributes and n_counts prior to sum ensembl id (#461)

Update geneformer/tokenizer.py (#450)

Update geneformer/tokenizer.py (#415)

edit docs formatting

update tokenizer to defaults for 95M models for special token and input size

precommit formatting

Add function for summing of Ensembl IDs (#377)

move dicts to init

update tokenizer to include eos token

fix cell state gene embeddings bug (#345)

patch datasets save_to_disk

correct typo

Update readthedocs for classifier

Get the gene keys and gene list keys from the token dictionary instead of medians (#304)

Add classifier module and examples

Fix typo (#301)

Add option for variable input_size and to add CLS/SEP Tokens (#299)

edit docstring format to highlight options

change doc formatting

add sphinx docs

Add option for modified batch size for loom tokenizer

Add option for modifying chunk size for anndata tokenizer

tokenizer-uncropped-input_ids (#275)

anndata_tokenizer (#170)

Add error for no files found and suppress loompy import warning

Update tokenizer to allow tokenization without custom cell attributes

Modify tokenizer to allow renaming attr names btwn loom and .dataset

Add further explanation regarding input file format for transcriptome tokenizer

Add further explanation to tokenizer example script and updated tokenizer to match loompy raised error

Fix bug with metadata when processing multiple .loom files (#3)

Add data collator for cell classification and example for cell classification

Add Geneformer tokenizer and updated model card