Hindi
Marathi
English
tokenizers
tokenizer
bpe
hinglish
minglish
code-mixed
indic
nlp
research-paper
akshar-32k / akshar_training_pipeline.ipynb

Commit History

Update akshar_training_pipeline.ipynb
4dbe576
verified

Sujalvc commited on

Initial release of Akshar: The High-Efficiency Desi Tokenizer
0c87312
verified

Sujalvc commited on

Upload akshar_training_pipeline.ipynb with huggingface_hub
a46756f
verified

Sujalvc commited on