Hindi
Marathi
English
tokenizers
tokenizer
bpe
hinglish
minglish
code-mixed
indic
nlp
research-paper

Commit History

Update README.md
6d4dfb8
verified

Sujalvc commited on

Update akshar_training_pipeline.ipynb
4dbe576
verified

Sujalvc commited on

Delete romanized-mar.png with huggingface_hub
6174b2b
verified

Sujalvc commited on

Delete romanized-hindi.png with huggingface_hub
ec00830
verified

Sujalvc commited on

Delete avg-score.png with huggingface_hub
8fdea1f
verified

Sujalvc commited on

Delete akshar-32k.json with huggingface_hub
de40b27
verified

Sujalvc commited on

Update README.md
ced1a35
verified

Sujalvc commited on

Initial release of Akshar: The High-Efficiency Desi Tokenizer
0c87312
verified

Sujalvc commited on

Upload README.md with huggingface_hub
f9e12be
verified

Sujalvc commited on

Upload akshar_training_pipeline.ipynb with huggingface_hub
a46756f
verified

Sujalvc commited on

Upload README.md with huggingface_hub
e0f3038
verified

Sujalvc commited on

Upload avg-score.png with huggingface_hub
2be0961
verified

Sujalvc commited on

Upload romanized-hindi.png with huggingface_hub
c6a9e20
verified

Sujalvc commited on

Upload romanized-mar.png with huggingface_hub
4a76b0c
verified

Sujalvc commited on

Upload akshar-32k.json with huggingface_hub
af58c41
verified

Sujalvc commited on

Upload README.md with huggingface_hub
1ddd474
verified

Sujalvc commited on

Upload Akshar-32k tokenizer and README
fd55aa7
verified

Sujalvc commited on

Upload Akshar-32k tokenizer and README
ad1ad72
verified

Sujalvc commited on

Upload Akshar-32k tokenizer and README
5a32612
verified

Sujalvc commited on

initial commit
d17fc3c
verified

Sujalvc commited on