Xerv-AI
/

CRAYON-tokenizer

Text Generation

hardware-accelerated

double-array-trie

Model card Files Files and versions

CRAYON-tokenizer / src /crayon /resources /dat /vocab_standard.json

Phase-Technologies's picture

Phase-Technologies

Upload folder using huggingface_hub

708f4a3 verified 4 months ago

Raw History Contribute Delete

2.28 MB

File too large to display, you can check the raw version instead.