Khmer SentencePiece Tokenizer

Khmer SentencePiece tokenizer packaged for Hugging Face AutoTokenizer.

Load

from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("Msok99/KhmerLLM_Unigram_Official_v1_18k", use_fast=False)

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support