kurdish-kurmanji-tokenizer / tokenizer.json
muzaffercky's picture
Remove byte level as pre-tokenizer
82eb3df verified
Raw
History
1.41 MB
File too large to display, you can check the raw version instead.