Pragya / tokenizer_config.json
ArushBuilds's picture
Upload 3 files
345462d
Raw History Blame
102 Bytes
{
"vocab_size": 12288,
"bos_id": 12287,
"eos_id": 12287,
"pad_id": 12287,
"unk_id": 12287
}