timothydillan
/

oim-script-equitable-regional-sp-bpe-32k-native-weighted-v0

regional-languages

low-resource-languages

script-equitable

native-weighted

Model card Files Files and versions

oim-script-equitable-regional-sp-bpe-32k-native-weighted-v0 / provenance

5.27 kB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

timothydillan's picture

Upload native-weighted script-equitable tokenizer v0

32e63f5 verified 3 months ago

script_equitable_v0_native_weighted_manifest.json

5.27 kB
Upload native-weighted script-equitable tokenizer v0 3 months ago