Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
timothydillan
/
oim-script-equitable-regional-sp-bpe-32k-native-weighted-v0
Like
0
6 languages
tokenizers
tokenizer
indonesian
regional-languages
low-resource-languages
sentencepiece
script-equitable
native-script
aksara
native-weighted
License:
other
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
oim-script-equitable-regional-sp-bpe-32k-native-weighted-v0
1.31 MB
Ctrl+K
Ctrl+K
1 contributor
History:
8 commits
timothydillan
Update v0 public manifest metadata
e35e1ea
verified
3 months ago
benchmarks
Upload benchmarks/gemma_baseline_summary.md with huggingface_hub
3 months ago
provenance
Upload native-weighted script-equitable tokenizer v0
3 months ago
.gitattributes
Safe
1.52 kB
initial commit
3 months ago
MANIFEST.json
Safe
2.82 kB
Update v0 public manifest metadata
3 months ago
README.md
Safe
6.39 kB
Public v0: add Gemma baseline headline, provenance/licensing, fix file list
3 months ago
oim-script-equitable-regional-v0-native-weighted-32k-sp-bpe.model
756 kB
xet
Upload native-weighted script-equitable tokenizer v0
3 months ago
oim-script-equitable-regional-v0-native-weighted-32k-sp-bpe.vocab
Safe
473 kB
Upload native-weighted script-equitable tokenizer v0
3 months ago
