File size: 409 Bytes
53bb0c5
c807fbd
 
 
341d45d
1
2
3
4
5
This page presents the average per-position byte compression rate, demonstrating the long-context capabilities of the models.

Calculated at the byte level, these metrics allow for direct comparison across different tokenizers.

Benchmarks utilize the [UncheatableEval-Long dataset series](https://huggingface.co/collections/Jellyfish042/uncheatableeval), with sequence lengths extending up to 32k characters.