Spaces:
Running
Running
File size: 409 Bytes
53bb0c5 c807fbd 341d45d | 1 2 3 4 5 | This page presents the average per-position byte compression rate, demonstrating the long-context capabilities of the models.
Calculated at the byte level, these metrics allow for direct comparison across different tokenizers.
Benchmarks utilize the [UncheatableEval-Long dataset series](https://huggingface.co/collections/Jellyfish042/uncheatableeval), with sequence lengths extending up to 32k characters. |