UncheatableEval / longctx_about.md
Jellyfish042's picture
update readme
341d45d
|
Raw
History Blame
409 Bytes
This page presents the average per-position byte compression rate, demonstrating the long-context capabilities of the models.
Calculated at the byte level, these metrics allow for direct comparison across different tokenizers.
Benchmarks utilize the [UncheatableEval-Long dataset series](https://huggingface.co/collections/Jellyfish042/uncheatableeval), with sequence lengths extending up to 32k characters.