---
license: apache-2.0
base_model:
- teknium/OpenHermes-13B
library_name: transformers
tags:
- RoPE-scaling
---

## OpenHermes 13B 40K

It's a bit language drunk at the moment, I'm going to sober it up soon. 
As a dyslexic, I know kin when I see it 🤡 
It certainly won't help you with your spelling!
I'll be fine-tuning back up again soon, so it's ickle AI flamigo legs
won't bow and wobble like it has to pee anymore. 
Or in nerdo corperate speak
Context window extended to 32K via linear RoPE scaling. 
Requires post-RoPE stabilization finetune for coherence.