Note Nous re-training for YaRN stretches. Gutenberg press library, full novels. Produced brilliant result on retraining the 13B 64K. Will be using on Openhermes 2 13B 32K and Hermes2 Yi 34B 40K

Note re-training for YaRN stretch in Cappy.

Babsie/Hermes2Yi-34B-40k

Text Generation • 34B • Updated Oct 16, 2025 • 9

Note RoPE stretched to 40K from 4K. tested responses in pod with 500K token responses. seems ok. Needs to be tested in chat. May need re-training with YaRN dataset.

Babsie/CapyberaHermesYi-34B-ChatML-200K

Updated Oct 22, 2025 • 4

Note Chat template added as there was none. Very briefly tested in chat to 2K tokens to see if template worked. Will be testing further.

Babsie/OpenHermes2-13B-32K

Text Generation • 13B • Updated Oct 15, 2025 • 5

Note RoPE stretched to 32K. Language drunk. Needs fine tuning re-training. Will be doing with a subset of Nous "deepmind/pg19" re-training for YaRN dataset.

Babsie/NousYarnFlashLlama-13B-64k

Text Generation • Updated Oct 24, 2025 • 4

Note Flash attention Added. Tested briefly in pod to ensure chat template and stability with 1k token response. Still need to test in chat.

Babsie/TrckstrExtDimenBrainDamageNO_USE_RefernceOnly

Text Generation • 71B • Updated Feb 15 • 5

Note NOTE: define base number in all future builds with SCE+TIES hybrid merge. Never use "all crimes" again.