---
base_model: arnir0/Tiny-LLM
library_name: transformers
pipeline_tag: text-generation
tags:
- cenn
- knowledge-distillation
- transformer-free
- language-modeling
- recurrent-neural-network
---

# TinyCeNN-LM Distilled

Transformer-free CeNN student distilled from `arnir0/Tiny-LLM`.

- Transformer layers remaining: 0
- CeNN recurrent steps: 7
- CeNN receptive field: 255 tokens
- Training tokens: 10,002,432
- Best student CE: 5.247066
- Teacher CE: 4.423090
- Teacher-gap recovery: 84.92%

Load with the `TinyCeNN-LM` GitHub package via `build_cenn_student()`.