---
model_name: L56-D1920-qwen_mamba2_qwen2-e2-i3840-s128-hd64-gn6-A0-S4096-step1
tags:
- yulanmini
- hybrid
- mamba
---

# L56-D1920-qwen_mamba2_qwen2-e2-i3840-s128-hd64-gn6-A0-S4096-step1

This is a model uploaded from /home/luowenyang/pretrain-linear-moe/RADLADS-paper/out/L56-D1920-qwen_mamba2_qwen2-e2-i3840-s128-hd64-gn6-A0-S4096--step1.