---
model_name: L56-D1920-qwen_gdn_qwen2-e1-nh6-hd64-nvh30-A0-S512-step1-rand2b-token2B
tags:
- yulanmini
- hybrid
- mamba
---

# L56-D1920-qwen_gdn_qwen2-e1-nh6-hd64-nvh30-A0-S512-step1-rand2b-token2B

This is a model uploaded from /mnt/nanjingcephfs/project_wx-rec-alg-bdc-exp/bwzheng/yulan/hyw/pretrain-linear-moe-dev/RADLADS-paper/out/L56-D1920-qwen_gdn_qwen2-e1-nh6-hd64-nvh30-A0-S512--step1-rand2b-token2B.