Add model card with tags for L56-D1920-qwen_gdn_qwen2-e1-nh6-hd64-nvh30-A0-S512-step1-rand2b-token2B
Browse files
README.md
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
model_name: L56-D1920-qwen_gdn_qwen2-e1-nh6-hd64-nvh30-A0-S512-step1-rand2b-token2B
|
| 3 |
+
tags:
|
| 4 |
+
- yulanmini
|
| 5 |
+
- hybrid
|
| 6 |
+
- mamba
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# L56-D1920-qwen_gdn_qwen2-e1-nh6-hd64-nvh30-A0-S512-step1-rand2b-token2B
|
| 10 |
+
|
| 11 |
+
This is a model uploaded from /mnt/nanjingcephfs/project_wx-rec-alg-bdc-exp/bwzheng/yulan/hyw/pretrain-linear-moe-dev/RADLADS-paper/out/L56-D1920-qwen_gdn_qwen2-e1-nh6-hd64-nvh30-A0-S512--step1-rand2b-token2B.
|