Update README.md
Browse files
README.md
CHANGED
|
@@ -22,9 +22,22 @@ tags:
|
|
| 22 |
- 平台:LLaMA Factory
|
| 23 |
- GPU:Tesla V100-SXM2-16GB
|
| 24 |
|
| 25 |
-
| 项 |
|
| 26 |
-
| - | - |
|
| 27 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
---
|
| 29 |
|
| 30 |
## ⚠️ 许可证与严格使用限制 (License & Restrictions)
|
|
|
|
| 22 |
- 平台:LLaMA Factory
|
| 23 |
- GPU:Tesla V100-SXM2-16GB
|
| 24 |
|
| 25 |
+
| 项 | 值 |
|
| 26 |
+
| - | - |
|
| 27 |
+
| 学习率 | 7e-5 |
|
| 28 |
+
| 微调方法 | LoRA |
|
| 29 |
+
| LoRA秩 | 16 |
|
| 30 |
+
| LoRA缩放系数 | 32 |
|
| 31 |
+
| LoRA随机丢弃 | 0.05 |
|
| 32 |
+
| 预热步数 | 150 |
|
| 33 |
+
| 批处理大小 | 2 |
|
| 34 |
+
| 梯度累计 | 6 |
|
| 35 |
+
| 计算类型 | pure_bf16 |
|
| 36 |
+
| 量化方法 | bnb |
|
| 37 |
+
| 量化等级 | 4 |
|
| 38 |
+
| 对话模板 | gemma4n |
|
| 39 |
+
| 结束时Epoch | ~0.245 |
|
| 40 |
+
| 结束时耗时 | ~64.5小时 |
|
| 41 |
---
|
| 42 |
|
| 43 |
## ⚠️ 许可证与严格使用限制 (License & Restrictions)
|