HY-2012 commited on
Commit
013cbf4
·
verified ·
1 Parent(s): 0058acd

Clean deployment package and clarify file layout

Browse files
MODEL_SHA256SUMS CHANGED
@@ -4,12 +4,6 @@ f64eda392b2186b61830aece478dd6d415f7d584a71ab12f45f28127f5a43e35 models/axmodel
4
  dfe5ae88a2549f708ab9134d1c6dbd8c53e49aff76fedff8a902459a7c4b6597 models/axmodels_650/tts_prefill.axmodel
5
  31294cf854687c937f5769baf44b796b055e559bc74bb0450af327c51c8f6969 models/onnxmodels/moss_tts_decode_step.onnx
6
  710ca7f6123372488a1641c579159908d8e6461569ae0b83fc071de8eb3de34f models/onnxmodels/moss_tts_decode_step.data
7
- 35f309211297e504ed42b57e3011234023b78a453b8c5ba1e1d690ccb3612136 models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.onnx
8
- 9269ab372a4f59d4db869c44da21b228abf2bf1db7059b1144d0a536c5cec985 models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.data
9
- 0a59338df1984be8bcd4b49020eae5572c3eff03c4fdda75ead8c03c02e6e8b8 models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx
10
- 7232d99b91b6be4b0bc86486b7df1c17f05bf6fae93c8629552274ab1a61cd91 models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx.data
11
- 31294cf854687c937f5769baf44b796b055e559bc74bb0450af327c51c8f6969 models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.onnx
12
- 710ca7f6123372488a1641c579159908d8e6461569ae0b83fc071de8eb3de34f models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.data
13
  eddd60c9cbe74805d94342c032143f1a7d7af91f02af21eb749b6f919804e9be bin/moss_tts_ax650/moss_tts_ax650
14
  ab8c4363e06ac80b3d1279ea55ebea44e906c5b131ba783ff684a067540c0e94 bin/moss_tts_ax650/libonnxruntime.so.1.23.2
15
  e229c8e7b2abc2a50e550b3ed099178bdbe1948cf3a40447f753a01720aa9052 bin/moss_tts_ax650/libonnxruntime_providers_shared.so
 
4
  dfe5ae88a2549f708ab9134d1c6dbd8c53e49aff76fedff8a902459a7c4b6597 models/axmodels_650/tts_prefill.axmodel
5
  31294cf854687c937f5769baf44b796b055e559bc74bb0450af327c51c8f6969 models/onnxmodels/moss_tts_decode_step.onnx
6
  710ca7f6123372488a1641c579159908d8e6461569ae0b83fc071de8eb3de34f models/onnxmodels/moss_tts_decode_step.data
 
 
 
 
 
 
7
  eddd60c9cbe74805d94342c032143f1a7d7af91f02af21eb749b6f919804e9be bin/moss_tts_ax650/moss_tts_ax650
8
  ab8c4363e06ac80b3d1279ea55ebea44e906c5b131ba783ff684a067540c0e94 bin/moss_tts_ax650/libonnxruntime.so.1.23.2
9
  e229c8e7b2abc2a50e550b3ed099178bdbe1948cf3a40447f753a01720aa9052 bin/moss_tts_ax650/libonnxruntime_providers_shared.so
README.md CHANGED
@@ -17,7 +17,22 @@ MOSS-TTS-Nano 的 AX650 板端推理包,包含量化 AXModel、默认质量路
17
 
18
  <https://github.com/AXERA-TECH/Moss-TTS-Nano.AXERA>
19
 
20
- ## 1. 安装 Python 依赖
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
  板端需要匹配 AX650 的 `axengine/pyaxengine`,并安装:
23
 
@@ -28,7 +43,7 @@ python3 -c "import axengine, numpy, sentencepiece; print('runtime OK')"
28
 
29
  如果只使用 C++ 程序,可以跳过 Python 依赖安装。
30
 
31
- ## 2. Python 推理
32
 
33
  在本目录执行:
34
 
@@ -50,7 +65,7 @@ python3 python/infer_moss_tts.py \
50
  `Ava`、`Bella`、`Adam`、`Nathan`、`Soyo`、`Saki`、`Mortis`、`Umiri`、`Mei`、`Anon`、
51
  `Arisa` 和 `Trump`。
52
 
53
- ## 3. C++ AX650 推理(推荐)
54
 
55
  程序已经编译好,不需要在板端编译:
56
 
@@ -82,23 +97,5 @@ FP32 路径产生一致的 Token/WAV,稳态 RTF 约 `1.10–1.13`。
82
 
83
  程序加载时间不计入 RTF。板端同时运行其他 NPU/CPU 任务时,RTF 会升高。
84
 
85
- ## 4. 可选模型
86
-
87
- `models/onnxmodels/candidates/static320_int8_qdq/` 是速度实验模型,最佳观测 RTF 约
88
- `0.85`,但 Token 可能与默认 FP32 路径不同,使用前请先试听。原始 512-KV FP32 模型位于
89
- `models/onnxmodels/candidates/default_512_fp32/`,仅用于回归对比。
90
-
91
  全 AXModel 的 `tts_decode_step.axmodel` 仅用于诊断;长句可能提前停止或出现尾部噪音,
92
  默认不推荐。
93
-
94
- ## 5. 文件说明
95
-
96
- ```text
97
- models/axmodels_650/ AX650 量化模型
98
- models/onnxmodels/ 默认 static320 FP32 decode ONNX 和候选模型
99
- bin/moss_tts_ax650/ C++ 可执行文件和 ONNX Runtime 库
100
- config/ tokenizer 和推理元数据
101
- python/ Python 推理入口
102
- ```
103
-
104
- `config.json` 按发布规范保留,内容为空对象 `{}`。
 
17
 
18
  <https://github.com/AXERA-TECH/Moss-TTS-Nano.AXERA>
19
 
20
+ ## 1. 文件说明
21
+
22
+ ```text
23
+ models/axmodels_650/ AX650 量化模型
24
+ models/onnxmodels/ 默认 static320 FP32 decode ONNX
25
+ bin/moss_tts_ax650/ C++ 可执行文件和 ONNX Runtime 库
26
+ config/ tokenizer 和推理元数据
27
+ python/ Python 推理入口
28
+ scripts/ Python 运行时辅助模块
29
+ configuration.json 模型运行配置
30
+ config.json Hugging Face 发布规范配置,内容为 {}
31
+ ```
32
+
33
+ 默认推理链路使用 `models/onnxmodels/moss_tts_decode_step.onnx`。
34
+
35
+ ## 2. 安装 Python 依赖
36
 
37
  板端需要匹配 AX650 的 `axengine/pyaxengine`,并安装:
38
 
 
43
 
44
  如果只使用 C++ 程序,可以跳过 Python 依赖安装。
45
 
46
+ ## 3. Python 推理
47
 
48
  在本目录执行:
49
 
 
65
  `Ava`、`Bella`、`Adam`、`Nathan`、`Soyo`、`Saki`、`Mortis`、`Umiri`、`Mei`、`Anon`、
66
  `Arisa` 和 `Trump`。
67
 
68
+ ## 4. C++ AX650 推理(推荐)
69
 
70
  程序已经编译好,不需要在板端编译:
71
 
 
97
 
98
  程序加载时间不计入 RTF。板端同时运行其他 NPU/CPU 任务时,RTF 会升高。
99
 
 
 
 
 
 
 
100
  全 AXModel 的 `tts_decode_step.axmodel` 仅用于诊断;长句可能提前停止或出现尾部噪音,
101
  默认不推荐。
 
 
 
 
 
 
 
 
 
 
 
 
models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.data DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:9269ab372a4f59d4db869c44da21b228abf2bf1db7059b1144d0a536c5cec985
3
- size 881631240
 
 
 
 
models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.onnx DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:35f309211297e504ed42b57e3011234023b78a453b8c5ba1e1d690ccb3612136
3
- size 178765
 
 
 
 
models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.data DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:710ca7f6123372488a1641c579159908d8e6461569ae0b83fc071de8eb3de34f
3
- size 440816136
 
 
 
 
models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.onnx DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:31294cf854687c937f5769baf44b796b055e559bc74bb0450af327c51c8f6969
3
- size 151626
 
 
 
 
models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0a59338df1984be8bcd4b49020eae5572c3eff03c4fdda75ead8c03c02e6e8b8
3
- size 638590
 
 
 
 
models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx.data DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7232d99b91b6be4b0bc86486b7df1c17f05bf6fae93c8629552274ab1a61cd91
3
- size 186012168
 
 
 
 
verify_package.sh CHANGED
@@ -11,12 +11,6 @@ required=(
11
  models/axmodels_650/tts_prefill.axmodel models/axmodels_650/tts_decode_step.axmodel
12
  models/axmodels_650/tts_local_fixed_sampled_frame.axmodel models/axmodels_650/codec_decode.axmodel
13
  models/onnxmodels/moss_tts_decode_step.onnx models/onnxmodels/moss_tts_decode_step.data
14
- models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.onnx
15
- models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.data
16
- models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx
17
- models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx.data
18
- models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.onnx
19
- models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.data
20
  bin/moss_tts_ax650/moss_tts_ax650 bin/moss_tts_ax650/libonnxruntime.so.1.23.2
21
  )
22
  for path in "${required[@]}"; do
 
11
  models/axmodels_650/tts_prefill.axmodel models/axmodels_650/tts_decode_step.axmodel
12
  models/axmodels_650/tts_local_fixed_sampled_frame.axmodel models/axmodels_650/codec_decode.axmodel
13
  models/onnxmodels/moss_tts_decode_step.onnx models/onnxmodels/moss_tts_decode_step.data
 
 
 
 
 
 
14
  bin/moss_tts_ax650/moss_tts_ax650 bin/moss_tts_ax650/libonnxruntime.so.1.23.2
15
  )
16
  for path in "${required[@]}"; do