Clean deployment package and clarify file layout
Browse files- MODEL_SHA256SUMS +0 -6
- README.md +18 -21
- models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.data +0 -3
- models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.onnx +0 -3
- models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.data +0 -3
- models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.onnx +0 -3
- models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx +0 -3
- models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx.data +0 -3
- verify_package.sh +0 -6
MODEL_SHA256SUMS
CHANGED
|
@@ -4,12 +4,6 @@ f64eda392b2186b61830aece478dd6d415f7d584a71ab12f45f28127f5a43e35 models/axmodel
|
|
| 4 |
dfe5ae88a2549f708ab9134d1c6dbd8c53e49aff76fedff8a902459a7c4b6597 models/axmodels_650/tts_prefill.axmodel
|
| 5 |
31294cf854687c937f5769baf44b796b055e559bc74bb0450af327c51c8f6969 models/onnxmodels/moss_tts_decode_step.onnx
|
| 6 |
710ca7f6123372488a1641c579159908d8e6461569ae0b83fc071de8eb3de34f models/onnxmodels/moss_tts_decode_step.data
|
| 7 |
-
35f309211297e504ed42b57e3011234023b78a453b8c5ba1e1d690ccb3612136 models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.onnx
|
| 8 |
-
9269ab372a4f59d4db869c44da21b228abf2bf1db7059b1144d0a536c5cec985 models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.data
|
| 9 |
-
0a59338df1984be8bcd4b49020eae5572c3eff03c4fdda75ead8c03c02e6e8b8 models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx
|
| 10 |
-
7232d99b91b6be4b0bc86486b7df1c17f05bf6fae93c8629552274ab1a61cd91 models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx.data
|
| 11 |
-
31294cf854687c937f5769baf44b796b055e559bc74bb0450af327c51c8f6969 models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.onnx
|
| 12 |
-
710ca7f6123372488a1641c579159908d8e6461569ae0b83fc071de8eb3de34f models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.data
|
| 13 |
eddd60c9cbe74805d94342c032143f1a7d7af91f02af21eb749b6f919804e9be bin/moss_tts_ax650/moss_tts_ax650
|
| 14 |
ab8c4363e06ac80b3d1279ea55ebea44e906c5b131ba783ff684a067540c0e94 bin/moss_tts_ax650/libonnxruntime.so.1.23.2
|
| 15 |
e229c8e7b2abc2a50e550b3ed099178bdbe1948cf3a40447f753a01720aa9052 bin/moss_tts_ax650/libonnxruntime_providers_shared.so
|
|
|
|
| 4 |
dfe5ae88a2549f708ab9134d1c6dbd8c53e49aff76fedff8a902459a7c4b6597 models/axmodels_650/tts_prefill.axmodel
|
| 5 |
31294cf854687c937f5769baf44b796b055e559bc74bb0450af327c51c8f6969 models/onnxmodels/moss_tts_decode_step.onnx
|
| 6 |
710ca7f6123372488a1641c579159908d8e6461569ae0b83fc071de8eb3de34f models/onnxmodels/moss_tts_decode_step.data
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
eddd60c9cbe74805d94342c032143f1a7d7af91f02af21eb749b6f919804e9be bin/moss_tts_ax650/moss_tts_ax650
|
| 8 |
ab8c4363e06ac80b3d1279ea55ebea44e906c5b131ba783ff684a067540c0e94 bin/moss_tts_ax650/libonnxruntime.so.1.23.2
|
| 9 |
e229c8e7b2abc2a50e550b3ed099178bdbe1948cf3a40447f753a01720aa9052 bin/moss_tts_ax650/libonnxruntime_providers_shared.so
|
README.md
CHANGED
|
@@ -17,7 +17,22 @@ MOSS-TTS-Nano 的 AX650 板端推理包,包含量化 AXModel、默认质量路
|
|
| 17 |
|
| 18 |
<https://github.com/AXERA-TECH/Moss-TTS-Nano.AXERA>
|
| 19 |
|
| 20 |
-
## 1.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
|
| 22 |
板端需要匹配 AX650 的 `axengine/pyaxengine`,并安装:
|
| 23 |
|
|
@@ -28,7 +43,7 @@ python3 -c "import axengine, numpy, sentencepiece; print('runtime OK')"
|
|
| 28 |
|
| 29 |
如果只使用 C++ 程序,可以跳过 Python 依赖安装。
|
| 30 |
|
| 31 |
-
##
|
| 32 |
|
| 33 |
在本目录执行:
|
| 34 |
|
|
@@ -50,7 +65,7 @@ python3 python/infer_moss_tts.py \
|
|
| 50 |
`Ava`、`Bella`、`Adam`、`Nathan`、`Soyo`、`Saki`、`Mortis`、`Umiri`、`Mei`、`Anon`、
|
| 51 |
`Arisa` 和 `Trump`。
|
| 52 |
|
| 53 |
-
##
|
| 54 |
|
| 55 |
程序已经编译好,不需要在板端编译:
|
| 56 |
|
|
@@ -82,23 +97,5 @@ FP32 路径产生一致的 Token/WAV,稳态 RTF 约 `1.10–1.13`。
|
|
| 82 |
|
| 83 |
程序加载时间不计入 RTF。板端同时运行其他 NPU/CPU 任务时,RTF 会升高。
|
| 84 |
|
| 85 |
-
## 4. 可选模型
|
| 86 |
-
|
| 87 |
-
`models/onnxmodels/candidates/static320_int8_qdq/` 是速度实验模型,最佳观测 RTF 约
|
| 88 |
-
`0.85`,但 Token 可能与默认 FP32 路径不同,使用前请先试听。原始 512-KV FP32 模型位于
|
| 89 |
-
`models/onnxmodels/candidates/default_512_fp32/`,仅用于回归对比。
|
| 90 |
-
|
| 91 |
全 AXModel 的 `tts_decode_step.axmodel` 仅用于诊断;长句可能提前停止或出现尾部噪音,
|
| 92 |
默认不推荐。
|
| 93 |
-
|
| 94 |
-
## 5. 文件说明
|
| 95 |
-
|
| 96 |
-
```text
|
| 97 |
-
models/axmodels_650/ AX650 量化模型
|
| 98 |
-
models/onnxmodels/ 默认 static320 FP32 decode ONNX 和候选模型
|
| 99 |
-
bin/moss_tts_ax650/ C++ 可执行文件和 ONNX Runtime 库
|
| 100 |
-
config/ tokenizer 和推理元数据
|
| 101 |
-
python/ Python 推理入口
|
| 102 |
-
```
|
| 103 |
-
|
| 104 |
-
`config.json` 按发布规范保留,内容为空对象 `{}`。
|
|
|
|
| 17 |
|
| 18 |
<https://github.com/AXERA-TECH/Moss-TTS-Nano.AXERA>
|
| 19 |
|
| 20 |
+
## 1. 文件说明
|
| 21 |
+
|
| 22 |
+
```text
|
| 23 |
+
models/axmodels_650/ AX650 量化模型
|
| 24 |
+
models/onnxmodels/ 默认 static320 FP32 decode ONNX
|
| 25 |
+
bin/moss_tts_ax650/ C++ 可执行文件和 ONNX Runtime 库
|
| 26 |
+
config/ tokenizer 和推理元数据
|
| 27 |
+
python/ Python 推理入口
|
| 28 |
+
scripts/ Python 运行时辅助模块
|
| 29 |
+
configuration.json 模型运行配置
|
| 30 |
+
config.json Hugging Face 发布规范配置,内容为 {}
|
| 31 |
+
```
|
| 32 |
+
|
| 33 |
+
默认推理链路使用 `models/onnxmodels/moss_tts_decode_step.onnx`。
|
| 34 |
+
|
| 35 |
+
## 2. 安装 Python 依赖
|
| 36 |
|
| 37 |
板端需要匹配 AX650 的 `axengine/pyaxengine`,并安装:
|
| 38 |
|
|
|
|
| 43 |
|
| 44 |
如果只使用 C++ 程序,可以跳过 Python 依赖安装。
|
| 45 |
|
| 46 |
+
## 3. Python 推理
|
| 47 |
|
| 48 |
在本目录执行:
|
| 49 |
|
|
|
|
| 65 |
`Ava`、`Bella`、`Adam`、`Nathan`、`Soyo`、`Saki`、`Mortis`、`Umiri`、`Mei`、`Anon`、
|
| 66 |
`Arisa` 和 `Trump`。
|
| 67 |
|
| 68 |
+
## 4. C++ AX650 推理(推荐)
|
| 69 |
|
| 70 |
程序已经编译好,不需要在板端编译:
|
| 71 |
|
|
|
|
| 97 |
|
| 98 |
程序加载时间不计入 RTF。板端同时运行其他 NPU/CPU 任务时,RTF 会升高。
|
| 99 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 100 |
全 AXModel 的 `tts_decode_step.axmodel` 仅用于诊断;长句可能提前停止或出现尾部噪音,
|
| 101 |
默认不推荐。
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.data
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:9269ab372a4f59d4db869c44da21b228abf2bf1db7059b1144d0a536c5cec985
|
| 3 |
-
size 881631240
|
|
|
|
|
|
|
|
|
|
|
|
models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.onnx
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:35f309211297e504ed42b57e3011234023b78a453b8c5ba1e1d690ccb3612136
|
| 3 |
-
size 178765
|
|
|
|
|
|
|
|
|
|
|
|
models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.data
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:710ca7f6123372488a1641c579159908d8e6461569ae0b83fc071de8eb3de34f
|
| 3 |
-
size 440816136
|
|
|
|
|
|
|
|
|
|
|
|
models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.onnx
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:31294cf854687c937f5769baf44b796b055e559bc74bb0450af327c51c8f6969
|
| 3 |
-
size 151626
|
|
|
|
|
|
|
|
|
|
|
|
models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:0a59338df1984be8bcd4b49020eae5572c3eff03c4fdda75ead8c03c02e6e8b8
|
| 3 |
-
size 638590
|
|
|
|
|
|
|
|
|
|
|
|
models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx.data
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:7232d99b91b6be4b0bc86486b7df1c17f05bf6fae93c8629552274ab1a61cd91
|
| 3 |
-
size 186012168
|
|
|
|
|
|
|
|
|
|
|
|
verify_package.sh
CHANGED
|
@@ -11,12 +11,6 @@ required=(
|
|
| 11 |
models/axmodels_650/tts_prefill.axmodel models/axmodels_650/tts_decode_step.axmodel
|
| 12 |
models/axmodels_650/tts_local_fixed_sampled_frame.axmodel models/axmodels_650/codec_decode.axmodel
|
| 13 |
models/onnxmodels/moss_tts_decode_step.onnx models/onnxmodels/moss_tts_decode_step.data
|
| 14 |
-
models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.onnx
|
| 15 |
-
models/onnxmodels/candidates/default_512_fp32/moss_tts_decode_step.data
|
| 16 |
-
models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx
|
| 17 |
-
models/onnxmodels/candidates/static320_int8_qdq/moss_tts_decode_step.onnx.data
|
| 18 |
-
models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.onnx
|
| 19 |
-
models/onnxmodels/candidates/static320_fp32/moss_tts_decode_step.data
|
| 20 |
bin/moss_tts_ax650/moss_tts_ax650 bin/moss_tts_ax650/libonnxruntime.so.1.23.2
|
| 21 |
)
|
| 22 |
for path in "${required[@]}"; do
|
|
|
|
| 11 |
models/axmodels_650/tts_prefill.axmodel models/axmodels_650/tts_decode_step.axmodel
|
| 12 |
models/axmodels_650/tts_local_fixed_sampled_frame.axmodel models/axmodels_650/codec_decode.axmodel
|
| 13 |
models/onnxmodels/moss_tts_decode_step.onnx models/onnxmodels/moss_tts_decode_step.data
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
bin/moss_tts_ax650/moss_tts_ax650 bin/moss_tts_ax650/libonnxruntime.so.1.23.2
|
| 15 |
)
|
| 16 |
for path in "${required[@]}"; do
|