Qwen3-TTS-Streaming-ONNX / logs /log_test-streaming-onnx-cudagraphcompat-g5-xlarge-male-petergriffin-continuous-streaming-codec-last-chunk-dynamic-1.txt
pltobing's picture
docs: add examples from the latest commit on cont. stream.
ecbe102
Raw
History Blame Contribute Delete
429 kB
2026-04-30 19:25:37.962911883 [W:onnxruntime:Default, device_discovery.cc:325 DiscoverDevicesForPlatform] GPU device discovery failed: device_discovery.cc:92 ReadFileContents Failed to open file: "/sys/class/drm/card0/device/vendor"
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
2026-04-30 19:25:39.059 [INFO] __main__: Building inferencer...
2026-04-30 19:25:39.059 [INFO] src.inference.qwen3_tts_inferencer_onnx: Loading ONNX sessions...
2026-04-30 19:25:39.059 [INFO] src.inference.qwen3_tts_inferencer_onnx: talker prefill <- ./qwen3-tts_onnx/talker_model_prefill.onnx
2026-04-30 19:25:47.420 [INFO] src.inference.qwen3_tts_inferencer_onnx: local prefill <- ./qwen3-tts_onnx/talker_local_model_prefill.onnx
2026-04-30 19:25:47.581 [INFO] src.inference.qwen3_tts_inferencer_onnx: talker step <- ./qwen3-tts_onnx/talker_model_step.onnx
2026-04-30 19:25:48.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: local step <- ./qwen3-tts_onnx/talker_local_model_step.onnx
2026-04-30 19:25:48.746 [INFO] src.inference.qwen3_tts_inferencer_onnx: local lm_head <- ./qwen3-tts_onnx/talker_local_lm_head.onnx
2026-04-30 19:25:48.866 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec decoder <- ./qwen3-tts_onnx/codec_decoder_model.onnx
2026-04-30 19:25:49.201 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec decoder dynamic chunks <- ./qwen3-tts_onnx/codec_decoder_model_dynamic_chunks.onnx
2026-04-30 19:25:49.840 [INFO] src.inference.qwen3_tts_inferencer_onnx: speaker encoder <- ./qwen3-tts_onnx/speaker_encoder_model.onnx
2026-04-30 19:25:49.895600752 [W:onnxruntime:, transformer_memcpy.cc:111 ApplyImpl] 3 Memcpy nodes are added to the graph main_graph for CUDAExecutionProvider. It might have negative impact on performance (including unable to run CUDA graph). Set session_options.log_severity_level=1 to see the detail logs before this message.
2026-04-30 19:25:49.928 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec embed <- ./qwen3-tts_onnx/talker_codec_embed_model.onnx
2026-04-30 19:25:50.060 [INFO] src.inference.qwen3_tts_inferencer_onnx: text embed proj <- ./qwen3-tts_onnx/text_embed_proj_model.onnx
2026-04-30 19:25:52.605 [INFO] src.inference.qwen3_tts_inferencer_onnx: [OK] All ONNX sessions loaded.
2026-04-30 19:25:53.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: Allocating device KV-cache buffers...
2026-04-30 19:25:53.382 [INFO] src.inference.qwen3_tts_inferencer_onnx: IOBinding wired for all models (prefill + step).
2026-04-30 19:25:53.382 [INFO] src.inference.qwen3_tts_inferencer_onnx: Allocating device KV-cache buffer of codec decoder...
2026-04-30 19:25:53.384 [INFO] __main__: Running 50 warmup iteration(s)...
2026-04-30 19:25:53.401 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up speaker encoder...
2026-04-30 19:25:53.703 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run speaker encoder in 0.29 s. --> 5.89 ms. per run.
2026-04-30 19:25:53.703 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up text embed proj....
2026-04-30 19:25:53.714 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run text embed proj. in 0.01 s. --> 0.22 ms. per run.
2026-04-30 19:25:53.714 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up talker prefill...
2026-04-30 19:25:54.187 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run talker prefill in 0.47 s. --> 9.44 ms. per run.
2026-04-30 19:25:54.188 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up talker step...
2026-04-30 19:25:54.577 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run talker step in 0.39 s. --> 7.76 ms. per run.
2026-04-30 19:25:54.577 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up local talker prefill...
2026-04-30 19:25:54.645 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run local talker prefill in 0.07 s. --> 1.36 ms. per run.
2026-04-30 19:25:54.645 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up local talker step...
2026-04-30 19:25:54.702 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run local talker step in 0.06 s. --> 1.13 ms. per run.
2026-04-30 19:25:54.702 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up local talker batched lm_head...
2026-04-30 19:25:54.719 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run local batched lm_head in 0.02 s. --> 0.34 ms. per run.
2026-04-30 19:25:54.719 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up codec decoder...
2026-04-30 19:25:55.116 [INFO] src.inference.qwen3_tts_inferencer_onnx: 12 iter. run codec_decoder in 0.40 s. --> 32.94 ms. per run.
2026-04-30 19:25:55.116 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up codec decoder with dynamic chunk frames (n=2)...
2026-04-30 19:25:55.337 [INFO] src.inference.qwen3_tts_inferencer_onnx: 6 iter. run codec_decoder_dynamic in 0.21 s. --> 34.23 ms. per run.
2026-04-30 19:25:55.338 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warmup latency summary:
2026-04-30 19:25:55.338 [INFO] src.inference.qwen3_tts_inferencer_onnx: speaker_encoder
2026-04-30 19:25:55.338 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=5.89 ms.
2026-04-30 19:25:55.338 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=29.17 ms.
2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=1.71 ms.
2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=1.91 ms.
2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=1.67 ms.
2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=210.07 ms.
2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: text_embed_proj
2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=0.22 ms.
2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=0.71 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=0.12 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=0.14 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=0.11 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=5.16 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: talker_prefill
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=9.44 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=5.57 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=8.64 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=8.66 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=8.63 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=48.44 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: talker_step
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=7.76 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=3.35 ms.
2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=7.27 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=7.29 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=7.27 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=31.22 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: local_prefill
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=1.36 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=1.00 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=1.21 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=1.23 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=1.21 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=8.33 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: local_step
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=1.13 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=0.63 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=1.04 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=1.06 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=1.04 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=5.51 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: local_lm_head
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=0.34 ms.
2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=0.21 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=0.30 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=0.32 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=0.30 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=1.83 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec_decoder
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=32.94 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=30.58 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=23.72 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=73.52 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=23.70 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=134.37 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec_decoder_dynamic
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=34.23 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=16.02 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=27.11 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=59.33 ms.
2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=26.95 ms.
2026-04-30 19:25:55.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=70.06 ms.
2026-04-30 19:25:55.366 [INFO] __main__: Warmup complete in 1.98 s
2026-04-30 19:25:55.366 [INFO] __main__: speaker_encoder mean=5.89 ms min=1.67 ms max=210.07 ms
2026-04-30 19:25:55.366 [INFO] __main__: text_embed_proj mean=0.22 ms min=0.11 ms max=5.16 ms
2026-04-30 19:25:55.366 [INFO] __main__: talker_prefill mean=9.44 ms min=8.63 ms max=48.44 ms
2026-04-30 19:25:55.366 [INFO] __main__: talker_step mean=7.76 ms min=7.27 ms max=31.22 ms
2026-04-30 19:25:55.366 [INFO] __main__: local_prefill mean=1.36 ms min=1.21 ms max=8.33 ms
2026-04-30 19:25:55.366 [INFO] __main__: local_step mean=1.13 ms min=1.04 ms max=5.51 ms
2026-04-30 19:25:55.366 [INFO] __main__: local_lm_head mean=0.34 ms min=0.30 ms max=1.83 ms
2026-04-30 19:25:55.366 [INFO] __main__: codec_decoder mean=32.94 ms min=23.70 ms max=134.37 ms
2026-04-30 19:25:55.366 [INFO] __main__: codec_decoder_dynamic mean=34.23 ms min=26.95 ms max=70.06 ms
2026-04-30 19:25:55.366 [INFO] __main__: Synthesising: 'В зависимости от ситуации,'
2026-04-30 19:25:55.366 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment В -> text_cache В
2026-04-30 19:25:55.366 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False
2026-04-30 19:25:55.366 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069
2026-04-30 19:25:55.454 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076
0.08690926]]] (1, 1, 1024)
2026-04-30 19:25:55.455 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]]
2026-04-30 19:25:55.460 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]]] (1, 4, 1024)
2026-04-30 19:25:55.461 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 1, 1024)
2026-04-30 19:25:55.461 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]
[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076
0.08690926]
[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 6, 1024)
2026-04-30 19:25:55.461 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22
Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:25:55.462 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:25:55.462 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3)
2026-04-30 19:25:55.463 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3)
2026-04-30 19:25:55.463 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024)
2026-04-30 19:25:55.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036
-0.00767252]]] (1, 1, 1024)
2026-04-30 19:25:55.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528
0.00424147]]] (1, 1, 1024)
2026-04-30 19:25:55.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724
-0.00170945]
[ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198
0.00132705]
[ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966
0.0080104 ]
[ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711
0.00252486]
[-0.02064589 0.05184897 0.01909059 ... 0.2070941 0.06416605
0.09115074]
[ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459
-0.00718043]]] (1, 6, 1024)
2026-04-30 19:25:55.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]
...
[ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03
-2.0710612e-04 2.5248611e-03]
[-2.0645889e-02 5.1848970e-02 1.9090585e-02 ... 2.0709410e-01
6.4166047e-02 9.1150738e-02]
[ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03
3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024)
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=9; step_idx=0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache В
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment з -> text_cache В з
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache В за
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache В зав
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зави
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache В завис
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зависи
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache В зависим
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache В зависимо
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache В зависимос
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache В зависимост
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зависимости
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache В зависимости
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache В зависимости о
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache В зависимости от
2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache В зависимости от
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache В зависимости от с
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зависимости от си
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache В зависимости от сит
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment у -> text_cache В зависимости от ситу
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache В зависимости от ситуа
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ц -> text_cache В зависимости от ситуац
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зависимости от ситуаци
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зависимости от ситуации
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment , -> text_cache В зависимости от ситуации,
2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['В зависимости от ситуации,'] 26
Qwen3TTSProcessor __call__ text ['В зависимости от ситуации,']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 16206, 139133, 20264, 139367, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1]])}
2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 16206, 139133, 20264, 139367, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1]])}
2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 16206 139133 20264 139367 11]] (1, 5)
2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 16206 139133 20264 139367 11]] (1, 5)
2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment В зависимости от ситуации, 26 -> tokenized_segment [np.int64(16206), np.int64(139133), np.int64(20264), np.int64(139367), np.int64(11)] 5
2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(16206), np.int64(139133), np.int64(20264), np.int64(139367), np.int64(11)]
2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(16206), np.int64(139133), np.int64(20264), np.int64(139367), np.int64(11)] 5
2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 16206 -> pending_tokens [np.int64(139133), np.int64(20264), np.int64(139367), np.int64(11)] 4
2026-04-30 19:25:55.520 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-0 vq [1995] (1,) int64
2026-04-30 19:25:55.546 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-1 vq-rvq [[[1995 1184 373 530 1716 1105 654 43 2010 1217 605 123 317 1462
1699 3]]] (1, 1, 16) int64
2026-04-30 19:25:55.547 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 139133 -> pending_tokens [np.int64(20264), np.int64(139367), np.int64(11)] 3
2026-04-30 19:25:55.554 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-1 vq [215] (1,) int64
2026-04-30 19:25:55.582 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-2 vq-rvq [[[ 215 2031 69 995 246 1908 25 171 743 86 1076 170 1108 822
1839 388]]] (1, 1, 16) int64
2026-04-30 19:25:55.582 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 20264 -> pending_tokens [np.int64(139367), np.int64(11)] 2
2026-04-30 19:25:55.590 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-2 vq [212] (1,) int64
2026-04-30 19:25:55.617 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-3 vq-rvq [[[ 212 1924 1471 1414 363 964 970 1881 1504 1955 743 146 1514 1873
715 1668]]] (1, 1, 16) int64
2026-04-30 19:25:55.617 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 139367 -> pending_tokens [np.int64(11)] 1
2026-04-30 19:25:55.625 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-3 vq [1181] (1,) int64
2026-04-30 19:25:55.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-4 vq-rvq [[[1181 781 736 884 1164 698 185 1252 1700 781 194 204 2017 1909
527 1807]]] (1, 1, 16) int64
2026-04-30 19:25:55.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11 -> pending_tokens [] 0
2026-04-30 19:25:55.660 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-4 vq [1985] (1,) int64
2026-04-30 19:25:55.687 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-5 vq-rvq [[[1985 1534 810 1979 82 877 1300 14 632 532 1402 1117 36 609
1145 381]]] (1, 1, 16) int64
2026-04-30 19:25:55.687 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 chunk_tokens [[[1995 215 212 1181]
[1184 2031 1924 781]
[ 373 69 1471 736]
[ 530 995 1414 884]
[1716 246 363 1164]
[1105 1908 964 698]
[ 654 25 970 185]
[ 43 171 1881 1252]
[2010 743 1504 1700]
[1217 86 1955 781]
[ 605 1076 743 194]
[ 123 170 146 204]
[ 317 1108 1514 2017]
[1462 822 1873 1909]
[1699 1839 715 527]
[ 3 388 1668 1807]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:55.711 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 wav [[[-0.02130234 -0.01856662 -0.01710658 ... 0.00041982 0.00062048
0.0006307 ]]] -0.04178531840443611 -4.523760071606375e-05 0.0025097329635173082 0.023125281557440758 (1, 1, 7680)
2026-04-30 19:25:55.711 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0
2026-04-30 19:25:55.711 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1
2026-04-30 19:25:55.712 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:55.712 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1
2026-04-30 19:25:55.712 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0
2026-04-30 19:25:55.720 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-5 vq [1707] (1,) int64
2026-04-30 19:25:55.747 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-6 vq-rvq [[[1707 693 1438 1778 1888 35 383 516 2047 112 209 788 1737 1693
199 1732]]] (1, 1, 16) int64
2026-04-30 19:25:55.755 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-6 vq [1813] (1,) int64
2026-04-30 19:25:55.781 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-7 vq-rvq [[[1813 227 2024 1357 345 812 2033 209 1096 1946 1783 498 1173 455
645 1191]]] (1, 1, 16) int64
2026-04-30 19:25:55.789 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-7 vq [1538] (1,) int64
2026-04-30 19:25:55.817 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-8 vq-rvq [[[1538 1161 1615 1403 360 71 554 681 366 355 1882 16 1045 1117
1355 1482]]] (1, 1, 16) int64
2026-04-30 19:25:55.825 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-8 vq [148] (1,) int64
2026-04-30 19:25:55.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-9 vq-rvq [[[ 148 893 1196 10 450 205 232 763 1537 1662 715 214 1887 984
663 1098]]] (1, 1, 16) int64
2026-04-30 19:25:55.860 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-9 vq [1115] (1,) int64
2026-04-30 19:25:55.887 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-10 vq-rvq [[[1115 941 1955 66 889 176 508 523 33 797 1159 104 2004 2014
1058 97]]] (1, 1, 16) int64
2026-04-30 19:25:55.895 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-10 vq [1634] (1,) int64
2026-04-30 19:25:55.922 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-11 vq-rvq [[[1634 1377 103 417 313 1694 296 517 337 1534 22 639 350 566
209 550]]] (1, 1, 16) int64
2026-04-30 19:25:55.930 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-11 vq [741] (1,) int64
2026-04-30 19:25:55.957 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-12 vq-rvq [[[ 741 1989 1230 1367 280 710 1525 1172 154 25 103 598 180 693
1888 820]]] (1, 1, 16) int64
2026-04-30 19:25:55.965 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-12 vq [383] (1,) int64
2026-04-30 19:25:55.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-13 vq-rvq [[[ 383 1821 1276 517 1009 83 95 1703 1976 851 272 88 450 553
1204 601]]] (1, 1, 16) int64
2026-04-30 19:25:56.000 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-13 vq [1804] (1,) int64
2026-04-30 19:25:56.026 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-14 vq-rvq [[[1804 1832 384 433 846 1121 1634 400 1673 1804 1287 1207 441 303
1662 1780]]] (1, 1, 16) int64
2026-04-30 19:25:56.034 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-14 vq [1559] (1,) int64
2026-04-30 19:25:56.061 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-15 vq-rvq [[[1559 1891 1356 193 218 1831 1627 1440 1360 1612 1916 236 53 1547
1488 663]]] (1, 1, 16) int64
2026-04-30 19:25:56.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-15 vq [1196] (1,) int64
2026-04-30 19:25:56.096 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-16 vq-rvq [[[1196 1806 1904 2005 1343 972 854 1496 344 1828 739 202 1252 1110
615 242]]] (1, 1, 16) int64
2026-04-30 19:25:56.104 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-16 vq [1847] (1,) int64
2026-04-30 19:25:56.131 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-17 vq-rvq [[[1847 736 979 1857 987 1390 1821 742 182 1600 302 612 1492 1325
1786 1697]]] (1, 1, 16) int64
2026-04-30 19:25:56.139 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-17 vq [1808] (1,) int64
2026-04-30 19:25:56.166 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-18 vq-rvq [[[1808 1514 377 81 1330 1807 911 751 1196 1979 1225 279 51 295
873 1207]]] (1, 1, 16) int64
2026-04-30 19:25:56.174 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-18 vq [704] (1,) int64
2026-04-30 19:25:56.201 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-19 vq-rvq [[[ 704 194 1040 784 1771 1472 15 1293 803 1473 515 853 620 1013
639 1929]]] (1, 1, 16) int64
2026-04-30 19:25:56.209 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-19 vq [152] (1,) int64
2026-04-30 19:25:56.236 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-20 vq-rvq [[[ 152 1116 483 1511 720 1475 1680 624 1989 369 874 1312 1220 407
412 1921]]] (1, 1, 16) int64
2026-04-30 19:25:56.244 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-20 vq [151] (1,) int64
2026-04-30 19:25:56.271 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-21 vq-rvq [[[ 151 700 1964 319 102 1643 610 1585 142 898 1752 583 465 321
1961 366]]] (1, 1, 16) int64
2026-04-30 19:25:56.279 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-21 vq [1647] (1,) int64
2026-04-30 19:25:56.306 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-22 vq-rvq [[[1647 1228 933 1442 253 736 411 164 884 1352 861 76 1259 953
163 1696]]] (1, 1, 16) int64
2026-04-30 19:25:56.314 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-22 vq [1456] (1,) int64
2026-04-30 19:25:56.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-23 vq-rvq [[[1456 1194 785 1544 1137 1555 485 342 209 939 1043 1447 144 139
7 491]]] (1, 1, 16) int64
2026-04-30 19:25:56.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-23 vq [255] (1,) int64
2026-04-30 19:25:56.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-24 vq-rvq [[[ 255 613 1951 458 1083 232 18 1309 1482 340 1365 299 855 1048
1142 631]]] (1, 1, 16) int64
2026-04-30 19:25:56.384 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-24 vq [308] (1,) int64
2026-04-30 19:25:56.411 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-25 vq-rvq [[[ 308 637 1759 1532 800 982 187 1982 2035 1442 924 1389 417 75
521 294]]] (1, 1, 16) int64
2026-04-30 19:25:56.419 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-25 vq [2019] (1,) int64
2026-04-30 19:25:56.446 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-26 vq-rvq [[[2019 1990 1151 1146 323 403 1846 1922 15 402 584 321 1112 117
1233 680]]] (1, 1, 16) int64
2026-04-30 19:25:56.454 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-26 vq [360] (1,) int64
2026-04-30 19:25:56.481 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-27 vq-rvq [[[ 360 340 387 549 302 1103 275 881 508 631 1454 1490 1060 590
1900 741]]] (1, 1, 16) int64
2026-04-30 19:25:56.489 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-27 vq [1065] (1,) int64
2026-04-30 19:25:56.515 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-28 vq-rvq [[[1065 415 1100 805 1178 1776 311 1055 1620 321 430 1208 392 1616
1286 1179]]] (1, 1, 16) int64
2026-04-30 19:25:56.523 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-28 vq [1624] (1,) int64
2026-04-30 19:25:56.550 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-29 vq-rvq [[[1624 382 180 1829 178 284 1352 149 1098 1458 1780 1820 1222 1886
434 203]]] (1, 1, 16) int64
2026-04-30 19:25:56.558 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-29 vq [1910] (1,) int64
2026-04-30 19:25:56.585 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-30 vq-rvq [[[1910 667 14 1070 1092 616 1321 709 1680 1654 1346 223 1017 1268
1009 302]]] (1, 1, 16) int64
2026-04-30 19:25:56.593 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-30 vq [1353] (1,) int64
2026-04-30 19:25:56.620 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-31 vq-rvq [[[1353 682 1006 1670 918 1794 1861 313 1162 1001 649 1077 493 1799
1988 1823]]] (1, 1, 16) int64
2026-04-30 19:25:56.628 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-31 vq [1961] (1,) int64
2026-04-30 19:25:56.655 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-32 vq-rvq [[[1961 543 1399 1336 1030 143 836 1569 1803 50 970 545 1315 1445
1755 625]]] (1, 1, 16) int64
2026-04-30 19:25:56.663 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-32 vq [1931] (1,) int64
2026-04-30 19:25:56.690 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-33 vq-rvq [[[1931 1572 1054 629 1854 2036 761 1641 192 1589 324 437 1713 724
1306 1534]]] (1, 1, 16) int64
2026-04-30 19:25:56.698 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-33 vq [1945] (1,) int64
2026-04-30 19:25:56.725 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-34 vq-rvq [[[1945 1838 293 191 76 187 305 421 882 1308 1583 439 155 288
203 1624]]] (1, 1, 16) int64
2026-04-30 19:25:56.733 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-34 vq [2150] (1,) int64
2026-04-30 19:25:56.733 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 chunk_tokens [[[1985 1707 1813 1538]
[1534 693 227 1161]
[ 810 1438 2024 1615]
[1979 1778 1357 1403]
[ 82 1888 345 360]
[ 877 35 812 71]
[1300 383 2033 554]
[ 14 516 209 681]
[ 632 2047 1096 366]
[ 532 112 1946 355]
[1402 209 1783 1882]
[1117 788 498 16]
[ 36 1737 1173 1045]
[ 609 1693 455 1117]
[1145 199 645 1355]
[ 381 1732 1191 1482]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:56.757 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 wav [[[ 0.00029411 -0.00040776 -0.00044942 ... -0.02424868 0.02291245
0.05937432]]] -0.35627102851867676 4.4474294554675e-05 0.042314205318689346 0.3049390912055969 (1, 1, 7680)
2026-04-30 19:25:56.757 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 chunk_tokens [[[ 148 1115 1634 741]
[ 893 941 1377 1989]
[1196 1955 103 1230]
[ 10 66 417 1367]
[ 450 889 313 280]
[ 205 176 1694 710]
[ 232 508 296 1525]
[ 763 523 517 1172]
[1537 33 337 154]
[1662 797 1534 25]
[ 715 1159 22 103]
[ 214 104 639 598]
[1887 2004 350 180]
[ 984 2014 566 693]
[ 663 1058 209 1888]
[1098 97 550 820]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:56.782 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 wav [[[ 0.07660156 0.07495726 0.06135209 ... -0.1206022 -0.12184623
-0.1139332 ]]] -0.28353917598724365 7.324956641241442e-06 0.0670274943113327 0.2517559826374054 (1, 1, 7680)
2026-04-30 19:25:56.782 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 chunk_tokens [[[ 383 1804 1559 1196]
[1821 1832 1891 1806]
[1276 384 1356 1904]
[ 517 433 193 2005]
[1009 846 218 1343]
[ 83 1121 1831 972]
[ 95 1634 1627 854]
[1703 400 1440 1496]
[1976 1673 1360 344]
[ 851 1804 1612 1828]
[ 272 1287 1916 739]
[ 88 1207 236 202]
[ 450 441 53 1252]
[ 553 303 1547 1110]
[1204 1662 1488 615]
[ 601 1780 663 242]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:56.806 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 wav [[[-0.10050648 -0.08953431 -0.07884923 ... -0.01869578 -0.0167346
-0.01763956]]] -0.2835456132888794 4.1264713217969984e-05 0.06424345821142197 0.3513103127479553 (1, 1, 7680)
2026-04-30 19:25:56.806 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 chunk_tokens [[[1847 1808 704 152]
[ 736 1514 194 1116]
[ 979 377 1040 483]
[1857 81 784 1511]
[ 987 1330 1771 720]
[1390 1807 1472 1475]
[1821 911 15 1680]
[ 742 751 1293 624]
[ 182 1196 803 1989]
[1600 1979 1473 369]
[ 302 1225 515 874]
[ 612 279 853 1312]
[1492 51 620 1220]
[1325 295 1013 407]
[1786 873 639 412]
[1697 1207 1929 1921]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:56.830 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 wav [[[-1.2177158e-02 -6.4980479e-05 1.2000869e-02 ... -4.9953014e-03
2.0064995e-02 8.1494255e-03]]] -0.3423512578010559 6.946954817976803e-05 0.03836448863148689 0.43560561537742615 (1, 1, 7680)
2026-04-30 19:25:56.831 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 chunk_tokens [[[ 151 1647 1456 255]
[ 700 1228 1194 613]
[1964 933 785 1951]
[ 319 1442 1544 458]
[ 102 253 1137 1083]
[1643 736 1555 232]
[ 610 411 485 18]
[1585 164 342 1309]
[ 142 884 209 1482]
[ 898 1352 939 340]
[1752 861 1043 1365]
[ 583 76 1447 299]
[ 465 1259 144 855]
[ 321 953 139 1048]
[1961 163 7 1142]
[ 366 1696 491 631]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:56.855 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 wav [[[-0.03188938 -0.00509401 0.04241933 ... -0.09476525 -0.18832558
-0.23867904]]] -0.35616523027420044 0.00012159249308751896 0.08303991705179214 0.28495997190475464 (1, 1, 7680)
2026-04-30 19:25:56.855 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 chunk_tokens [[[ 308 2019 360 1065]
[ 637 1990 340 415]
[1759 1151 387 1100]
[1532 1146 549 805]
[ 800 323 302 1178]
[ 982 403 1103 1776]
[ 187 1846 275 311]
[1982 1922 881 1055]
[2035 15 508 1620]
[1442 402 631 321]
[ 924 584 1454 430]
[1389 321 1490 1208]
[ 417 1112 1060 392]
[ 75 117 590 1616]
[ 521 1233 1900 1286]
[ 294 680 741 1179]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:56.879 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 wav [[[-0.2519588 -0.24120857 -0.2249308 ... -0.00908731 -0.00565482
-0.00478506]]] -0.302659809589386 -0.0002039571845671162 0.06957393139600754 0.3183087110519409 (1, 1, 7680)
2026-04-30 19:25:56.879 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 chunk_tokens [[[1624 1910 1353 1961]
[ 382 667 682 543]
[ 180 14 1006 1399]
[1829 1070 1670 1336]
[ 178 1092 918 1030]
[ 284 616 1794 143]
[1352 1321 1861 836]
[ 149 709 313 1569]
[1098 1680 1162 1803]
[1458 1654 1001 50]
[1780 1346 649 970]
[1820 223 1077 545]
[1222 1017 493 1315]
[1886 1268 1799 1445]
[ 434 1009 1988 1755]
[ 203 302 1823 625]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:56.903 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 wav [[[-4.7078328e-03 7.2684824e-03 2.4840837e-02 ... -1.4027000e-05
1.5263325e-04 1.7792435e-04]]] -0.1658807247877121 0.00014102911518421024 0.03195255622267723 0.18852373957633972 (1, 1, 7680)
2026-04-30 19:25:56.903 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 chunk_tokens [[[1931 1945]
[1572 1838]
[1054 293]
[ 629 191]
[1854 76]
[2036 187]
[ 761 305]
[1641 421]
[ 192 882]
[1589 1308]
[ 324 1583]
[ 437 439]
[1713 155]
[ 724 288]
[1306 203]
[1534 1624]]] (1, 16, 2) n_chunk_frames 2
2026-04-30 19:25:56.934 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 wav [[[1.19311335e-04 2.77099258e-04 4.16864146e-04 ... 1.06179923e-05
1.06252701e-05 1.15810089e-05]]] -0.001969335600733757 3.6782610550289974e-05 0.0005604626494459808 0.0020639824215322733 (1, 1, 3840)
2026-04-30 19:25:56.934 [INFO] __main__: Synthesising: 'важна не только точность,'
2026-04-30 19:25:56.934 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache в
2026-04-30 19:25:56.934 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False
2026-04-30 19:25:56.938 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list [array([[[0. , 0. , 0. , ..., 0.02545166,
0.01660156, 0.00424194]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00057983, -0.00170898, -0.00448608, ..., -0.0769043 ,
-0.06759644, -0.04257202]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00872803, 0.01107788, 0.00918579, ..., 0.01818848,
0.02148438, 0.00485229]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00686646, -0.01239014, -0.02319336, ..., -0.06646729,
-0.11431885, -0.15585327]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.19403076, -0.21664429, -0.21463013, ..., -0.02148438,
0.00299072, 0.02600098]]], shape=(1, 1, 7680), dtype=float32), array([[[0.05737305, 0.08822632, 0.10968018, ..., 0.04669189,
0.02362061, 0.01470947]]], shape=(1, 1, 7680), dtype=float32), array([[[0.02764893, 0.04623413, 0.0713501 , ..., 0.27127075,
0.32421875, 0.34362793]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.3463745 , 0.3418274 , 0.31503296, ..., -0.00198364,
-0.00198364, -0.00189209]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00192261, -0.00183105, -0.00143433, ..., 0.03048706,
0.04208374, 0.03811646]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02389526, 0.00814819, -0.00369263, ..., -0.00463867,
-0.00466919, -0.00515747]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00616455, -0.00744629, -0.00830078, ..., -0.03097534,
-0.05169678, -0.03753662]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00628662, -0.0045166 , -0.01385498, ..., 0.03604126,
0.01898193, -0.02606201]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.07327271, -0.0708313 , -0.0380249 , ..., -0.00189209,
-0.00308228, -0.00543213]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00762939, -0.00808716, -0.0062561 , ..., -0.04867554,
-0.06396484, -0.07067871]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.06478882, -0.04742432, -0.02655029, ..., -0.00927734,
-0.00787354, -0.01217651]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01885986, -0.02545166, -0.02856445, ..., -0.05807495,
-0.03890991, -0.02404785]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01531982, -0.01760864, -0.02178955, ..., 0.02804565,
0.02838135, 0.02767944]]], shape=(1, 1, 7680), dtype=float32), array([[[0.02700806, 0.02609253, 0.02459717, ..., 0.02215576,
0.02230835, 0.02636719]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.03475952, 0.03826904, 0.02764893, ..., 0.01647949,
-0.01455688, -0.00036621]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00704956, -0.03173828, -0.06103516, ..., 0.00976562,
0.01080322, 0.00741577]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00210571, -0.00189209, -0.00598145, ..., 0.0350647 ,
0.03173828, 0.01358032]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00378418, -0.025177 , -0.04141235, ..., -0.00460815,
0.00967407, 0.01904297]]], shape=(1, 1, 7680), dtype=float32), array([[[ 2.5421143e-02, 3.4332275e-02, 4.8004150e-02, ...,
6.4086914e-04, 3.0517578e-05, -7.6293945e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.00106812, -0.00131226, -0.00180054, ..., -0.00238037,
-0.00210571, -0.00195312]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00131226, -0.00048828, -0.00064087, ..., -0.12442017,
-0.13143921, -0.15240479]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.17025757, -0.16925049, -0.14294434, ..., 0.00350952,
0.00283813, 0.00177002]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00201416, 0.003479 , 0.00323486, ..., -0.02636719,
-0.02493286, 0.00787354]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04818726, 0.05957031, 0.03213501, ..., -0.11203003,
-0.09613037, -0.09103394]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.09631348, -0.10897827, -0.12399292, ..., -0.00085449,
-0.00091553, -0.00048828]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.0000000e+00, 6.1035156e-05, -1.2207031e-04, ...,
1.3381958e-01, 1.6635132e-01, 2.0919800e-01]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 2.3223877e-01, 2.0669556e-01, 1.3903809e-01, ...,
-1.8310547e-04, -1.5258789e-04, -9.1552734e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[-9.1552734e-05, -6.1035156e-05, -3.0517578e-05, ...,
0.0000000e+00, -3.0517578e-05, 0.0000000e+00]]],
shape=(1, 1, 5339), dtype=float32), array([[[-0.02130234, -0.01856662, -0.01710658, ..., 0.00041982,
0.00062048, 0.0006307 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00029411, -0.00040776, -0.00044942, ..., -0.02424868,
0.02291245, 0.05937432]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.07660156, 0.07495726, 0.06135209, ..., -0.1206022 ,
-0.12184623, -0.1139332 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10050648, -0.08953431, -0.07884923, ..., -0.01869578,
-0.0167346 , -0.01763956]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2177158e-02, -6.4980479e-05, 1.2000869e-02, ...,
-4.9953014e-03, 2.0064995e-02, 8.1494255e-03]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03188938, -0.00509401, 0.04241933, ..., -0.09476525,
-0.18832558, -0.23867904]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.2519588 , -0.24120857, -0.2249308 , ..., -0.00908731,
-0.00565482, -0.00478506]]], shape=(1, 1, 7680), dtype=float32), array([[[-4.7078328e-03, 7.2684824e-03, 2.4840837e-02, ...,
-1.4027000e-05, 1.5263325e-04, 1.7792435e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[1.19311335e-04, 2.77099258e-04, 4.16864146e-04, ...,
1.06179923e-05, 1.06252701e-05, 1.15810089e-05]]],
shape=(1, 1, 3840), dtype=float32)] 41
2026-04-30 19:25:56.938 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history [0.0000000e+00 0.0000000e+00 0.0000000e+00 ... 1.0617992e-05 1.0625270e-05
1.1581009e-05] (308699,) float32
2026-04-30 19:25:56.939 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history_after cut_idx 16 [-1.5319824e-02 -1.7608643e-02 -2.1789551e-02 ... 1.0617992e-05
1.0625270e-05 1.1581009e-05] (185819,) float32
2026-04-30 19:25:56.941 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list_after cut_idx 16 [array([[[-0.01531982, -0.01760864, -0.02178955, ..., 0.02804565,
0.02838135, 0.02767944]]], shape=(1, 1, 7680), dtype=float32), array([[[0.02700806, 0.02609253, 0.02459717, ..., 0.02215576,
0.02230835, 0.02636719]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.03475952, 0.03826904, 0.02764893, ..., 0.01647949,
-0.01455688, -0.00036621]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00704956, -0.03173828, -0.06103516, ..., 0.00976562,
0.01080322, 0.00741577]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00210571, -0.00189209, -0.00598145, ..., 0.0350647 ,
0.03173828, 0.01358032]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00378418, -0.025177 , -0.04141235, ..., -0.00460815,
0.00967407, 0.01904297]]], shape=(1, 1, 7680), dtype=float32), array([[[ 2.5421143e-02, 3.4332275e-02, 4.8004150e-02, ...,
6.4086914e-04, 3.0517578e-05, -7.6293945e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.00106812, -0.00131226, -0.00180054, ..., -0.00238037,
-0.00210571, -0.00195312]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00131226, -0.00048828, -0.00064087, ..., -0.12442017,
-0.13143921, -0.15240479]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.17025757, -0.16925049, -0.14294434, ..., 0.00350952,
0.00283813, 0.00177002]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00201416, 0.003479 , 0.00323486, ..., -0.02636719,
-0.02493286, 0.00787354]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04818726, 0.05957031, 0.03213501, ..., -0.11203003,
-0.09613037, -0.09103394]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.09631348, -0.10897827, -0.12399292, ..., -0.00085449,
-0.00091553, -0.00048828]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.0000000e+00, 6.1035156e-05, -1.2207031e-04, ...,
1.3381958e-01, 1.6635132e-01, 2.0919800e-01]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 2.3223877e-01, 2.0669556e-01, 1.3903809e-01, ...,
-1.8310547e-04, -1.5258789e-04, -9.1552734e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[-9.1552734e-05, -6.1035156e-05, -3.0517578e-05, ...,
0.0000000e+00, -3.0517578e-05, 0.0000000e+00]]],
shape=(1, 1, 5339), dtype=float32), array([[[-0.02130234, -0.01856662, -0.01710658, ..., 0.00041982,
0.00062048, 0.0006307 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00029411, -0.00040776, -0.00044942, ..., -0.02424868,
0.02291245, 0.05937432]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.07660156, 0.07495726, 0.06135209, ..., -0.1206022 ,
-0.12184623, -0.1139332 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10050648, -0.08953431, -0.07884923, ..., -0.01869578,
-0.0167346 , -0.01763956]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2177158e-02, -6.4980479e-05, 1.2000869e-02, ...,
-4.9953014e-03, 2.0064995e-02, 8.1494255e-03]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03188938, -0.00509401, 0.04241933, ..., -0.09476525,
-0.18832558, -0.23867904]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.2519588 , -0.24120857, -0.2249308 , ..., -0.00908731,
-0.00565482, -0.00478506]]], shape=(1, 1, 7680), dtype=float32), array([[[-4.7078328e-03, 7.2684824e-03, 2.4840837e-02, ...,
-1.4027000e-05, 1.5263325e-04, 1.7792435e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[1.19311335e-04, 2.77099258e-04, 4.16864146e-04, ...,
1.06179923e-05, 1.06252701e-05, 1.15810089e-05]]],
shape=(1, 1, 3840), dtype=float32)] 25
2026-04-30 19:25:56.941 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069
2026-04-30 19:25:57.015 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[ 0.00643774 0.07635596 -0.06491913 ... 0.20177338 0.0492254
0.11219472]]] (1, 1, 1024)
2026-04-30 19:25:57.015 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]]
2026-04-30 19:25:57.015 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]]] (1, 4, 1024)
2026-04-30 19:25:57.015 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 1, 1024)
2026-04-30 19:25:57.016 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]
[ 0.00643774 0.07635596 -0.06491913 ... 0.20177338 0.0492254
0.11219472]
[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 6, 1024)
2026-04-30 19:25:57.016 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22
Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:25:57.016 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:25:57.016 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3)
2026-04-30 19:25:57.016 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3)
2026-04-30 19:25:57.017 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024)
2026-04-30 19:25:57.017 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036
-0.00767252]]] (1, 1, 1024)
2026-04-30 19:25:57.017 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528
0.00424147]]] (1, 1, 1024)
2026-04-30 19:25:57.018 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724
-0.00170945]
[ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198
0.00132705]
[ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966
0.0080104 ]
[ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711
0.00252486]
[ 0.01121592 0.07254998 -0.06661529 ... 0.19248903 0.05078068
0.11643619]
[ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459
-0.00718043]]] (1, 6, 1024)
2026-04-30 19:25:57.018 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]
...
[ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03
-2.0710612e-04 2.5248611e-03]
[ 1.1215920e-02 7.2549976e-02 -6.6615291e-02 ... 1.9248903e-01
5.0780680e-02 1.1643619e-01]
[ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03
3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024)
2026-04-30 19:25:57.064 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=53; step_idx=53
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill cont done; talker_seq_len=53; step_idx=53
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache ва
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ж -> text_cache важ
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache важн
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache важна
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache важна
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache важна н
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache важна не
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache важна не
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache важна не т
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache важна не то
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache важна не тол
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ь -> text_cache важна не толь
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache важна не тольк
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache важна не только
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache важна не только
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache важна не только т
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache важна не только то
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ч -> text_cache важна не только точ
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache важна не только точн
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache важна не только точно
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache важна не только точнос
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache важна не только точност
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ь -> text_cache важна не только точность
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment , -> text_cache важна не только точность,
2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['важна не только точность,'] 25
Qwen3TTSProcessor __call__ text ['важна не только точность,']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 5474, 37557, 14191, 18658, 73626, 81602, 60279, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 5474, 37557, 14191, 18658, 73626, 81602, 60279, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 5474 37557 14191 18658 73626 81602 60279 11]] (1, 8)
2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 5474 37557 14191 18658 73626 81602 60279 11]] (1, 8)
2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment важна не только точность, 25 -> tokenized_segment [np.int64(5474), np.int64(37557), np.int64(14191), np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 8
2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(5474), np.int64(37557), np.int64(14191), np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)]
2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(5474), np.int64(37557), np.int64(14191), np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 8
2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 5474 -> pending_tokens [np.int64(37557), np.int64(14191), np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 7
2026-04-30 19:25:57.111 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-53 vq [1221] (1,) int64
2026-04-30 19:25:57.138 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-54 vq-rvq [[[1221 785 99 77 621 1441 1570 691 1793 241 1015 1149 1055 119
320 197]]] (1, 1, 16) int64
2026-04-30 19:25:57.138 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 37557 -> pending_tokens [np.int64(14191), np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 6
2026-04-30 19:25:57.146 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-54 vq [2042] (1,) int64
2026-04-30 19:25:57.173 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-55 vq-rvq [[[2042 636 1070 630 1799 1672 1718 418 284 1789 846 298 318 1460
79 1745]]] (1, 1, 16) int64
2026-04-30 19:25:57.173 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 14191 -> pending_tokens [np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 5
2026-04-30 19:25:57.181 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-55 vq [1609] (1,) int64
2026-04-30 19:25:57.208 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-56 vq-rvq [[[1609 1593 952 1154 1077 356 1416 120 767 526 958 484 1378 1280
1096 285]]] (1, 1, 16) int64
2026-04-30 19:25:57.208 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 18658 -> pending_tokens [np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 4
2026-04-30 19:25:57.216 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-56 vq [480] (1,) int64
2026-04-30 19:25:57.243 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-57 vq-rvq [[[ 480 241 72 1730 36 766 204 871 556 1875 153 84 1125 929
152 503]]] (1, 1, 16) int64
2026-04-30 19:25:57.243 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 73626 -> pending_tokens [np.int64(81602), np.int64(60279), np.int64(11)] 3
2026-04-30 19:25:57.251 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-57 vq [1088] (1,) int64
2026-04-30 19:25:57.278 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-58 vq-rvq [[[1088 845 884 1092 475 14 798 1783 877 1451 1300 1038 358 134
181 299]]] (1, 1, 16) int64
2026-04-30 19:25:57.278 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 81602 -> pending_tokens [np.int64(60279), np.int64(11)] 2
2026-04-30 19:25:57.286 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-58 vq [1809] (1,) int64
2026-04-30 19:25:57.313 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-59 vq-rvq [[[1809 727 1957 1783 1214 1163 458 1096 156 589 708 172 1909 1531
897 1650]]] (1, 1, 16) int64
2026-04-30 19:25:57.313 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 60279 -> pending_tokens [np.int64(11)] 1
2026-04-30 19:25:57.321 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-59 vq [400] (1,) int64
2026-04-30 19:25:57.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-60 vq-rvq [[[ 400 407 507 36 1051 711 505 1116 1786 854 359 797 507 1880
392 245]]] (1, 1, 16) int64
2026-04-30 19:25:57.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11 -> pending_tokens [] 0
2026-04-30 19:25:57.356 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-60 vq [935] (1,) int64
2026-04-30 19:25:57.383 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-61 vq-rvq [[[ 935 710 534 130 488 1388 405 849 667 1770 373 111 568 1076
118 702]]] (1, 1, 16) int64
2026-04-30 19:25:57.383 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-34 chunk_tokens [[[1221 2042 1609 480]
[ 785 636 1593 241]
[ 99 1070 952 72]
[ 77 630 1154 1730]
[ 621 1799 1077 36]
[1441 1672 356 766]
[1570 1718 1416 204]
[ 691 418 120 871]
[1793 284 767 556]
[ 241 1789 526 1875]
[1015 846 958 153]
[1149 298 484 84]
[1055 318 1378 1125]
[ 119 1460 1280 929]
[ 320 79 1096 152]
[ 197 1745 285 503]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:57.407 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-34 wav [[[ 1.2349803e-05 1.2119761e-05 2.1108619e-05 ... -1.6870323e-01
-1.3621169e-01 -8.6433820e-02]]] -0.3643661439418793 -1.744547626003623e-05 0.06652440875768661 0.3390018343925476 (1, 1, 7680)
2026-04-30 19:25:57.408 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-38 chunk_tokens [[[1088 1809 400 935]
[ 845 727 407 710]
[ 884 1957 507 534]
[1092 1783 36 130]
[ 475 1214 1051 488]
[ 14 1163 711 1388]
[ 798 458 505 405]
[1783 1096 1116 849]
[ 877 156 1786 667]
[1451 589 854 1770]
[1300 708 359 373]
[1038 172 797 111]
[ 358 1909 507 568]
[ 134 1531 1880 1076]
[ 181 897 392 118]
[ 299 1650 245 702]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-38 wav [[[-0.03330091 0.00856069 0.03467582 ... -0.04072727 -0.03181617
-0.00645593]]] -0.24222812056541443 -6.13010925007984e-05 0.060314808040857315 0.37109240889549255 (1, 1, 7680)
2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0
2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1
2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1
2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0
2026-04-30 19:25:57.440 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-61 vq [332] (1,) int64
2026-04-30 19:25:57.467 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-62 vq-rvq [[[ 332 1414 379 982 1287 1805 17 1408 623 259 1493 294 1569 396
1969 11]]] (1, 1, 16) int64
2026-04-30 19:25:57.475 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-62 vq [178] (1,) int64
2026-04-30 19:25:57.502 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-63 vq-rvq [[[ 178 740 609 1805 1484 74 1476 620 589 1698 1320 996 1777 1000
1180 234]]] (1, 1, 16) int64
2026-04-30 19:25:57.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-63 vq [303] (1,) int64
2026-04-30 19:25:57.536 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-64 vq-rvq [[[ 303 1047 206 1652 1019 62 1193 889 169 371 367 872 1104 178
30 57]]] (1, 1, 16) int64
2026-04-30 19:25:57.544 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-64 vq [326] (1,) int64
2026-04-30 19:25:57.571 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-65 vq-rvq [[[ 326 887 374 636 1607 977 350 1344 111 815 38 885 106 152
257 1173]]] (1, 1, 16) int64
2026-04-30 19:25:57.579 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-65 vq [494] (1,) int64
2026-04-30 19:25:57.606 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-66 vq-rvq [[[ 494 666 1704 585 479 164 1123 637 573 1993 323 121 1551 1425
818 225]]] (1, 1, 16) int64
2026-04-30 19:25:57.614 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-66 vq [75] (1,) int64
2026-04-30 19:25:57.640 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-67 vq-rvq [[[ 75 721 657 202 927 1645 1968 273 700 253 1295 1527 904 225
1525 270]]] (1, 1, 16) int64
2026-04-30 19:25:57.648 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-67 vq [875] (1,) int64
2026-04-30 19:25:57.675 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-68 vq-rvq [[[ 875 1773 1275 1302 500 1192 603 596 198 346 178 874 815 670
1284 1411]]] (1, 1, 16) int64
2026-04-30 19:25:57.683 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-68 vq [612] (1,) int64
2026-04-30 19:25:57.710 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-69 vq-rvq [[[ 612 92 1120 651 608 1207 2032 1069 553 746 1775 931 1844 1537
280 953]]] (1, 1, 16) int64
2026-04-30 19:25:57.718 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-69 vq [828] (1,) int64
2026-04-30 19:25:57.745 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-70 vq-rvq [[[ 828 1200 369 1765 1204 443 1137 878 517 498 461 969 494 1761
1729 1963]]] (1, 1, 16) int64
2026-04-30 19:25:57.753 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-70 vq [357] (1,) int64
2026-04-30 19:25:57.779 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-71 vq-rvq [[[ 357 273 0 1853 351 1318 736 11 271 430 748 889 782 1421
1122 1022]]] (1, 1, 16) int64
2026-04-30 19:25:57.787 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-71 vq [914] (1,) int64
2026-04-30 19:25:57.814 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-72 vq-rvq [[[ 914 1809 636 1982 1328 1079 540 151 461 91 1194 521 1477 997
1761 1225]]] (1, 1, 16) int64
2026-04-30 19:25:57.822 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-72 vq [4] (1,) int64
2026-04-30 19:25:57.849 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-73 vq-rvq [[[ 4 572 28 1722 860 112 163 690 410 775 1071 465 1230 1497
266 1405]]] (1, 1, 16) int64
2026-04-30 19:25:57.857 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-73 vq [759] (1,) int64
2026-04-30 19:25:57.884 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-74 vq-rvq [[[ 759 844 1989 1533 1402 840 1516 1915 1390 1626 1905 1601 870 701
396 126]]] (1, 1, 16) int64
2026-04-30 19:25:57.892 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-74 vq [2150] (1,) int64
2026-04-30 19:25:57.892 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-42 chunk_tokens [[[ 332 178 303 326]
[1414 740 1047 887]
[ 379 609 206 374]
[ 982 1805 1652 636]
[1287 1484 1019 1607]
[1805 74 62 977]
[ 17 1476 1193 350]
[1408 620 889 1344]
[ 623 589 169 111]
[ 259 1698 371 815]
[1493 1320 367 38]
[ 294 996 872 885]
[1569 1777 1104 106]
[ 396 1000 178 152]
[1969 1180 30 257]
[ 11 234 57 1173]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:57.916 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-42 wav [[[ 0.01122023 0.00413963 -0.00393783 ... -0.00029461 0.00421931
-0.00251451]]] -0.3219706416130066 0.00016606935241725296 0.0811227560043335 0.32183170318603516 (1, 1, 7680)
2026-04-30 19:25:57.916 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-46 chunk_tokens [[[ 494 75 875 612]
[ 666 721 1773 92]
[1704 657 1275 1120]
[ 585 202 1302 651]
[ 479 927 500 608]
[ 164 1645 1192 1207]
[1123 1968 603 2032]
[ 637 273 596 1069]
[ 573 700 198 553]
[1993 253 346 746]
[ 323 1295 178 1775]
[ 121 1527 874 931]
[1551 904 815 1844]
[1425 225 670 1537]
[ 818 1525 1284 280]
[ 225 270 1411 953]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:57.940 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-46 wav [[[-0.0154132 -0.02377532 -0.02271089 ... 0.02933036 0.023146
0.01213897]]] -0.25987228751182556 0.00021866057068109512 0.03468051925301552 0.2589060962200165 (1, 1, 7680)
2026-04-30 19:25:57.941 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-50 chunk_tokens [[[ 828 357 914 4]
[1200 273 1809 572]
[ 369 0 636 28]
[1765 1853 1982 1722]
[1204 351 1328 860]
[ 443 1318 1079 112]
[1137 736 540 163]
[ 878 11 151 690]
[ 517 271 461 410]
[ 498 430 91 775]
[ 461 748 1194 1071]
[ 969 889 521 465]
[ 494 782 1477 1230]
[1761 1421 997 1497]
[1729 1122 1761 266]
[1963 1022 1225 1405]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:57.965 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-50 wav [[[-0.00091471 -0.01367491 -0.02537205 ... -0.00178504 0.00290802
0.00261759]]] -0.10340271145105362 -0.00010349442163715139 0.01529962569475174 0.12059158831834793 (1, 1, 7680)
2026-04-30 19:25:57.965 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-54 chunk_tokens [[[ 759]
[ 844]
[1989]
[1533]
[1402]
[ 840]
[1516]
[1915]
[1390]
[1626]
[1905]
[1601]
[ 870]
[ 701]
[ 396]
[ 126]]] (1, 16, 1) n_chunk_frames 1
2026-04-30 19:25:58.029 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-54 wav [[[-2.6994986e-03 -8.4007008e-04 2.4883149e-03 ... 1.0968803e-05
1.0850177e-05 1.1066140e-05]]] -0.015569623559713364 1.784202868293505e-05 0.0029718538280576468 0.021655267104506493 (1, 1, 1920)
2026-04-30 19:25:58.029 [INFO] src.inference.qwen3_tts_inferencer_onnx: reset_turn reset_generation_state step-idx-75
2026-04-30 19:25:58.047 [INFO] __main__: Synthesising: 'но и низкая задержка.'
2026-04-30 19:25:58.047 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache н
2026-04-30 19:25:58.047 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False
2026-04-30 19:25:58.047 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069
2026-04-30 19:25:58.127 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076
0.08690926]]] (1, 1, 1024)
2026-04-30 19:25:58.127 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]]
2026-04-30 19:25:58.127 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]]] (1, 4, 1024)
2026-04-30 19:25:58.127 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 1, 1024)
2026-04-30 19:25:58.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]
[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076
0.08690926]
[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 6, 1024)
2026-04-30 19:25:58.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22
Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:25:58.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:25:58.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3)
2026-04-30 19:25:58.129 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3)
2026-04-30 19:25:58.129 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024)
2026-04-30 19:25:58.129 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036
-0.00767252]]] (1, 1, 1024)
2026-04-30 19:25:58.130 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528
0.00424147]]] (1, 1, 1024)
2026-04-30 19:25:58.130 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724
-0.00170945]
[ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198
0.00132705]
[ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966
0.0080104 ]
[ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711
0.00252486]
[-0.02064589 0.05184897 0.01909059 ... 0.2070941 0.06416605
0.09115074]
[ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459
-0.00718043]]] (1, 6, 1024)
2026-04-30 19:25:58.130 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]
...
[ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03
-2.0710612e-04 2.5248611e-03]
[-2.0645889e-02 5.1848970e-02 1.9090585e-02 ... 2.0709410e-01
6.4166047e-02 9.1150738e-02]
[ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03
3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024)
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=9; step_idx=0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache но
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache но
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache но и
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache но и
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache но и н
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache но и ни
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment з -> text_cache но и низ
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache но и низк
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache но и низка
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache но и низкая
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache но и низкая
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment з -> text_cache но и низкая з
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache но и низкая за
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache но и низкая зад
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache но и низкая заде
2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache но и низкая задер
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ж -> text_cache но и низкая задерж
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache но и низкая задержк
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache но и низкая задержка
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment . -> text_cache но и низкая задержка.
2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['но и низкая задержка.'] 21
Qwen3TTSProcessor __call__ text ['но и низкая задержка.']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 13685, 7587, 6709, 40773, 125107, 52180, 57569, 13132,
13]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 13685, 7587, 6709, 40773, 125107, 52180, 57569, 13132,
13]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 13685 7587 6709 40773 125107 52180 57569 13132 13]] (1, 9)
2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 13685 7587 6709 40773 125107 52180 57569 13132 13]] (1, 9)
2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment но и низкая задержка. 21 -> tokenized_segment [np.int64(13685), np.int64(7587), np.int64(6709), np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 9
2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(13685), np.int64(7587), np.int64(6709), np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)]
2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(13685), np.int64(7587), np.int64(6709), np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 9
2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13685 -> pending_tokens [np.int64(7587), np.int64(6709), np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 8
2026-04-30 19:25:58.185 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-0 vq [1995] (1,) int64
2026-04-30 19:25:58.212 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-1 vq-rvq [[[1995 1534 69 156 293 871 157 628 1976 836 35 1264 1174 1903
1360 1265]]] (1, 1, 16) int64
2026-04-30 19:25:58.212 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 7587 -> pending_tokens [np.int64(6709), np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 7
2026-04-30 19:25:58.220 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-1 vq [215] (1,) int64
2026-04-30 19:25:58.247 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-2 vq-rvq [[[ 215 911 373 270 817 1084 848 108 510 68 1652 886 1318 224
247 429]]] (1, 1, 16) int64
2026-04-30 19:25:58.247 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6709 -> pending_tokens [np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 6
2026-04-30 19:25:58.255 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-2 vq [1521] (1,) int64
2026-04-30 19:25:58.282 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-3 vq-rvq [[[1521 1408 1402 1979 1705 178 1776 359 174 1469 1000 434 686 1094
801 413]]] (1, 1, 16) int64
2026-04-30 19:25:58.282 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 40773 -> pending_tokens [np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 5
2026-04-30 19:25:58.290 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-3 vq [1095] (1,) int64
2026-04-30 19:25:58.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-4 vq-rvq [[[1095 682 581 1327 1706 2010 970 1984 1728 12 243 755 1321 1077
1127 139]]] (1, 1, 16) int64
2026-04-30 19:25:58.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 125107 -> pending_tokens [np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 4
2026-04-30 19:25:58.325 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-4 vq [1985] (1,) int64
2026-04-30 19:25:58.352 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-5 vq-rvq [[[1985 781 1586 1532 820 1763 338 1569 488 583 1265 1920 1329 286
795 1066]]] (1, 1, 16) int64
2026-04-30 19:25:58.352 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 52180 -> pending_tokens [np.int64(57569), np.int64(13132), np.int64(13)] 3
2026-04-30 19:25:58.360 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-5 vq [251] (1,) int64
2026-04-30 19:25:58.387 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-6 vq-rvq [[[ 251 563 1396 1805 1921 169 364 787 798 2019 413 820 1846 986
2 1385]]] (1, 1, 16) int64
2026-04-30 19:25:58.387 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 57569 -> pending_tokens [np.int64(13132), np.int64(13)] 2
2026-04-30 19:25:58.395 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-6 vq [673] (1,) int64
2026-04-30 19:25:58.421 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-7 vq-rvq [[[ 673 440 1750 570 1263 342 1539 694 1191 1567 651 322 1252 576
129 271]]] (1, 1, 16) int64
2026-04-30 19:25:58.422 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13132 -> pending_tokens [np.int64(13)] 1
2026-04-30 19:25:58.430 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-7 vq [1850] (1,) int64
2026-04-30 19:25:58.456 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-8 vq-rvq [[[1850 407 1614 1847 329 870 1376 609 3 499 592 1466 913 649
595 612]]] (1, 1, 16) int64
2026-04-30 19:25:58.457 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13 -> pending_tokens [] 0
2026-04-30 19:25:58.465 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-8 vq [603] (1,) int64
2026-04-30 19:25:58.491 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-9 vq-rvq [[[ 603 1713 74 7 1771 1121 147 1890 194 1143 86 16 950 590
1359 1680]]] (1, 1, 16) int64
2026-04-30 19:25:58.492 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 chunk_tokens [[[1995 215 1521 1095]
[1534 911 1408 682]
[ 69 373 1402 581]
[ 156 270 1979 1327]
[ 293 817 1705 1706]
[ 871 1084 178 2010]
[ 157 848 1776 970]
[ 628 108 359 1984]
[1976 510 174 1728]
[ 836 68 1469 12]
[ 35 1652 1000 243]
[1264 886 434 755]
[1174 1318 686 1321]
[1903 224 1094 1077]
[1360 247 801 1127]
[1265 429 413 139]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:58.516 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 wav [[[-0.02139645 -0.0189162 -0.01778135 ... -0.00045287 -0.00059633
-0.00165827]]] -0.06060675159096718 -3.906790152541362e-05 0.0041542695835232735 0.03418533504009247 (1, 1, 7680)
2026-04-30 19:25:58.516 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 chunk_tokens [[[1985 251 673 1850]
[ 781 563 440 407]
[1586 1396 1750 1614]
[1532 1805 570 1847]
[ 820 1921 1263 329]
[1763 169 342 870]
[ 338 364 1539 1376]
[1569 787 694 609]
[ 488 798 1191 3]
[ 583 2019 1567 499]
[1265 413 651 592]
[1920 820 322 1466]
[1329 1846 1252 913]
[ 286 986 576 649]
[ 795 2 129 595]
[1066 1385 271 612]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 wav [[[-0.00221966 -0.00138947 -0.000929 ... -0.1126425 -0.1338531
-0.13333385]]] -0.2866828441619873 -4.102538150618784e-05 0.053047213703393936 0.2836780846118927 (1, 1, 7680)
2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0
2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1
2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1
2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0
2026-04-30 19:25:58.548 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-9 vq [432] (1,) int64
2026-04-30 19:25:58.575 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-10 vq-rvq [[[ 432 1513 844 1935 1769 1323 747 1096 107 666 1051 1541 1954 1701
1444 257]]] (1, 1, 16) int64
2026-04-30 19:25:58.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-10 vq [1566] (1,) int64
2026-04-30 19:25:58.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-11 vq-rvq [[[1566 118 1365 36 1490 687 1060 445 1749 1948 352 1957 317 1583
615 1817]]] (1, 1, 16) int64
2026-04-30 19:25:58.618 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-11 vq [551] (1,) int64
2026-04-30 19:25:58.646 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-12 vq-rvq [[[ 551 1354 65 1625 177 1876 155 817 1336 1556 715 447 486 1383
754 369]]] (1, 1, 16) int64
2026-04-30 19:25:58.654 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-12 vq [679] (1,) int64
2026-04-30 19:25:58.681 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-13 vq-rvq [[[ 679 1116 189 576 1178 964 793 351 350 1506 21 461 985 1369
329 864]]] (1, 1, 16) int64
2026-04-30 19:25:58.689 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-13 vq [821] (1,) int64
2026-04-30 19:25:58.716 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-14 vq-rvq [[[ 821 631 1332 2000 341 501 1972 1233 167 463 1411 1572 1943 472
626 1278]]] (1, 1, 16) int64
2026-04-30 19:25:58.724 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-14 vq [1265] (1,) int64
2026-04-30 19:25:58.751 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-15 vq-rvq [[[1265 1024 72 631 929 1040 873 1303 1930 1404 883 1049 164 1184
1829 1314]]] (1, 1, 16) int64
2026-04-30 19:25:58.759 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-15 vq [1132] (1,) int64
2026-04-30 19:25:58.786 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-16 vq-rvq [[[1132 181 0 120 1965 1999 630 1176 573 851 1001 1372 878 2005
1340 1047]]] (1, 1, 16) int64
2026-04-30 19:25:58.794 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-16 vq [1215] (1,) int64
2026-04-30 19:25:58.821 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-17 vq-rvq [[[1215 1013 318 1970 330 831 524 1123 1494 243 597 412 1997 1590
7 833]]] (1, 1, 16) int64
2026-04-30 19:25:58.829 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-17 vq [1304] (1,) int64
2026-04-30 19:25:58.856 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-18 vq-rvq [[[1304 1403 98 1347 426 1146 864 976 1752 74 643 150 980 1736
1018 718]]] (1, 1, 16) int64
2026-04-30 19:25:58.864 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-18 vq [1162] (1,) int64
2026-04-30 19:25:58.891 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-19 vq-rvq [[[1162 714 1269 1043 159 1462 650 1709 1723 1418 636 19 186 1355
1165 1277]]] (1, 1, 16) int64
2026-04-30 19:25:58.899 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-19 vq [1363] (1,) int64
2026-04-30 19:25:58.925 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-20 vq-rvq [[[1363 328 606 1060 758 424 1332 1605 587 870 1019 1865 515 175
1953 341]]] (1, 1, 16) int64
2026-04-30 19:25:58.933 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-20 vq [1947] (1,) int64
2026-04-30 19:25:58.960 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-21 vq-rvq [[[1947 32 1351 790 299 1159 676 898 1925 797 271 1561 1161 1074
123 1165]]] (1, 1, 16) int64
2026-04-30 19:25:58.968 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-21 vq [2004] (1,) int64
2026-04-30 19:25:58.995 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-22 vq-rvq [[[2004 1517 1142 1302 1919 812 1083 883 640 410 539 1327 1036 894
1066 1681]]] (1, 1, 16) int64
2026-04-30 19:25:59.003 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-22 vq [610] (1,) int64
2026-04-30 19:25:59.029 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-23 vq-rvq [[[ 610 201 1667 1861 650 897 857 1105 1707 1696 1669 545 77 578
249 428]]] (1, 1, 16) int64
2026-04-30 19:25:59.037 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-23 vq [2150] (1,) int64
2026-04-30 19:25:59.037 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 chunk_tokens [[[ 603 432 1566 551]
[1713 1513 118 1354]
[ 74 844 1365 65]
[ 7 1935 36 1625]
[1771 1769 1490 177]
[1121 1323 687 1876]
[ 147 747 1060 155]
[1890 1096 445 817]
[ 194 107 1749 1336]
[1143 666 1948 1556]
[ 86 1051 352 715]
[ 16 1541 1957 447]
[ 950 1954 317 486]
[ 590 1701 1583 1383]
[1359 1444 615 754]
[1680 257 1817 369]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:59.062 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 wav [[[-0.10775348 -0.05212127 0.0396859 ... -0.04563401 -0.03402565
-0.03579839]]] -0.2528039216995239 0.00014185786130838096 0.08753377944231033 0.3491342067718506 (1, 1, 7680)
2026-04-30 19:25:59.062 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 chunk_tokens [[[ 679 821 1265 1132]
[1116 631 1024 181]
[ 189 1332 72 0]
[ 576 2000 631 120]
[1178 341 929 1965]
[ 964 501 1040 1999]
[ 793 1972 873 630]
[ 351 1233 1303 1176]
[ 350 167 1930 573]
[1506 463 1404 851]
[ 21 1411 883 1001]
[ 461 1572 1049 1372]
[ 985 1943 164 878]
[1369 472 1184 2005]
[ 329 626 1829 1340]
[ 864 1278 1314 1047]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:59.086 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 wav [[[-0.03745677 -0.02658239 -0.02583151 ... -0.0121026 -0.00580872
-0.01895227]]] -0.3388431966304779 -5.873028840142069e-06 0.08189456164836884 0.3841433525085449 (1, 1, 7680)
2026-04-30 19:25:59.086 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 chunk_tokens [[[1215 1304 1162 1363]
[1013 1403 714 328]
[ 318 98 1269 606]
[1970 1347 1043 1060]
[ 330 426 159 758]
[ 831 1146 1462 424]
[ 524 864 650 1332]
[1123 976 1709 1605]
[1494 1752 1723 587]
[ 243 74 1418 870]
[ 597 643 636 1019]
[ 412 150 19 1865]
[1997 980 186 515]
[1590 1736 1355 175]
[ 7 1018 1165 1953]
[ 833 718 1277 341]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:59.110 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 wav [[[-0.0263972 -0.01400574 -0.01092716 ... -0.00139586 0.00422512
0.00643334]]] -0.3704526722431183 2.6455960323801264e-05 0.08883234858512878 0.43402376770973206 (1, 1, 7680)
2026-04-30 19:25:59.110 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 chunk_tokens [[[1947 2004 610]
[ 32 1517 201]
[1351 1142 1667]
[ 790 1302 1861]
[ 299 1919 650]
[1159 812 897]
[ 676 1083 857]
[ 898 883 1105]
[1925 640 1707]
[ 797 410 1696]
[ 271 539 1669]
[1561 1327 545]
[1161 1036 77]
[1074 894 578]
[ 123 1066 249]
[1165 1681 428]]] (1, 16, 3) n_chunk_frames 3
2026-04-30 19:25:59.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 wav [[[ 0.00588865 0.00345067 -0.00066399 ... 0.00632556 0.00391393
0.00175216]]] -0.1507491022348404 1.726094342302531e-05 0.0315101258456707 0.2467532902956009 (1, 1, 5760)
2026-04-30 19:25:59.176 [INFO] __main__: Synthesising: 'Если это происходит не мгновенно,'
2026-04-30 19:25:59.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment Е -> text_cache Е
2026-04-30 19:25:59.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False
2026-04-30 19:25:59.179 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list [array([[[-0.01531982, -0.01760864, -0.02178955, ..., 0.02804565,
0.02838135, 0.02767944]]], shape=(1, 1, 7680), dtype=float32), array([[[0.02700806, 0.02609253, 0.02459717, ..., 0.02215576,
0.02230835, 0.02636719]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.03475952, 0.03826904, 0.02764893, ..., 0.01647949,
-0.01455688, -0.00036621]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00704956, -0.03173828, -0.06103516, ..., 0.00976562,
0.01080322, 0.00741577]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00210571, -0.00189209, -0.00598145, ..., 0.0350647 ,
0.03173828, 0.01358032]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00378418, -0.025177 , -0.04141235, ..., -0.00460815,
0.00967407, 0.01904297]]], shape=(1, 1, 7680), dtype=float32), array([[[ 2.5421143e-02, 3.4332275e-02, 4.8004150e-02, ...,
6.4086914e-04, 3.0517578e-05, -7.6293945e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.00106812, -0.00131226, -0.00180054, ..., -0.00238037,
-0.00210571, -0.00195312]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00131226, -0.00048828, -0.00064087, ..., -0.12442017,
-0.13143921, -0.15240479]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.17025757, -0.16925049, -0.14294434, ..., 0.00350952,
0.00283813, 0.00177002]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00201416, 0.003479 , 0.00323486, ..., -0.02636719,
-0.02493286, 0.00787354]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04818726, 0.05957031, 0.03213501, ..., -0.11203003,
-0.09613037, -0.09103394]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.09631348, -0.10897827, -0.12399292, ..., -0.00085449,
-0.00091553, -0.00048828]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.0000000e+00, 6.1035156e-05, -1.2207031e-04, ...,
1.3381958e-01, 1.6635132e-01, 2.0919800e-01]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 2.3223877e-01, 2.0669556e-01, 1.3903809e-01, ...,
-1.8310547e-04, -1.5258789e-04, -9.1552734e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[-9.1552734e-05, -6.1035156e-05, -3.0517578e-05, ...,
0.0000000e+00, -3.0517578e-05, 0.0000000e+00]]],
shape=(1, 1, 5339), dtype=float32), array([[[-0.02130234, -0.01856662, -0.01710658, ..., 0.00041982,
0.00062048, 0.0006307 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00029411, -0.00040776, -0.00044942, ..., -0.02424868,
0.02291245, 0.05937432]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.07660156, 0.07495726, 0.06135209, ..., -0.1206022 ,
-0.12184623, -0.1139332 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10050648, -0.08953431, -0.07884923, ..., -0.01869578,
-0.0167346 , -0.01763956]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2177158e-02, -6.4980479e-05, 1.2000869e-02, ...,
-4.9953014e-03, 2.0064995e-02, 8.1494255e-03]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03188938, -0.00509401, 0.04241933, ..., -0.09476525,
-0.18832558, -0.23867904]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.2519588 , -0.24120857, -0.2249308 , ..., -0.00908731,
-0.00565482, -0.00478506]]], shape=(1, 1, 7680), dtype=float32), array([[[-4.7078328e-03, 7.2684824e-03, 2.4840837e-02, ...,
-1.4027000e-05, 1.5263325e-04, 1.7792435e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[1.19311335e-04, 2.77099258e-04, 4.16864146e-04, ...,
1.06179923e-05, 1.06252701e-05, 1.15810089e-05]]],
shape=(1, 1, 3840), dtype=float32), array([[[ 1.2349803e-05, 1.2119761e-05, 2.1108619e-05, ...,
-1.6870323e-01, -1.3621169e-01, -8.6433820e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03330091, 0.00856069, 0.03467582, ..., -0.04072727,
-0.03181617, -0.00645593]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01122023, 0.00413963, -0.00393783, ..., -0.00029461,
0.00421931, -0.00251451]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0154132 , -0.02377532, -0.02271089, ..., 0.02933036,
0.023146 , 0.01213897]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00091471, -0.01367491, -0.02537205, ..., -0.00178504,
0.00290802, 0.00261759]]], shape=(1, 1, 7680), dtype=float32), array([[[-2.6994986e-03, -8.4007008e-04, 2.4883149e-03, ...,
1.0968803e-05, 1.0850177e-05, 1.1066140e-05]]],
shape=(1, 1, 1920), dtype=float32), array([[[-0.02139645, -0.0189162 , -0.01778135, ..., -0.00045287,
-0.00059633, -0.00165827]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00221966, -0.00138947, -0.000929 , ..., -0.1126425 ,
-0.1338531 , -0.13333385]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10775348, -0.05212127, 0.0396859 , ..., -0.04563401,
-0.03402565, -0.03579839]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03745677, -0.02658239, -0.02583151, ..., -0.0121026 ,
-0.00580872, -0.01895227]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0263972 , -0.01400574, -0.01092716, ..., -0.00139586,
0.00422512, 0.00643334]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00588865, 0.00345067, -0.00066399, ..., 0.00632556,
0.00391393, 0.00175216]]], shape=(1, 1, 5760), dtype=float32)] 37
2026-04-30 19:25:59.180 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history [-0.01531982 -0.01760864 -0.02178955 ... 0.00632556 0.00391393
0.00175216] (270299,) float32
2026-04-30 19:25:59.180 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history_after cut_idx 11 [0.04818726 0.05957031 0.03213501 ... 0.00632556 0.00391393 0.00175216] (185819,) float32
2026-04-30 19:25:59.183 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list_after cut_idx 11 [array([[[ 0.04818726, 0.05957031, 0.03213501, ..., -0.11203003,
-0.09613037, -0.09103394]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.09631348, -0.10897827, -0.12399292, ..., -0.00085449,
-0.00091553, -0.00048828]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.0000000e+00, 6.1035156e-05, -1.2207031e-04, ...,
1.3381958e-01, 1.6635132e-01, 2.0919800e-01]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 2.3223877e-01, 2.0669556e-01, 1.3903809e-01, ...,
-1.8310547e-04, -1.5258789e-04, -9.1552734e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[-9.1552734e-05, -6.1035156e-05, -3.0517578e-05, ...,
0.0000000e+00, -3.0517578e-05, 0.0000000e+00]]],
shape=(1, 1, 5339), dtype=float32), array([[[-0.02130234, -0.01856662, -0.01710658, ..., 0.00041982,
0.00062048, 0.0006307 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00029411, -0.00040776, -0.00044942, ..., -0.02424868,
0.02291245, 0.05937432]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.07660156, 0.07495726, 0.06135209, ..., -0.1206022 ,
-0.12184623, -0.1139332 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10050648, -0.08953431, -0.07884923, ..., -0.01869578,
-0.0167346 , -0.01763956]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2177158e-02, -6.4980479e-05, 1.2000869e-02, ...,
-4.9953014e-03, 2.0064995e-02, 8.1494255e-03]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03188938, -0.00509401, 0.04241933, ..., -0.09476525,
-0.18832558, -0.23867904]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.2519588 , -0.24120857, -0.2249308 , ..., -0.00908731,
-0.00565482, -0.00478506]]], shape=(1, 1, 7680), dtype=float32), array([[[-4.7078328e-03, 7.2684824e-03, 2.4840837e-02, ...,
-1.4027000e-05, 1.5263325e-04, 1.7792435e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[1.19311335e-04, 2.77099258e-04, 4.16864146e-04, ...,
1.06179923e-05, 1.06252701e-05, 1.15810089e-05]]],
shape=(1, 1, 3840), dtype=float32), array([[[ 1.2349803e-05, 1.2119761e-05, 2.1108619e-05, ...,
-1.6870323e-01, -1.3621169e-01, -8.6433820e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03330091, 0.00856069, 0.03467582, ..., -0.04072727,
-0.03181617, -0.00645593]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01122023, 0.00413963, -0.00393783, ..., -0.00029461,
0.00421931, -0.00251451]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0154132 , -0.02377532, -0.02271089, ..., 0.02933036,
0.023146 , 0.01213897]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00091471, -0.01367491, -0.02537205, ..., -0.00178504,
0.00290802, 0.00261759]]], shape=(1, 1, 7680), dtype=float32), array([[[-2.6994986e-03, -8.4007008e-04, 2.4883149e-03, ...,
1.0968803e-05, 1.0850177e-05, 1.1066140e-05]]],
shape=(1, 1, 1920), dtype=float32), array([[[-0.02139645, -0.0189162 , -0.01778135, ..., -0.00045287,
-0.00059633, -0.00165827]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00221966, -0.00138947, -0.000929 , ..., -0.1126425 ,
-0.1338531 , -0.13333385]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10775348, -0.05212127, 0.0396859 , ..., -0.04563401,
-0.03402565, -0.03579839]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03745677, -0.02658239, -0.02583151, ..., -0.0121026 ,
-0.00580872, -0.01895227]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0263972 , -0.01400574, -0.01092716, ..., -0.00139586,
0.00422512, 0.00643334]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00588865, 0.00345067, -0.00066399, ..., 0.00632556,
0.00391393, 0.00175216]]], shape=(1, 1, 5760), dtype=float32)] 26
2026-04-30 19:25:59.183 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069
2026-04-30 19:25:59.255 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[ 0.04367745 0.0921593 -0.08114579 ... 0.15368369 0.03052648
0.08212201]]] (1, 1, 1024)
2026-04-30 19:25:59.255 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]]
2026-04-30 19:25:59.256 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]]] (1, 4, 1024)
2026-04-30 19:25:59.256 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 1, 1024)
2026-04-30 19:25:59.256 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]
[ 0.04367745 0.0921593 -0.08114579 ... 0.15368369 0.03052648
0.08212201]
[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 6, 1024)
2026-04-30 19:25:59.256 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22
Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:25:59.257 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:25:59.257 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3)
2026-04-30 19:25:59.257 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3)
2026-04-30 19:25:59.257 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024)
2026-04-30 19:25:59.258 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036
-0.00767252]]] (1, 1, 1024)
2026-04-30 19:25:59.258 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528
0.00424147]]] (1, 1, 1024)
2026-04-30 19:25:59.258 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724
-0.00170945]
[ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198
0.00132705]
[ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966
0.0080104 ]
[ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711
0.00252486]
[ 0.04845563 0.08835331 -0.08284196 ... 0.14439934 0.03208176
0.08636349]
[ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459
-0.00718043]]] (1, 6, 1024)
2026-04-30 19:25:59.259 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]
...
[ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03
-2.0710612e-04 2.5248611e-03]
[ 4.8455633e-02 8.8353314e-02 -8.2841955e-02 ... 1.4439934e-01
3.2081764e-02 8.6363487e-02]
[ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03
3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024)
2026-04-30 19:25:59.304 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=42; step_idx=42
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill cont done; talker_seq_len=42; step_idx=42
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache Ес
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache Есл
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache Если
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache Если
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment э -> text_cache Если э
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache Если эт
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Если это
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache Если это
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment п -> text_cache Если это п
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache Если это пр
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Если это про
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache Если это прои
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache Если это проис
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment х -> text_cache Если это происх
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Если это происхо
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache Если это происход
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache Если это происходи
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache Если это происходит
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache Если это происходит
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Если это происходит н
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache Если это происходит не
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache Если это происходит не
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache Если это происходит не м
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache Если это происходит не мг
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Если это происходит не мгн
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Если это происходит не мгно
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache Если это происходит не мгнов
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache Если это происходит не мгнове
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Если это происходит не мгновен
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Если это происходит не мгновенн
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Если это происходит не мгновенно
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['Если это происходит не '] 23
Qwen3TTSProcessor __call__ text ['Если это происходит не ']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 55091, 32202, 67879, 136830, 18658, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1]])}
2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 55091, 32202, 67879, 136830, 18658, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1]])}
2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 55091 32202 67879 136830 18658 220]] (1, 6)
2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 55091 32202 67879 136830 18658 220]] (1, 6)
2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment Если это происходит не 23 -> tokenized_segment [np.int64(55091), np.int64(32202), np.int64(67879), np.int64(136830), np.int64(18658), np.int64(220)] 6
2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(55091), np.int64(32202), np.int64(67879), np.int64(136830), np.int64(18658), np.int64(220)]
2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(55091), np.int64(32202), np.int64(67879), np.int64(136830), np.int64(18658), np.int64(220)] 6
2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 55091 -> pending_tokens [np.int64(32202), np.int64(67879), np.int64(136830), np.int64(18658), np.int64(220)] 5
2026-04-30 19:25:59.354 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-42 vq [1221] (1,) int64
2026-04-30 19:25:59.381 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-43 vq-rvq [[[1221 1026 1890 308 1532 678 1353 147 750 1772 282 905 366 1437
145 166]]] (1, 1, 16) int64
2026-04-30 19:25:59.381 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 32202 -> pending_tokens [np.int64(67879), np.int64(136830), np.int64(18658), np.int64(220)] 4
2026-04-30 19:25:59.389 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-43 vq [210] (1,) int64
2026-04-30 19:25:59.417 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-44 vq-rvq [[[ 210 1184 1974 1382 427 74 1456 848 195 76 1522 31 588 671
512 850]]] (1, 1, 16) int64
2026-04-30 19:25:59.417 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 67879 -> pending_tokens [np.int64(136830), np.int64(18658), np.int64(220)] 3
2026-04-30 19:25:59.425 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-44 vq [1494] (1,) int64
2026-04-30 19:25:59.453 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-45 vq-rvq [[[1494 689 1062 1503 360 1143 242 1238 236 122 1449 1461 501 126
566 297]]] (1, 1, 16) int64
2026-04-30 19:25:59.453 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 136830 -> pending_tokens [np.int64(18658), np.int64(220)] 2
2026-04-30 19:25:59.461 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-45 vq [964] (1,) int64
2026-04-30 19:25:59.488 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-46 vq-rvq [[[ 964 1231 1955 1258 2036 1514 955 1727 885 1487 1034 1555 745 2040
299 1266]]] (1, 1, 16) int64
2026-04-30 19:25:59.488 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 18658 -> pending_tokens [np.int64(220)] 1
2026-04-30 19:25:59.496 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-46 vq [1083] (1,) int64
2026-04-30 19:25:59.524 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-47 vq-rvq [[[1083 1806 1104 404 250 212 523 1393 1886 1347 373 828 802 629
58 1557]]] (1, 1, 16) int64
2026-04-30 19:25:59.524 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 220 -> pending_tokens [] 0
2026-04-30 19:25:59.532 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-47 vq [1932] (1,) int64
2026-04-30 19:25:59.558 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-48 vq-rvq [[[1932 1698 349 71 1810 681 799 1316 1819 1021 2002 669 1540 587
1688 1759]]] (1, 1, 16) int64
2026-04-30 19:25:59.559 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-23 chunk_tokens [[[1221 210 1494 964]
[1026 1184 689 1231]
[1890 1974 1062 1955]
[ 308 1382 1503 1258]
[1532 427 360 2036]
[ 678 74 1143 1514]
[1353 1456 242 955]
[ 147 848 1238 1727]
[ 750 195 236 885]
[1772 76 122 1487]
[ 282 1522 1449 1034]
[ 905 31 1461 1555]
[ 366 588 501 745]
[1437 671 126 2040]
[ 145 512 566 299]
[ 166 850 297 1266]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:59.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-23 wav [[[ 0.0010756 0.00117576 0.00123106 ... -0.04100708 -0.0458885
-0.04321691]]] -0.09460076689720154 3.915204797522165e-05 0.01097010262310505 0.10221011191606522 (1, 1, 7680)
2026-04-30 19:25:59.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment , -> text_cache мгновенно,
2026-04-30 19:25:59.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['мгновенно,'] 10
Qwen3TTSProcessor __call__ text ['мгновенно,']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 6442, 15390, 46705, 124448, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1]])}
2026-04-30 19:25:59.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 6442, 15390, 46705, 124448, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1]])}
2026-04-30 19:25:59.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 6442 15390 46705 124448 11]] (1, 5)
2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 6442 15390 46705 124448 11]] (1, 5)
2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment мгновенно, 10 -> tokenized_segment [np.int64(6442), np.int64(15390), np.int64(46705), np.int64(124448), np.int64(11)] 5
2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(6442), np.int64(15390), np.int64(46705), np.int64(124448), np.int64(11)]
2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(6442), np.int64(15390), np.int64(46705), np.int64(124448), np.int64(11)] 5
2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6442 -> pending_tokens [np.int64(15390), np.int64(46705), np.int64(124448), np.int64(11)] 4
2026-04-30 19:25:59.592 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-48 vq [1785] (1,) int64
2026-04-30 19:25:59.619 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-49 vq-rvq [[[1785 922 1304 1294 365 1930 1931 2015 205 1694 246 863 1104 841
239 156]]] (1, 1, 16) int64
2026-04-30 19:25:59.619 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 15390 -> pending_tokens [np.int64(46705), np.int64(124448), np.int64(11)] 3
2026-04-30 19:25:59.627 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-49 vq [1209] (1,) int64
2026-04-30 19:25:59.655 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-50 vq-rvq [[[1209 171 1926 1078 883 1696 896 727 1162 1659 85 1185 101 421
781 1882]]] (1, 1, 16) int64
2026-04-30 19:25:59.655 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 46705 -> pending_tokens [np.int64(124448), np.int64(11)] 2
2026-04-30 19:25:59.663 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-50 vq [1917] (1,) int64
2026-04-30 19:25:59.690 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-51 vq-rvq [[[1917 53 1520 1049 327 917 108 1955 366 354 1278 99 734 2021
1469 59]]] (1, 1, 16) int64
2026-04-30 19:25:59.690 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 124448 -> pending_tokens [np.int64(11)] 1
2026-04-30 19:25:59.698 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-51 vq [1460] (1,) int64
2026-04-30 19:25:59.726 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-52 vq-rvq [[[1460 1321 725 1366 936 685 1087 1513 833 1284 887 1580 1737 1858
1839 625]]] (1, 1, 16) int64
2026-04-30 19:25:59.726 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11 -> pending_tokens [] 0
2026-04-30 19:25:59.734 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-52 vq [129] (1,) int64
2026-04-30 19:25:59.761 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-53 vq-rvq [[[ 129 1709 120 871 67 1542 453 1787 421 259 1645 1131 310 700
733 1444]]] (1, 1, 16) int64
2026-04-30 19:25:59.761 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-27 chunk_tokens [[[1083 1932 1785 1209]
[1806 1698 922 171]
[1104 349 1304 1926]
[ 404 71 1294 1078]
[ 250 1810 365 883]
[ 212 681 1930 1696]
[ 523 799 1931 896]
[1393 1316 2015 727]
[1886 1819 205 1162]
[1347 1021 1694 1659]
[ 373 2002 246 85]
[ 828 669 863 1185]
[ 802 1540 1104 101]
[ 629 587 841 421]
[ 58 1688 239 781]
[1557 1759 156 1882]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:59.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-27 wav [[[-0.05036464 -0.03583061 -0.00757636 ... 0.05205004 0.01185071
-0.03961121]]] -0.36656999588012695 -3.813831790466793e-05 0.10111234337091446 0.3662589490413666 (1, 1, 7680)
2026-04-30 19:25:59.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0
2026-04-30 19:25:59.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1
2026-04-30 19:25:59.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:25:59.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1
2026-04-30 19:25:59.786 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0
2026-04-30 19:25:59.793 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-53 vq [720] (1,) int64
2026-04-30 19:25:59.820 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-54 vq-rvq [[[ 720 1183 1 289 525 1030 342 1728 23 1052 627 824 507 1306
986 1273]]] (1, 1, 16) int64
2026-04-30 19:25:59.820 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-31 chunk_tokens [[[1917 1460 129 720]
[ 53 1321 1709 1183]
[1520 725 120 1]
[1049 1366 871 289]
[ 327 936 67 525]
[ 917 685 1542 1030]
[ 108 1087 453 342]
[1955 1513 1787 1728]
[ 366 833 421 23]
[ 354 1284 259 1052]
[1278 887 1645 627]
[ 99 1580 1131 824]
[ 734 1737 310 507]
[2021 1858 700 1306]
[1469 1839 733 986]
[ 59 625 1444 1273]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:25:59.845 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-31 wav [[[-0.08307496 -0.11176797 -0.1242267 ... -0.00193561 0.005123
0.0037974 ]]] -0.2764914035797119 5.477688682731241e-05 0.06263019889593124 0.3027763068675995 (1, 1, 7680)
2026-04-30 19:25:59.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-54 vq [1041] (1,) int64
2026-04-30 19:25:59.879 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-55 vq-rvq [[[1041 265 1891 1914 222 232 1531 1885 1029 1211 905 556 171 1073
1403 1007]]] (1, 1, 16) int64
2026-04-30 19:25:59.887 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-55 vq [339] (1,) int64
2026-04-30 19:25:59.914 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-56 vq-rvq [[[ 339 1971 1436 1631 477 15 1466 1779 1709 538 525 191 1054 1160
766 1207]]] (1, 1, 16) int64
2026-04-30 19:25:59.922 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-56 vq [1249] (1,) int64
2026-04-30 19:25:59.949 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-57 vq-rvq [[[1249 411 1545 1616 1062 717 1705 421 1286 143 1203 359 885 616
1033 1564]]] (1, 1, 16) int64
2026-04-30 19:25:59.957 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-57 vq [156] (1,) int64
2026-04-30 19:25:59.984 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-58 vq-rvq [[[ 156 304 359 1040 992 1087 1099 113 289 1884 1015 546 106 1586
1043 88]]] (1, 1, 16) int64
2026-04-30 19:25:59.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-58 vq [1875] (1,) int64
2026-04-30 19:26:00.018 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-59 vq-rvq [[[1875 337 1012 18 1120 1949 1411 1302 1350 677 674 1014 21 1196
1362 434]]] (1, 1, 16) int64
2026-04-30 19:26:00.026 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-59 vq [1772] (1,) int64
2026-04-30 19:26:00.053 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-60 vq-rvq [[[1772 559 499 1788 591 446 1457 377 102 62 716 194 637 1734
287 103]]] (1, 1, 16) int64
2026-04-30 19:26:00.061 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-60 vq [689] (1,) int64
2026-04-30 19:26:00.088 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-61 vq-rvq [[[ 689 633 702 657 479 134 1435 1547 878 1283 1297 610 414 1342
1461 1396]]] (1, 1, 16) int64
2026-04-30 19:26:00.096 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-61 vq [502] (1,) int64
2026-04-30 19:26:00.123 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-62 vq-rvq [[[ 502 672 390 68 1863 1632 780 520 1989 334 169 342 982 994
807 891]]] (1, 1, 16) int64
2026-04-30 19:26:00.131 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-62 vq [1002] (1,) int64
2026-04-30 19:26:00.158 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-63 vq-rvq [[[1002 669 578 1462 1360 312 73 964 882 475 1493 1240 1142 1319
446 1922]]] (1, 1, 16) int64
2026-04-30 19:26:00.166 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-63 vq [1907] (1,) int64
2026-04-30 19:26:00.193 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-64 vq-rvq [[[1907 1588 1302 52 1987 1303 1989 149 1049 1247 703 1844 40 520
851 1498]]] (1, 1, 16) int64
2026-04-30 19:26:00.201 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-64 vq [1656] (1,) int64
2026-04-30 19:26:00.227 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-65 vq-rvq [[[1656 30 1238 621 1683 291 75 563 973 149 1691 217 867 1223
1481 858]]] (1, 1, 16) int64
2026-04-30 19:26:00.235 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-65 vq [348] (1,) int64
2026-04-30 19:26:00.262 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-66 vq-rvq [[[ 348 1915 1476 819 1468 1 2036 995 894 375 2001 1333 1091 707
1699 1964]]] (1, 1, 16) int64
2026-04-30 19:26:00.270 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-66 vq [906] (1,) int64
2026-04-30 19:26:00.297 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-67 vq-rvq [[[ 906 1924 1085 1442 1671 343 312 1556 136 272 1289 613 1150 84
1584 1462]]] (1, 1, 16) int64
2026-04-30 19:26:00.305 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-67 vq [1126] (1,) int64
2026-04-30 19:26:00.332 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-68 vq-rvq [[[1126 1363 1906 1497 475 654 667 395 701 1653 1566 677 75 321
742 1225]]] (1, 1, 16) int64
2026-04-30 19:26:00.340 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-68 vq [1621] (1,) int64
2026-04-30 19:26:00.367 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-69 vq-rvq [[[1621 1174 1406 1613 38 153 32 317 1787 1457 442 1667 41 1218
128 1289]]] (1, 1, 16) int64
2026-04-30 19:26:00.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-69 vq [841] (1,) int64
2026-04-30 19:26:00.402 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-70 vq-rvq [[[ 841 1389 88 1544 1331 1579 305 1644 256 1204 773 1022 453 68
729 1508]]] (1, 1, 16) int64
2026-04-30 19:26:00.411 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-70 vq [422] (1,) int64
2026-04-30 19:26:00.438 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-71 vq-rvq [[[ 422 1768 816 1597 1721 963 226 1386 124 2009 1425 265 1878 552
27 742]]] (1, 1, 16) int64
2026-04-30 19:26:00.446 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-71 vq [396] (1,) int64
2026-04-30 19:26:00.473 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-72 vq-rvq [[[ 396 183 290 2002 1107 1490 822 42 302 1662 1437 902 832 294
791 1159]]] (1, 1, 16) int64
2026-04-30 19:26:00.481 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-72 vq [832] (1,) int64
2026-04-30 19:26:00.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-73 vq-rvq [[[ 832 552 626 1350 1752 341 1689 1514 216 418 997 392 144 823
841 403]]] (1, 1, 16) int64
2026-04-30 19:26:00.517 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-73 vq [1764] (1,) int64
2026-04-30 19:26:00.544 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-74 vq-rvq [[[1764 359 514 1431 325 1338 1556 636 367 1697 1063 450 1109 565
770 179]]] (1, 1, 16) int64
2026-04-30 19:26:00.552 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-74 vq [1928] (1,) int64
2026-04-30 19:26:00.579 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-75 vq-rvq [[[1928 28 735 1053 916 1787 661 606 985 182 1515 603 1685 1472
1744 755]]] (1, 1, 16) int64
2026-04-30 19:26:00.587 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-75 vq [1115] (1,) int64
2026-04-30 19:26:00.614 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-76 vq-rvq [[[1115 155 82 671 1238 162 225 981 431 252 1404 218 71 918
784 157]]] (1, 1, 16) int64
2026-04-30 19:26:00.622 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-76 vq [21] (1,) int64
2026-04-30 19:26:00.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-77 vq-rvq [[[ 21 299 571 489 1130 1742 1056 1497 1706 1537 114 980 872 284
254 1843]]] (1, 1, 16) int64
2026-04-30 19:26:00.658 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-77 vq [1906] (1,) int64
2026-04-30 19:26:00.684 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-78 vq-rvq [[[1906 1654 1762 1483 1134 631 1116 835 755 1751 813 1739 93 81
1842 593]]] (1, 1, 16) int64
2026-04-30 19:26:00.692 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-78 vq [870] (1,) int64
2026-04-30 19:26:00.719 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-79 vq-rvq [[[ 870 1465 1030 311 2002 143 350 1490 1313 1081 951 95 300 536
693 2039]]] (1, 1, 16) int64
2026-04-30 19:26:00.727 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-79 vq [447] (1,) int64
2026-04-30 19:26:00.754 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-80 vq-rvq [[[ 447 1302 465 1712 935 221 1817 770 166 1747 36 840 1403 1
577 678]]] (1, 1, 16) int64
2026-04-30 19:26:00.762 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-80 vq [602] (1,) int64
2026-04-30 19:26:00.789 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-81 vq-rvq [[[ 602 1329 634 1484 476 1992 480 1436 1758 390 1696 794 1427 106
716 1658]]] (1, 1, 16) int64
2026-04-30 19:26:00.797 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-81 vq [2150] (1,) int64
2026-04-30 19:26:00.797 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-35 chunk_tokens [[[1041 339 1249 156]
[ 265 1971 411 304]
[1891 1436 1545 359]
[1914 1631 1616 1040]
[ 222 477 1062 992]
[ 232 15 717 1087]
[1531 1466 1705 1099]
[1885 1779 421 113]
[1029 1709 1286 289]
[1211 538 143 1884]
[ 905 525 1203 1015]
[ 556 191 359 546]
[ 171 1054 885 106]
[1073 1160 616 1586]
[1403 766 1033 1043]
[1007 1207 1564 88]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:00.821 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-35 wav [[[-0.00899126 -0.00369494 0.00981118 ... -0.00399455 -0.00319744
-0.00289368]]] -0.278908371925354 4.246875687385909e-05 0.07475152611732483 0.38985109329223633 (1, 1, 7680)
2026-04-30 19:26:00.822 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-39 chunk_tokens [[[1875 1772 689 502]
[ 337 559 633 672]
[1012 499 702 390]
[ 18 1788 657 68]
[1120 591 479 1863]
[1949 446 134 1632]
[1411 1457 1435 780]
[1302 377 1547 520]
[1350 102 878 1989]
[ 677 62 1283 334]
[ 674 716 1297 169]
[1014 194 610 342]
[ 21 637 414 982]
[1196 1734 1342 994]
[1362 287 1461 807]
[ 434 103 1396 891]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:00.846 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-39 wav [[[-0.00285673 -0.0034839 -0.00415278 ... 0.00778646 0.00595145
-0.0043805 ]]] -0.2765483260154724 9.143220268015284e-06 0.06062217429280281 0.3825187683105469 (1, 1, 7680)
2026-04-30 19:26:00.846 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-43 chunk_tokens [[[1002 1907 1656 348]
[ 669 1588 30 1915]
[ 578 1302 1238 1476]
[1462 52 621 819]
[1360 1987 1683 1468]
[ 312 1303 291 1]
[ 73 1989 75 2036]
[ 964 149 563 995]
[ 882 1049 973 894]
[ 475 1247 149 375]
[1493 703 1691 2001]
[1240 1844 217 1333]
[1142 40 867 1091]
[1319 520 1223 707]
[ 446 851 1481 1699]
[1922 1498 858 1964]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:00.870 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-43 wav [[[-0.01552802 -0.01487012 -0.01219678 ... -0.00294759 0.00343194
0.0008437 ]]] -0.2960159182548523 2.2809199435869232e-05 0.0668618455529213 0.3031485974788666 (1, 1, 7680)
2026-04-30 19:26:00.870 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-47 chunk_tokens [[[ 906 1126 1621 841]
[1924 1363 1174 1389]
[1085 1906 1406 88]
[1442 1497 1613 1544]
[1671 475 38 1331]
[ 343 654 153 1579]
[ 312 667 32 305]
[1556 395 317 1644]
[ 136 701 1787 256]
[ 272 1653 1457 1204]
[1289 1566 442 773]
[ 613 677 1667 1022]
[1150 75 41 453]
[ 84 321 1218 68]
[1584 742 128 729]
[1462 1225 1289 1508]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:00.894 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-47 wav [[[-0.00404704 0.00067246 0.00399263 ... 0.09798931 0.20872854
0.2311011 ]]] -0.25243639945983887 5.265988875180483e-05 0.049168795347213745 0.2518003284931183 (1, 1, 7680)
2026-04-30 19:26:00.895 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-51 chunk_tokens [[[ 422 396 832 1764]
[1768 183 552 359]
[ 816 290 626 514]
[1597 2002 1350 1431]
[1721 1107 1752 325]
[ 963 1490 341 1338]
[ 226 822 1689 1556]
[1386 42 1514 636]
[ 124 302 216 367]
[2009 1662 418 1697]
[1425 1437 997 1063]
[ 265 902 392 450]
[1878 832 144 1109]
[ 552 294 823 565]
[ 27 791 841 770]
[ 742 1159 403 179]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:00.919 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-51 wav [[[ 0.14216125 0.06682034 0.02212509 ... 0.06106113 0.00223079
-0.05518628]]] -0.25642016530036926 -4.215189164824551e-06 0.07405433058738708 0.3941096067428589 (1, 1, 7680)
2026-04-30 19:26:00.919 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-55 chunk_tokens [[[1928 1115 21 1906]
[ 28 155 299 1654]
[ 735 82 571 1762]
[1053 671 489 1483]
[ 916 1238 1130 1134]
[1787 162 1742 631]
[ 661 225 1056 1116]
[ 606 981 1497 835]
[ 985 431 1706 755]
[ 182 252 1537 1751]
[1515 1404 114 813]
[ 603 218 980 1739]
[1685 71 872 93]
[1472 918 284 81]
[1744 784 254 1842]
[ 755 157 1843 593]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:00.943 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-55 wav [[[-0.10738115 -0.11622868 -0.06752186 ... 0.03509749 0.03198082
0.02877127]]] -0.2850886285305023 6.992658745730296e-05 0.08521004766225815 0.39866259694099426 (1, 1, 7680)
2026-04-30 19:26:00.943 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-59 chunk_tokens [[[ 870 447 602]
[1465 1302 1329]
[1030 465 634]
[ 311 1712 1484]
[2002 935 476]
[ 143 221 1992]
[ 350 1817 480]
[1490 770 1436]
[1313 166 1758]
[1081 1747 390]
[ 951 36 1696]
[ 95 840 794]
[ 300 1403 1427]
[ 536 1 106]
[ 693 577 716]
[2039 678 1658]]] (1, 16, 3) n_chunk_frames 3
2026-04-30 19:26:00.974 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-59 wav [[[2.69281808e-02 2.77648699e-02 3.07107549e-02 ... 1.15126495e-05
1.21511912e-05 1.15567072e-05]]] -0.09340479224920273 -3.71767018805258e-05 0.025410572066903114 0.0996907576918602 (1, 1, 5760)
2026-04-30 19:26:00.974 [INFO] src.inference.qwen3_tts_inferencer_onnx: reset_turn reset_generation_state step-idx-82
2026-04-30 19:26:00.992 [INFO] __main__: Synthesising: 'то теряется эффект живого общения.'
2026-04-30 19:26:00.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache т
2026-04-30 19:26:00.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False
2026-04-30 19:26:00.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069
2026-04-30 19:26:01.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076
0.08690926]]] (1, 1, 1024)
2026-04-30 19:26:01.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]]
2026-04-30 19:26:01.072 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]]] (1, 4, 1024)
2026-04-30 19:26:01.072 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 1, 1024)
2026-04-30 19:26:01.072 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]
[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076
0.08690926]
[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 6, 1024)
2026-04-30 19:26:01.072 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22
Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:01.073 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:01.073 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3)
2026-04-30 19:26:01.073 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3)
2026-04-30 19:26:01.074 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024)
2026-04-30 19:26:01.074 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036
-0.00767252]]] (1, 1, 1024)
2026-04-30 19:26:01.074 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528
0.00424147]]] (1, 1, 1024)
2026-04-30 19:26:01.074 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724
-0.00170945]
[ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198
0.00132705]
[ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966
0.0080104 ]
[ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711
0.00252486]
[-0.02064589 0.05184897 0.01909059 ... 0.2070941 0.06416605
0.09115074]
[ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459
-0.00718043]]] (1, 6, 1024)
2026-04-30 19:26:01.075 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]
...
[ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03
-2.0710612e-04 2.5248611e-03]
[-2.0645889e-02 5.1848970e-02 1.9090585e-02 ... 2.0709410e-01
6.4166047e-02 9.1150738e-02]
[ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03
3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024)
2026-04-30 19:26:01.118 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=9; step_idx=0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache то т
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache то те
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache то тер
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache то теря
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache то теряе
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache то теряет
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache то теряетс
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache то теряется
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то теряется
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment э -> text_cache то теряется э
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ф -> text_cache то теряется эф
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ф -> text_cache то теряется эфф
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache то теряется эффе
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache то теряется эффек
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache то теряется эффект
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то теряется эффект
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ж -> text_cache то теряется эффект ж
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache то теряется эффект жи
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache то теряется эффект жив
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то теряется эффект живо
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache то теряется эффект живог
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то теряется эффект живого
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то теряется эффект живого
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то теряется эффект живого о
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment б -> text_cache то теряется эффект живого об
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment щ -> text_cache то теряется эффект живого общ
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache то теряется эффект живого обще
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache то теряется эффект живого общен
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache то теряется эффект живого общени
2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['то теряется эффект живого '] 26
Qwen3TTSProcessor __call__ text ['то теряется эффект живого ']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 24634, 135010, 4235, 49719, 132716, 29556, 134030, 22107,
220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 24634, 135010, 4235, 49719, 132716, 29556, 134030, 22107,
220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 24634 135010 4235 49719 132716 29556 134030 22107 220]] (1, 9)
2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 24634 135010 4235 49719 132716 29556 134030 22107 220]] (1, 9)
2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment то теряется эффект живого 26 -> tokenized_segment [np.int64(24634), np.int64(135010), np.int64(4235), np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 9
2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(24634), np.int64(135010), np.int64(4235), np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)]
2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(24634), np.int64(135010), np.int64(4235), np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 9
2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 24634 -> pending_tokens [np.int64(135010), np.int64(4235), np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 8
2026-04-30 19:26:01.129 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-0 vq [1995] (1,) int64
2026-04-30 19:26:01.156 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-1 vq-rvq [[[1995 1159 0 22 2015 407 641 2008 1058 844 743 1603 706 1759
1772 1435]]] (1, 1, 16) int64
2026-04-30 19:26:01.156 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 135010 -> pending_tokens [np.int64(4235), np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 7
2026-04-30 19:26:01.164 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-1 vq [215] (1,) int64
2026-04-30 19:26:01.190 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-2 vq-rvq [[[ 215 1009 1093 310 1531 785 1751 1215 1304 905 1265 1382 783 781
82 803]]] (1, 1, 16) int64
2026-04-30 19:26:01.191 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 4235 -> pending_tokens [np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 6
2026-04-30 19:26:01.199 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-2 vq [212] (1,) int64
2026-04-30 19:26:01.225 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-3 vq-rvq [[[ 212 1134 730 1884 1430 698 274 1814 1728 38 1076 362 527 1529
1213 1668]]] (1, 1, 16) int64
2026-04-30 19:26:01.225 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 49719 -> pending_tokens [np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 5
2026-04-30 19:26:01.233 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-3 vq [1181] (1,) int64
2026-04-30 19:26:01.260 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-4 vq-rvq [[[1181 1722 1096 1458 243 1093 20 1902 930 2030 223 990 996 2027
1008 901]]] (1, 1, 16) int64
2026-04-30 19:26:01.260 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 132716 -> pending_tokens [np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 4
2026-04-30 19:26:01.268 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-4 vq [462] (1,) int64
2026-04-30 19:26:01.294 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-5 vq-rvq [[[ 462 284 1758 371 1210 406 55 1034 480 1584 255 146 729 1484
586 1978]]] (1, 1, 16) int64
2026-04-30 19:26:01.294 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 29556 -> pending_tokens [np.int64(134030), np.int64(22107), np.int64(220)] 3
2026-04-30 19:26:01.302 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-5 vq [1225] (1,) int64
2026-04-30 19:26:01.329 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-6 vq-rvq [[[1225 1534 373 1579 1286 601 206 1639 173 37 683 53 865 1556
135 819]]] (1, 1, 16) int64
2026-04-30 19:26:01.329 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 134030 -> pending_tokens [np.int64(22107), np.int64(220)] 2
2026-04-30 19:26:01.337 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-6 vq [628] (1,) int64
2026-04-30 19:26:01.364 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-7 vq-rvq [[[ 628 535 379 1374 645 161 1628 1218 627 860 1753 419 1304 637
1926 536]]] (1, 1, 16) int64
2026-04-30 19:26:01.364 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 22107 -> pending_tokens [np.int64(220)] 1
2026-04-30 19:26:01.372 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-7 vq [606] (1,) int64
2026-04-30 19:26:01.398 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-8 vq-rvq [[[ 606 940 1515 1822 70 745 1920 609 539 1185 1050 1869 503 1727
821 1169]]] (1, 1, 16) int64
2026-04-30 19:26:01.398 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 220 -> pending_tokens [] 0
2026-04-30 19:26:01.406 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-8 vq [828] (1,) int64
2026-04-30 19:26:01.433 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-9 vq-rvq [[[ 828 1894 396 509 515 940 1416 1198 415 741 587 1989 1165 1918
115 1532]]] (1, 1, 16) int64
2026-04-30 19:26:01.433 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 chunk_tokens [[[1995 215 212 1181]
[1159 1009 1134 1722]
[ 0 1093 730 1096]
[ 22 310 1884 1458]
[2015 1531 1430 243]
[ 407 785 698 1093]
[ 641 1751 274 20]
[2008 1215 1814 1902]
[1058 1304 1728 930]
[ 844 905 38 2030]
[ 743 1265 1076 223]
[1603 1382 362 990]
[ 706 783 527 996]
[1759 781 1529 2027]
[1772 82 1213 1008]
[1435 803 1668 901]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:01.458 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 wav [[[-2.0247478e-02 -1.6132748e-02 -1.4229195e-02 ... 1.1977663e-05
1.1495073e-05 1.2644601e-05]]] -0.020247478038072586 -5.6528027926106006e-05 0.0009806811576709151 0.005252548027783632 (1, 1, 7680)
2026-04-30 19:26:01.458 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 chunk_tokens [[[ 462 1225 628 606]
[ 284 1534 535 940]
[1758 373 379 1515]
[ 371 1579 1374 1822]
[1210 1286 645 70]
[ 406 601 161 745]
[ 55 206 1628 1920]
[1034 1639 1218 609]
[ 480 173 627 539]
[1584 37 860 1185]
[ 255 683 1753 1050]
[ 146 53 419 1869]
[ 729 865 1304 503]
[1484 1556 637 1727]
[ 586 135 1926 821]
[1978 819 536 1169]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 wav [[[ 1.2498698e-05 1.2433531e-05 1.1404698e-05 ... -5.8077216e-02
-5.1980902e-02 -5.0722528e-02]]] -0.2770718038082123 -0.00012726392014883459 0.06354878842830658 0.25196802616119385 (1, 1, 7680)
2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache общения
2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment . -> text_cache общения.
2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['общения.'] 8
Qwen3TTSProcessor __call__ text ['общения.']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[54157, 18492, 13]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[54157, 18492, 13]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[54157 18492 13]] (1, 3)
2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[54157 18492 13]] (1, 3)
2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment общения. 8 -> tokenized_segment [np.int64(54157), np.int64(18492), np.int64(13)] 3
2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(54157), np.int64(18492), np.int64(13)]
2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(54157), np.int64(18492), np.int64(13)] 3
2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 54157 -> pending_tokens [np.int64(18492), np.int64(13)] 2
2026-04-30 19:26:01.491 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-9 vq [266] (1,) int64
2026-04-30 19:26:01.518 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-10 vq-rvq [[[ 266 171 1379 7 639 1606 1087 778 568 830 1870 1207 677 926
290 179]]] (1, 1, 16) int64
2026-04-30 19:26:01.518 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 18492 -> pending_tokens [np.int64(13)] 1
2026-04-30 19:26:01.526 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-10 vq [532] (1,) int64
2026-04-30 19:26:01.553 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-11 vq-rvq [[[ 532 440 1567 379 1769 1572 939 1459 1246 959 1300 211 2019 1510
701 924]]] (1, 1, 16) int64
2026-04-30 19:26:01.553 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13 -> pending_tokens [] 0
2026-04-30 19:26:01.561 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-11 vq [1212] (1,) int64
2026-04-30 19:26:01.588 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-12 vq-rvq [[[1212 637 11 1218 770 342 1376 686 20 1263 430 1628 129 1950
1018 341]]] (1, 1, 16) int64
2026-04-30 19:26:01.588 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 chunk_tokens [[[ 828 266 532 1212]
[1894 171 440 637]
[ 396 1379 1567 11]
[ 509 7 379 1218]
[ 515 639 1769 770]
[ 940 1606 1572 342]
[1416 1087 939 1376]
[1198 778 1459 686]
[ 415 568 1246 20]
[ 741 830 959 1263]
[ 587 1870 1300 430]
[1989 1207 211 1628]
[1165 677 2019 129]
[1918 926 1510 1950]
[ 115 290 701 1018]
[1532 179 924 341]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 wav [[[-0.05217085 -0.05058753 -0.03975262 ... 0.21015896 0.11327256
0.02125037]]] -0.36741623282432556 0.00015898160927463323 0.09106618165969849 0.36809754371643066 (1, 1, 7680)
2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0
2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1
2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1
2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0
2026-04-30 19:26:01.621 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-12 vq [23] (1,) int64
2026-04-30 19:26:01.648 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-13 vq-rvq [[[ 23 1808 50 1594 1454 783 1352 1241 944 36 187 1728 756 1807
333 896]]] (1, 1, 16) int64
2026-04-30 19:26:01.656 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-13 vq [871] (1,) int64
2026-04-30 19:26:01.683 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-14 vq-rvq [[[ 871 707 590 322 193 51 54 1780 1599 990 296 1425 832 1215
464 897]]] (1, 1, 16) int64
2026-04-30 19:26:01.691 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-14 vq [360] (1,) int64
2026-04-30 19:26:01.718 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-15 vq-rvq [[[ 360 1553 617 1357 1716 919 2034 561 178 366 864 352 55 264
504 1979]]] (1, 1, 16) int64
2026-04-30 19:26:01.726 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-15 vq [1218] (1,) int64
2026-04-30 19:26:01.753 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-16 vq-rvq [[[1218 1520 627 582 944 5 1996 488 878 1801 251 5 0 1016
764 503]]] (1, 1, 16) int64
2026-04-30 19:26:01.761 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-16 vq [1351] (1,) int64
2026-04-30 19:26:01.788 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-17 vq-rvq [[[1351 927 1671 2003 1231 639 603 198 972 1611 213 522 1106 1997
30 159]]] (1, 1, 16) int64
2026-04-30 19:26:01.796 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-17 vq [1838] (1,) int64
2026-04-30 19:26:01.823 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-18 vq-rvq [[[1838 1806 340 747 1372 143 523 993 1062 238 201 95 31 1176
143 992]]] (1, 1, 16) int64
2026-04-30 19:26:01.831 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-18 vq [1516] (1,) int64
2026-04-30 19:26:01.858 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-19 vq-rvq [[[1516 1217 1088 947 906 2008 2026 325 315 1288 584 321 254 765
258 1254]]] (1, 1, 16) int64
2026-04-30 19:26:01.866 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-19 vq [1830] (1,) int64
2026-04-30 19:26:01.893 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-20 vq-rvq [[[1830 1415 1448 673 64 179 1680 450 272 390 875 1963 480 119
1269 101]]] (1, 1, 16) int64
2026-04-30 19:26:01.901 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-20 vq [113] (1,) int64
2026-04-30 19:26:01.928 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-21 vq-rvq [[[ 113 761 1217 1415 1019 1995 994 1297 792 362 853 912 525 613
1332 288]]] (1, 1, 16) int64
2026-04-30 19:26:01.936 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-21 vq [1250] (1,) int64
2026-04-30 19:26:01.964 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-22 vq-rvq [[[1250 1392 741 1567 538 176 490 675 1905 358 883 956 474 69
1829 1843]]] (1, 1, 16) int64
2026-04-30 19:26:01.972 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-22 vq [103] (1,) int64
2026-04-30 19:26:01.999 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-23 vq-rvq [[[ 103 257 1242 1241 648 96 688 1576 1291 20 576 322 1135 245
595 126]]] (1, 1, 16) int64
2026-04-30 19:26:02.008 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-23 vq [906] (1,) int64
2026-04-30 19:26:02.035 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-24 vq-rvq [[[ 906 72 463 841 1401 189 339 1563 382 522 31 284 987 2040
585 496]]] (1, 1, 16) int64
2026-04-30 19:26:02.043 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-24 vq [180] (1,) int64
2026-04-30 19:26:02.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-25 vq-rvq [[[ 180 16 474 588 846 1064 1623 1445 974 1820 1023 593 838 1533
34 369]]] (1, 1, 16) int64
2026-04-30 19:26:02.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-25 vq [1853] (1,) int64
2026-04-30 19:26:02.105 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-26 vq-rvq [[[1853 1905 1087 1598 468 1159 738 1012 874 183 670 285 153 632
1978 1748]]] (1, 1, 16) int64
2026-04-30 19:26:02.113 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-26 vq [1462] (1,) int64
2026-04-30 19:26:02.140 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-27 vq-rvq [[[1462 1477 1436 1987 869 676 90 700 670 1967 44 1578 567 814
114 27]]] (1, 1, 16) int64
2026-04-30 19:26:02.148 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-27 vq [51] (1,) int64
2026-04-30 19:26:02.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-28 vq-rvq [[[ 51 1111 1263 928 1398 679 931 400 109 221 163 1290 666 1264
1627 501]]] (1, 1, 16) int64
2026-04-30 19:26:02.183 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-28 vq [1447] (1,) int64
2026-04-30 19:26:02.210 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-29 vq-rvq [[[1447 373 471 1078 92 879 32 1773 209 1940 443 16 316 1128
1306 1288]]] (1, 1, 16) int64
2026-04-30 19:26:02.218 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-29 vq [784] (1,) int64
2026-04-30 19:26:02.245 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-30 vq-rvq [[[ 784 1820 1478 606 1083 1982 1131 874 29 815 1000 1330 702 1980
1339 232]]] (1, 1, 16) int64
2026-04-30 19:26:02.253 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-30 vq [991] (1,) int64
2026-04-30 19:26:02.280 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-31 vq-rvq [[[ 991 1001 640 799 188 1112 1323 876 223 1567 1582 1410 1886 1398
956 1863]]] (1, 1, 16) int64
2026-04-30 19:26:02.288 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-31 vq [1743] (1,) int64
2026-04-30 19:26:02.316 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-32 vq-rvq [[[1743 860 1909 1197 102 1302 397 2003 743 121 218 1465 1630 364
1455 1732]]] (1, 1, 16) int64
2026-04-30 19:26:02.324 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-32 vq [610] (1,) int64
2026-04-30 19:26:02.351 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-33 vq-rvq [[[ 610 1884 1904 345 1951 1868 1349 338 1930 250 87 1315 47 146
1609 632]]] (1, 1, 16) int64
2026-04-30 19:26:02.359 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-33 vq [1528] (1,) int64
2026-04-30 19:26:02.386 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-34 vq-rvq [[[1528 740 1476 733 79 1693 1492 999 1151 478 1255 1042 676 412
1066 1120]]] (1, 1, 16) int64
2026-04-30 19:26:02.394 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-34 vq [1711] (1,) int64
2026-04-30 19:26:02.421 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-35 vq-rvq [[[1711 1101 1554 671 447 476 1649 909 229 1549 373 962 863 794
1395 472]]] (1, 1, 16) int64
2026-04-30 19:26:02.429 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-35 vq [1500] (1,) int64
2026-04-30 19:26:02.456 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-36 vq-rvq [[[1500 768 1272 1979 1193 1352 958 104 1203 640 1403 347 461 395
1182 1753]]] (1, 1, 16) int64
2026-04-30 19:26:02.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-36 vq [963] (1,) int64
2026-04-30 19:26:02.490 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-37 vq-rvq [[[ 963 760 1691 1670 610 964 736 1428 1647 1943 421 1512 948 905
1492 617]]] (1, 1, 16) int64
2026-04-30 19:26:02.498 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-37 vq [743] (1,) int64
2026-04-30 19:26:02.525 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-38 vq-rvq [[[ 743 1015 702 1294 106 709 491 1036 86 1162 1772 306 769 596
519 236]]] (1, 1, 16) int64
2026-04-30 19:26:02.533 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-38 vq [148] (1,) int64
2026-04-30 19:26:02.560 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-39 vq-rvq [[[ 148 887 1970 849 916 1019 1129 302 1819 232 22 730 1918 1162
1808 3]]] (1, 1, 16) int64
2026-04-30 19:26:02.568 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-39 vq [908] (1,) int64
2026-04-30 19:26:02.595 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-40 vq-rvq [[[ 908 1772 648 312 757 927 1060 233 202 927 448 1208 1350 117
74 333]]] (1, 1, 16) int64
2026-04-30 19:26:02.603 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-40 vq [1360] (1,) int64
2026-04-30 19:26:02.629 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-41 vq-rvq [[[1360 1045 1978 1175 317 652 957 1326 1597 40 1037 57 1070 989
1401 168]]] (1, 1, 16) int64
2026-04-30 19:26:02.637 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-41 vq [1739] (1,) int64
2026-04-30 19:26:02.664 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-42 vq-rvq [[[1739 844 679 962 583 1737 278 765 1010 1869 1088 553 546 341
375 1067]]] (1, 1, 16) int64
2026-04-30 19:26:02.672 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-42 vq [2150] (1,) int64
2026-04-30 19:26:02.672 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 chunk_tokens [[[ 23 871 360 1218]
[1808 707 1553 1520]
[ 50 590 617 627]
[1594 322 1357 582]
[1454 193 1716 944]
[ 783 51 919 5]
[1352 54 2034 1996]
[1241 1780 561 488]
[ 944 1599 178 878]
[ 36 990 366 1801]
[ 187 296 864 251]
[1728 1425 352 5]
[ 756 832 55 0]
[1807 1215 264 1016]
[ 333 464 504 764]
[ 896 897 1979 503]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:02.696 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 wav [[[-0.03852101 -0.06222959 -0.06324419 ... 0.00308757 0.01666446
0.02635817]]] -0.3823830783367157 6.125232175691053e-05 0.09384987503290176 0.3529222905635834 (1, 1, 7680)
2026-04-30 19:26:02.696 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 chunk_tokens [[[1351 1838 1516 1830]
[ 927 1806 1217 1415]
[1671 340 1088 1448]
[2003 747 947 673]
[1231 1372 906 64]
[ 639 143 2008 179]
[ 603 523 2026 1680]
[ 198 993 325 450]
[ 972 1062 315 272]
[1611 238 1288 390]
[ 213 201 584 875]
[ 522 95 321 1963]
[1106 31 254 480]
[1997 1176 765 119]
[ 30 143 258 1269]
[ 159 992 1254 101]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:02.721 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 wav [[[ 0.02811593 0.01903336 0.00181638 ... -0.00637799 -0.00625728
-0.01839462]]] -0.2889702618122101 -5.0208214815938845e-05 0.06494311988353729 0.2914096415042877 (1, 1, 7680)
2026-04-30 19:26:02.721 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 chunk_tokens [[[ 113 1250 103 906]
[ 761 1392 257 72]
[1217 741 1242 463]
[1415 1567 1241 841]
[1019 538 648 1401]
[1995 176 96 189]
[ 994 490 688 339]
[1297 675 1576 1563]
[ 792 1905 1291 382]
[ 362 358 20 522]
[ 853 883 576 31]
[ 912 956 322 284]
[ 525 474 1135 987]
[ 613 69 245 2040]
[1332 1829 595 585]
[ 288 1843 126 496]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:02.745 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 wav [[[-3.6303084e-02 -4.4228390e-02 -4.6101980e-02 ... 4.6050473e-04
-4.0465111e-05 -2.4329145e-04]]] -0.36047816276550293 7.727897173026577e-05 0.07270871102809906 0.34643569588661194 (1, 1, 7680)
2026-04-30 19:26:02.745 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 chunk_tokens [[[ 180 1853 1462 51]
[ 16 1905 1477 1111]
[ 474 1087 1436 1263]
[ 588 1598 1987 928]
[ 846 468 869 1398]
[1064 1159 676 679]
[1623 738 90 931]
[1445 1012 700 400]
[ 974 874 670 109]
[1820 183 1967 221]
[1023 670 44 163]
[ 593 285 1578 1290]
[ 838 153 567 666]
[1533 632 814 1264]
[ 34 1978 114 1627]
[ 369 1748 27 501]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:02.769 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 wav [[[7.2466741e-05 2.7459790e-04 3.0666371e-04 ... 8.0509745e-03
1.3393108e-02 9.4361240e-03]]] -0.27722132205963135 1.9477576643112116e-05 0.06931047886610031 0.29797351360321045 (1, 1, 7680)
2026-04-30 19:26:02.769 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 chunk_tokens [[[1447 784 991 1743]
[ 373 1820 1001 860]
[ 471 1478 640 1909]
[1078 606 799 1197]
[ 92 1083 188 102]
[ 879 1982 1112 1302]
[ 32 1131 1323 397]
[1773 874 876 2003]
[ 209 29 223 743]
[1940 815 1567 121]
[ 443 1000 1582 218]
[ 16 1330 1410 1465]
[ 316 702 1886 1630]
[1128 1980 1398 364]
[1306 1339 956 1455]
[1288 232 1863 1732]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:02.794 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 wav [[[ 0.00426391 0.00582221 0.00909369 ... -0.02768227 -0.02276854
-0.01686861]]] -0.36572250723838806 0.00010111744632013142 0.10399573296308517 0.36718446016311646 (1, 1, 7680)
2026-04-30 19:26:02.794 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 chunk_tokens [[[ 610 1528 1711 1500]
[1884 740 1101 768]
[1904 1476 1554 1272]
[ 345 733 671 1979]
[1951 79 447 1193]
[1868 1693 476 1352]
[1349 1492 1649 958]
[ 338 999 909 104]
[1930 1151 229 1203]
[ 250 478 1549 640]
[ 87 1255 373 1403]
[1315 1042 962 347]
[ 47 676 863 461]
[ 146 412 794 395]
[1609 1066 1395 1182]
[ 632 1120 472 1753]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:02.818 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 wav [[[-0.01355644 -0.01526949 -0.01623942 ... 0.0395449 0.05279908
0.00224491]]] -0.353689044713974 9.688013051345479e-06 0.06698057800531387 0.3341635763645172 (1, 1, 7680)
2026-04-30 19:26:02.818 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 chunk_tokens [[[ 963 743 148 908]
[ 760 1015 887 1772]
[1691 702 1970 648]
[1670 1294 849 312]
[ 610 106 916 757]
[ 964 709 1019 927]
[ 736 491 1129 1060]
[1428 1036 302 233]
[1647 86 1819 202]
[1943 1162 232 927]
[ 421 1772 22 448]
[1512 306 730 1208]
[ 948 769 1918 1350]
[ 905 596 1162 117]
[1492 519 1808 74]
[ 617 236 3 333]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:02.843 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 wav [[[-0.01579052 0.00150335 -0.02962946 ... -0.00423873 -0.00033509
0.00640968]]] -0.2924741506576538 -3.654159081634134e-05 0.07507737725973129 0.3149661123752594 (1, 1, 7680)
2026-04-30 19:26:02.843 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-40 chunk_tokens [[[1360 1739]
[1045 844]
[1978 679]
[1175 962]
[ 317 583]
[ 652 1737]
[ 957 278]
[1326 765]
[1597 1010]
[ 40 1869]
[1037 1088]
[ 57 553]
[1070 546]
[ 989 341]
[1401 375]
[ 168 1067]]] (1, 16, 2) n_chunk_frames 2
2026-04-30 19:26:02.908 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-40 wav [[[1.9390190e-02 3.0609204e-02 3.0704437e-02 ... 1.1317945e-05
1.0956299e-05 1.1030028e-05]]] -0.13680139183998108 0.00013362053141463548 0.015219715423882008 0.1303817480802536 (1, 1, 3840)
2026-04-30 19:26:02.908 [INFO] __main__: Synthesising: 'Мы наконец-то достигли момента,'
2026-04-30 19:26:02.908 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment М -> text_cache М
2026-04-30 19:26:02.908 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False
2026-04-30 19:26:02.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list [array([[[ 0.04818726, 0.05957031, 0.03213501, ..., -0.11203003,
-0.09613037, -0.09103394]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.09631348, -0.10897827, -0.12399292, ..., -0.00085449,
-0.00091553, -0.00048828]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.0000000e+00, 6.1035156e-05, -1.2207031e-04, ...,
1.3381958e-01, 1.6635132e-01, 2.0919800e-01]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 2.3223877e-01, 2.0669556e-01, 1.3903809e-01, ...,
-1.8310547e-04, -1.5258789e-04, -9.1552734e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[-9.1552734e-05, -6.1035156e-05, -3.0517578e-05, ...,
0.0000000e+00, -3.0517578e-05, 0.0000000e+00]]],
shape=(1, 1, 5339), dtype=float32), array([[[-0.02130234, -0.01856662, -0.01710658, ..., 0.00041982,
0.00062048, 0.0006307 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00029411, -0.00040776, -0.00044942, ..., -0.02424868,
0.02291245, 0.05937432]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.07660156, 0.07495726, 0.06135209, ..., -0.1206022 ,
-0.12184623, -0.1139332 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10050648, -0.08953431, -0.07884923, ..., -0.01869578,
-0.0167346 , -0.01763956]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2177158e-02, -6.4980479e-05, 1.2000869e-02, ...,
-4.9953014e-03, 2.0064995e-02, 8.1494255e-03]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03188938, -0.00509401, 0.04241933, ..., -0.09476525,
-0.18832558, -0.23867904]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.2519588 , -0.24120857, -0.2249308 , ..., -0.00908731,
-0.00565482, -0.00478506]]], shape=(1, 1, 7680), dtype=float32), array([[[-4.7078328e-03, 7.2684824e-03, 2.4840837e-02, ...,
-1.4027000e-05, 1.5263325e-04, 1.7792435e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[1.19311335e-04, 2.77099258e-04, 4.16864146e-04, ...,
1.06179923e-05, 1.06252701e-05, 1.15810089e-05]]],
shape=(1, 1, 3840), dtype=float32), array([[[ 1.2349803e-05, 1.2119761e-05, 2.1108619e-05, ...,
-1.6870323e-01, -1.3621169e-01, -8.6433820e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03330091, 0.00856069, 0.03467582, ..., -0.04072727,
-0.03181617, -0.00645593]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01122023, 0.00413963, -0.00393783, ..., -0.00029461,
0.00421931, -0.00251451]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0154132 , -0.02377532, -0.02271089, ..., 0.02933036,
0.023146 , 0.01213897]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00091471, -0.01367491, -0.02537205, ..., -0.00178504,
0.00290802, 0.00261759]]], shape=(1, 1, 7680), dtype=float32), array([[[-2.6994986e-03, -8.4007008e-04, 2.4883149e-03, ...,
1.0968803e-05, 1.0850177e-05, 1.1066140e-05]]],
shape=(1, 1, 1920), dtype=float32), array([[[-0.02139645, -0.0189162 , -0.01778135, ..., -0.00045287,
-0.00059633, -0.00165827]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00221966, -0.00138947, -0.000929 , ..., -0.1126425 ,
-0.1338531 , -0.13333385]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10775348, -0.05212127, 0.0396859 , ..., -0.04563401,
-0.03402565, -0.03579839]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03745677, -0.02658239, -0.02583151, ..., -0.0121026 ,
-0.00580872, -0.01895227]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0263972 , -0.01400574, -0.01092716, ..., -0.00139586,
0.00422512, 0.00643334]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00588865, 0.00345067, -0.00066399, ..., 0.00632556,
0.00391393, 0.00175216]]], shape=(1, 1, 5760), dtype=float32), array([[[ 0.0010756 , 0.00117576, 0.00123106, ..., -0.04100708,
-0.0458885 , -0.04321691]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.05036464, -0.03583061, -0.00757636, ..., 0.05205004,
0.01185071, -0.03961121]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.08307496, -0.11176797, -0.1242267 , ..., -0.00193561,
0.005123 , 0.0037974 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00899126, -0.00369494, 0.00981118, ..., -0.00399455,
-0.00319744, -0.00289368]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00285673, -0.0034839 , -0.00415278, ..., 0.00778646,
0.00595145, -0.0043805 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01552802, -0.01487012, -0.01219678, ..., -0.00294759,
0.00343194, 0.0008437 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00404704, 0.00067246, 0.00399263, ..., 0.09798931,
0.20872854, 0.2311011 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.14216125, 0.06682034, 0.02212509, ..., 0.06106113,
0.00223079, -0.05518628]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10738115, -0.11622868, -0.06752186, ..., 0.03509749,
0.03198082, 0.02877127]]], shape=(1, 1, 7680), dtype=float32), array([[[2.69281808e-02, 2.77648699e-02, 3.07107549e-02, ...,
1.15126495e-05, 1.21511912e-05, 1.15567072e-05]]],
shape=(1, 1, 5760), dtype=float32), array([[[-2.0247478e-02, -1.6132748e-02, -1.4229195e-02, ...,
1.1977663e-05, 1.1495073e-05, 1.2644601e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 1.2498698e-05, 1.2433531e-05, 1.1404698e-05, ...,
-5.8077216e-02, -5.1980902e-02, -5.0722528e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.05217085, -0.05058753, -0.03975262, ..., 0.21015896,
0.11327256, 0.02125037]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03852101, -0.06222959, -0.06324419, ..., 0.00308757,
0.01666446, 0.02635817]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02811593, 0.01903336, 0.00181638, ..., -0.00637799,
-0.00625728, -0.01839462]]], shape=(1, 1, 7680), dtype=float32), array([[[-3.6303084e-02, -4.4228390e-02, -4.6101980e-02, ...,
4.6050473e-04, -4.0465111e-05, -2.4329145e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[7.2466741e-05, 2.7459790e-04, 3.0666371e-04, ...,
8.0509745e-03, 1.3393108e-02, 9.4361240e-03]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 0.00426391, 0.00582221, 0.00909369, ..., -0.02768227,
-0.02276854, -0.01686861]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01355644, -0.01526949, -0.01623942, ..., 0.0395449 ,
0.05279908, 0.00224491]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01579052, 0.00150335, -0.02962946, ..., -0.00423873,
-0.00033509, 0.00640968]]], shape=(1, 1, 7680), dtype=float32), array([[[1.9390190e-02, 3.0609204e-02, 3.0704437e-02, ...,
1.1317945e-05, 1.0956299e-05, 1.1030028e-05]]],
shape=(1, 1, 3840), dtype=float32)] 47
2026-04-30 19:26:02.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history [4.8187256e-02 5.9570312e-02 3.2135010e-02 ... 1.1317945e-05 1.0956299e-05
1.1030028e-05] (341339,) float32
2026-04-30 19:26:02.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history_after cut_idx 21 [-2.2196597e-03 -1.3894709e-03 -9.2900067e-04 ... 1.1317945e-05
1.0956299e-05 1.1030028e-05] (192000,) float32
2026-04-30 19:26:02.916 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list_after cut_idx 21 [array([[[-0.00221966, -0.00138947, -0.000929 , ..., -0.1126425 ,
-0.1338531 , -0.13333385]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10775348, -0.05212127, 0.0396859 , ..., -0.04563401,
-0.03402565, -0.03579839]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03745677, -0.02658239, -0.02583151, ..., -0.0121026 ,
-0.00580872, -0.01895227]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0263972 , -0.01400574, -0.01092716, ..., -0.00139586,
0.00422512, 0.00643334]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00588865, 0.00345067, -0.00066399, ..., 0.00632556,
0.00391393, 0.00175216]]], shape=(1, 1, 5760), dtype=float32), array([[[ 0.0010756 , 0.00117576, 0.00123106, ..., -0.04100708,
-0.0458885 , -0.04321691]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.05036464, -0.03583061, -0.00757636, ..., 0.05205004,
0.01185071, -0.03961121]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.08307496, -0.11176797, -0.1242267 , ..., -0.00193561,
0.005123 , 0.0037974 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00899126, -0.00369494, 0.00981118, ..., -0.00399455,
-0.00319744, -0.00289368]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00285673, -0.0034839 , -0.00415278, ..., 0.00778646,
0.00595145, -0.0043805 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01552802, -0.01487012, -0.01219678, ..., -0.00294759,
0.00343194, 0.0008437 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00404704, 0.00067246, 0.00399263, ..., 0.09798931,
0.20872854, 0.2311011 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.14216125, 0.06682034, 0.02212509, ..., 0.06106113,
0.00223079, -0.05518628]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10738115, -0.11622868, -0.06752186, ..., 0.03509749,
0.03198082, 0.02877127]]], shape=(1, 1, 7680), dtype=float32), array([[[2.69281808e-02, 2.77648699e-02, 3.07107549e-02, ...,
1.15126495e-05, 1.21511912e-05, 1.15567072e-05]]],
shape=(1, 1, 5760), dtype=float32), array([[[-2.0247478e-02, -1.6132748e-02, -1.4229195e-02, ...,
1.1977663e-05, 1.1495073e-05, 1.2644601e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 1.2498698e-05, 1.2433531e-05, 1.1404698e-05, ...,
-5.8077216e-02, -5.1980902e-02, -5.0722528e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.05217085, -0.05058753, -0.03975262, ..., 0.21015896,
0.11327256, 0.02125037]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03852101, -0.06222959, -0.06324419, ..., 0.00308757,
0.01666446, 0.02635817]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02811593, 0.01903336, 0.00181638, ..., -0.00637799,
-0.00625728, -0.01839462]]], shape=(1, 1, 7680), dtype=float32), array([[[-3.6303084e-02, -4.4228390e-02, -4.6101980e-02, ...,
4.6050473e-04, -4.0465111e-05, -2.4329145e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[7.2466741e-05, 2.7459790e-04, 3.0666371e-04, ...,
8.0509745e-03, 1.3393108e-02, 9.4361240e-03]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 0.00426391, 0.00582221, 0.00909369, ..., -0.02768227,
-0.02276854, -0.01686861]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01355644, -0.01526949, -0.01623942, ..., 0.0395449 ,
0.05279908, 0.00224491]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01579052, 0.00150335, -0.02962946, ..., -0.00423873,
-0.00033509, 0.00640968]]], shape=(1, 1, 7680), dtype=float32), array([[[1.9390190e-02, 3.0609204e-02, 3.0704437e-02, ...,
1.1317945e-05, 1.0956299e-05, 1.1030028e-05]]],
shape=(1, 1, 3840), dtype=float32)] 26
2026-04-30 19:26:02.916 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069
2026-04-30 19:26:02.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[ 0.04276081 0.10415712 -0.05638932 ... 0.12182362 0.07653181
0.08928564]]] (1, 1, 1024)
2026-04-30 19:26:02.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]]
2026-04-30 19:26:02.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]]] (1, 4, 1024)
2026-04-30 19:26:02.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 1, 1024)
2026-04-30 19:26:02.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]
[ 0.04276081 0.10415712 -0.05638932 ... 0.12182362 0.07653181
0.08928564]
[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 6, 1024)
2026-04-30 19:26:02.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22
Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:02.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:02.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3)
2026-04-30 19:26:02.993 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3)
2026-04-30 19:26:02.993 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024)
2026-04-30 19:26:02.993 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036
-0.00767252]]] (1, 1, 1024)
2026-04-30 19:26:02.994 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528
0.00424147]]] (1, 1, 1024)
2026-04-30 19:26:02.994 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724
-0.00170945]
[ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198
0.00132705]
[ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966
0.0080104 ]
[ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711
0.00252486]
[ 0.047539 0.10035113 -0.05808548 ... 0.11253928 0.0780871
0.09352712]
[ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459
-0.00718043]]] (1, 6, 1024)
2026-04-30 19:26:02.994 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]
...
[ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03
-2.0710612e-04 2.5248611e-03]
[ 4.7538996e-02 1.0035113e-01 -5.8085475e-02 ... 1.1253928e-01
7.8087099e-02 9.3527116e-02]
[ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03
3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024)
2026-04-30 19:26:03.039 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=61; step_idx=61
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill cont done; talker_seq_len=61; step_idx=61
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ы -> text_cache Мы
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache Мы
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Мы н
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache Мы на
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache Мы нак
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Мы нако
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Мы након
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache Мы наконе
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ц -> text_cache Мы наконец
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment - -> text_cache Мы наконец-
2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['Мы наконец-'] 11
Qwen3TTSProcessor __call__ text ['Мы наконец-']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 37991, 4552, 6709, 15869, 17316, 126499, 12]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 37991, 4552, 6709, 15869, 17316, 126499, 12]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 37991 4552 6709 15869 17316 126499 12]] (1, 7)
2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 37991 4552 6709 15869 17316 126499 12]] (1, 7)
2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment Мы наконец- 11 -> tokenized_segment [np.int64(37991), np.int64(4552), np.int64(6709), np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)] 7
2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(37991), np.int64(4552), np.int64(6709), np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)]
2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(37991), np.int64(4552), np.int64(6709), np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)] 7
2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 37991 -> pending_tokens [np.int64(4552), np.int64(6709), np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)] 6
2026-04-30 19:26:03.088 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-61 vq [1221] (1,) int64
2026-04-30 19:26:03.115 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-62 vq-rvq [[[1221 1390 1612 91 1463 2030 1696 1369 334 995 264 1096 407 421
142 428]]] (1, 1, 16) int64
2026-04-30 19:26:03.115 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 4552 -> pending_tokens [np.int64(6709), np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)] 5
2026-04-30 19:26:03.123 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-62 vq [2042] (1,) int64
2026-04-30 19:26:03.149 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-63 vq-rvq [[[2042 412 818 532 1373 463 1718 435 887 1736 100 546 963 388
651 742]]] (1, 1, 16) int64
2026-04-30 19:26:03.150 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6709 -> pending_tokens [np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)] 4
2026-04-30 19:26:03.158 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-63 vq [1707] (1,) int64
2026-04-30 19:26:03.184 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-64 vq-rvq [[[1707 1243 1747 1575 1799 182 884 978 410 1721 1185 1055 672 1104
833 1038]]] (1, 1, 16) int64
2026-04-30 19:26:03.184 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 15869 -> pending_tokens [np.int64(17316), np.int64(126499), np.int64(12)] 3
2026-04-30 19:26:03.192 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-64 vq [397] (1,) int64
2026-04-30 19:26:03.219 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-65 vq-rvq [[[ 397 407 1310 595 542 294 284 519 1716 111 1610 1437 222 317
860 156]]] (1, 1, 16) int64
2026-04-30 19:26:03.219 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 17316 -> pending_tokens [np.int64(126499), np.int64(12)] 2
2026-04-30 19:26:03.227 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-65 vq [830] (1,) int64
2026-04-30 19:26:03.254 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-66 vq-rvq [[[ 830 299 2003 1215 927 982 1406 1676 773 768 2018 1447 1045 655
1606 1336]]] (1, 1, 16) int64
2026-04-30 19:26:03.254 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 126499 -> pending_tokens [np.int64(12)] 1
2026-04-30 19:26:03.262 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-66 vq [1782] (1,) int64
2026-04-30 19:26:03.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-67 vq-rvq [[[1782 1698 1787 277 1263 167 1388 134 1689 690 269 996 1069 706
169 59]]] (1, 1, 16) int64
2026-04-30 19:26:03.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 12 -> pending_tokens [] 0
2026-04-30 19:26:03.297 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-67 vq [287] (1,) int64
2026-04-30 19:26:03.323 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-68 vq-rvq [[[ 287 1924 69 564 295 372 10 31 1047 512 386 96 343 530
1351 17]]] (1, 1, 16) int64
2026-04-30 19:26:03.324 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-42 chunk_tokens [[[1221 2042 1707 397]
[1390 412 1243 407]
[1612 818 1747 1310]
[ 91 532 1575 595]
[1463 1373 1799 542]
[2030 463 182 294]
[1696 1718 884 284]
[1369 435 978 519]
[ 334 887 410 1716]
[ 995 1736 1721 111]
[ 264 100 1185 1610]
[1096 546 1055 1437]
[ 407 963 672 222]
[ 421 388 1104 317]
[ 142 651 833 860]
[ 428 742 1038 156]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-42 wav [[[ 1.1094540e-05 1.1138460e-05 1.1009237e-05 ... -2.2123540e-02
-2.2558490e-02 -1.9299621e-02]]] -0.3667455315589905 -8.192218228941783e-05 0.051546160131692886 0.37703007459640503 (1, 1, 7680)
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache т
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache то д
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то до
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache то дос
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache то дост
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache то дости
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache то достиг
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache то достигл
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache то достигли
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то достигли
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache то достигли м
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то достигли мо
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache то достигли мом
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache то достигли моме
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache то достигли момен
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache то достигли момент
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache то достигли момента
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment , -> text_cache то достигли момента,
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['то достигли момента,'] 20
Qwen3TTSProcessor __call__ text ['то достигли момента,']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 24634, 139062, 11073, 130485, 87731, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 24634, 139062, 11073, 130485, 87731, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 24634 139062 11073 130485 87731 11]] (1, 6)
2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 24634 139062 11073 130485 87731 11]] (1, 6)
2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment то достигли момента, 20 -> tokenized_segment [np.int64(24634), np.int64(139062), np.int64(11073), np.int64(130485), np.int64(87731), np.int64(11)] 6
2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(24634), np.int64(139062), np.int64(11073), np.int64(130485), np.int64(87731), np.int64(11)]
2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(24634), np.int64(139062), np.int64(11073), np.int64(130485), np.int64(87731), np.int64(11)] 6
2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 24634 -> pending_tokens [np.int64(139062), np.int64(11073), np.int64(130485), np.int64(87731), np.int64(11)] 5
2026-04-30 19:26:03.358 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-68 vq [1621] (1,) int64
2026-04-30 19:26:03.385 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-69 vq-rvq [[[1621 1082 448 400 1626 1338 1419 1179 489 1966 765 131 1689 553
1068 619]]] (1, 1, 16) int64
2026-04-30 19:26:03.385 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 139062 -> pending_tokens [np.int64(11073), np.int64(130485), np.int64(87731), np.int64(11)] 4
2026-04-30 19:26:03.393 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-69 vq [1055] (1,) int64
2026-04-30 19:26:03.420 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-70 vq-rvq [[[1055 149 569 1965 903 768 911 342 400 575 609 865 309 430
1324 1061]]] (1, 1, 16) int64
2026-04-30 19:26:03.420 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11073 -> pending_tokens [np.int64(130485), np.int64(87731), np.int64(11)] 3
2026-04-30 19:26:03.428 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-70 vq [770] (1,) int64
2026-04-30 19:26:03.456 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-71 vq-rvq [[[ 770 915 216 1366 1121 468 121 1709 1099 1134 1156 446 223 75
891 1082]]] (1, 1, 16) int64
2026-04-30 19:26:03.456 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 130485 -> pending_tokens [np.int64(87731), np.int64(11)] 2
2026-04-30 19:26:03.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-71 vq [499] (1,) int64
2026-04-30 19:26:03.491 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-72 vq-rvq [[[ 499 1532 110 382 941 1185 935 413 1541 25 799 1421 217 1037
873 1002]]] (1, 1, 16) int64
2026-04-30 19:26:03.491 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 87731 -> pending_tokens [np.int64(11)] 1
2026-04-30 19:26:03.499 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-72 vq [935] (1,) int64
2026-04-30 19:26:03.526 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-73 vq-rvq [[[ 935 1224 1429 1973 818 1914 275 103 1336 1327 352 289 387 205
1188 1024]]] (1, 1, 16) int64
2026-04-30 19:26:03.526 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11 -> pending_tokens [] 0
2026-04-30 19:26:03.534 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-73 vq [402] (1,) int64
2026-04-30 19:26:03.561 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-74 vq-rvq [[[ 402 1161 1269 319 119 975 602 1536 432 585 1617 853 560 417
1681 1402]]] (1, 1, 16) int64
2026-04-30 19:26:03.561 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-46 chunk_tokens [[[ 830 1782 287 1621]
[ 299 1698 1924 1082]
[2003 1787 69 448]
[1215 277 564 400]
[ 927 1263 295 1626]
[ 982 167 372 1338]
[1406 1388 10 1419]
[1676 134 31 1179]
[ 773 1689 1047 489]
[ 768 690 512 1966]
[2018 269 386 765]
[1447 996 96 131]
[1045 1069 343 1689]
[ 655 706 530 553]
[1606 169 1351 1068]
[1336 59 17 619]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:03.585 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-46 wav [[[0.00221431 0.03934583 0.0700637 ... 0.01913414 0.04059763 0.06542776]]] -0.2998812198638916 0.0001630938786547631 0.07838644087314606 0.33400189876556396 (1, 1, 7680)
2026-04-30 19:26:03.586 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-50 chunk_tokens [[[1055 770 499 935]
[ 149 915 1532 1224]
[ 569 216 110 1429]
[1965 1366 382 1973]
[ 903 1121 941 818]
[ 768 468 1185 1914]
[ 911 121 935 275]
[ 342 1709 413 103]
[ 400 1099 1541 1336]
[ 575 1134 25 1327]
[ 609 1156 799 352]
[ 865 446 1421 289]
[ 309 223 217 387]
[ 430 75 1037 205]
[1324 891 873 1188]
[1061 1082 1002 1024]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-50 wav [[[0.08465035 0.0946539 0.09328509 ... 0.0472551 0.05668663 0.05911173]]] -0.41971355676651 2.49695385718951e-05 0.07336953282356262 0.34725117683410645 (1, 1, 7680)
2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0
2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1
2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1
2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0
2026-04-30 19:26:03.618 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-74 vq [1316] (1,) int64
2026-04-30 19:26:03.645 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-75 vq-rvq [[[1316 1002 192 1761 1004 1542 70 1129 261 448 563 1222 100 276
418 197]]] (1, 1, 16) int64
2026-04-30 19:26:03.653 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-75 vq [177] (1,) int64
2026-04-30 19:26:03.680 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-76 vq-rvq [[[ 177 1183 2028 633 1945 1051 1205 1143 62 705 1670 304 458 1590
1 58]]] (1, 1, 16) int64
2026-04-30 19:26:03.688 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-76 vq [1196] (1,) int64
2026-04-30 19:26:03.715 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-77 vq-rvq [[[1196 87 658 1207 848 1837 1930 1811 643 814 81 820 1104 188
134 219]]] (1, 1, 16) int64
2026-04-30 19:26:03.723 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-77 vq [891] (1,) int64
2026-04-30 19:26:03.749 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-78 vq-rvq [[[ 891 718 34 428 1484 1012 1968 1148 32 243 1480 378 1958 1327
1280 1357]]] (1, 1, 16) int64
2026-04-30 19:26:03.757 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-78 vq [777] (1,) int64
2026-04-30 19:26:03.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-79 vq-rvq [[[ 777 1525 146 1201 588 403 1350 709 1866 1032 1990 190 1516 1789
127 1094]]] (1, 1, 16) int64
2026-04-30 19:26:03.792 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-79 vq [833] (1,) int64
2026-04-30 19:26:03.819 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-80 vq-rvq [[[ 833 1377 609 549 708 1294 346 1289 1844 1398 641 1576 1876 1417
71 996]]] (1, 1, 16) int64
2026-04-30 19:26:03.827 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-80 vq [1559] (1,) int64
2026-04-30 19:26:03.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-81 vq-rvq [[[1559 1378 2045 1595 3 246 970 952 186 212 678 1040 1932 1374
953 823]]] (1, 1, 16) int64
2026-04-30 19:26:03.861 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-81 vq [28] (1,) int64
2026-04-30 19:26:03.888 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-82 vq-rvq [[[ 28 1354 153 367 360 1253 1037 1486 1162 488 319 253 1712 1897
1347 1641]]] (1, 1, 16) int64
2026-04-30 19:26:03.896 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-82 vq [158] (1,) int64
2026-04-30 19:26:03.923 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-83 vq-rvq [[[ 158 1809 503 10 260 865 654 830 528 1684 1396 1636 878 402
1138 694]]] (1, 1, 16) int64
2026-04-30 19:26:03.931 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-83 vq [2030] (1,) int64
2026-04-30 19:26:03.958 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-84 vq-rvq [[[2030 1971 1116 189 841 1694 183 182 350 617 297 1927 5 958
537 198]]] (1, 1, 16) int64
2026-04-30 19:26:03.966 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-84 vq [2020] (1,) int64
2026-04-30 19:26:03.993 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-85 vq-rvq [[[2020 545 310 1224 39 1812 195 1521 435 1403 2007 1443 412 960
1957 1595]]] (1, 1, 16) int64
2026-04-30 19:26:04.001 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-85 vq [825] (1,) int64
2026-04-30 19:26:04.028 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-86 vq-rvq [[[ 825 1821 1718 1989 1167 87 44 878 1228 1347 1997 1699 895 1
1906 1385]]] (1, 1, 16) int64
2026-04-30 19:26:04.036 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-86 vq [667] (1,) int64
2026-04-30 19:26:04.063 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-87 vq-rvq [[[ 667 1058 1708 706 1493 1607 383 1441 1507 1330 206 17 1300 1449
678 967]]] (1, 1, 16) int64
2026-04-30 19:26:04.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-87 vq [1406] (1,) int64
2026-04-30 19:26:04.098 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-88 vq-rvq [[[1406 834 28 30 704 25 710 174 834 1047 123 1992 261 19
941 1345]]] (1, 1, 16) int64
2026-04-30 19:26:04.106 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-88 vq [195] (1,) int64
2026-04-30 19:26:04.133 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-89 vq-rvq [[[ 195 1175 1442 232 315 1465 547 1466 369 105 1720 676 716 1993
66 1405]]] (1, 1, 16) int64
2026-04-30 19:26:04.141 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-89 vq [1603] (1,) int64
2026-04-30 19:26:04.168 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-90 vq-rvq [[[1603 1782 399 533 1579 1414 11 1620 1305 340 1136 1212 150 58
1778 1622]]] (1, 1, 16) int64
2026-04-30 19:26:04.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-90 vq [1106] (1,) int64
2026-04-30 19:26:04.203 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-91 vq-rvq [[[1106 638 1001 1977 1680 1733 1512 1194 940 1471 713 123 394 754
499 90]]] (1, 1, 16) int64
2026-04-30 19:26:04.211 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-91 vq [1182] (1,) int64
2026-04-30 19:26:04.238 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-92 vq-rvq [[[1182 1456 1273 1913 481 59 648 1517 1564 1235 1015 119 11 81
721 206]]] (1, 1, 16) int64
2026-04-30 19:26:04.246 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-92 vq [1958] (1,) int64
2026-04-30 19:26:04.273 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-93 vq-rvq [[[1958 433 1937 494 884 174 1093 1061 52 1700 608 1185 199 72
44 1706]]] (1, 1, 16) int64
2026-04-30 19:26:04.281 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-93 vq [863] (1,) int64
2026-04-30 19:26:04.308 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-94 vq-rvq [[[ 863 693 1454 750 625 634 1113 192 1442 850 1401 420 1675 872
683 1036]]] (1, 1, 16) int64
2026-04-30 19:26:04.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-94 vq [2150] (1,) int64
2026-04-30 19:26:04.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-54 chunk_tokens [[[ 402 1316 177 1196]
[1161 1002 1183 87]
[1269 192 2028 658]
[ 319 1761 633 1207]
[ 119 1004 1945 848]
[ 975 1542 1051 1837]
[ 602 70 1205 1930]
[1536 1129 1143 1811]
[ 432 261 62 643]
[ 585 448 705 814]
[1617 563 1670 81]
[ 853 1222 304 820]
[ 560 100 458 1104]
[ 417 276 1590 188]
[1681 418 1 134]
[1402 197 58 219]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:04.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-54 wav [[[ 0.04501721 0.0241992 0.01363233 ... -0.04057647 -0.05749581
-0.0651198 ]]] -0.4347250461578369 -4.3712687329389155e-05 0.0809682309627533 0.315145879983902 (1, 1, 7680)
2026-04-30 19:26:04.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-58 chunk_tokens [[[ 891 777 833 1559]
[ 718 1525 1377 1378]
[ 34 146 609 2045]
[ 428 1201 549 1595]
[1484 588 708 3]
[1012 403 1294 246]
[1968 1350 346 970]
[1148 709 1289 952]
[ 32 1866 1844 186]
[ 243 1032 1398 212]
[1480 1990 641 678]
[ 378 190 1576 1040]
[1958 1516 1876 1932]
[1327 1789 1417 1374]
[1280 127 71 953]
[1357 1094 996 823]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:04.365 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-58 wav [[[-0.06861783 -0.06905188 -0.06281615 ... -0.00338598 0.00180774
0.00092616]]] -0.39641478657722473 3.9381378883263096e-05 0.06513799726963043 0.28704598546028137 (1, 1, 7680)
2026-04-30 19:26:04.366 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-62 chunk_tokens [[[ 28 158 2030 2020]
[1354 1809 1971 545]
[ 153 503 1116 310]
[ 367 10 189 1224]
[ 360 260 841 39]
[1253 865 1694 1812]
[1037 654 183 195]
[1486 830 182 1521]
[1162 528 350 435]
[ 488 1684 617 1403]
[ 319 1396 297 2007]
[ 253 1636 1927 1443]
[1712 878 5 412]
[1897 402 958 960]
[1347 1138 537 1957]
[1641 694 198 1595]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:04.390 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-62 wav [[[-0.00584421 -0.00096309 0.00632945 ... 0.00375346 0.00384357
0.00217619]]] -0.3507983982563019 1.487454142079514e-06 0.07993330806493759 0.3479536771774292 (1, 1, 7680)
2026-04-30 19:26:04.390 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-66 chunk_tokens [[[ 825 667 1406 195]
[1821 1058 834 1175]
[1718 1708 28 1442]
[1989 706 30 232]
[1167 1493 704 315]
[ 87 1607 25 1465]
[ 44 383 710 547]
[ 878 1441 174 1466]
[1228 1507 834 369]
[1347 1330 1047 105]
[1997 206 123 1720]
[1699 17 1992 676]
[ 895 1300 261 716]
[ 1 1449 19 1993]
[1906 678 941 66]
[1385 967 1345 1405]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:04.414 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-66 wav [[[-0.00579548 -0.01757104 -0.0243005 ... 0.00547749 0.00660871
0.009783 ]]] -0.30730149149894714 7.387773075606674e-05 0.07454356551170349 0.42008545994758606 (1, 1, 7680)
2026-04-30 19:26:04.414 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-70 chunk_tokens [[[1603 1106 1182 1958]
[1782 638 1456 433]
[ 399 1001 1273 1937]
[ 533 1977 1913 494]
[1579 1680 481 884]
[1414 1733 59 174]
[ 11 1512 648 1093]
[1620 1194 1517 1061]
[1305 940 1564 52]
[ 340 1471 1235 1700]
[1136 713 1015 608]
[1212 123 119 1185]
[ 150 394 11 199]
[ 58 754 81 72]
[1778 499 721 44]
[1622 90 206 1706]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:04.438 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-70 wav [[[ 0.01747901 0.02681293 0.03847475 ... -0.02004432 -0.02144283
-0.0218131 ]]] -0.4774703085422516 4.8207220970653e-05 0.07886362075805664 0.2929850220680237 (1, 1, 7680)
2026-04-30 19:26:04.438 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-74 chunk_tokens [[[ 863]
[ 693]
[1454]
[ 750]
[ 625]
[ 634]
[1113]
[ 192]
[1442]
[ 850]
[1401]
[ 420]
[1675]
[ 872]
[ 683]
[1036]]] (1, 16, 1) n_chunk_frames 1
2026-04-30 19:26:04.504 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-74 wav [[[-1.9715637e-02 -1.6528632e-02 -1.3177541e-02 ... 1.1422026e-05
1.1317023e-05 1.1494269e-05]]] -0.031071737408638 -7.873835420468822e-05 0.008015702478587627 0.03967128321528435 (1, 1, 1920)
2026-04-30 19:26:04.505 [INFO] src.inference.qwen3_tts_inferencer_onnx: reset_turn reset_generation_state step-idx-95
2026-04-30 19:26:04.522 [INFO] __main__: Synthesising: 'когда технологии стали достаточно быстрыми,'
2026-04-30 19:26:04.522 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache к
2026-04-30 19:26:04.523 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False
2026-04-30 19:26:04.523 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069
2026-04-30 19:26:04.602 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076
0.08690926]]] (1, 1, 1024)
2026-04-30 19:26:04.602 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]]
2026-04-30 19:26:04.602 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]]] (1, 4, 1024)
2026-04-30 19:26:04.603 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 1, 1024)
2026-04-30 19:26:04.603 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]
[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076
0.08690926]
[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 6, 1024)
2026-04-30 19:26:04.603 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22
Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:04.604 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:04.604 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3)
2026-04-30 19:26:04.604 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3)
2026-04-30 19:26:04.604 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024)
2026-04-30 19:26:04.605 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036
-0.00767252]]] (1, 1, 1024)
2026-04-30 19:26:04.605 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528
0.00424147]]] (1, 1, 1024)
2026-04-30 19:26:04.605 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724
-0.00170945]
[ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198
0.00132705]
[ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966
0.0080104 ]
[ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711
0.00252486]
[-0.02064589 0.05184897 0.01909059 ... 0.2070941 0.06416605
0.09115074]
[ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459
-0.00718043]]] (1, 6, 1024)
2026-04-30 19:26:04.606 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]
...
[ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03
-2.0710612e-04 2.5248611e-03]
[-2.0645889e-02 5.1848970e-02 1.9090585e-02 ... 2.0709410e-01
6.4166047e-02 9.1150738e-02]
[ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03
3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024)
2026-04-30 19:26:04.649 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=9; step_idx=0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache ко
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache ког
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache когд
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache когда
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache когда
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache когда т
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache когда те
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment х -> text_cache когда тех
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache когда техн
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache когда техно
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache когда технол
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache когда техноло
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache когда технолог
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache когда технологи
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache когда технологии
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache когда технологии
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache когда технологии с
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache когда технологии ст
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache когда технологии ста
2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache когда технологии стал
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache когда технологии стали
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache когда технологии стали
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache когда технологии стали д
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache когда технологии стали до
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache когда технологии стали дос
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache когда технологии стали дост
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache когда технологии стали доста
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache когда технологии стали достат
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache когда технологии стали достато
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ч -> text_cache когда технологии стали достаточ
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache когда технологии стали достаточн
2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['когда технологии стали '] 23
Qwen3TTSProcessor __call__ text ['когда технологии стали ']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 4793, 124846, 142651, 135906, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1]])}
2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 4793, 124846, 142651, 135906, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1]])}
2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 4793 124846 142651 135906 220]] (1, 5)
2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 4793 124846 142651 135906 220]] (1, 5)
2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment когда технологии стали 23 -> tokenized_segment [np.int64(4793), np.int64(124846), np.int64(142651), np.int64(135906), np.int64(220)] 5
2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(4793), np.int64(124846), np.int64(142651), np.int64(135906), np.int64(220)]
2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(4793), np.int64(124846), np.int64(142651), np.int64(135906), np.int64(220)] 5
2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 4793 -> pending_tokens [np.int64(124846), np.int64(142651), np.int64(135906), np.int64(220)] 4
2026-04-30 19:26:04.660 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-0 vq [1995] (1,) int64
2026-04-30 19:26:04.687 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-1 vq-rvq [[[1995 1221 283 22 107 69 1751 604 679 765 2009 1593 266 160
1376 1058]]] (1, 1, 16) int64
2026-04-30 19:26:04.687 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 124846 -> pending_tokens [np.int64(142651), np.int64(135906), np.int64(220)] 3
2026-04-30 19:26:04.695 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-1 vq [215] (1,) int64
2026-04-30 19:26:04.722 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-2 vq-rvq [[[ 215 1889 1402 238 914 219 1579 126 249 1179 400 256 965 144
911 1023]]] (1, 1, 16) int64
2026-04-30 19:26:04.722 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 142651 -> pending_tokens [np.int64(135906), np.int64(220)] 2
2026-04-30 19:26:04.730 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-2 vq [212] (1,) int64
2026-04-30 19:26:04.757 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-3 vq-rvq [[[ 212 1071 1054 282 610 1506 1148 2029 1242 1454 743 2034 1464 177
126 1049]]] (1, 1, 16) int64
2026-04-30 19:26:04.757 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 135906 -> pending_tokens [np.int64(220)] 1
2026-04-30 19:26:04.765 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-3 vq [1181] (1,) int64
2026-04-30 19:26:04.792 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-4 vq-rvq [[[1181 1704 928 354 947 785 1640 1641 705 1607 1652 796 783 818
159 1764]]] (1, 1, 16) int64
2026-04-30 19:26:04.792 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 220 -> pending_tokens [] 0
2026-04-30 19:26:04.800 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-4 vq [462] (1,) int64
2026-04-30 19:26:04.827 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-5 vq-rvq [[[ 462 582 705 864 442 449 474 1777 1154 266 1702 1753 1160 237
1837 161]]] (1, 1, 16) int64
2026-04-30 19:26:04.828 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 chunk_tokens [[[1995 215 212 1181]
[1221 1889 1071 1704]
[ 283 1402 1054 928]
[ 22 238 282 354]
[ 107 914 610 947]
[ 69 219 1506 785]
[1751 1579 1148 1640]
[ 604 126 2029 1641]
[ 679 249 1242 705]
[ 765 1179 1454 1607]
[2009 400 743 1652]
[1593 256 2034 796]
[ 266 965 1464 783]
[ 160 144 177 818]
[1376 911 126 159]
[1058 1023 1049 1764]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 wav [[[-2.06317715e-02 -1.67933665e-02 -1.47240255e-02 ... 6.64611871e-05
-4.19520393e-06 -7.44241624e-05]]] -0.03491878882050514 -5.533664079848677e-05 0.001796408905647695 0.0195828378200531 (1, 1, 7680)
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache достаточно
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache достаточно
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment б -> text_cache достаточно б
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ы -> text_cache достаточно бы
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache достаточно быс
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache достаточно быст
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache достаточно быстр
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ы -> text_cache достаточно быстры
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache достаточно быстрым
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache достаточно быстрыми
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment , -> text_cache достаточно быстрыми,
2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['достаточно быстрыми,'] 20
Qwen3TTSProcessor __call__ text ['достаточно быстрыми,']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 6949, 24276, 7972, 127310, 37660, 6597, 38003, 63780,
11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 6949, 24276, 7972, 127310, 37660, 6597, 38003, 63780,
11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 6949 24276 7972 127310 37660 6597 38003 63780 11]] (1, 9)
2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 6949 24276 7972 127310 37660 6597 38003 63780 11]] (1, 9)
2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment достаточно быстрыми, 20 -> tokenized_segment [np.int64(6949), np.int64(24276), np.int64(7972), np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 9
2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(6949), np.int64(24276), np.int64(7972), np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)]
2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(6949), np.int64(24276), np.int64(7972), np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 9
2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6949 -> pending_tokens [np.int64(24276), np.int64(7972), np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 8
2026-04-30 19:26:04.861 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-5 vq [1225] (1,) int64
2026-04-30 19:26:04.888 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-6 vq-rvq [[[1225 1825 534 2042 1456 412 1489 1182 1379 758 196 1170 520 1545
1692 319]]] (1, 1, 16) int64
2026-04-30 19:26:04.888 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 24276 -> pending_tokens [np.int64(7972), np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 7
2026-04-30 19:26:04.896 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-6 vq [628] (1,) int64
2026-04-30 19:26:04.924 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-7 vq-rvq [[[ 628 817 1643 77 2036 1890 1753 62 968 221 1153 454 811 80
2041 295]]] (1, 1, 16) int64
2026-04-30 19:26:04.924 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 7972 -> pending_tokens [np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 6
2026-04-30 19:26:04.932 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-7 vq [499] (1,) int64
2026-04-30 19:26:04.959 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-8 vq-rvq [[[ 499 1809 1734 36 380 736 1416 730 2004 797 609 195 883 252
106 1160]]] (1, 1, 16) int64
2026-04-30 19:26:04.959 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 127310 -> pending_tokens [np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 5
2026-04-30 19:26:04.967 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-8 vq [1953] (1,) int64
2026-04-30 19:26:04.993 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-9 vq-rvq [[[1953 1826 459 1987 661 333 410 1010 1836 768 299 1155 765 35
858 113]]] (1, 1, 16) int64
2026-04-30 19:26:04.994 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 37660 -> pending_tokens [np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 4
2026-04-30 19:26:05.002 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-9 vq [777] (1,) int64
2026-04-30 19:26:05.028 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-10 vq-rvq [[[ 777 1400 373 1850 841 1731 1929 122 647 189 121 321 1593 1692
439 134]]] (1, 1, 16) int64
2026-04-30 19:26:05.028 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6597 -> pending_tokens [np.int64(38003), np.int64(63780), np.int64(11)] 3
2026-04-30 19:26:05.036 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-10 vq [297] (1,) int64
2026-04-30 19:26:05.063 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-11 vq-rvq [[[ 297 1510 741 1241 1769 938 101 648 519 1125 2014 736 1689 780
122 381]]] (1, 1, 16) int64
2026-04-30 19:26:05.063 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 38003 -> pending_tokens [np.int64(63780), np.int64(11)] 2
2026-04-30 19:26:05.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-11 vq [1145] (1,) int64
2026-04-30 19:26:05.098 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-12 vq-rvq [[[1145 1696 1750 758 222 1793 458 367 202 100 473 1014 120 962
637 1657]]] (1, 1, 16) int64
2026-04-30 19:26:05.098 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 63780 -> pending_tokens [np.int64(11)] 1
2026-04-30 19:26:05.106 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-12 vq [39] (1,) int64
2026-04-30 19:26:05.133 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-13 vq-rvq [[[ 39 1021 837 277 1464 1807 294 1316 1706 447 1077 1055 1346 205
665 632]]] (1, 1, 16) int64
2026-04-30 19:26:05.133 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11 -> pending_tokens [] 0
2026-04-30 19:26:05.141 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-13 vq [1845] (1,) int64
2026-04-30 19:26:05.168 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-14 vq-rvq [[[1845 1165 394 146 159 1813 1216 1399 1678 149 1560 68 815 1
1622 1235]]] (1, 1, 16) int64
2026-04-30 19:26:05.169 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 chunk_tokens [[[ 462 1225 628 499]
[ 582 1825 817 1809]
[ 705 534 1643 1734]
[ 864 2042 77 36]
[ 442 1456 2036 380]
[ 449 412 1890 736]
[ 474 1489 1753 1416]
[1777 1182 62 730]
[1154 1379 968 2004]
[ 266 758 221 797]
[1702 196 1153 609]
[1753 1170 454 195]
[1160 520 811 883]
[ 237 1545 80 252]
[1837 1692 2041 106]
[ 161 319 295 1160]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:05.193 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 wav [[[-8.0167578e-05 -4.1713702e-05 3.4347220e-05 ... 1.4899543e-02
1.9630753e-02 2.1652387e-02]]] -0.24945759773254395 1.0724160347308498e-05 0.03428755700588226 0.3815094232559204 (1, 1, 7680)
2026-04-30 19:26:05.193 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 chunk_tokens [[[1953 777 297 1145]
[1826 1400 1510 1696]
[ 459 373 741 1750]
[1987 1850 1241 758]
[ 661 841 1769 222]
[ 333 1731 938 1793]
[ 410 1929 101 458]
[1010 122 648 367]
[1836 647 519 202]
[ 768 189 1125 100]
[ 299 121 2014 473]
[1155 321 736 1014]
[ 765 1593 1689 120]
[ 35 1692 780 962]
[ 858 439 122 637]
[ 113 134 381 1657]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 wav [[[0.02029367 0.01627654 0.01006193 ... 0.06808572 0.06454458 0.05861032]]] -0.38842353224754333 5.7938919781008735e-05 0.05044485256075859 0.2728379964828491 (1, 1, 7680)
2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0
2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1
2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1
2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0
2026-04-30 19:26:05.225 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-14 vq [477] (1,) int64
2026-04-30 19:26:05.252 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-15 vq-rvq [[[ 477 1201 7 10 993 403 1457 169 1973 1347 354 546 759 166
659 1732]]] (1, 1, 16) int64
2026-04-30 19:26:05.260 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-15 vq [133] (1,) int64
2026-04-30 19:26:05.287 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-16 vq-rvq [[[ 133 1501 1379 1860 690 1385 767 1818 1092 581 251 217 577 1691
1062 438]]] (1, 1, 16) int64
2026-04-30 19:26:05.295 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-16 vq [1634] (1,) int64
2026-04-30 19:26:05.322 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-17 vq-rvq [[[1634 845 902 1438 63 763 750 709 1991 208 1886 720 1736 1325
259 1079]]] (1, 1, 16) int64
2026-04-30 19:26:05.330 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-17 vq [177] (1,) int64
2026-04-30 19:26:05.358 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-18 vq-rvq [[[ 177 273 0 770 299 1944 1776 136 1351 1317 719 798 156 1221
77 747]]] (1, 1, 16) int64
2026-04-30 19:26:05.366 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-18 vq [1196] (1,) int64
2026-04-30 19:26:05.393 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-19 vq-rvq [[[1196 1013 1029 663 1488 614 446 763 477 769 269 16 181 971
1660 236]]] (1, 1, 16) int64
2026-04-30 19:26:05.401 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-19 vq [506] (1,) int64
2026-04-30 19:26:05.428 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-20 vq-rvq [[[ 506 1971 413 276 1512 1269 736 1679 1576 1804 1700 194 309 4
451 1096]]] (1, 1, 16) int64
2026-04-30 19:26:05.436 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-20 vq [532] (1,) int64
2026-04-30 19:26:05.463 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-21 vq-rvq [[[ 532 1151 66 776 682 260 10 609 1044 947 739 2032 1070 1022
2031 1559]]] (1, 1, 16) int64
2026-04-30 19:26:05.471 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-21 vq [269] (1,) int64
2026-04-30 19:26:05.498 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-22 vq-rvq [[[ 269 1892 1689 1288 1548 1981 94 640 281 830 12 739 548 979
191 564]]] (1, 1, 16) int64
2026-04-30 19:26:05.506 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-22 vq [1745] (1,) int64
2026-04-30 19:26:05.533 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-23 vq-rvq [[[1745 1592 1688 155 1960 1876 1627 1058 894 568 922 1441 1101 1244
281 940]]] (1, 1, 16) int64
2026-04-30 19:26:05.541 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-23 vq [575] (1,) int64
2026-04-30 19:26:05.568 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-24 vq-rvq [[[ 575 1371 1999 1593 1727 2011 1680 1650 1692 652 522 312 902 1124
1453 510]]] (1, 1, 16) int64
2026-04-30 19:26:05.577 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-24 vq [36] (1,) int64
2026-04-30 19:26:05.604 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-25 vq-rvq [[[ 36 621 342 1557 1270 126 1376 1347 1012 702 156 1458 810 500
645 540]]] (1, 1, 16) int64
2026-04-30 19:26:05.612 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-25 vq [875] (1,) int64
2026-04-30 19:26:05.639 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-26 vq-rvq [[[ 875 1588 385 692 732 573 254 400 792 1769 686 596 1820 389
1910 179]]] (1, 1, 16) int64
2026-04-30 19:26:05.647 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-26 vq [515] (1,) int64
2026-04-30 19:26:05.674 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-27 vq-rvq [[[ 515 600 1231 489 627 1546 483 770 37 170 337 812 852 693
1402 81]]] (1, 1, 16) int64
2026-04-30 19:26:05.682 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-27 vq [1947] (1,) int64
2026-04-30 19:26:05.710 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-28 vq-rvq [[[1947 32 1287 417 1117 1794 392 1055 984 1911 153 1031 438 1869
217 626]]] (1, 1, 16) int64
2026-04-30 19:26:05.718 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-28 vq [2004] (1,) int64
2026-04-30 19:26:05.744 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-29 vq-rvq [[[2004 127 273 145 623 35 1583 1891 36 1998 531 1295 1175 1769
1449 202]]] (1, 1, 16) int64
2026-04-30 19:26:05.752 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-29 vq [156] (1,) int64
2026-04-30 19:26:05.779 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-30 vq-rvq [[[ 156 1759 187 1642 1607 669 676 1769 856 375 1883 44 1062 674
396 1680]]] (1, 1, 16) int64
2026-04-30 19:26:05.787 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-30 vq [1743] (1,) int64
2026-04-30 19:26:05.814 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-31 vq-rvq [[[1743 944 1095 2000 1054 1879 95 255 1024 988 167 964 314 936
379 207]]] (1, 1, 16) int64
2026-04-30 19:26:05.822 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-31 vq [496] (1,) int64
2026-04-30 19:26:05.849 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-32 vq-rvq [[[ 496 1354 1942 1697 1263 229 544 498 1632 1007 373 81 1046 587
1348 151]]] (1, 1, 16) int64
2026-04-30 19:26:05.857 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-32 vq [679] (1,) int64
2026-04-30 19:26:05.884 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-33 vq-rvq [[[ 679 1183 710 884 1983 1610 996 354 1542 1796 1666 924 934 496
1152 1176]]] (1, 1, 16) int64
2026-04-30 19:26:05.892 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-33 vq [1514] (1,) int64
2026-04-30 19:26:05.918 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-34 vq-rvq [[[1514 1233 2007 621 779 189 150 1096 722 668 1616 178 507 869
7 12]]] (1, 1, 16) int64
2026-04-30 19:26:05.926 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-34 vq [982] (1,) int64
2026-04-30 19:26:05.953 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-35 vq-rvq [[[ 982 1595 1770 370 1019 1659 256 1916 11 733 549 1659 1268 1757
701 59]]] (1, 1, 16) int64
2026-04-30 19:26:05.961 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-35 vq [1063] (1,) int64
2026-04-30 19:26:05.988 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-36 vq-rvq [[[1063 1772 246 1417 1681 1494 832 342 1503 530 424 1676 1340 1327
1571 687]]] (1, 1, 16) int64
2026-04-30 19:26:05.996 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-36 vq [121] (1,) int64
2026-04-30 19:26:06.023 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-37 vq-rvq [[[ 121 1042 1879 1782 1702 1511 364 1823 1269 1237 799 1076 809 1339
420 1115]]] (1, 1, 16) int64
2026-04-30 19:26:06.031 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-37 vq [2150] (1,) int64
2026-04-30 19:26:06.031 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 chunk_tokens [[[ 39 1845 477 133]
[1021 1165 1201 1501]
[ 837 394 7 1379]
[ 277 146 10 1860]
[1464 159 993 690]
[1807 1813 403 1385]
[ 294 1216 1457 767]
[1316 1399 169 1818]
[1706 1678 1973 1092]
[ 447 149 1347 581]
[1077 1560 354 251]
[1055 68 546 217]
[1346 815 759 577]
[ 205 1 166 1691]
[ 665 1622 659 1062]
[ 632 1235 1732 438]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:06.055 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 wav [[[ 0.05094757 0.04577596 0.04464076 ... -0.03615839 -0.03458475
0.00780901]]] -0.38215261697769165 4.1282673919340596e-05 0.08734284341335297 0.27787166833877563 (1, 1, 7680)
2026-04-30 19:26:06.055 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 chunk_tokens [[[1634 177 1196 506]
[ 845 273 1013 1971]
[ 902 0 1029 413]
[1438 770 663 276]
[ 63 299 1488 1512]
[ 763 1944 614 1269]
[ 750 1776 446 736]
[ 709 136 763 1679]
[1991 1351 477 1576]
[ 208 1317 769 1804]
[1886 719 269 1700]
[ 720 798 16 194]
[1736 156 181 309]
[1325 1221 971 4]
[ 259 77 1660 451]
[1079 747 236 1096]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:06.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 wav [[[0.05842641 0.09555472 0.10986558 ... 0.0013969 0.01872239 0.04114778]]] -0.3857892155647278 9.528391092317179e-05 0.06948209553956985 0.33023425936698914 (1, 1, 7680)
2026-04-30 19:26:06.080 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 chunk_tokens [[[ 532 269 1745 575]
[1151 1892 1592 1371]
[ 66 1689 1688 1999]
[ 776 1288 155 1593]
[ 682 1548 1960 1727]
[ 260 1981 1876 2011]
[ 10 94 1627 1680]
[ 609 640 1058 1650]
[1044 281 894 1692]
[ 947 830 568 652]
[ 739 12 922 522]
[2032 739 1441 312]
[1070 548 1101 902]
[1022 979 1244 1124]
[2031 191 281 1453]
[1559 564 940 510]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:06.104 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 wav [[[ 0.05213842 0.05569138 0.06345794 ... -0.00115294 -0.00027638
-0.00037019]]] -0.3263360857963562 -0.0001289134524995461 0.06016819179058075 0.2761137783527374 (1, 1, 7680)
2026-04-30 19:26:06.104 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 chunk_tokens [[[ 36 875 515 1947]
[ 621 1588 600 32]
[ 342 385 1231 1287]
[1557 692 489 417]
[1270 732 627 1117]
[ 126 573 1546 1794]
[1376 254 483 392]
[1347 400 770 1055]
[1012 792 37 984]
[ 702 1769 170 1911]
[ 156 686 337 153]
[1458 596 812 1031]
[ 810 1820 852 438]
[ 500 389 693 1869]
[ 645 1910 1402 217]
[ 540 179 81 626]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:06.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 wav [[[-1.2735376e-03 -7.3580118e-04 3.0488527e-05 ... 8.4239952e-03
3.2757007e-02 1.1410726e-02]]] -0.3552726209163666 1.0374716111982707e-05 0.06672560423612595 0.2960858643054962 (1, 1, 7680)
2026-04-30 19:26:06.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 chunk_tokens [[[2004 156 1743 496]
[ 127 1759 944 1354]
[ 273 187 1095 1942]
[ 145 1642 2000 1697]
[ 623 1607 1054 1263]
[ 35 669 1879 229]
[1583 676 95 544]
[1891 1769 255 498]
[ 36 856 1024 1632]
[1998 375 988 1007]
[ 531 1883 167 373]
[1295 44 964 81]
[1175 1062 314 1046]
[1769 674 936 587]
[1449 396 379 1348]
[ 202 1680 207 151]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:06.152 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 wav [[[-0.03925117 -0.01366347 0.03734893 ... -0.04557104 -0.04238814
-0.02026677]]] -0.3543156683444977 0.00015050903311930597 0.0831756666302681 0.2808587849140167 (1, 1, 7680)
2026-04-30 19:26:06.153 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 chunk_tokens [[[ 679 1514 982 1063]
[1183 1233 1595 1772]
[ 710 2007 1770 246]
[ 884 621 370 1417]
[1983 779 1019 1681]
[1610 189 1659 1494]
[ 996 150 256 832]
[ 354 1096 1916 342]
[1542 722 11 1503]
[1796 668 733 530]
[1666 1616 549 424]
[ 924 178 1659 1676]
[ 934 507 1268 1340]
[ 496 869 1757 1327]
[1152 7 701 1571]
[1176 12 59 687]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:06.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 wav [[[ 0.02351574 0.06001395 0.05978361 ... 0.00261743 -0.03956862
-0.06221673]]] -0.3753751516342163 -0.00010315112012904137 0.05548836290836334 0.26587414741516113 (1, 1, 7680)
2026-04-30 19:26:06.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 chunk_tokens [[[ 121]
[1042]
[1879]
[1782]
[1702]
[1511]
[ 364]
[1823]
[1269]
[1237]
[ 799]
[1076]
[ 809]
[1339]
[ 420]
[1115]]] (1, 16, 1) n_chunk_frames 1
2026-04-30 19:26:06.206 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 wav [[[-6.3454241e-02 -3.5933349e-02 1.2640217e-03 ... 1.9708219e-05
1.7832308e-05 1.5235857e-05]]] -0.10036860406398773 -5.3411822591442615e-05 0.011042192578315735 0.08905704319477081 (1, 1, 1920)
2026-04-30 19:26:06.206 [INFO] __main__: Synthesising: 'чтобы люди могли просто общаться.'
2026-04-30 19:26:06.206 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ч -> text_cache ч
2026-04-30 19:26:06.206 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False
2026-04-30 19:26:06.211 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list [array([[[-0.00221966, -0.00138947, -0.000929 , ..., -0.1126425 ,
-0.1338531 , -0.13333385]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10775348, -0.05212127, 0.0396859 , ..., -0.04563401,
-0.03402565, -0.03579839]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03745677, -0.02658239, -0.02583151, ..., -0.0121026 ,
-0.00580872, -0.01895227]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0263972 , -0.01400574, -0.01092716, ..., -0.00139586,
0.00422512, 0.00643334]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00588865, 0.00345067, -0.00066399, ..., 0.00632556,
0.00391393, 0.00175216]]], shape=(1, 1, 5760), dtype=float32), array([[[ 0.0010756 , 0.00117576, 0.00123106, ..., -0.04100708,
-0.0458885 , -0.04321691]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.05036464, -0.03583061, -0.00757636, ..., 0.05205004,
0.01185071, -0.03961121]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.08307496, -0.11176797, -0.1242267 , ..., -0.00193561,
0.005123 , 0.0037974 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00899126, -0.00369494, 0.00981118, ..., -0.00399455,
-0.00319744, -0.00289368]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00285673, -0.0034839 , -0.00415278, ..., 0.00778646,
0.00595145, -0.0043805 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01552802, -0.01487012, -0.01219678, ..., -0.00294759,
0.00343194, 0.0008437 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00404704, 0.00067246, 0.00399263, ..., 0.09798931,
0.20872854, 0.2311011 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.14216125, 0.06682034, 0.02212509, ..., 0.06106113,
0.00223079, -0.05518628]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10738115, -0.11622868, -0.06752186, ..., 0.03509749,
0.03198082, 0.02877127]]], shape=(1, 1, 7680), dtype=float32), array([[[2.69281808e-02, 2.77648699e-02, 3.07107549e-02, ...,
1.15126495e-05, 1.21511912e-05, 1.15567072e-05]]],
shape=(1, 1, 5760), dtype=float32), array([[[-2.0247478e-02, -1.6132748e-02, -1.4229195e-02, ...,
1.1977663e-05, 1.1495073e-05, 1.2644601e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 1.2498698e-05, 1.2433531e-05, 1.1404698e-05, ...,
-5.8077216e-02, -5.1980902e-02, -5.0722528e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.05217085, -0.05058753, -0.03975262, ..., 0.21015896,
0.11327256, 0.02125037]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03852101, -0.06222959, -0.06324419, ..., 0.00308757,
0.01666446, 0.02635817]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02811593, 0.01903336, 0.00181638, ..., -0.00637799,
-0.00625728, -0.01839462]]], shape=(1, 1, 7680), dtype=float32), array([[[-3.6303084e-02, -4.4228390e-02, -4.6101980e-02, ...,
4.6050473e-04, -4.0465111e-05, -2.4329145e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[7.2466741e-05, 2.7459790e-04, 3.0666371e-04, ...,
8.0509745e-03, 1.3393108e-02, 9.4361240e-03]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 0.00426391, 0.00582221, 0.00909369, ..., -0.02768227,
-0.02276854, -0.01686861]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01355644, -0.01526949, -0.01623942, ..., 0.0395449 ,
0.05279908, 0.00224491]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01579052, 0.00150335, -0.02962946, ..., -0.00423873,
-0.00033509, 0.00640968]]], shape=(1, 1, 7680), dtype=float32), array([[[1.9390190e-02, 3.0609204e-02, 3.0704437e-02, ...,
1.1317945e-05, 1.0956299e-05, 1.1030028e-05]]],
shape=(1, 1, 3840), dtype=float32), array([[[ 1.1094540e-05, 1.1138460e-05, 1.1009237e-05, ...,
-2.2123540e-02, -2.2558490e-02, -1.9299621e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[0.00221431, 0.03934583, 0.0700637 , ..., 0.01913414,
0.04059763, 0.06542776]]], shape=(1, 1, 7680), dtype=float32), array([[[0.08465035, 0.0946539 , 0.09328509, ..., 0.0472551 ,
0.05668663, 0.05911173]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04501721, 0.0241992 , 0.01363233, ..., -0.04057647,
-0.05749581, -0.0651198 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.06861783, -0.06905188, -0.06281615, ..., -0.00338598,
0.00180774, 0.00092616]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00584421, -0.00096309, 0.00632945, ..., 0.00375346,
0.00384357, 0.00217619]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00579548, -0.01757104, -0.0243005 , ..., 0.00547749,
0.00660871, 0.009783 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01747901, 0.02681293, 0.03847475, ..., -0.02004432,
-0.02144283, -0.0218131 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.9715637e-02, -1.6528632e-02, -1.3177541e-02, ...,
1.1422026e-05, 1.1317023e-05, 1.1494269e-05]]],
shape=(1, 1, 1920), dtype=float32), array([[[-2.06317715e-02, -1.67933665e-02, -1.47240255e-02, ...,
6.64611871e-05, -4.19520393e-06, -7.44241624e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[-8.0167578e-05, -4.1713702e-05, 3.4347220e-05, ...,
1.4899543e-02, 1.9630753e-02, 2.1652387e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[0.02029367, 0.01627654, 0.01006193, ..., 0.06808572,
0.06454458, 0.05861032]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05094757, 0.04577596, 0.04464076, ..., -0.03615839,
-0.03458475, 0.00780901]]], shape=(1, 1, 7680), dtype=float32), array([[[0.05842641, 0.09555472, 0.10986558, ..., 0.0013969 ,
0.01872239, 0.04114778]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05213842, 0.05569138, 0.06345794, ..., -0.00115294,
-0.00027638, -0.00037019]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2735376e-03, -7.3580118e-04, 3.0488527e-05, ...,
8.4239952e-03, 3.2757007e-02, 1.1410726e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03925117, -0.01366347, 0.03734893, ..., -0.04557104,
-0.04238814, -0.02026677]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02351574, 0.06001395, 0.05978361, ..., 0.00261743,
-0.03956862, -0.06221673]]], shape=(1, 1, 7680), dtype=float32), array([[[-6.3454241e-02, -3.5933349e-02, 1.2640217e-03, ...,
1.9708219e-05, 1.7832308e-05, 1.5235857e-05]]],
shape=(1, 1, 1920), dtype=float32)] 45
2026-04-30 19:26:06.211 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history [-2.2196597e-03 -1.3894709e-03 -9.2900067e-04 ... 1.9708219e-05
1.7832308e-05 1.5235857e-05] (326400,) float32
2026-04-30 19:26:06.211 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history_after cut_idx 18 [-3.8521007e-02 -6.2229592e-02 -6.3244194e-02 ... 1.9708219e-05
1.7832308e-05 1.5235857e-05] (192000,) float32
2026-04-30 19:26:06.214 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list_after cut_idx 18 [array([[[-0.03852101, -0.06222959, -0.06324419, ..., 0.00308757,
0.01666446, 0.02635817]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02811593, 0.01903336, 0.00181638, ..., -0.00637799,
-0.00625728, -0.01839462]]], shape=(1, 1, 7680), dtype=float32), array([[[-3.6303084e-02, -4.4228390e-02, -4.6101980e-02, ...,
4.6050473e-04, -4.0465111e-05, -2.4329145e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[7.2466741e-05, 2.7459790e-04, 3.0666371e-04, ...,
8.0509745e-03, 1.3393108e-02, 9.4361240e-03]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 0.00426391, 0.00582221, 0.00909369, ..., -0.02768227,
-0.02276854, -0.01686861]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01355644, -0.01526949, -0.01623942, ..., 0.0395449 ,
0.05279908, 0.00224491]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01579052, 0.00150335, -0.02962946, ..., -0.00423873,
-0.00033509, 0.00640968]]], shape=(1, 1, 7680), dtype=float32), array([[[1.9390190e-02, 3.0609204e-02, 3.0704437e-02, ...,
1.1317945e-05, 1.0956299e-05, 1.1030028e-05]]],
shape=(1, 1, 3840), dtype=float32), array([[[ 1.1094540e-05, 1.1138460e-05, 1.1009237e-05, ...,
-2.2123540e-02, -2.2558490e-02, -1.9299621e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[0.00221431, 0.03934583, 0.0700637 , ..., 0.01913414,
0.04059763, 0.06542776]]], shape=(1, 1, 7680), dtype=float32), array([[[0.08465035, 0.0946539 , 0.09328509, ..., 0.0472551 ,
0.05668663, 0.05911173]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04501721, 0.0241992 , 0.01363233, ..., -0.04057647,
-0.05749581, -0.0651198 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.06861783, -0.06905188, -0.06281615, ..., -0.00338598,
0.00180774, 0.00092616]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00584421, -0.00096309, 0.00632945, ..., 0.00375346,
0.00384357, 0.00217619]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00579548, -0.01757104, -0.0243005 , ..., 0.00547749,
0.00660871, 0.009783 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01747901, 0.02681293, 0.03847475, ..., -0.02004432,
-0.02144283, -0.0218131 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.9715637e-02, -1.6528632e-02, -1.3177541e-02, ...,
1.1422026e-05, 1.1317023e-05, 1.1494269e-05]]],
shape=(1, 1, 1920), dtype=float32), array([[[-2.06317715e-02, -1.67933665e-02, -1.47240255e-02, ...,
6.64611871e-05, -4.19520393e-06, -7.44241624e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[-8.0167578e-05, -4.1713702e-05, 3.4347220e-05, ...,
1.4899543e-02, 1.9630753e-02, 2.1652387e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[0.02029367, 0.01627654, 0.01006193, ..., 0.06808572,
0.06454458, 0.05861032]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05094757, 0.04577596, 0.04464076, ..., -0.03615839,
-0.03458475, 0.00780901]]], shape=(1, 1, 7680), dtype=float32), array([[[0.05842641, 0.09555472, 0.10986558, ..., 0.0013969 ,
0.01872239, 0.04114778]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05213842, 0.05569138, 0.06345794, ..., -0.00115294,
-0.00027638, -0.00037019]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2735376e-03, -7.3580118e-04, 3.0488527e-05, ...,
8.4239952e-03, 3.2757007e-02, 1.1410726e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03925117, -0.01366347, 0.03734893, ..., -0.04557104,
-0.04238814, -0.02026677]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02351574, 0.06001395, 0.05978361, ..., 0.00261743,
-0.03956862, -0.06221673]]], shape=(1, 1, 7680), dtype=float32), array([[[-6.3454241e-02, -3.5933349e-02, 1.2640217e-03, ...,
1.9708219e-05, 1.7832308e-05, 1.5235857e-05]]],
shape=(1, 1, 1920), dtype=float32)] 27
2026-04-30 19:26:06.215 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069
2026-04-30 19:26:06.287 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[ 0.00079289 0.06733401 -0.0398349 ... 0.18074517 0.0866328
0.04901728]]] (1, 1, 1024)
2026-04-30 19:26:06.288 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]]
2026-04-30 19:26:06.288 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]]] (1, 4, 1024)
2026-04-30 19:26:06.288 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 1, 1024)
2026-04-30 19:26:06.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]
[ 0.00079289 0.06733401 -0.0398349 ... 0.18074517 0.0866328
0.04901728]
[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 6, 1024)
2026-04-30 19:26:06.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22
Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:06.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:06.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3)
2026-04-30 19:26:06.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3)
2026-04-30 19:26:06.290 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024)
2026-04-30 19:26:06.290 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036
-0.00767252]]] (1, 1, 1024)
2026-04-30 19:26:06.290 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528
0.00424147]]] (1, 1, 1024)
2026-04-30 19:26:06.291 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724
-0.00170945]
[ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198
0.00132705]
[ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966
0.0080104 ]
[ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711
0.00252486]
[ 0.00557107 0.06352802 -0.04153106 ... 0.17146082 0.08818809
0.05325875]
[ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459
-0.00718043]]] (1, 6, 1024)
2026-04-30 19:26:06.291 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]
...
[ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03
-2.0710612e-04 2.5248611e-03]
[ 5.5710729e-03 6.3528024e-02 -4.1531056e-02 ... 1.7146082e-01
8.8188089e-02 5.3258754e-02]
[ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03
3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024)
2026-04-30 19:26:06.335 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=56; step_idx=56
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill cont done; talker_seq_len=56; step_idx=56
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache чт
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache что
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment б -> text_cache чтоб
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ы -> text_cache чтобы
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache чтобы
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache чтобы л
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ю -> text_cache чтобы лю
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache чтобы люд
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache чтобы люди
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache чтобы люди
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache чтобы люди м
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache чтобы люди мо
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache чтобы люди мог
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache чтобы люди могл
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache чтобы люди могли
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache чтобы люди могли
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment п -> text_cache чтобы люди могли п
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache чтобы люди могли пр
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache чтобы люди могли про
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache чтобы люди могли прос
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache чтобы люди могли прост
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache чтобы люди могли просто
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache чтобы люди могли просто
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache чтобы люди могли просто о
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment б -> text_cache чтобы люди могли просто об
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment щ -> text_cache чтобы люди могли просто общ
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache чтобы люди могли просто обща
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache чтобы люди могли просто общат
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ь -> text_cache чтобы люди могли просто общать
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache чтобы люди могли просто общатьс
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache чтобы люди могли просто общаться
2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['чтобы люди могли просто '] 24
Qwen3TTSProcessor __call__ text ['чтобы люди могли просто ']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 6020, 1792, 50873, 132782, 125649, 11073, 129021, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 6020, 1792, 50873, 132782, 125649, 11073, 129021, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 6020 1792 50873 132782 125649 11073 129021 220]] (1, 8)
2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 6020 1792 50873 132782 125649 11073 129021 220]] (1, 8)
2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment чтобы люди могли просто 24 -> tokenized_segment [np.int64(6020), np.int64(1792), np.int64(50873), np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 8
2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(6020), np.int64(1792), np.int64(50873), np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)]
2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(6020), np.int64(1792), np.int64(50873), np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 8
2026-04-30 19:26:06.377 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6020 -> pending_tokens [np.int64(1792), np.int64(50873), np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 7
2026-04-30 19:26:06.385 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-56 vq [1221] (1,) int64
2026-04-30 19:26:06.412 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-57 vq-rvq [[[1221 1026 69 1258 1894 1085 687 1569 711 836 1831 1044 1256 222
846 782]]] (1, 1, 16) int64
2026-04-30 19:26:06.412 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 1792 -> pending_tokens [np.int64(50873), np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 6
2026-04-30 19:26:06.420 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-57 vq [2042] (1,) int64
2026-04-30 19:26:06.447 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-58 vq-rvq [[[2042 1095 608 1765 103 616 1203 1595 276 462 896 704 76 264
300 593]]] (1, 1, 16) int64
2026-04-30 19:26:06.447 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 50873 -> pending_tokens [np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 5
2026-04-30 19:26:06.455 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-58 vq [14] (1,) int64
2026-04-30 19:26:06.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-59 vq-rvq [[[ 14 1168 1214 249 280 1328 1028 465 108 1404 690 285 1785 628
1299 153]]] (1, 1, 16) int64
2026-04-30 19:26:06.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 132782 -> pending_tokens [np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 4
2026-04-30 19:26:06.490 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-59 vq [1228] (1,) int64
2026-04-30 19:26:06.517 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-60 vq-rvq [[[1228 317 331 926 846 342 1080 1884 272 132 915 1254 720 1902
614 1777]]] (1, 1, 16) int64
2026-04-30 19:26:06.517 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 125649 -> pending_tokens [np.int64(11073), np.int64(129021), np.int64(220)] 3
2026-04-30 19:26:06.525 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-60 vq [159] (1,) int64
2026-04-30 19:26:06.552 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-61 vq-rvq [[[ 159 758 350 158 1102 142 59 1648 1663 1682 157 580 1798 685
715 664]]] (1, 1, 16) int64
2026-04-30 19:26:06.552 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11073 -> pending_tokens [np.int64(129021), np.int64(220)] 2
2026-04-30 19:26:06.560 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-61 vq [1091] (1,) int64
2026-04-30 19:26:06.587 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-62 vq-rvq [[[1091 55 1747 1494 944 294 1380 534 951 735 1266 13 1085 517
397 985]]] (1, 1, 16) int64
2026-04-30 19:26:06.587 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 129021 -> pending_tokens [np.int64(220)] 1
2026-04-30 19:26:06.595 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-62 vq [1976] (1,) int64
2026-04-30 19:26:06.622 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-63 vq-rvq [[[1976 1243 1615 919 50 1403 619 1348 62 499 1452 1098 1894 1579
364 1723]]] (1, 1, 16) int64
2026-04-30 19:26:06.622 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 220 -> pending_tokens [] 0
2026-04-30 19:26:06.630 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-63 vq [1248] (1,) int64
2026-04-30 19:26:06.657 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-64 vq-rvq [[[1248 615 563 1474 470 612 1730 931 277 1572 1691 790 1436 1886
1240 1220]]] (1, 1, 16) int64
2026-04-30 19:26:06.657 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-37 chunk_tokens [[[1221 2042 14 1228]
[1026 1095 1168 317]
[ 69 608 1214 331]
[1258 1765 249 926]
[1894 103 280 846]
[1085 616 1328 342]
[ 687 1203 1028 1080]
[1569 1595 465 1884]
[ 711 276 108 272]
[ 836 462 1404 132]
[1831 896 690 915]
[1044 704 285 1254]
[1256 76 1785 720]
[ 222 264 628 1902]
[ 846 300 1299 614]
[ 782 593 153 1777]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:06.681 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-37 wav [[[6.4516030e-06 3.8836665e-06 3.5758250e-05 ... 2.0419013e-02
5.6000661e-02 7.9175197e-02]]] -0.39740338921546936 0.00012032289669150487 0.057172417640686035 0.32271844148635864 (1, 1, 7680)
2026-04-30 19:26:06.682 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-41 chunk_tokens [[[ 159 1091 1976 1248]
[ 758 55 1243 615]
[ 350 1747 1615 563]
[ 158 1494 919 1474]
[1102 944 50 470]
[ 142 294 1403 612]
[ 59 1380 619 1730]
[1648 534 1348 931]
[1663 951 62 277]
[1682 735 499 1572]
[ 157 1266 1452 1691]
[ 580 13 1098 790]
[1798 1085 1894 1436]
[ 685 517 1579 1886]
[ 715 397 364 1240]
[ 664 985 1723 1220]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-41 wav [[[0.07597505 0.05851083 0.06002833 ... 0.07287683 0.04599379 0.01605063]]] -0.2856764495372772 9.037656855070964e-05 0.06580641865730286 0.25454413890838623 (1, 1, 7680)
2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment . -> text_cache общаться.
2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['общаться.'] 9
Qwen3TTSProcessor __call__ text ['общаться.']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[54157, 97681, 13]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[54157, 97681, 13]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[54157 97681 13]] (1, 3)
2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[54157 97681 13]] (1, 3)
2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment общаться. 9 -> tokenized_segment [np.int64(54157), np.int64(97681), np.int64(13)] 3
2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(54157), np.int64(97681), np.int64(13)]
2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(54157), np.int64(97681), np.int64(13)] 3
2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 54157 -> pending_tokens [np.int64(97681), np.int64(13)] 2
2026-04-30 19:26:06.715 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-64 vq [51] (1,) int64
2026-04-30 19:26:06.742 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-65 vq-rvq [[[ 51 836 265 1485 1394 1865 571 1917 1099 496 561 227 602 221
10 188]]] (1, 1, 16) int64
2026-04-30 19:26:06.742 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 97681 -> pending_tokens [np.int64(13)] 1
2026-04-30 19:26:06.750 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-65 vq [434] (1,) int64
2026-04-30 19:26:06.777 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-66 vq-rvq [[[ 434 1217 503 2003 1926 2016 630 1801 1382 404 1596 480 848 1558
654 270]]] (1, 1, 16) int64
2026-04-30 19:26:06.777 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13 -> pending_tokens [] 0
2026-04-30 19:26:06.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-66 vq [1644] (1,) int64
2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-67 vq-rvq [[[1644 1808 735 1710 1282 288 1087 806 998 59 177 19 51 1767
460 1207]]] (1, 1, 16) int64
2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0
2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1
2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1
2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0
2026-04-30 19:26:06.820 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-67 vq [383] (1,) int64
2026-04-30 19:26:06.847 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-68 vq-rvq [[[ 383 1746 1031 1633 797 85 166 274 1976 1525 789 338 223 361
1277 536]]] (1, 1, 16) int64
2026-04-30 19:26:06.847 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-45 chunk_tokens [[[ 51 434 1644 383]
[ 836 1217 1808 1746]
[ 265 503 735 1031]
[1485 2003 1710 1633]
[1394 1926 1282 797]
[1865 2016 288 85]
[ 571 630 1087 166]
[1917 1801 806 274]
[1099 1382 998 1976]
[ 496 404 59 1525]
[ 561 1596 177 789]
[ 227 480 19 338]
[ 602 848 51 223]
[ 221 1558 1767 361]
[ 10 654 460 1277]
[ 188 270 1207 536]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:06.871 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-45 wav [[[0.00099137 0.00403599 0.01846475 ... 0.02468315 0.01271362 0.00035484]]] -0.3146056532859802 -0.0002403859980404377 0.07929908484220505 0.37690261006355286 (1, 1, 7680)
2026-04-30 19:26:06.879 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-68 vq [825] (1,) int64
2026-04-30 19:26:06.906 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-69 vq-rvq [[[ 825 371 1395 1038 953 1384 906 810 330 550 1607 1673 802 1334
1169 552]]] (1, 1, 16) int64
2026-04-30 19:26:06.914 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-69 vq [851] (1,) int64
2026-04-30 19:26:06.941 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-70 vq-rvq [[[ 851 1209 1426 671 1434 344 974 1051 205 111 615 416 876 488
129 25]]] (1, 1, 16) int64
2026-04-30 19:26:06.949 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-70 vq [1460] (1,) int64
2026-04-30 19:26:06.976 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-71 vq-rvq [[[1460 1698 2033 189 1405 522 1672 519 1096 1097 1152 1037 1808 895
729 367]]] (1, 1, 16) int64
2026-04-30 19:26:06.984 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-71 vq [912] (1,) int64
2026-04-30 19:26:07.011 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-72 vq-rvq [[[ 912 1195 533 818 967 20 250 1275 482 1635 502 882 1288 1779
1502 1923]]] (1, 1, 16) int64
2026-04-30 19:26:07.019 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-72 vq [1358] (1,) int64
2026-04-30 19:26:07.046 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-73 vq-rvq [[[1358 781 1896 1979 229 335 187 1497 428 1351 359 1350 1629 508
1070 1512]]] (1, 1, 16) int64
2026-04-30 19:26:07.054 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-73 vq [1935] (1,) int64
2026-04-30 19:26:07.081 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-74 vq-rvq [[[1935 695 264 2009 1148 113 377 460 100 1768 2006 352 1112 404
693 612]]] (1, 1, 16) int64
2026-04-30 19:26:07.089 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-74 vq [1980] (1,) int64
2026-04-30 19:26:07.116 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-75 vq-rvq [[[1980 1577 789 86 867 535 1850 1404 876 11 1493 1667 218 1618
1334 959]]] (1, 1, 16) int64
2026-04-30 19:26:07.124 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-75 vq [967] (1,) int64
2026-04-30 19:26:07.151 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-76 vq-rvq [[[ 967 438 707 1129 844 14 1817 581 309 352 725 1207 257 467
476 583]]] (1, 1, 16) int64
2026-04-30 19:26:07.159 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-76 vq [1559] (1,) int64
2026-04-30 19:26:07.186 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-77 vq-rvq [[[1559 1651 80 1399 474 174 1402 371 2017 1357 1057 66 387 1744
374 813]]] (1, 1, 16) int64
2026-04-30 19:26:07.194 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-77 vq [272] (1,) int64
2026-04-30 19:26:07.221 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-78 vq-rvq [[[ 272 1148 431 143 492 750 631 1319 1241 1232 415 1498 236 763
1323 174]]] (1, 1, 16) int64
2026-04-30 19:26:07.229 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-78 vq [1528] (1,) int64
2026-04-30 19:26:07.256 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-79 vq-rvq [[[1528 736 1490 1256 479 90 1389 1402 1087 345 1 662 364 711
435 504]]] (1, 1, 16) int64
2026-04-30 19:26:07.264 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-79 vq [1808] (1,) int64
2026-04-30 19:26:07.291 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-80 vq-rvq [[[1808 1574 580 441 1368 963 1097 386 2010 833 209 1198 1627 476
649 1381]]] (1, 1, 16) int64
2026-04-30 19:26:07.299 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-80 vq [1500] (1,) int64
2026-04-30 19:26:07.326 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-81 vq-rvq [[[1500 1319 430 1363 1863 632 1065 1634 159 656 119 1425 1327 27
1708 962]]] (1, 1, 16) int64
2026-04-30 19:26:07.334 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-81 vq [1168] (1,) int64
2026-04-30 19:26:07.361 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-82 vq-rvq [[[1168 1807 1429 1791 242 1248 1069 1012 886 826 1227 169 1159 1853
859 1620]]] (1, 1, 16) int64
2026-04-30 19:26:07.369 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-82 vq [963] (1,) int64
2026-04-30 19:26:07.396 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-83 vq-rvq [[[ 963 1660 1471 507 1900 176 2042 41 1151 1252 1427 723 563 558
793 759]]] (1, 1, 16) int64
2026-04-30 19:26:07.404 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-83 vq [743] (1,) int64
2026-04-30 19:26:07.431 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-84 vq-rvq [[[ 743 816 1848 2030 1953 24 5 1416 1451 1403 319 1319 1199 1260
937 1408]]] (1, 1, 16) int64
2026-04-30 19:26:07.439 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-84 vq [417] (1,) int64
2026-04-30 19:26:07.466 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-85 vq-rvq [[[ 417 443 41 747 1865 240 1662 1409 926 358 636 238 659 684
1249 1416]]] (1, 1, 16) int64
2026-04-30 19:26:07.474 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-85 vq [1407] (1,) int64
2026-04-30 19:26:07.501 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-86 vq-rvq [[[1407 340 1840 66 1115 774 296 1653 813 1176 809 1392 1106 1039
1141 1878]]] (1, 1, 16) int64
2026-04-30 19:26:07.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-86 vq [204] (1,) int64
2026-04-30 19:26:07.536 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-87 vq-rvq [[[ 204 1858 604 252 1430 915 1309 370 1653 1362 246 460 1230 382
273 1167]]] (1, 1, 16) int64
2026-04-30 19:26:07.544 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-87 vq [381] (1,) int64
2026-04-30 19:26:07.571 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-88 vq-rvq [[[ 381 201 1237 787 1026 115 678 499 1175 493 349 96 1641 256
1516 1499]]] (1, 1, 16) int64
2026-04-30 19:26:07.579 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-88 vq [863] (1,) int64
2026-04-30 19:26:07.606 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-89 vq-rvq [[[ 863 1875 706 1628 390 1575 1770 318 248 1285 195 183 822 123
503 467]]] (1, 1, 16) int64
2026-04-30 19:26:07.614 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-89 vq [2150] (1,) int64
2026-04-30 19:26:07.615 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-49 chunk_tokens [[[ 825 851 1460 912]
[ 371 1209 1698 1195]
[1395 1426 2033 533]
[1038 671 189 818]
[ 953 1434 1405 967]
[1384 344 522 20]
[ 906 974 1672 250]
[ 810 1051 519 1275]
[ 330 205 1096 482]
[ 550 111 1097 1635]
[1607 615 1152 502]
[1673 416 1037 882]
[ 802 876 1808 1288]
[1334 488 895 1779]
[1169 129 729 1502]
[ 552 25 367 1923]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:07.639 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-49 wav [[[-0.00084715 0.01164515 0.02932669 ... 0.00305634 0.002376
0.00176231]]] -0.30304887890815735 0.00018249574350193143 0.0709570050239563 0.35016027092933655 (1, 1, 7680)
2026-04-30 19:26:07.639 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-53 chunk_tokens [[[1358 1935 1980 967]
[ 781 695 1577 438]
[1896 264 789 707]
[1979 2009 86 1129]
[ 229 1148 867 844]
[ 335 113 535 14]
[ 187 377 1850 1817]
[1497 460 1404 581]
[ 428 100 876 309]
[1351 1768 11 352]
[ 359 2006 1493 725]
[1350 352 1667 1207]
[1629 1112 218 257]
[ 508 404 1618 467]
[1070 693 1334 476]
[1512 612 959 583]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:07.663 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-53 wav [[[ 0.00133303 0.00114176 0.00112796 ... -0.03397415 0.03560583
0.00734547]]] -0.3596225678920746 -7.715798346907832e-06 0.08781254291534424 0.30450180172920227 (1, 1, 7680)
2026-04-30 19:26:07.663 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-57 chunk_tokens [[[1559 272 1528 1808]
[1651 1148 736 1574]
[ 80 431 1490 580]
[1399 143 1256 441]
[ 474 492 479 1368]
[ 174 750 90 963]
[1402 631 1389 1097]
[ 371 1319 1402 386]
[2017 1241 1087 2010]
[1357 1232 345 833]
[1057 415 1 209]
[ 66 1498 662 1198]
[ 387 236 364 1627]
[1744 763 711 476]
[ 374 1323 435 649]
[ 813 174 504 1381]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:07.687 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-57 wav [[[-0.04759482 0.00231559 0.03089104 ... 0.18176867 0.13269146
0.06594509]]] -0.4350372850894928 0.00012260368384886533 0.05727505311369896 0.3781623840332031 (1, 1, 7680)
2026-04-30 19:26:07.688 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-61 chunk_tokens [[[1500 1168 963 743]
[1319 1807 1660 816]
[ 430 1429 1471 1848]
[1363 1791 507 2030]
[1863 242 1900 1953]
[ 632 1248 176 24]
[1065 1069 2042 5]
[1634 1012 41 1416]
[ 159 886 1151 1451]
[ 656 826 1252 1403]
[ 119 1227 1427 319]
[1425 169 723 1319]
[1327 1159 563 1199]
[ 27 1853 558 1260]
[1708 859 793 937]
[ 962 1620 759 1408]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:07.712 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-61 wav [[[-0.00594246 -0.07083042 -0.11743579 ... -0.01224556 -0.0012733
0.00776599]]] -0.35602352023124695 -9.005195897771046e-05 0.06507798284292221 0.2743745744228363 (1, 1, 7680)
2026-04-30 19:26:07.712 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-65 chunk_tokens [[[ 417 1407 204 381]
[ 443 340 1858 201]
[ 41 1840 604 1237]
[ 747 66 252 787]
[1865 1115 1430 1026]
[ 240 774 915 115]
[1662 296 1309 678]
[1409 1653 370 499]
[ 926 813 1653 1175]
[ 358 1176 1362 493]
[ 636 809 246 349]
[ 238 1392 460 96]
[ 659 1106 1230 1641]
[ 684 1039 382 256]
[1249 1141 273 1516]
[1416 1878 1167 1499]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:07.736 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-65 wav [[[ 0.00711998 -0.00636461 -0.02865032 ... 0.01531223 0.02133005
0.02612119]]] -0.3169194757938385 4.87714605696965e-05 0.04392051696777344 0.18612053990364075 (1, 1, 7680)
2026-04-30 19:26:07.736 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-69 chunk_tokens [[[ 863]
[1875]
[ 706]
[1628]
[ 390]
[1575]
[1770]
[ 318]
[ 248]
[1285]
[ 195]
[ 183]
[ 822]
[ 123]
[ 503]
[ 467]]] (1, 16, 1) n_chunk_frames 1
2026-04-30 19:26:07.766 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-69 wav [[[2.5798496e-02 2.0124789e-02 9.4997659e-03 ... 1.0540312e-05
1.0445123e-05 1.0610051e-05]]] -0.06146857514977455 -9.881023288471624e-05 0.006389988120645285 0.028675077483057976 (1, 1, 1920)
2026-04-30 19:26:07.766 [INFO] src.inference.qwen3_tts_inferencer_onnx: reset_turn reset_generation_state step-idx-90
2026-04-30 19:26:07.784 [INFO] __main__: Synthesising: 'И это огромный сдвиг'
2026-04-30 19:26:07.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment И -> text_cache И
2026-04-30 19:26:07.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False
2026-04-30 19:26:07.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069
2026-04-30 19:26:07.864 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076
0.08690926]]] (1, 1, 1024)
2026-04-30 19:26:07.864 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]]
2026-04-30 19:26:07.864 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]]] (1, 4, 1024)
2026-04-30 19:26:07.864 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 1, 1024)
2026-04-30 19:26:07.865 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]
[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076
0.08690926]
[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 6, 1024)
2026-04-30 19:26:07.865 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22
Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:07.865 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:07.865 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3)
2026-04-30 19:26:07.865 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3)
2026-04-30 19:26:07.866 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024)
2026-04-30 19:26:07.866 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036
-0.00767252]]] (1, 1, 1024)
2026-04-30 19:26:07.866 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528
0.00424147]]] (1, 1, 1024)
2026-04-30 19:26:07.867 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724
-0.00170945]
[ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198
0.00132705]
[ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966
0.0080104 ]
[ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711
0.00252486]
[-0.02064589 0.05184897 0.01909059 ... 0.2070941 0.06416605
0.09115074]
[ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459
-0.00718043]]] (1, 6, 1024)
2026-04-30 19:26:07.867 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]
...
[ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03
-2.0710612e-04 2.5248611e-03]
[-2.0645889e-02 5.1848970e-02 1.9090585e-02 ... 2.0709410e-01
6.4166047e-02 9.1150738e-02]
[ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03
3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024)
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=9; step_idx=0
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache И
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment э -> text_cache И э
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache И эт
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache И это
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache И это
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache И это о
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache И это ог
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache И это огр
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache И это огро
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache И это огром
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache И это огромн
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ы -> text_cache И это огромны
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment й -> text_cache И это огромный
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache И это огромный
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache И это огромный с
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache И это огромный сд
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache И это огромный сдв
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache И это огромный сдви
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache И это огромный сдвиг
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache И это огромный сдвиг 20
2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['И это огромный сдвиг'] 20
Qwen3TTSProcessor __call__ text ['И это огромный сдвиг']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 30174, 67879, 127776, 12228, 33513, 5409, 140179]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 30174, 67879, 127776, 12228, 33513, 5409, 140179]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 30174 67879 127776 12228 33513 5409 140179]] (1, 7)
2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 30174 67879 127776 12228 33513 5409 140179]] (1, 7)
2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(30174), np.int64(67879), np.int64(127776), np.int64(12228), np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 8
2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(30174), np.int64(67879), np.int64(127776), np.int64(12228), np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 8
2026-04-30 19:26:07.914 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 30174 -> pending_tokens [np.int64(67879), np.int64(127776), np.int64(12228), np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 7
2026-04-30 19:26:07.922 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-0 vq [1995] (1,) int64
2026-04-30 19:26:07.948 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-1 vq-rvq [[[1995 1159 0 22 247 69 1579 426 853 312 1358 969 1956 118
224 419]]] (1, 1, 16) int64
2026-04-30 19:26:07.949 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 67879 -> pending_tokens [np.int64(127776), np.int64(12228), np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 6
2026-04-30 19:26:07.957 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-1 vq [215] (1,) int64
2026-04-30 19:26:07.983 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-2 vq-rvq [[[ 215 1134 933 371 243 1748 55 1641 1253 38 743 823 527 1529
82 901]]] (1, 1, 16) int64
2026-04-30 19:26:07.983 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 127776 -> pending_tokens [np.int64(12228), np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 5
2026-04-30 19:26:07.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-2 vq [212] (1,) int64
2026-04-30 19:26:08.018 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-3 vq-rvq [[[ 212 1666 771 1670 1210 1347 310 1034 241 455 2040 175 1677 1422
1213 1668]]] (1, 1, 16) int64
2026-04-30 19:26:08.018 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 12228 -> pending_tokens [np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 4
2026-04-30 19:26:08.026 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-3 vq [1181] (1,) int64
2026-04-30 19:26:08.053 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-4 vq-rvq [[[1181 957 1093 515 909 407 1841 486 564 1974 1657 362 1851 1654
273 129]]] (1, 1, 16) int64
2026-04-30 19:26:08.053 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 33513 -> pending_tokens [np.int64(5409), np.int64(140179), np.int64(151673)] 3
2026-04-30 19:26:08.061 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-4 vq [462] (1,) int64
2026-04-30 19:26:08.087 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-5 vq-rvq [[[ 462 1809 1975 1363 1648 497 1751 668 1242 1462 876 124 1779 1366
647 223]]] (1, 1, 16) int64
2026-04-30 19:26:08.087 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 5409 -> pending_tokens [np.int64(140179), np.int64(151673)] 2
2026-04-30 19:26:08.095 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-5 vq [1225] (1,) int64
2026-04-30 19:26:08.122 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-6 vq-rvq [[[1225 636 1104 1192 537 1880 1811 1688 1551 412 512 1644 924 1326
398 1689]]] (1, 1, 16) int64
2026-04-30 19:26:08.122 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 140179 -> pending_tokens [np.int64(151673)] 1
2026-04-30 19:26:08.130 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-6 vq [333] (1,) int64
2026-04-30 19:26:08.157 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-7 vq-rvq [[[ 333 597 1277 77 1155 1861 1097 931 202 904 1616 1985 396 1554
487 144]]] (1, 1, 16) int64
2026-04-30 19:26:08.157 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0
2026-04-30 19:26:08.165 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-7 vq [948] (1,) int64
2026-04-30 19:26:08.191 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-8 vq-rvq [[[ 948 1698 1396 1783 1769 1801 1352 359 1673 252 993 1509 2030 536
744 80]]] (1, 1, 16) int64
2026-04-30 19:26:08.191 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 chunk_tokens [[[1995 215 212 1181]
[1159 1134 1666 957]
[ 0 933 771 1093]
[ 22 371 1670 515]
[ 247 243 1210 909]
[ 69 1748 1347 407]
[1579 55 310 1841]
[ 426 1641 1034 486]
[ 853 1253 241 564]
[ 312 38 455 1974]
[1358 743 2040 1657]
[ 969 823 175 362]
[1956 527 1677 1851]
[ 118 1529 1422 1654]
[ 224 82 1213 273]
[ 419 901 1668 129]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:08.216 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 wav [[[-2.0183910e-02 -1.5937209e-02 -1.3884507e-02 ... 5.7107034e-05
3.8642902e-05 1.1677517e-05]]] -0.02084321156144142 -5.6190634495578706e-05 0.0011370863066986203 0.010447698645293713 (1, 1, 7680)
2026-04-30 19:26:08.216 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 chunk_tokens [[[ 462 1225 333 948]
[1809 636 597 1698]
[1975 1104 1277 1396]
[1363 1192 77 1783]
[1648 537 1155 1769]
[ 497 1880 1861 1801]
[1751 1811 1097 1352]
[ 668 1688 931 359]
[1242 1551 202 1673]
[1462 412 904 252]
[ 876 512 1616 993]
[ 124 1644 1985 1509]
[1779 924 396 2030]
[1366 1326 1554 536]
[ 647 398 487 744]
[ 223 1689 144 80]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:08.240 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 wav [[[-3.8887060e-06 -1.9734021e-05 -8.4024796e-06 ... 1.1066332e-01
8.8470802e-02 5.8433518e-02]]] -0.2045511156320572 0.00010347345232730731 0.04608716815710068 0.2536100447177887 (1, 1, 7680)
2026-04-30 19:26:08.248 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-8 vq [1363] (1,) int64
2026-04-30 19:26:08.275 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-9 vq-rvq [[[1363 328 30 2009 440 765 864 886 1632 43 2006 294 816 209
823 344]]] (1, 1, 16) int64
2026-04-30 19:26:08.282 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-9 vq [1249] (1,) int64
2026-04-30 19:26:08.309 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-10 vq-rvq [[[1249 721 1687 1092 644 1303 206 609 1173 1791 883 300 263 848
516 1515]]] (1, 1, 16) int64
2026-04-30 19:26:08.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-10 vq [269] (1,) int64
2026-04-30 19:26:08.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-11 vq-rvq [[[ 269 1888 1100 1053 690 1010 1545 127 968 383 1355 468 1277 1149
731 960]]] (1, 1, 16) int64
2026-04-30 19:26:08.352 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-11 vq [1532] (1,) int64
2026-04-30 19:26:08.378 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-12 vq-rvq [[[1532 875 725 489 529 1434 45 1699 959 830 346 1625 283 377
764 1410]]] (1, 1, 16) int64
2026-04-30 19:26:08.386 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-12 vq [1769] (1,) int64
2026-04-30 19:26:08.413 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-13 vq-rvq [[[1769 1355 1072 189 1547 539 135 1611 162 1585 1264 522 376 1524
942 850]]] (1, 1, 16) int64
2026-04-30 19:26:08.421 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-13 vq [1105] (1,) int64
2026-04-30 19:26:08.448 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-14 vq-rvq [[[1105 1323 1391 1513 1852 412 69 1605 1449 1172 1315 1040 1366 350
1910 848]]] (1, 1, 16) int64
2026-04-30 19:26:08.456 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-14 vq [22] (1,) int64
2026-04-30 19:26:08.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-15 vq-rvq [[[ 22 172 582 909 445 46 1860 1124 568 749 265 16 22 908
531 1437]]] (1, 1, 16) int64
2026-04-30 19:26:08.491 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-15 vq [1919] (1,) int64
2026-04-30 19:26:08.517 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-16 vq-rvq [[[1919 443 63 146 1844 614 1670 1079 1298 1028 52 853 1060 2044
222 310]]] (1, 1, 16) int64
2026-04-30 19:26:08.525 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-16 vq [1699] (1,) int64
2026-04-30 19:26:08.552 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-17 vq-rvq [[[1699 1113 1827 606 296 1641 863 787 606 229 318 676 1853 840
3 2019]]] (1, 1, 16) int64
2026-04-30 19:26:08.560 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-17 vq [1401] (1,) int64
2026-04-30 19:26:08.587 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-18 vq-rvq [[[1401 208 1794 492 1434 724 457 1495 1339 414 1528 236 69 929
1685 546]]] (1, 1, 16) int64
2026-04-30 19:26:08.595 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-18 vq [1759] (1,) int64
2026-04-30 19:26:08.622 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-19 vq-rvq [[[1759 739 856 1366 1098 1511 1682 1510 263 1214 2025 178 1321 64
1935 1128]]] (1, 1, 16) int64
2026-04-30 19:26:08.630 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-19 vq [1509] (1,) int64
2026-04-30 19:26:08.657 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-20 vq-rvq [[[1509 386 878 633 1868 1350 870 1086 186 212 935 332 498 1710
526 1358]]] (1, 1, 16) int64
2026-04-30 19:26:08.665 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-20 vq [101] (1,) int64
2026-04-30 19:26:08.692 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-21 vq-rvq [[[ 101 552 1643 545 1294 1302 1408 367 1252 690 191 220 447 1324
1752 1497]]] (1, 1, 16) int64
2026-04-30 19:26:08.700 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-21 vq [1786] (1,) int64
2026-04-30 19:26:08.727 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-22 vq-rvq [[[1786 1361 1196 7 1118 1365 651 183 563 1655 958 1061 4 1886
344 1724]]] (1, 1, 16) int64
2026-04-30 19:26:08.735 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-22 vq [510] (1,) int64
2026-04-30 19:26:08.762 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-23 vq-rvq [[[ 510 72 1471 343 377 1026 15 1466 67 565 2028 536 106 1209
944 1218]]] (1, 1, 16) int64
2026-04-30 19:26:08.770 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-23 vq [759] (1,) int64
2026-04-30 19:26:08.797 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-24 vq-rvq [[[ 759 844 679 60 229 1985 970 998 1037 1221 198 1952 1520 847
1541 1195]]] (1, 1, 16) int64
2026-04-30 19:26:08.805 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-24 vq [2150] (1,) int64
2026-04-30 19:26:08.805 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 chunk_tokens [[[1363 1249 269 1532]
[ 328 721 1888 875]
[ 30 1687 1100 725]
[2009 1092 1053 489]
[ 440 644 690 529]
[ 765 1303 1010 1434]
[ 864 206 1545 45]
[ 886 609 127 1699]
[1632 1173 968 959]
[ 43 1791 383 830]
[2006 883 1355 346]
[ 294 300 468 1625]
[ 816 263 1277 283]
[ 209 848 1149 377]
[ 823 516 731 764]
[ 344 1515 960 1410]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:08.829 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 wav [[[ 0.03129857 0.00853362 -0.01033144 ... 0.09652691 0.09359639
0.08388945]]] -0.2293231338262558 -5.644173143082298e-05 0.0785219594836235 0.3838101625442505 (1, 1, 7680)
2026-04-30 19:26:08.829 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 chunk_tokens [[[1769 1105 22 1919]
[1355 1323 172 443]
[1072 1391 582 63]
[ 189 1513 909 146]
[1547 1852 445 1844]
[ 539 412 46 614]
[ 135 69 1860 1670]
[1611 1605 1124 1079]
[ 162 1449 568 1298]
[1585 1172 749 1028]
[1264 1315 265 52]
[ 522 1040 16 853]
[ 376 1366 22 1060]
[1524 350 908 2044]
[ 942 1910 531 222]
[ 850 848 1437 310]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:08.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 wav [[[ 0.05809088 0.02357002 -0.00454529 ... -0.0498165 -0.04576993
-0.03763081]]] -0.3089529573917389 -3.526918703755655e-07 0.09083333611488342 0.3005658984184265 (1, 1, 7680)
2026-04-30 19:26:08.854 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 chunk_tokens [[[1699 1401 1759 1509]
[1113 208 739 386]
[1827 1794 856 878]
[ 606 492 1366 633]
[ 296 1434 1098 1868]
[1641 724 1511 1350]
[ 863 457 1682 870]
[ 787 1495 1510 1086]
[ 606 1339 263 186]
[ 229 414 1214 212]
[ 318 1528 2025 935]
[ 676 236 178 332]
[1853 69 1321 498]
[ 840 929 64 1710]
[ 3 1685 1935 526]
[2019 546 1128 1358]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:08.878 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 wav [[[-2.2946877e-02 -2.3201210e-03 2.1217730e-02 ... 1.0006299e-05
-3.3452941e-04 -1.9635350e-04]]] -0.24175524711608887 3.526797809172422e-05 0.053924478590488434 0.29685649275779724 (1, 1, 7680)
2026-04-30 19:26:08.878 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 chunk_tokens [[[ 101 1786 510 759]
[ 552 1361 72 844]
[1643 1196 1471 679]
[ 545 7 343 60]
[1294 1118 377 229]
[1302 1365 1026 1985]
[1408 651 15 970]
[ 367 183 1466 998]
[1252 563 67 1037]
[ 690 1655 565 1221]
[ 191 958 2028 198]
[ 220 1061 536 1952]
[ 447 4 106 1520]
[1324 1886 1209 847]
[1752 344 944 1541]
[1497 1724 1218 1195]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:08.902 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 wav [[[5.07825869e-04 1.12122181e-03 5.06746350e-04 ... 1.08543572e-05
1.14508384e-05 1.15422645e-05]]] -0.25886231660842896 9.83110749075422e-06 0.04671125486493111 0.2909148931503296 (1, 1, 7680)
2026-04-30 19:26:08.902 [INFO] __main__: Synthesising: 'для мирового бизнеса.'
2026-04-30 19:26:08.902 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache д
2026-04-30 19:26:08.902 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False
2026-04-30 19:26:08.907 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list [array([[[-0.03852101, -0.06222959, -0.06324419, ..., 0.00308757,
0.01666446, 0.02635817]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02811593, 0.01903336, 0.00181638, ..., -0.00637799,
-0.00625728, -0.01839462]]], shape=(1, 1, 7680), dtype=float32), array([[[-3.6303084e-02, -4.4228390e-02, -4.6101980e-02, ...,
4.6050473e-04, -4.0465111e-05, -2.4329145e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[7.2466741e-05, 2.7459790e-04, 3.0666371e-04, ...,
8.0509745e-03, 1.3393108e-02, 9.4361240e-03]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 0.00426391, 0.00582221, 0.00909369, ..., -0.02768227,
-0.02276854, -0.01686861]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01355644, -0.01526949, -0.01623942, ..., 0.0395449 ,
0.05279908, 0.00224491]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01579052, 0.00150335, -0.02962946, ..., -0.00423873,
-0.00033509, 0.00640968]]], shape=(1, 1, 7680), dtype=float32), array([[[1.9390190e-02, 3.0609204e-02, 3.0704437e-02, ...,
1.1317945e-05, 1.0956299e-05, 1.1030028e-05]]],
shape=(1, 1, 3840), dtype=float32), array([[[ 1.1094540e-05, 1.1138460e-05, 1.1009237e-05, ...,
-2.2123540e-02, -2.2558490e-02, -1.9299621e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[0.00221431, 0.03934583, 0.0700637 , ..., 0.01913414,
0.04059763, 0.06542776]]], shape=(1, 1, 7680), dtype=float32), array([[[0.08465035, 0.0946539 , 0.09328509, ..., 0.0472551 ,
0.05668663, 0.05911173]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04501721, 0.0241992 , 0.01363233, ..., -0.04057647,
-0.05749581, -0.0651198 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.06861783, -0.06905188, -0.06281615, ..., -0.00338598,
0.00180774, 0.00092616]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00584421, -0.00096309, 0.00632945, ..., 0.00375346,
0.00384357, 0.00217619]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00579548, -0.01757104, -0.0243005 , ..., 0.00547749,
0.00660871, 0.009783 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01747901, 0.02681293, 0.03847475, ..., -0.02004432,
-0.02144283, -0.0218131 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.9715637e-02, -1.6528632e-02, -1.3177541e-02, ...,
1.1422026e-05, 1.1317023e-05, 1.1494269e-05]]],
shape=(1, 1, 1920), dtype=float32), array([[[-2.06317715e-02, -1.67933665e-02, -1.47240255e-02, ...,
6.64611871e-05, -4.19520393e-06, -7.44241624e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[-8.0167578e-05, -4.1713702e-05, 3.4347220e-05, ...,
1.4899543e-02, 1.9630753e-02, 2.1652387e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[0.02029367, 0.01627654, 0.01006193, ..., 0.06808572,
0.06454458, 0.05861032]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05094757, 0.04577596, 0.04464076, ..., -0.03615839,
-0.03458475, 0.00780901]]], shape=(1, 1, 7680), dtype=float32), array([[[0.05842641, 0.09555472, 0.10986558, ..., 0.0013969 ,
0.01872239, 0.04114778]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05213842, 0.05569138, 0.06345794, ..., -0.00115294,
-0.00027638, -0.00037019]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2735376e-03, -7.3580118e-04, 3.0488527e-05, ...,
8.4239952e-03, 3.2757007e-02, 1.1410726e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03925117, -0.01366347, 0.03734893, ..., -0.04557104,
-0.04238814, -0.02026677]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02351574, 0.06001395, 0.05978361, ..., 0.00261743,
-0.03956862, -0.06221673]]], shape=(1, 1, 7680), dtype=float32), array([[[-6.3454241e-02, -3.5933349e-02, 1.2640217e-03, ...,
1.9708219e-05, 1.7832308e-05, 1.5235857e-05]]],
shape=(1, 1, 1920), dtype=float32), array([[[6.4516030e-06, 3.8836665e-06, 3.5758250e-05, ...,
2.0419013e-02, 5.6000661e-02, 7.9175197e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[0.07597505, 0.05851083, 0.06002833, ..., 0.07287683,
0.04599379, 0.01605063]]], shape=(1, 1, 7680), dtype=float32), array([[[0.00099137, 0.00403599, 0.01846475, ..., 0.02468315,
0.01271362, 0.00035484]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00084715, 0.01164515, 0.02932669, ..., 0.00305634,
0.002376 , 0.00176231]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00133303, 0.00114176, 0.00112796, ..., -0.03397415,
0.03560583, 0.00734547]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.04759482, 0.00231559, 0.03089104, ..., 0.18176867,
0.13269146, 0.06594509]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00594246, -0.07083042, -0.11743579, ..., -0.01224556,
-0.0012733 , 0.00776599]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00711998, -0.00636461, -0.02865032, ..., 0.01531223,
0.02133005, 0.02612119]]], shape=(1, 1, 7680), dtype=float32), array([[[2.5798496e-02, 2.0124789e-02, 9.4997659e-03, ...,
1.0540312e-05, 1.0445123e-05, 1.0610051e-05]]],
shape=(1, 1, 1920), dtype=float32), array([[[-2.0183910e-02, -1.5937209e-02, -1.3884507e-02, ...,
5.7107034e-05, 3.8642902e-05, 1.1677517e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[-3.8887060e-06, -1.9734021e-05, -8.4024796e-06, ...,
1.1066332e-01, 8.8470802e-02, 5.8433518e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 0.03129857, 0.00853362, -0.01033144, ..., 0.09652691,
0.09359639, 0.08388945]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05809088, 0.02357002, -0.00454529, ..., -0.0498165 ,
-0.04576993, -0.03763081]]], shape=(1, 1, 7680), dtype=float32), array([[[-2.2946877e-02, -2.3201210e-03, 2.1217730e-02, ...,
1.0006299e-05, -3.3452941e-04, -1.9635350e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[5.07825869e-04, 1.12122181e-03, 5.06746350e-04, ...,
1.08543572e-05, 1.14508384e-05, 1.15422645e-05]]],
shape=(1, 1, 7680), dtype=float32)] 42
2026-04-30 19:26:08.907 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history [-3.85210067e-02 -6.22295924e-02 -6.32441938e-02 ... 1.08543572e-05
1.14508384e-05 1.15422645e-05] (301440,) float32
2026-04-30 19:26:08.908 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history_after cut_idx 15 [1.74790137e-02 2.68129278e-02 3.84747460e-02 ... 1.08543572e-05
1.14508384e-05 1.15422645e-05] (190080,) float32
2026-04-30 19:26:08.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list_after cut_idx 15 [array([[[ 0.01747901, 0.02681293, 0.03847475, ..., -0.02004432,
-0.02144283, -0.0218131 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.9715637e-02, -1.6528632e-02, -1.3177541e-02, ...,
1.1422026e-05, 1.1317023e-05, 1.1494269e-05]]],
shape=(1, 1, 1920), dtype=float32), array([[[-2.06317715e-02, -1.67933665e-02, -1.47240255e-02, ...,
6.64611871e-05, -4.19520393e-06, -7.44241624e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[-8.0167578e-05, -4.1713702e-05, 3.4347220e-05, ...,
1.4899543e-02, 1.9630753e-02, 2.1652387e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[0.02029367, 0.01627654, 0.01006193, ..., 0.06808572,
0.06454458, 0.05861032]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05094757, 0.04577596, 0.04464076, ..., -0.03615839,
-0.03458475, 0.00780901]]], shape=(1, 1, 7680), dtype=float32), array([[[0.05842641, 0.09555472, 0.10986558, ..., 0.0013969 ,
0.01872239, 0.04114778]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05213842, 0.05569138, 0.06345794, ..., -0.00115294,
-0.00027638, -0.00037019]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2735376e-03, -7.3580118e-04, 3.0488527e-05, ...,
8.4239952e-03, 3.2757007e-02, 1.1410726e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[-0.03925117, -0.01366347, 0.03734893, ..., -0.04557104,
-0.04238814, -0.02026677]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02351574, 0.06001395, 0.05978361, ..., 0.00261743,
-0.03956862, -0.06221673]]], shape=(1, 1, 7680), dtype=float32), array([[[-6.3454241e-02, -3.5933349e-02, 1.2640217e-03, ...,
1.9708219e-05, 1.7832308e-05, 1.5235857e-05]]],
shape=(1, 1, 1920), dtype=float32), array([[[6.4516030e-06, 3.8836665e-06, 3.5758250e-05, ...,
2.0419013e-02, 5.6000661e-02, 7.9175197e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[0.07597505, 0.05851083, 0.06002833, ..., 0.07287683,
0.04599379, 0.01605063]]], shape=(1, 1, 7680), dtype=float32), array([[[0.00099137, 0.00403599, 0.01846475, ..., 0.02468315,
0.01271362, 0.00035484]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00084715, 0.01164515, 0.02932669, ..., 0.00305634,
0.002376 , 0.00176231]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00133303, 0.00114176, 0.00112796, ..., -0.03397415,
0.03560583, 0.00734547]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.04759482, 0.00231559, 0.03089104, ..., 0.18176867,
0.13269146, 0.06594509]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00594246, -0.07083042, -0.11743579, ..., -0.01224556,
-0.0012733 , 0.00776599]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00711998, -0.00636461, -0.02865032, ..., 0.01531223,
0.02133005, 0.02612119]]], shape=(1, 1, 7680), dtype=float32), array([[[2.5798496e-02, 2.0124789e-02, 9.4997659e-03, ...,
1.0540312e-05, 1.0445123e-05, 1.0610051e-05]]],
shape=(1, 1, 1920), dtype=float32), array([[[-2.0183910e-02, -1.5937209e-02, -1.3884507e-02, ...,
5.7107034e-05, 3.8642902e-05, 1.1677517e-05]]],
shape=(1, 1, 7680), dtype=float32), array([[[-3.8887060e-06, -1.9734021e-05, -8.4024796e-06, ...,
1.1066332e-01, 8.8470802e-02, 5.8433518e-02]]],
shape=(1, 1, 7680), dtype=float32), array([[[ 0.03129857, 0.00853362, -0.01033144, ..., 0.09652691,
0.09359639, 0.08388945]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05809088, 0.02357002, -0.00454529, ..., -0.0498165 ,
-0.04576993, -0.03763081]]], shape=(1, 1, 7680), dtype=float32), array([[[-2.2946877e-02, -2.3201210e-03, 2.1217730e-02, ...,
1.0006299e-05, -3.3452941e-04, -1.9635350e-04]]],
shape=(1, 1, 7680), dtype=float32), array([[[5.07825869e-04, 1.12122181e-03, 5.06746350e-04, ...,
1.08543572e-05, 1.14508384e-05, 1.15422645e-05]]],
shape=(1, 1, 7680), dtype=float32)] 27
2026-04-30 19:26:08.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069
2026-04-30 19:26:08.985 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02861767 0.04147377 -0.04973026 ... 0.1851612 0.07234052
0.06604917]]] (1, 1, 1024)
2026-04-30 19:26:08.985 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]]
2026-04-30 19:26:08.986 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]]] (1, 4, 1024)
2026-04-30 19:26:08.986 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 1, 1024)
2026-04-30 19:26:08.986 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252
-0.00595093]
[-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727
-0.00291443]
[ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438
0.00376892]
[-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239
-0.00171661]
[-0.02861767 0.04147377 -0.04973026 ... 0.1851612 0.07234052
0.06604917]
[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936
0.0004921 ]]] (1, 6, 1024)
2026-04-30 19:26:08.986 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22
Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:08.987 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])}
2026-04-30 19:26:08.987 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3)
2026-04-30 19:26:08.987 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3)
2026-04-30 19:26:08.987 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024)
2026-04-30 19:26:08.988 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036
-0.00767252]]] (1, 1, 1024)
2026-04-30 19:26:08.988 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528
0.00424147]]] (1, 1, 1024)
2026-04-30 19:26:08.988 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724
-0.00170945]
[ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198
0.00132705]
[ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966
0.0080104 ]
[ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711
0.00252486]
[-0.02383949 0.03766778 -0.05142642 ... 0.17587686 0.0738958
0.07029065]
[ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459
-0.00718043]]] (1, 6, 1024)
2026-04-30 19:26:08.989 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03
1.6852217e-03 -3.0699652e-04]
[-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02
1.0521024e-02 -2.8837420e-02]
[ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03
4.2793620e-04 -2.2229077e-03]
...
[ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03
-2.0710612e-04 2.5248611e-03]
[-2.3839490e-02 3.7667781e-02 -5.1426422e-02 ... 1.7587686e-01
7.3895805e-02 7.0290647e-02]
[ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03
3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024)
2026-04-30 19:26:09.033 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=43; step_idx=43
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill cont done; talker_seq_len=43; step_idx=43
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache дл
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache для
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache для
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache для м
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache для ми
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache для мир
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache для миро
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache для миров
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache для мирово
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache для мировог
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache для мирового
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache для мирового
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment б -> text_cache для мирового б
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache для мирового би
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment з -> text_cache для мирового биз
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache для мирового бизн
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache для мирового бизне
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache для мирового бизнес
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache для мирового бизнеса
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment . -> text_cache для мирового бизнеса.
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['для мирового бизнеса.'] 21
Qwen3TTSProcessor __call__ text ['для мирового бизнеса.']
Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'}
Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 6949, 13695, 138061, 22107, 132199, 1478, 13]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 6949, 13695, 138061, 22107, 132199, 1478, 13]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])}
2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 6949 13695 138061 22107 132199 1478 13]] (1, 7)
2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 6949 13695 138061 22107 132199 1478 13]] (1, 7)
2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment для мирового бизнеса. 21 -> tokenized_segment [np.int64(6949), np.int64(13695), np.int64(138061), np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)] 7
2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(6949), np.int64(13695), np.int64(138061), np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)]
2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(6949), np.int64(13695), np.int64(138061), np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)] 7
2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6949 -> pending_tokens [np.int64(13695), np.int64(138061), np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)] 6
2026-04-30 19:26:09.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-43 vq [1221] (1,) int64
2026-04-30 19:26:09.106 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-44 vq-rvq [[[1221 1889 373 973 111 736 1204 188 1653 1305 1538 411 196 1583
305 770]]] (1, 1, 16) int64
2026-04-30 19:26:09.106 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13695 -> pending_tokens [np.int64(138061), np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)] 5
2026-04-30 19:26:09.114 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-44 vq [2042] (1,) int64
2026-04-30 19:26:09.141 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-45 vq-rvq [[[2042 277 1038 252 360 1876 303 1648 107 736 88 126 866 1973
477 624]]] (1, 1, 16) int64
2026-04-30 19:26:09.142 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 138061 -> pending_tokens [np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)] 4
2026-04-30 19:26:09.150 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-45 vq [1812] (1,) int64
2026-04-30 19:26:09.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-46 vq-rvq [[[1812 1975 702 912 1514 1129 1098 275 591 465 1421 412 503 465
1096 1053]]] (1, 1, 16) int64
2026-04-30 19:26:09.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 22107 -> pending_tokens [np.int64(132199), np.int64(1478), np.int64(13)] 3
2026-04-30 19:26:09.185 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-46 vq [905] (1,) int64
2026-04-30 19:26:09.212 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-47 vq-rvq [[[ 905 637 1379 1325 70 445 1987 864 975 1721 701 956 1358 3
133 1381]]] (1, 1, 16) int64
2026-04-30 19:26:09.212 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 132199 -> pending_tokens [np.int64(1478), np.int64(13)] 2
2026-04-30 19:26:09.220 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-47 vq [1406] (1,) int64
2026-04-30 19:26:09.247 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-48 vq-rvq [[[1406 1561 216 71 1606 523 1920 203 17 1284 86 1733 688 1115
77 785]]] (1, 1, 16) int64
2026-04-30 19:26:09.247 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 1478 -> pending_tokens [np.int64(13)] 1
2026-04-30 19:26:09.255 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-48 vq [1804] (1,) int64
2026-04-30 19:26:09.282 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-49 vq-rvq [[[1804 1175 1088 319 846 1810 75 1281 1823 375 1998 959 674 2042
73 627]]] (1, 1, 16) int64
2026-04-30 19:26:09.282 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13 -> pending_tokens [] 0
2026-04-30 19:26:09.290 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-49 vq [1239] (1,) int64
2026-04-30 19:26:09.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-50 vq-rvq [[[1239 1155 11 777 39 731 1286 1608 925 730 683 987 417 2043
1169 2031]]] (1, 1, 16) int64
2026-04-30 19:26:09.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 chunk_tokens [[[1221 2042 1812 905]
[1889 277 1975 637]
[ 373 1038 702 1379]
[ 973 252 912 1325]
[ 111 360 1514 70]
[ 736 1876 1129 445]
[1204 303 1098 1987]
[ 188 1648 275 864]
[1653 107 591 975]
[1305 736 465 1721]
[1538 88 1421 701]
[ 411 126 412 956]
[ 196 866 503 1358]
[1583 1973 465 3]
[ 305 477 1096 133]
[ 770 624 1053 1381]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 wav [[[1.0586618e-05 1.0957512e-05 1.1577104e-05 ... 1.7860198e-01
2.2454987e-01 2.2613712e-01]]] -0.2697470486164093 2.8067548555554822e-05 0.06279374659061432 0.29932451248168945 (1, 1, 7680)
2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0
2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1
2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False
2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1
2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0
2026-04-30 19:26:09.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-50 vq [613] (1,) int64
2026-04-30 19:26:09.377 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-51 vq-rvq [[[ 613 248 443 533 466 1474 204 1818 719 581 802 141 784 1918
1958 766]]] (1, 1, 16) int64
2026-04-30 19:26:09.377 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 chunk_tokens [[[1406 1804 1239 613]
[1561 1175 1155 248]
[ 216 1088 11 443]
[ 71 319 777 533]
[1606 846 39 466]
[ 523 1810 731 1474]
[1920 75 1286 204]
[ 203 1281 1608 1818]
[ 17 1823 925 719]
[1284 375 730 581]
[ 86 1998 683 802]
[1733 959 987 141]
[ 688 674 417 784]
[1115 2042 2043 1918]
[ 77 73 1169 1958]
[ 785 627 2031 766]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:09.401 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 wav [[[ 0.18334845 0.09610437 -0.00970795 ... -0.14953831 -0.13082638
-0.10510523]]] -0.3167853057384491 -6.515438872156665e-05 0.08525040000677109 0.3474375605583191 (1, 1, 7680)
2026-04-30 19:26:09.409 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-51 vq [1845] (1,) int64
2026-04-30 19:26:09.436 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-52 vq-rvq [[[1845 1716 2038 1642 825 1307 1284 751 1099 1860 596 77 1422 923
730 593]]] (1, 1, 16) int64
2026-04-30 19:26:09.445 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-52 vq [1053] (1,) int64
2026-04-30 19:26:09.472 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-53 vq-rvq [[[1053 1199 861 1987 457 294 523 727 1090 125 1080 885 746 922
1087 207]]] (1, 1, 16) int64
2026-04-30 19:26:09.480 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-53 vq [1032] (1,) int64
2026-04-30 19:26:09.507 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-54 vq-rvq [[[1032 409 801 1855 1183 553 1931 498 305 1226 1015 1981 584 1033
365 1428]]] (1, 1, 16) int64
2026-04-30 19:26:09.515 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-54 vq [919] (1,) int64
2026-04-30 19:26:09.542 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-55 vq-rvq [[[ 919 1330 1787 884 491 15 1583 778 410 1142 549 404 855 1867
1089 1882]]] (1, 1, 16) int64
2026-04-30 19:26:09.551 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-55 vq [868] (1,) int64
2026-04-30 19:26:09.578 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-56 vq-rvq [[[ 868 151 1170 94 967 1177 10 1010 1639 76 273 892 1009 605
1758 1864]]] (1, 1, 16) int64
2026-04-30 19:26:09.586 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-56 vq [1809] (1,) int64
2026-04-30 19:26:09.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-57 vq-rvq [[[1809 727 1843 955 328 791 155 832 827 1421 1138 750 1211 599
1106 137]]] (1, 1, 16) int64
2026-04-30 19:26:09.621 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-57 vq [1677] (1,) int64
2026-04-30 19:26:09.647 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-58 vq-rvq [[[1677 823 434 27 1196 1210 291 1787 283 744 1796 174 125 102
1249 1014]]] (1, 1, 16) int64
2026-04-30 19:26:09.655 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-58 vq [1922] (1,) int64
2026-04-30 19:26:09.682 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-59 vq-rvq [[[1922 1116 581 812 299 514 695 633 1190 1884 477 561 948 560
350 200]]] (1, 1, 16) int64
2026-04-30 19:26:09.690 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-59 vq [1036] (1,) int64
2026-04-30 19:26:09.717 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-60 vq-rvq [[[1036 1302 555 102 254 2009 804 750 260 355 1752 874 77 335
158 1042]]] (1, 1, 16) int64
2026-04-30 19:26:09.725 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-60 vq [1739] (1,) int64
2026-04-30 19:26:09.752 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-61 vq-rvq [[[1739 614 139 589 937 390 1428 1264 1149 1208 385 1302 52 1617
132 123]]] (1, 1, 16) int64
2026-04-30 19:26:09.760 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-61 vq [2150] (1,) int64
2026-04-30 19:26:09.760 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 chunk_tokens [[[1845 1053 1032 919]
[1716 1199 409 1330]
[2038 861 801 1787]
[1642 1987 1855 884]
[ 825 457 1183 491]
[1307 294 553 15]
[1284 523 1931 1583]
[ 751 727 498 778]
[1099 1090 305 410]
[1860 125 1226 1142]
[ 596 1080 1015 549]
[ 77 885 1981 404]
[1422 746 584 855]
[ 923 922 1033 1867]
[ 730 1087 365 1089]
[ 593 207 1428 1882]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:09.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 wav [[[-0.07561389 -0.03827108 0.00077153 ... 0.05170149 0.01008281
-0.01854178]]] -0.3299378752708435 6.148191459942609e-05 0.0932779535651207 0.4610540270805359 (1, 1, 7680)
2026-04-30 19:26:09.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 chunk_tokens [[[ 868 1809 1677 1922]
[ 151 727 823 1116]
[1170 1843 434 581]
[ 94 955 27 812]
[ 967 328 1196 299]
[1177 791 1210 514]
[ 10 155 291 695]
[1010 832 1787 633]
[1639 827 283 1190]
[ 76 1421 744 1884]
[ 273 1138 1796 477]
[ 892 750 174 561]
[1009 1211 125 948]
[ 605 599 102 560]
[1758 1106 1249 350]
[1864 137 1014 200]]] (1, 16, 4) n_chunk_frames 4
2026-04-30 19:26:09.808 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 wav [[[-0.01794823 0.02109164 0.07580939 ... -0.00013498 0.00663236
-0.00233094]]] -0.24763914942741394 6.338774983305484e-05 0.05173063650727272 0.2930958867073059 (1, 1, 7680)
2026-04-30 19:26:09.808 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-40 chunk_tokens [[[1036 1739]
[1302 614]
[ 555 139]
[ 102 589]
[ 254 937]
[2009 390]
[ 804 1428]
[ 750 1264]
[ 260 1149]
[ 355 1208]
[1752 385]
[ 874 1302]
[ 77 52]
[ 335 1617]
[ 158 132]
[1042 123]]] (1, 16, 2) n_chunk_frames 2
2026-04-30 19:26:09.874 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-40 wav [[[-1.92377660e-02 -3.73278069e-03 1.66180078e-02 ... 1.14267914e-05
1.12166836e-05 1.08007425e-05]]] -0.08614496886730194 9.791910088097211e-06 0.01625766046345234 0.1096140667796135 (1, 1, 3840)
2026-04-30 19:26:09.874 [INFO] __main__: Synthesis complete: 24.32 s audio in 14.51 s (RTF=0.597)
2026-04-30 19:26:09.876 [INFO] __main__: Wrote audio_synth/output_1777577155.366709.wav (24.32 s, 24000 Hz)