Qwen3-TTS-Streaming-ONNX / logs /log_test-streaming-onnx-cudagraphcompat-g5-xlarge-male-petergriffin-continuous-streaming-codec-last-chunk-dynamic-1.txt
| [0;93m2026-04-30 19:25:37.962911883 [W:onnxruntime:Default, device_discovery.cc:325 DiscoverDevicesForPlatform] GPU device discovery failed: device_discovery.cc:92 ReadFileContents Failed to open file: "/sys/class/drm/card0/device/vendor"[m | |
| None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used. | |
| None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used. | |
| 2026-04-30 19:25:39.059 [INFO] __main__: Building inferencer... | |
| 2026-04-30 19:25:39.059 [INFO] src.inference.qwen3_tts_inferencer_onnx: Loading ONNX sessions... | |
| 2026-04-30 19:25:39.059 [INFO] src.inference.qwen3_tts_inferencer_onnx: talker prefill <- ./qwen3-tts_onnx/talker_model_prefill.onnx | |
| 2026-04-30 19:25:47.420 [INFO] src.inference.qwen3_tts_inferencer_onnx: local prefill <- ./qwen3-tts_onnx/talker_local_model_prefill.onnx | |
| 2026-04-30 19:25:47.581 [INFO] src.inference.qwen3_tts_inferencer_onnx: talker step <- ./qwen3-tts_onnx/talker_model_step.onnx | |
| 2026-04-30 19:25:48.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: local step <- ./qwen3-tts_onnx/talker_local_model_step.onnx | |
| 2026-04-30 19:25:48.746 [INFO] src.inference.qwen3_tts_inferencer_onnx: local lm_head <- ./qwen3-tts_onnx/talker_local_lm_head.onnx | |
| 2026-04-30 19:25:48.866 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec decoder <- ./qwen3-tts_onnx/codec_decoder_model.onnx | |
| 2026-04-30 19:25:49.201 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec decoder dynamic chunks <- ./qwen3-tts_onnx/codec_decoder_model_dynamic_chunks.onnx | |
| 2026-04-30 19:25:49.840 [INFO] src.inference.qwen3_tts_inferencer_onnx: speaker encoder <- ./qwen3-tts_onnx/speaker_encoder_model.onnx | |
| [0;93m2026-04-30 19:25:49.895600752 [W:onnxruntime:, transformer_memcpy.cc:111 ApplyImpl] 3 Memcpy nodes are added to the graph main_graph for CUDAExecutionProvider. It might have negative impact on performance (including unable to run CUDA graph). Set session_options.log_severity_level=1 to see the detail logs before this message.[m | |
| 2026-04-30 19:25:49.928 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec embed <- ./qwen3-tts_onnx/talker_codec_embed_model.onnx | |
| 2026-04-30 19:25:50.060 [INFO] src.inference.qwen3_tts_inferencer_onnx: text embed proj <- ./qwen3-tts_onnx/text_embed_proj_model.onnx | |
| 2026-04-30 19:25:52.605 [INFO] src.inference.qwen3_tts_inferencer_onnx: [OK] All ONNX sessions loaded. | |
| 2026-04-30 19:25:53.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: Allocating device KV-cache buffers... | |
| 2026-04-30 19:25:53.382 [INFO] src.inference.qwen3_tts_inferencer_onnx: IOBinding wired for all models (prefill + step). | |
| 2026-04-30 19:25:53.382 [INFO] src.inference.qwen3_tts_inferencer_onnx: Allocating device KV-cache buffer of codec decoder... | |
| 2026-04-30 19:25:53.384 [INFO] __main__: Running 50 warmup iteration(s)... | |
| 2026-04-30 19:25:53.401 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up speaker encoder... | |
| 2026-04-30 19:25:53.703 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run speaker encoder in 0.29 s. --> 5.89 ms. per run. | |
| 2026-04-30 19:25:53.703 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up text embed proj.... | |
| 2026-04-30 19:25:53.714 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run text embed proj. in 0.01 s. --> 0.22 ms. per run. | |
| 2026-04-30 19:25:53.714 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up talker prefill... | |
| 2026-04-30 19:25:54.187 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run talker prefill in 0.47 s. --> 9.44 ms. per run. | |
| 2026-04-30 19:25:54.188 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up talker step... | |
| 2026-04-30 19:25:54.577 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run talker step in 0.39 s. --> 7.76 ms. per run. | |
| 2026-04-30 19:25:54.577 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up local talker prefill... | |
| 2026-04-30 19:25:54.645 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run local talker prefill in 0.07 s. --> 1.36 ms. per run. | |
| 2026-04-30 19:25:54.645 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up local talker step... | |
| 2026-04-30 19:25:54.702 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run local talker step in 0.06 s. --> 1.13 ms. per run. | |
| 2026-04-30 19:25:54.702 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up local talker batched lm_head... | |
| 2026-04-30 19:25:54.719 [INFO] src.inference.qwen3_tts_inferencer_onnx: 50 iter. run local batched lm_head in 0.02 s. --> 0.34 ms. per run. | |
| 2026-04-30 19:25:54.719 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up codec decoder... | |
| 2026-04-30 19:25:55.116 [INFO] src.inference.qwen3_tts_inferencer_onnx: 12 iter. run codec_decoder in 0.40 s. --> 32.94 ms. per run. | |
| 2026-04-30 19:25:55.116 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warming-up codec decoder with dynamic chunk frames (n=2)... | |
| 2026-04-30 19:25:55.337 [INFO] src.inference.qwen3_tts_inferencer_onnx: 6 iter. run codec_decoder_dynamic in 0.21 s. --> 34.23 ms. per run. | |
| 2026-04-30 19:25:55.338 [INFO] src.inference.qwen3_tts_inferencer_onnx: Warmup latency summary: | |
| 2026-04-30 19:25:55.338 [INFO] src.inference.qwen3_tts_inferencer_onnx: speaker_encoder | |
| 2026-04-30 19:25:55.338 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=5.89 ms. | |
| 2026-04-30 19:25:55.338 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=29.17 ms. | |
| 2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=1.71 ms. | |
| 2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=1.91 ms. | |
| 2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=1.67 ms. | |
| 2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=210.07 ms. | |
| 2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: text_embed_proj | |
| 2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=0.22 ms. | |
| 2026-04-30 19:25:55.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=0.71 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=0.12 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=0.14 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=0.11 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=5.16 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: talker_prefill | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=9.44 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=5.57 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=8.64 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=8.66 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=8.63 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=48.44 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: talker_step | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=7.76 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=3.35 ms. | |
| 2026-04-30 19:25:55.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=7.27 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=7.29 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=7.27 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=31.22 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: local_prefill | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=1.36 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=1.00 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=1.21 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=1.23 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=1.21 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=8.33 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: local_step | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=1.13 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=0.63 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=1.04 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=1.06 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=1.04 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=5.51 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: local_lm_head | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=0.34 ms. | |
| 2026-04-30 19:25:55.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=0.21 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=0.30 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=0.32 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=0.30 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=1.83 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec_decoder | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=32.94 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=30.58 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=23.72 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=73.52 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=23.70 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=134.37 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec_decoder_dynamic | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: mean=34.23 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: std=16.02 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: median=27.11 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: p95=59.33 ms. | |
| 2026-04-30 19:25:55.347 [INFO] src.inference.qwen3_tts_inferencer_onnx: min=26.95 ms. | |
| 2026-04-30 19:25:55.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: max=70.06 ms. | |
| 2026-04-30 19:25:55.366 [INFO] __main__: Warmup complete in 1.98 s | |
| 2026-04-30 19:25:55.366 [INFO] __main__: speaker_encoder mean=5.89 ms min=1.67 ms max=210.07 ms | |
| 2026-04-30 19:25:55.366 [INFO] __main__: text_embed_proj mean=0.22 ms min=0.11 ms max=5.16 ms | |
| 2026-04-30 19:25:55.366 [INFO] __main__: talker_prefill mean=9.44 ms min=8.63 ms max=48.44 ms | |
| 2026-04-30 19:25:55.366 [INFO] __main__: talker_step mean=7.76 ms min=7.27 ms max=31.22 ms | |
| 2026-04-30 19:25:55.366 [INFO] __main__: local_prefill mean=1.36 ms min=1.21 ms max=8.33 ms | |
| 2026-04-30 19:25:55.366 [INFO] __main__: local_step mean=1.13 ms min=1.04 ms max=5.51 ms | |
| 2026-04-30 19:25:55.366 [INFO] __main__: local_lm_head mean=0.34 ms min=0.30 ms max=1.83 ms | |
| 2026-04-30 19:25:55.366 [INFO] __main__: codec_decoder mean=32.94 ms min=23.70 ms max=134.37 ms | |
| 2026-04-30 19:25:55.366 [INFO] __main__: codec_decoder_dynamic mean=34.23 ms min=26.95 ms max=70.06 ms | |
| 2026-04-30 19:25:55.366 [INFO] __main__: Synthesising: 'В зависимости от ситуации,' | |
| 2026-04-30 19:25:55.366 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment В -> text_cache В | |
| 2026-04-30 19:25:55.366 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False | |
| 2026-04-30 19:25:55.366 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069 | |
| 2026-04-30 19:25:55.454 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076 | |
| 0.08690926]]] (1, 1, 1024) | |
| 2026-04-30 19:25:55.455 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]] | |
| 2026-04-30 19:25:55.460 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661]]] (1, 4, 1024) | |
| 2026-04-30 19:25:55.461 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 1, 1024) | |
| 2026-04-30 19:25:55.461 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661] | |
| [-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076 | |
| 0.08690926] | |
| [-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 6, 1024) | |
| 2026-04-30 19:25:55.461 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22 | |
| Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:25:55.462 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:25:55.462 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:25:55.463 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:25:55.463 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024) | |
| 2026-04-30 19:25:55.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036 | |
| -0.00767252]]] (1, 1, 1024) | |
| 2026-04-30 19:25:55.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528 | |
| 0.00424147]]] (1, 1, 1024) | |
| 2026-04-30 19:25:55.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724 | |
| -0.00170945] | |
| [ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198 | |
| 0.00132705] | |
| [ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966 | |
| 0.0080104 ] | |
| [ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711 | |
| 0.00252486] | |
| [-0.02064589 0.05184897 0.01909059 ... 0.2070941 0.06416605 | |
| 0.09115074] | |
| [ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459 | |
| -0.00718043]]] (1, 6, 1024) | |
| 2026-04-30 19:25:55.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03] | |
| ... | |
| [ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03 | |
| -2.0710612e-04 2.5248611e-03] | |
| [-2.0645889e-02 5.1848970e-02 1.9090585e-02 ... 2.0709410e-01 | |
| 6.4166047e-02 9.1150738e-02] | |
| [ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03 | |
| 3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024) | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=9; step_idx=0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache В | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment з -> text_cache В з | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache В за | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache В зав | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зави | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache В завис | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зависи | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache В зависим | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache В зависимо | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache В зависимос | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache В зависимост | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зависимости | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache В зависимости | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache В зависимости о | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache В зависимости от | |
| 2026-04-30 19:25:55.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache В зависимости от | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache В зависимости от с | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зависимости от си | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache В зависимости от сит | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment у -> text_cache В зависимости от ситу | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache В зависимости от ситуа | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ц -> text_cache В зависимости от ситуац | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зависимости от ситуаци | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache В зависимости от ситуации | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment , -> text_cache В зависимости от ситуации, | |
| 2026-04-30 19:25:55.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['В зависимости от ситуации,'] 26 | |
| Qwen3TTSProcessor __call__ text ['В зависимости от ситуации,'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 16206, 139133, 20264, 139367, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 16206, 139133, 20264, 139367, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 16206 139133 20264 139367 11]] (1, 5) | |
| 2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 16206 139133 20264 139367 11]] (1, 5) | |
| 2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment В зависимости от ситуации, 26 -> tokenized_segment [np.int64(16206), np.int64(139133), np.int64(20264), np.int64(139367), np.int64(11)] 5 | |
| 2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(16206), np.int64(139133), np.int64(20264), np.int64(139367), np.int64(11)] | |
| 2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(16206), np.int64(139133), np.int64(20264), np.int64(139367), np.int64(11)] 5 | |
| 2026-04-30 19:25:55.511 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 16206 -> pending_tokens [np.int64(139133), np.int64(20264), np.int64(139367), np.int64(11)] 4 | |
| 2026-04-30 19:25:55.520 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-0 vq [1995] (1,) int64 | |
| 2026-04-30 19:25:55.546 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-1 vq-rvq [[[1995 1184 373 530 1716 1105 654 43 2010 1217 605 123 317 1462 | |
| 1699 3]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.547 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 139133 -> pending_tokens [np.int64(20264), np.int64(139367), np.int64(11)] 3 | |
| 2026-04-30 19:25:55.554 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-1 vq [215] (1,) int64 | |
| 2026-04-30 19:25:55.582 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-2 vq-rvq [[[ 215 2031 69 995 246 1908 25 171 743 86 1076 170 1108 822 | |
| 1839 388]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.582 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 20264 -> pending_tokens [np.int64(139367), np.int64(11)] 2 | |
| 2026-04-30 19:25:55.590 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-2 vq [212] (1,) int64 | |
| 2026-04-30 19:25:55.617 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-3 vq-rvq [[[ 212 1924 1471 1414 363 964 970 1881 1504 1955 743 146 1514 1873 | |
| 715 1668]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.617 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 139367 -> pending_tokens [np.int64(11)] 1 | |
| 2026-04-30 19:25:55.625 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-3 vq [1181] (1,) int64 | |
| 2026-04-30 19:25:55.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-4 vq-rvq [[[1181 781 736 884 1164 698 185 1252 1700 781 194 204 2017 1909 | |
| 527 1807]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11 -> pending_tokens [] 0 | |
| 2026-04-30 19:25:55.660 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-4 vq [1985] (1,) int64 | |
| 2026-04-30 19:25:55.687 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-5 vq-rvq [[[1985 1534 810 1979 82 877 1300 14 632 532 1402 1117 36 609 | |
| 1145 381]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.687 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 chunk_tokens [[[1995 215 212 1181] | |
| [1184 2031 1924 781] | |
| [ 373 69 1471 736] | |
| [ 530 995 1414 884] | |
| [1716 246 363 1164] | |
| [1105 1908 964 698] | |
| [ 654 25 970 185] | |
| [ 43 171 1881 1252] | |
| [2010 743 1504 1700] | |
| [1217 86 1955 781] | |
| [ 605 1076 743 194] | |
| [ 123 170 146 204] | |
| [ 317 1108 1514 2017] | |
| [1462 822 1873 1909] | |
| [1699 1839 715 527] | |
| [ 3 388 1668 1807]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:55.711 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 wav [[[-0.02130234 -0.01856662 -0.01710658 ... 0.00041982 0.00062048 | |
| 0.0006307 ]]] -0.04178531840443611 -4.523760071606375e-05 0.0025097329635173082 0.023125281557440758 (1, 1, 7680) | |
| 2026-04-30 19:25:55.711 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0 | |
| 2026-04-30 19:25:55.711 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:25:55.712 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:55.712 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:25:55.712 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0 | |
| 2026-04-30 19:25:55.720 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-5 vq [1707] (1,) int64 | |
| 2026-04-30 19:25:55.747 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-6 vq-rvq [[[1707 693 1438 1778 1888 35 383 516 2047 112 209 788 1737 1693 | |
| 199 1732]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.755 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-6 vq [1813] (1,) int64 | |
| 2026-04-30 19:25:55.781 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-7 vq-rvq [[[1813 227 2024 1357 345 812 2033 209 1096 1946 1783 498 1173 455 | |
| 645 1191]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.789 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-7 vq [1538] (1,) int64 | |
| 2026-04-30 19:25:55.817 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-8 vq-rvq [[[1538 1161 1615 1403 360 71 554 681 366 355 1882 16 1045 1117 | |
| 1355 1482]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.825 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-8 vq [148] (1,) int64 | |
| 2026-04-30 19:25:55.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-9 vq-rvq [[[ 148 893 1196 10 450 205 232 763 1537 1662 715 214 1887 984 | |
| 663 1098]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.860 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-9 vq [1115] (1,) int64 | |
| 2026-04-30 19:25:55.887 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-10 vq-rvq [[[1115 941 1955 66 889 176 508 523 33 797 1159 104 2004 2014 | |
| 1058 97]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.895 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-10 vq [1634] (1,) int64 | |
| 2026-04-30 19:25:55.922 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-11 vq-rvq [[[1634 1377 103 417 313 1694 296 517 337 1534 22 639 350 566 | |
| 209 550]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.930 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-11 vq [741] (1,) int64 | |
| 2026-04-30 19:25:55.957 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-12 vq-rvq [[[ 741 1989 1230 1367 280 710 1525 1172 154 25 103 598 180 693 | |
| 1888 820]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:55.965 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-12 vq [383] (1,) int64 | |
| 2026-04-30 19:25:55.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-13 vq-rvq [[[ 383 1821 1276 517 1009 83 95 1703 1976 851 272 88 450 553 | |
| 1204 601]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.000 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-13 vq [1804] (1,) int64 | |
| 2026-04-30 19:25:56.026 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-14 vq-rvq [[[1804 1832 384 433 846 1121 1634 400 1673 1804 1287 1207 441 303 | |
| 1662 1780]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.034 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-14 vq [1559] (1,) int64 | |
| 2026-04-30 19:25:56.061 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-15 vq-rvq [[[1559 1891 1356 193 218 1831 1627 1440 1360 1612 1916 236 53 1547 | |
| 1488 663]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-15 vq [1196] (1,) int64 | |
| 2026-04-30 19:25:56.096 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-16 vq-rvq [[[1196 1806 1904 2005 1343 972 854 1496 344 1828 739 202 1252 1110 | |
| 615 242]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.104 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-16 vq [1847] (1,) int64 | |
| 2026-04-30 19:25:56.131 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-17 vq-rvq [[[1847 736 979 1857 987 1390 1821 742 182 1600 302 612 1492 1325 | |
| 1786 1697]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.139 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-17 vq [1808] (1,) int64 | |
| 2026-04-30 19:25:56.166 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-18 vq-rvq [[[1808 1514 377 81 1330 1807 911 751 1196 1979 1225 279 51 295 | |
| 873 1207]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.174 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-18 vq [704] (1,) int64 | |
| 2026-04-30 19:25:56.201 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-19 vq-rvq [[[ 704 194 1040 784 1771 1472 15 1293 803 1473 515 853 620 1013 | |
| 639 1929]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.209 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-19 vq [152] (1,) int64 | |
| 2026-04-30 19:25:56.236 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-20 vq-rvq [[[ 152 1116 483 1511 720 1475 1680 624 1989 369 874 1312 1220 407 | |
| 412 1921]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.244 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-20 vq [151] (1,) int64 | |
| 2026-04-30 19:25:56.271 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-21 vq-rvq [[[ 151 700 1964 319 102 1643 610 1585 142 898 1752 583 465 321 | |
| 1961 366]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.279 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-21 vq [1647] (1,) int64 | |
| 2026-04-30 19:25:56.306 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-22 vq-rvq [[[1647 1228 933 1442 253 736 411 164 884 1352 861 76 1259 953 | |
| 163 1696]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.314 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-22 vq [1456] (1,) int64 | |
| 2026-04-30 19:25:56.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-23 vq-rvq [[[1456 1194 785 1544 1137 1555 485 342 209 939 1043 1447 144 139 | |
| 7 491]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-23 vq [255] (1,) int64 | |
| 2026-04-30 19:25:56.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-24 vq-rvq [[[ 255 613 1951 458 1083 232 18 1309 1482 340 1365 299 855 1048 | |
| 1142 631]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.384 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-24 vq [308] (1,) int64 | |
| 2026-04-30 19:25:56.411 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-25 vq-rvq [[[ 308 637 1759 1532 800 982 187 1982 2035 1442 924 1389 417 75 | |
| 521 294]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.419 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-25 vq [2019] (1,) int64 | |
| 2026-04-30 19:25:56.446 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-26 vq-rvq [[[2019 1990 1151 1146 323 403 1846 1922 15 402 584 321 1112 117 | |
| 1233 680]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.454 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-26 vq [360] (1,) int64 | |
| 2026-04-30 19:25:56.481 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-27 vq-rvq [[[ 360 340 387 549 302 1103 275 881 508 631 1454 1490 1060 590 | |
| 1900 741]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.489 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-27 vq [1065] (1,) int64 | |
| 2026-04-30 19:25:56.515 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-28 vq-rvq [[[1065 415 1100 805 1178 1776 311 1055 1620 321 430 1208 392 1616 | |
| 1286 1179]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.523 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-28 vq [1624] (1,) int64 | |
| 2026-04-30 19:25:56.550 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-29 vq-rvq [[[1624 382 180 1829 178 284 1352 149 1098 1458 1780 1820 1222 1886 | |
| 434 203]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.558 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-29 vq [1910] (1,) int64 | |
| 2026-04-30 19:25:56.585 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-30 vq-rvq [[[1910 667 14 1070 1092 616 1321 709 1680 1654 1346 223 1017 1268 | |
| 1009 302]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.593 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-30 vq [1353] (1,) int64 | |
| 2026-04-30 19:25:56.620 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-31 vq-rvq [[[1353 682 1006 1670 918 1794 1861 313 1162 1001 649 1077 493 1799 | |
| 1988 1823]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.628 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-31 vq [1961] (1,) int64 | |
| 2026-04-30 19:25:56.655 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-32 vq-rvq [[[1961 543 1399 1336 1030 143 836 1569 1803 50 970 545 1315 1445 | |
| 1755 625]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.663 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-32 vq [1931] (1,) int64 | |
| 2026-04-30 19:25:56.690 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-33 vq-rvq [[[1931 1572 1054 629 1854 2036 761 1641 192 1589 324 437 1713 724 | |
| 1306 1534]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.698 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-33 vq [1945] (1,) int64 | |
| 2026-04-30 19:25:56.725 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-34 vq-rvq [[[1945 1838 293 191 76 187 305 421 882 1308 1583 439 155 288 | |
| 203 1624]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:56.733 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-34 vq [2150] (1,) int64 | |
| 2026-04-30 19:25:56.733 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 chunk_tokens [[[1985 1707 1813 1538] | |
| [1534 693 227 1161] | |
| [ 810 1438 2024 1615] | |
| [1979 1778 1357 1403] | |
| [ 82 1888 345 360] | |
| [ 877 35 812 71] | |
| [1300 383 2033 554] | |
| [ 14 516 209 681] | |
| [ 632 2047 1096 366] | |
| [ 532 112 1946 355] | |
| [1402 209 1783 1882] | |
| [1117 788 498 16] | |
| [ 36 1737 1173 1045] | |
| [ 609 1693 455 1117] | |
| [1145 199 645 1355] | |
| [ 381 1732 1191 1482]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:56.757 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 wav [[[ 0.00029411 -0.00040776 -0.00044942 ... -0.02424868 0.02291245 | |
| 0.05937432]]] -0.35627102851867676 4.4474294554675e-05 0.042314205318689346 0.3049390912055969 (1, 1, 7680) | |
| 2026-04-30 19:25:56.757 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 chunk_tokens [[[ 148 1115 1634 741] | |
| [ 893 941 1377 1989] | |
| [1196 1955 103 1230] | |
| [ 10 66 417 1367] | |
| [ 450 889 313 280] | |
| [ 205 176 1694 710] | |
| [ 232 508 296 1525] | |
| [ 763 523 517 1172] | |
| [1537 33 337 154] | |
| [1662 797 1534 25] | |
| [ 715 1159 22 103] | |
| [ 214 104 639 598] | |
| [1887 2004 350 180] | |
| [ 984 2014 566 693] | |
| [ 663 1058 209 1888] | |
| [1098 97 550 820]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:56.782 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 wav [[[ 0.07660156 0.07495726 0.06135209 ... -0.1206022 -0.12184623 | |
| -0.1139332 ]]] -0.28353917598724365 7.324956641241442e-06 0.0670274943113327 0.2517559826374054 (1, 1, 7680) | |
| 2026-04-30 19:25:56.782 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 chunk_tokens [[[ 383 1804 1559 1196] | |
| [1821 1832 1891 1806] | |
| [1276 384 1356 1904] | |
| [ 517 433 193 2005] | |
| [1009 846 218 1343] | |
| [ 83 1121 1831 972] | |
| [ 95 1634 1627 854] | |
| [1703 400 1440 1496] | |
| [1976 1673 1360 344] | |
| [ 851 1804 1612 1828] | |
| [ 272 1287 1916 739] | |
| [ 88 1207 236 202] | |
| [ 450 441 53 1252] | |
| [ 553 303 1547 1110] | |
| [1204 1662 1488 615] | |
| [ 601 1780 663 242]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:56.806 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 wav [[[-0.10050648 -0.08953431 -0.07884923 ... -0.01869578 -0.0167346 | |
| -0.01763956]]] -0.2835456132888794 4.1264713217969984e-05 0.06424345821142197 0.3513103127479553 (1, 1, 7680) | |
| 2026-04-30 19:25:56.806 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 chunk_tokens [[[1847 1808 704 152] | |
| [ 736 1514 194 1116] | |
| [ 979 377 1040 483] | |
| [1857 81 784 1511] | |
| [ 987 1330 1771 720] | |
| [1390 1807 1472 1475] | |
| [1821 911 15 1680] | |
| [ 742 751 1293 624] | |
| [ 182 1196 803 1989] | |
| [1600 1979 1473 369] | |
| [ 302 1225 515 874] | |
| [ 612 279 853 1312] | |
| [1492 51 620 1220] | |
| [1325 295 1013 407] | |
| [1786 873 639 412] | |
| [1697 1207 1929 1921]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:56.830 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 wav [[[-1.2177158e-02 -6.4980479e-05 1.2000869e-02 ... -4.9953014e-03 | |
| 2.0064995e-02 8.1494255e-03]]] -0.3423512578010559 6.946954817976803e-05 0.03836448863148689 0.43560561537742615 (1, 1, 7680) | |
| 2026-04-30 19:25:56.831 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 chunk_tokens [[[ 151 1647 1456 255] | |
| [ 700 1228 1194 613] | |
| [1964 933 785 1951] | |
| [ 319 1442 1544 458] | |
| [ 102 253 1137 1083] | |
| [1643 736 1555 232] | |
| [ 610 411 485 18] | |
| [1585 164 342 1309] | |
| [ 142 884 209 1482] | |
| [ 898 1352 939 340] | |
| [1752 861 1043 1365] | |
| [ 583 76 1447 299] | |
| [ 465 1259 144 855] | |
| [ 321 953 139 1048] | |
| [1961 163 7 1142] | |
| [ 366 1696 491 631]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:56.855 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 wav [[[-0.03188938 -0.00509401 0.04241933 ... -0.09476525 -0.18832558 | |
| -0.23867904]]] -0.35616523027420044 0.00012159249308751896 0.08303991705179214 0.28495997190475464 (1, 1, 7680) | |
| 2026-04-30 19:25:56.855 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 chunk_tokens [[[ 308 2019 360 1065] | |
| [ 637 1990 340 415] | |
| [1759 1151 387 1100] | |
| [1532 1146 549 805] | |
| [ 800 323 302 1178] | |
| [ 982 403 1103 1776] | |
| [ 187 1846 275 311] | |
| [1982 1922 881 1055] | |
| [2035 15 508 1620] | |
| [1442 402 631 321] | |
| [ 924 584 1454 430] | |
| [1389 321 1490 1208] | |
| [ 417 1112 1060 392] | |
| [ 75 117 590 1616] | |
| [ 521 1233 1900 1286] | |
| [ 294 680 741 1179]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:56.879 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 wav [[[-0.2519588 -0.24120857 -0.2249308 ... -0.00908731 -0.00565482 | |
| -0.00478506]]] -0.302659809589386 -0.0002039571845671162 0.06957393139600754 0.3183087110519409 (1, 1, 7680) | |
| 2026-04-30 19:25:56.879 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 chunk_tokens [[[1624 1910 1353 1961] | |
| [ 382 667 682 543] | |
| [ 180 14 1006 1399] | |
| [1829 1070 1670 1336] | |
| [ 178 1092 918 1030] | |
| [ 284 616 1794 143] | |
| [1352 1321 1861 836] | |
| [ 149 709 313 1569] | |
| [1098 1680 1162 1803] | |
| [1458 1654 1001 50] | |
| [1780 1346 649 970] | |
| [1820 223 1077 545] | |
| [1222 1017 493 1315] | |
| [1886 1268 1799 1445] | |
| [ 434 1009 1988 1755] | |
| [ 203 302 1823 625]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:56.903 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 wav [[[-4.7078328e-03 7.2684824e-03 2.4840837e-02 ... -1.4027000e-05 | |
| 1.5263325e-04 1.7792435e-04]]] -0.1658807247877121 0.00014102911518421024 0.03195255622267723 0.18852373957633972 (1, 1, 7680) | |
| 2026-04-30 19:25:56.903 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 chunk_tokens [[[1931 1945] | |
| [1572 1838] | |
| [1054 293] | |
| [ 629 191] | |
| [1854 76] | |
| [2036 187] | |
| [ 761 305] | |
| [1641 421] | |
| [ 192 882] | |
| [1589 1308] | |
| [ 324 1583] | |
| [ 437 439] | |
| [1713 155] | |
| [ 724 288] | |
| [1306 203] | |
| [1534 1624]]] (1, 16, 2) n_chunk_frames 2 | |
| 2026-04-30 19:25:56.934 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 wav [[[1.19311335e-04 2.77099258e-04 4.16864146e-04 ... 1.06179923e-05 | |
| 1.06252701e-05 1.15810089e-05]]] -0.001969335600733757 3.6782610550289974e-05 0.0005604626494459808 0.0020639824215322733 (1, 1, 3840) | |
| 2026-04-30 19:25:56.934 [INFO] __main__: Synthesising: 'важна не только точность,' | |
| 2026-04-30 19:25:56.934 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache в | |
| 2026-04-30 19:25:56.934 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False | |
| 2026-04-30 19:25:56.938 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list [array([[[0. , 0. , 0. , ..., 0.02545166, | |
| 0.01660156, 0.00424194]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00057983, -0.00170898, -0.00448608, ..., -0.0769043 , | |
| -0.06759644, -0.04257202]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00872803, 0.01107788, 0.00918579, ..., 0.01818848, | |
| 0.02148438, 0.00485229]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00686646, -0.01239014, -0.02319336, ..., -0.06646729, | |
| -0.11431885, -0.15585327]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.19403076, -0.21664429, -0.21463013, ..., -0.02148438, | |
| 0.00299072, 0.02600098]]], shape=(1, 1, 7680), dtype=float32), array([[[0.05737305, 0.08822632, 0.10968018, ..., 0.04669189, | |
| 0.02362061, 0.01470947]]], shape=(1, 1, 7680), dtype=float32), array([[[0.02764893, 0.04623413, 0.0713501 , ..., 0.27127075, | |
| 0.32421875, 0.34362793]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.3463745 , 0.3418274 , 0.31503296, ..., -0.00198364, | |
| -0.00198364, -0.00189209]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00192261, -0.00183105, -0.00143433, ..., 0.03048706, | |
| 0.04208374, 0.03811646]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02389526, 0.00814819, -0.00369263, ..., -0.00463867, | |
| -0.00466919, -0.00515747]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00616455, -0.00744629, -0.00830078, ..., -0.03097534, | |
| -0.05169678, -0.03753662]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00628662, -0.0045166 , -0.01385498, ..., 0.03604126, | |
| 0.01898193, -0.02606201]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.07327271, -0.0708313 , -0.0380249 , ..., -0.00189209, | |
| -0.00308228, -0.00543213]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00762939, -0.00808716, -0.0062561 , ..., -0.04867554, | |
| -0.06396484, -0.07067871]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.06478882, -0.04742432, -0.02655029, ..., -0.00927734, | |
| -0.00787354, -0.01217651]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01885986, -0.02545166, -0.02856445, ..., -0.05807495, | |
| -0.03890991, -0.02404785]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01531982, -0.01760864, -0.02178955, ..., 0.02804565, | |
| 0.02838135, 0.02767944]]], shape=(1, 1, 7680), dtype=float32), array([[[0.02700806, 0.02609253, 0.02459717, ..., 0.02215576, | |
| 0.02230835, 0.02636719]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.03475952, 0.03826904, 0.02764893, ..., 0.01647949, | |
| -0.01455688, -0.00036621]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00704956, -0.03173828, -0.06103516, ..., 0.00976562, | |
| 0.01080322, 0.00741577]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00210571, -0.00189209, -0.00598145, ..., 0.0350647 , | |
| 0.03173828, 0.01358032]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00378418, -0.025177 , -0.04141235, ..., -0.00460815, | |
| 0.00967407, 0.01904297]]], shape=(1, 1, 7680), dtype=float32), array([[[ 2.5421143e-02, 3.4332275e-02, 4.8004150e-02, ..., | |
| 6.4086914e-04, 3.0517578e-05, -7.6293945e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.00106812, -0.00131226, -0.00180054, ..., -0.00238037, | |
| -0.00210571, -0.00195312]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00131226, -0.00048828, -0.00064087, ..., -0.12442017, | |
| -0.13143921, -0.15240479]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.17025757, -0.16925049, -0.14294434, ..., 0.00350952, | |
| 0.00283813, 0.00177002]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00201416, 0.003479 , 0.00323486, ..., -0.02636719, | |
| -0.02493286, 0.00787354]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04818726, 0.05957031, 0.03213501, ..., -0.11203003, | |
| -0.09613037, -0.09103394]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.09631348, -0.10897827, -0.12399292, ..., -0.00085449, | |
| -0.00091553, -0.00048828]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.0000000e+00, 6.1035156e-05, -1.2207031e-04, ..., | |
| 1.3381958e-01, 1.6635132e-01, 2.0919800e-01]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 2.3223877e-01, 2.0669556e-01, 1.3903809e-01, ..., | |
| -1.8310547e-04, -1.5258789e-04, -9.1552734e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-9.1552734e-05, -6.1035156e-05, -3.0517578e-05, ..., | |
| 0.0000000e+00, -3.0517578e-05, 0.0000000e+00]]], | |
| shape=(1, 1, 5339), dtype=float32), array([[[-0.02130234, -0.01856662, -0.01710658, ..., 0.00041982, | |
| 0.00062048, 0.0006307 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00029411, -0.00040776, -0.00044942, ..., -0.02424868, | |
| 0.02291245, 0.05937432]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.07660156, 0.07495726, 0.06135209, ..., -0.1206022 , | |
| -0.12184623, -0.1139332 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10050648, -0.08953431, -0.07884923, ..., -0.01869578, | |
| -0.0167346 , -0.01763956]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2177158e-02, -6.4980479e-05, 1.2000869e-02, ..., | |
| -4.9953014e-03, 2.0064995e-02, 8.1494255e-03]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03188938, -0.00509401, 0.04241933, ..., -0.09476525, | |
| -0.18832558, -0.23867904]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.2519588 , -0.24120857, -0.2249308 , ..., -0.00908731, | |
| -0.00565482, -0.00478506]]], shape=(1, 1, 7680), dtype=float32), array([[[-4.7078328e-03, 7.2684824e-03, 2.4840837e-02, ..., | |
| -1.4027000e-05, 1.5263325e-04, 1.7792435e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[1.19311335e-04, 2.77099258e-04, 4.16864146e-04, ..., | |
| 1.06179923e-05, 1.06252701e-05, 1.15810089e-05]]], | |
| shape=(1, 1, 3840), dtype=float32)] 41 | |
| 2026-04-30 19:25:56.938 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history [0.0000000e+00 0.0000000e+00 0.0000000e+00 ... 1.0617992e-05 1.0625270e-05 | |
| 1.1581009e-05] (308699,) float32 | |
| 2026-04-30 19:25:56.939 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history_after cut_idx 16 [-1.5319824e-02 -1.7608643e-02 -2.1789551e-02 ... 1.0617992e-05 | |
| 1.0625270e-05 1.1581009e-05] (185819,) float32 | |
| 2026-04-30 19:25:56.941 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list_after cut_idx 16 [array([[[-0.01531982, -0.01760864, -0.02178955, ..., 0.02804565, | |
| 0.02838135, 0.02767944]]], shape=(1, 1, 7680), dtype=float32), array([[[0.02700806, 0.02609253, 0.02459717, ..., 0.02215576, | |
| 0.02230835, 0.02636719]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.03475952, 0.03826904, 0.02764893, ..., 0.01647949, | |
| -0.01455688, -0.00036621]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00704956, -0.03173828, -0.06103516, ..., 0.00976562, | |
| 0.01080322, 0.00741577]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00210571, -0.00189209, -0.00598145, ..., 0.0350647 , | |
| 0.03173828, 0.01358032]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00378418, -0.025177 , -0.04141235, ..., -0.00460815, | |
| 0.00967407, 0.01904297]]], shape=(1, 1, 7680), dtype=float32), array([[[ 2.5421143e-02, 3.4332275e-02, 4.8004150e-02, ..., | |
| 6.4086914e-04, 3.0517578e-05, -7.6293945e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.00106812, -0.00131226, -0.00180054, ..., -0.00238037, | |
| -0.00210571, -0.00195312]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00131226, -0.00048828, -0.00064087, ..., -0.12442017, | |
| -0.13143921, -0.15240479]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.17025757, -0.16925049, -0.14294434, ..., 0.00350952, | |
| 0.00283813, 0.00177002]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00201416, 0.003479 , 0.00323486, ..., -0.02636719, | |
| -0.02493286, 0.00787354]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04818726, 0.05957031, 0.03213501, ..., -0.11203003, | |
| -0.09613037, -0.09103394]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.09631348, -0.10897827, -0.12399292, ..., -0.00085449, | |
| -0.00091553, -0.00048828]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.0000000e+00, 6.1035156e-05, -1.2207031e-04, ..., | |
| 1.3381958e-01, 1.6635132e-01, 2.0919800e-01]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 2.3223877e-01, 2.0669556e-01, 1.3903809e-01, ..., | |
| -1.8310547e-04, -1.5258789e-04, -9.1552734e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-9.1552734e-05, -6.1035156e-05, -3.0517578e-05, ..., | |
| 0.0000000e+00, -3.0517578e-05, 0.0000000e+00]]], | |
| shape=(1, 1, 5339), dtype=float32), array([[[-0.02130234, -0.01856662, -0.01710658, ..., 0.00041982, | |
| 0.00062048, 0.0006307 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00029411, -0.00040776, -0.00044942, ..., -0.02424868, | |
| 0.02291245, 0.05937432]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.07660156, 0.07495726, 0.06135209, ..., -0.1206022 , | |
| -0.12184623, -0.1139332 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10050648, -0.08953431, -0.07884923, ..., -0.01869578, | |
| -0.0167346 , -0.01763956]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2177158e-02, -6.4980479e-05, 1.2000869e-02, ..., | |
| -4.9953014e-03, 2.0064995e-02, 8.1494255e-03]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03188938, -0.00509401, 0.04241933, ..., -0.09476525, | |
| -0.18832558, -0.23867904]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.2519588 , -0.24120857, -0.2249308 , ..., -0.00908731, | |
| -0.00565482, -0.00478506]]], shape=(1, 1, 7680), dtype=float32), array([[[-4.7078328e-03, 7.2684824e-03, 2.4840837e-02, ..., | |
| -1.4027000e-05, 1.5263325e-04, 1.7792435e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[1.19311335e-04, 2.77099258e-04, 4.16864146e-04, ..., | |
| 1.06179923e-05, 1.06252701e-05, 1.15810089e-05]]], | |
| shape=(1, 1, 3840), dtype=float32)] 25 | |
| 2026-04-30 19:25:56.941 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069 | |
| 2026-04-30 19:25:57.015 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[ 0.00643774 0.07635596 -0.06491913 ... 0.20177338 0.0492254 | |
| 0.11219472]]] (1, 1, 1024) | |
| 2026-04-30 19:25:57.015 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]] | |
| 2026-04-30 19:25:57.015 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661]]] (1, 4, 1024) | |
| 2026-04-30 19:25:57.015 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 1, 1024) | |
| 2026-04-30 19:25:57.016 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661] | |
| [ 0.00643774 0.07635596 -0.06491913 ... 0.20177338 0.0492254 | |
| 0.11219472] | |
| [-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 6, 1024) | |
| 2026-04-30 19:25:57.016 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22 | |
| Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:25:57.016 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:25:57.016 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:25:57.016 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:25:57.017 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024) | |
| 2026-04-30 19:25:57.017 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036 | |
| -0.00767252]]] (1, 1, 1024) | |
| 2026-04-30 19:25:57.017 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528 | |
| 0.00424147]]] (1, 1, 1024) | |
| 2026-04-30 19:25:57.018 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724 | |
| -0.00170945] | |
| [ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198 | |
| 0.00132705] | |
| [ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966 | |
| 0.0080104 ] | |
| [ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711 | |
| 0.00252486] | |
| [ 0.01121592 0.07254998 -0.06661529 ... 0.19248903 0.05078068 | |
| 0.11643619] | |
| [ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459 | |
| -0.00718043]]] (1, 6, 1024) | |
| 2026-04-30 19:25:57.018 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03] | |
| ... | |
| [ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03 | |
| -2.0710612e-04 2.5248611e-03] | |
| [ 1.1215920e-02 7.2549976e-02 -6.6615291e-02 ... 1.9248903e-01 | |
| 5.0780680e-02 1.1643619e-01] | |
| [ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03 | |
| 3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024) | |
| 2026-04-30 19:25:57.064 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=53; step_idx=53 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill cont done; talker_seq_len=53; step_idx=53 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache ва | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ж -> text_cache важ | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache важн | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache важна | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache важна | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache важна н | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache важна не | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache важна не | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache важна не т | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache важна не то | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache важна не тол | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.100 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ь -> text_cache важна не толь | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache важна не тольк | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache важна не только | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache важна не только | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache важна не только т | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache важна не только то | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ч -> text_cache важна не только точ | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache важна не только точн | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache важна не только точно | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache важна не только точнос | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache важна не только точност | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ь -> text_cache важна не только точность | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment , -> text_cache важна не только точность, | |
| 2026-04-30 19:25:57.101 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['важна не только точность,'] 25 | |
| Qwen3TTSProcessor __call__ text ['важна не только точность,'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 5474, 37557, 14191, 18658, 73626, 81602, 60279, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 5474, 37557, 14191, 18658, 73626, 81602, 60279, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 5474 37557 14191 18658 73626 81602 60279 11]] (1, 8) | |
| 2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 5474 37557 14191 18658 73626 81602 60279 11]] (1, 8) | |
| 2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment важна не только точность, 25 -> tokenized_segment [np.int64(5474), np.int64(37557), np.int64(14191), np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 8 | |
| 2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(5474), np.int64(37557), np.int64(14191), np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] | |
| 2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(5474), np.int64(37557), np.int64(14191), np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 8 | |
| 2026-04-30 19:25:57.102 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 5474 -> pending_tokens [np.int64(37557), np.int64(14191), np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 7 | |
| 2026-04-30 19:25:57.111 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-53 vq [1221] (1,) int64 | |
| 2026-04-30 19:25:57.138 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-54 vq-rvq [[[1221 785 99 77 621 1441 1570 691 1793 241 1015 1149 1055 119 | |
| 320 197]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.138 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 37557 -> pending_tokens [np.int64(14191), np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 6 | |
| 2026-04-30 19:25:57.146 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-54 vq [2042] (1,) int64 | |
| 2026-04-30 19:25:57.173 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-55 vq-rvq [[[2042 636 1070 630 1799 1672 1718 418 284 1789 846 298 318 1460 | |
| 79 1745]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.173 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 14191 -> pending_tokens [np.int64(18658), np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 5 | |
| 2026-04-30 19:25:57.181 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-55 vq [1609] (1,) int64 | |
| 2026-04-30 19:25:57.208 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-56 vq-rvq [[[1609 1593 952 1154 1077 356 1416 120 767 526 958 484 1378 1280 | |
| 1096 285]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.208 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 18658 -> pending_tokens [np.int64(73626), np.int64(81602), np.int64(60279), np.int64(11)] 4 | |
| 2026-04-30 19:25:57.216 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-56 vq [480] (1,) int64 | |
| 2026-04-30 19:25:57.243 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-57 vq-rvq [[[ 480 241 72 1730 36 766 204 871 556 1875 153 84 1125 929 | |
| 152 503]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.243 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 73626 -> pending_tokens [np.int64(81602), np.int64(60279), np.int64(11)] 3 | |
| 2026-04-30 19:25:57.251 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-57 vq [1088] (1,) int64 | |
| 2026-04-30 19:25:57.278 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-58 vq-rvq [[[1088 845 884 1092 475 14 798 1783 877 1451 1300 1038 358 134 | |
| 181 299]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.278 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 81602 -> pending_tokens [np.int64(60279), np.int64(11)] 2 | |
| 2026-04-30 19:25:57.286 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-58 vq [1809] (1,) int64 | |
| 2026-04-30 19:25:57.313 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-59 vq-rvq [[[1809 727 1957 1783 1214 1163 458 1096 156 589 708 172 1909 1531 | |
| 897 1650]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.313 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 60279 -> pending_tokens [np.int64(11)] 1 | |
| 2026-04-30 19:25:57.321 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-59 vq [400] (1,) int64 | |
| 2026-04-30 19:25:57.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-60 vq-rvq [[[ 400 407 507 36 1051 711 505 1116 1786 854 359 797 507 1880 | |
| 392 245]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11 -> pending_tokens [] 0 | |
| 2026-04-30 19:25:57.356 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-60 vq [935] (1,) int64 | |
| 2026-04-30 19:25:57.383 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-61 vq-rvq [[[ 935 710 534 130 488 1388 405 849 667 1770 373 111 568 1076 | |
| 118 702]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.383 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-34 chunk_tokens [[[1221 2042 1609 480] | |
| [ 785 636 1593 241] | |
| [ 99 1070 952 72] | |
| [ 77 630 1154 1730] | |
| [ 621 1799 1077 36] | |
| [1441 1672 356 766] | |
| [1570 1718 1416 204] | |
| [ 691 418 120 871] | |
| [1793 284 767 556] | |
| [ 241 1789 526 1875] | |
| [1015 846 958 153] | |
| [1149 298 484 84] | |
| [1055 318 1378 1125] | |
| [ 119 1460 1280 929] | |
| [ 320 79 1096 152] | |
| [ 197 1745 285 503]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:57.407 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-34 wav [[[ 1.2349803e-05 1.2119761e-05 2.1108619e-05 ... -1.6870323e-01 | |
| -1.3621169e-01 -8.6433820e-02]]] -0.3643661439418793 -1.744547626003623e-05 0.06652440875768661 0.3390018343925476 (1, 1, 7680) | |
| 2026-04-30 19:25:57.408 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-38 chunk_tokens [[[1088 1809 400 935] | |
| [ 845 727 407 710] | |
| [ 884 1957 507 534] | |
| [1092 1783 36 130] | |
| [ 475 1214 1051 488] | |
| [ 14 1163 711 1388] | |
| [ 798 458 505 405] | |
| [1783 1096 1116 849] | |
| [ 877 156 1786 667] | |
| [1451 589 854 1770] | |
| [1300 708 359 373] | |
| [1038 172 797 111] | |
| [ 358 1909 507 568] | |
| [ 134 1531 1880 1076] | |
| [ 181 897 392 118] | |
| [ 299 1650 245 702]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-38 wav [[[-0.03330091 0.00856069 0.03467582 ... -0.04072727 -0.03181617 | |
| -0.00645593]]] -0.24222812056541443 -6.13010925007984e-05 0.060314808040857315 0.37109240889549255 (1, 1, 7680) | |
| 2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0 | |
| 2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:25:57.432 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0 | |
| 2026-04-30 19:25:57.440 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-61 vq [332] (1,) int64 | |
| 2026-04-30 19:25:57.467 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-62 vq-rvq [[[ 332 1414 379 982 1287 1805 17 1408 623 259 1493 294 1569 396 | |
| 1969 11]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.475 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-62 vq [178] (1,) int64 | |
| 2026-04-30 19:25:57.502 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-63 vq-rvq [[[ 178 740 609 1805 1484 74 1476 620 589 1698 1320 996 1777 1000 | |
| 1180 234]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.510 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-63 vq [303] (1,) int64 | |
| 2026-04-30 19:25:57.536 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-64 vq-rvq [[[ 303 1047 206 1652 1019 62 1193 889 169 371 367 872 1104 178 | |
| 30 57]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.544 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-64 vq [326] (1,) int64 | |
| 2026-04-30 19:25:57.571 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-65 vq-rvq [[[ 326 887 374 636 1607 977 350 1344 111 815 38 885 106 152 | |
| 257 1173]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.579 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-65 vq [494] (1,) int64 | |
| 2026-04-30 19:25:57.606 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-66 vq-rvq [[[ 494 666 1704 585 479 164 1123 637 573 1993 323 121 1551 1425 | |
| 818 225]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.614 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-66 vq [75] (1,) int64 | |
| 2026-04-30 19:25:57.640 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-67 vq-rvq [[[ 75 721 657 202 927 1645 1968 273 700 253 1295 1527 904 225 | |
| 1525 270]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.648 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-67 vq [875] (1,) int64 | |
| 2026-04-30 19:25:57.675 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-68 vq-rvq [[[ 875 1773 1275 1302 500 1192 603 596 198 346 178 874 815 670 | |
| 1284 1411]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.683 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-68 vq [612] (1,) int64 | |
| 2026-04-30 19:25:57.710 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-69 vq-rvq [[[ 612 92 1120 651 608 1207 2032 1069 553 746 1775 931 1844 1537 | |
| 280 953]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.718 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-69 vq [828] (1,) int64 | |
| 2026-04-30 19:25:57.745 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-70 vq-rvq [[[ 828 1200 369 1765 1204 443 1137 878 517 498 461 969 494 1761 | |
| 1729 1963]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.753 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-70 vq [357] (1,) int64 | |
| 2026-04-30 19:25:57.779 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-71 vq-rvq [[[ 357 273 0 1853 351 1318 736 11 271 430 748 889 782 1421 | |
| 1122 1022]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.787 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-71 vq [914] (1,) int64 | |
| 2026-04-30 19:25:57.814 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-72 vq-rvq [[[ 914 1809 636 1982 1328 1079 540 151 461 91 1194 521 1477 997 | |
| 1761 1225]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.822 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-72 vq [4] (1,) int64 | |
| 2026-04-30 19:25:57.849 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-73 vq-rvq [[[ 4 572 28 1722 860 112 163 690 410 775 1071 465 1230 1497 | |
| 266 1405]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.857 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-73 vq [759] (1,) int64 | |
| 2026-04-30 19:25:57.884 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-74 vq-rvq [[[ 759 844 1989 1533 1402 840 1516 1915 1390 1626 1905 1601 870 701 | |
| 396 126]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:57.892 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-74 vq [2150] (1,) int64 | |
| 2026-04-30 19:25:57.892 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-42 chunk_tokens [[[ 332 178 303 326] | |
| [1414 740 1047 887] | |
| [ 379 609 206 374] | |
| [ 982 1805 1652 636] | |
| [1287 1484 1019 1607] | |
| [1805 74 62 977] | |
| [ 17 1476 1193 350] | |
| [1408 620 889 1344] | |
| [ 623 589 169 111] | |
| [ 259 1698 371 815] | |
| [1493 1320 367 38] | |
| [ 294 996 872 885] | |
| [1569 1777 1104 106] | |
| [ 396 1000 178 152] | |
| [1969 1180 30 257] | |
| [ 11 234 57 1173]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:57.916 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-42 wav [[[ 0.01122023 0.00413963 -0.00393783 ... -0.00029461 0.00421931 | |
| -0.00251451]]] -0.3219706416130066 0.00016606935241725296 0.0811227560043335 0.32183170318603516 (1, 1, 7680) | |
| 2026-04-30 19:25:57.916 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-46 chunk_tokens [[[ 494 75 875 612] | |
| [ 666 721 1773 92] | |
| [1704 657 1275 1120] | |
| [ 585 202 1302 651] | |
| [ 479 927 500 608] | |
| [ 164 1645 1192 1207] | |
| [1123 1968 603 2032] | |
| [ 637 273 596 1069] | |
| [ 573 700 198 553] | |
| [1993 253 346 746] | |
| [ 323 1295 178 1775] | |
| [ 121 1527 874 931] | |
| [1551 904 815 1844] | |
| [1425 225 670 1537] | |
| [ 818 1525 1284 280] | |
| [ 225 270 1411 953]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:57.940 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-46 wav [[[-0.0154132 -0.02377532 -0.02271089 ... 0.02933036 0.023146 | |
| 0.01213897]]] -0.25987228751182556 0.00021866057068109512 0.03468051925301552 0.2589060962200165 (1, 1, 7680) | |
| 2026-04-30 19:25:57.941 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-50 chunk_tokens [[[ 828 357 914 4] | |
| [1200 273 1809 572] | |
| [ 369 0 636 28] | |
| [1765 1853 1982 1722] | |
| [1204 351 1328 860] | |
| [ 443 1318 1079 112] | |
| [1137 736 540 163] | |
| [ 878 11 151 690] | |
| [ 517 271 461 410] | |
| [ 498 430 91 775] | |
| [ 461 748 1194 1071] | |
| [ 969 889 521 465] | |
| [ 494 782 1477 1230] | |
| [1761 1421 997 1497] | |
| [1729 1122 1761 266] | |
| [1963 1022 1225 1405]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:57.965 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-50 wav [[[-0.00091471 -0.01367491 -0.02537205 ... -0.00178504 0.00290802 | |
| 0.00261759]]] -0.10340271145105362 -0.00010349442163715139 0.01529962569475174 0.12059158831834793 (1, 1, 7680) | |
| 2026-04-30 19:25:57.965 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-54 chunk_tokens [[[ 759] | |
| [ 844] | |
| [1989] | |
| [1533] | |
| [1402] | |
| [ 840] | |
| [1516] | |
| [1915] | |
| [1390] | |
| [1626] | |
| [1905] | |
| [1601] | |
| [ 870] | |
| [ 701] | |
| [ 396] | |
| [ 126]]] (1, 16, 1) n_chunk_frames 1 | |
| 2026-04-30 19:25:58.029 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-54 wav [[[-2.6994986e-03 -8.4007008e-04 2.4883149e-03 ... 1.0968803e-05 | |
| 1.0850177e-05 1.1066140e-05]]] -0.015569623559713364 1.784202868293505e-05 0.0029718538280576468 0.021655267104506493 (1, 1, 1920) | |
| 2026-04-30 19:25:58.029 [INFO] src.inference.qwen3_tts_inferencer_onnx: reset_turn reset_generation_state step-idx-75 | |
| 2026-04-30 19:25:58.047 [INFO] __main__: Synthesising: 'но и низкая задержка.' | |
| 2026-04-30 19:25:58.047 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache н | |
| 2026-04-30 19:25:58.047 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False | |
| 2026-04-30 19:25:58.047 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069 | |
| 2026-04-30 19:25:58.127 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076 | |
| 0.08690926]]] (1, 1, 1024) | |
| 2026-04-30 19:25:58.127 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]] | |
| 2026-04-30 19:25:58.127 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661]]] (1, 4, 1024) | |
| 2026-04-30 19:25:58.127 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 1, 1024) | |
| 2026-04-30 19:25:58.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661] | |
| [-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076 | |
| 0.08690926] | |
| [-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 6, 1024) | |
| 2026-04-30 19:25:58.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22 | |
| Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:25:58.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:25:58.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:25:58.129 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:25:58.129 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024) | |
| 2026-04-30 19:25:58.129 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036 | |
| -0.00767252]]] (1, 1, 1024) | |
| 2026-04-30 19:25:58.130 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528 | |
| 0.00424147]]] (1, 1, 1024) | |
| 2026-04-30 19:25:58.130 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724 | |
| -0.00170945] | |
| [ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198 | |
| 0.00132705] | |
| [ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966 | |
| 0.0080104 ] | |
| [ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711 | |
| 0.00252486] | |
| [-0.02064589 0.05184897 0.01909059 ... 0.2070941 0.06416605 | |
| 0.09115074] | |
| [ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459 | |
| -0.00718043]]] (1, 6, 1024) | |
| 2026-04-30 19:25:58.130 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03] | |
| ... | |
| [ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03 | |
| -2.0710612e-04 2.5248611e-03] | |
| [-2.0645889e-02 5.1848970e-02 1.9090585e-02 ... 2.0709410e-01 | |
| 6.4166047e-02 9.1150738e-02] | |
| [ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03 | |
| 3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024) | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=9; step_idx=0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache но | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache но | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache но и | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache но и | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache но и н | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache но и ни | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment з -> text_cache но и низ | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache но и низк | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache но и низка | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache но и низкая | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache но и низкая | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment з -> text_cache но и низкая з | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache но и низкая за | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache но и низкая зад | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache но и низкая заде | |
| 2026-04-30 19:25:58.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache но и низкая задер | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ж -> text_cache но и низкая задерж | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache но и низкая задержк | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache но и низкая задержка | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment . -> text_cache но и низкая задержка. | |
| 2026-04-30 19:25:58.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['но и низкая задержка.'] 21 | |
| Qwen3TTSProcessor __call__ text ['но и низкая задержка.'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 13685, 7587, 6709, 40773, 125107, 52180, 57569, 13132, | |
| 13]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 13685, 7587, 6709, 40773, 125107, 52180, 57569, 13132, | |
| 13]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 13685 7587 6709 40773 125107 52180 57569 13132 13]] (1, 9) | |
| 2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 13685 7587 6709 40773 125107 52180 57569 13132 13]] (1, 9) | |
| 2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment но и низкая задержка. 21 -> tokenized_segment [np.int64(13685), np.int64(7587), np.int64(6709), np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 9 | |
| 2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(13685), np.int64(7587), np.int64(6709), np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] | |
| 2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(13685), np.int64(7587), np.int64(6709), np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 9 | |
| 2026-04-30 19:25:58.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13685 -> pending_tokens [np.int64(7587), np.int64(6709), np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 8 | |
| 2026-04-30 19:25:58.185 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-0 vq [1995] (1,) int64 | |
| 2026-04-30 19:25:58.212 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-1 vq-rvq [[[1995 1534 69 156 293 871 157 628 1976 836 35 1264 1174 1903 | |
| 1360 1265]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.212 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 7587 -> pending_tokens [np.int64(6709), np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 7 | |
| 2026-04-30 19:25:58.220 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-1 vq [215] (1,) int64 | |
| 2026-04-30 19:25:58.247 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-2 vq-rvq [[[ 215 911 373 270 817 1084 848 108 510 68 1652 886 1318 224 | |
| 247 429]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.247 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6709 -> pending_tokens [np.int64(40773), np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 6 | |
| 2026-04-30 19:25:58.255 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-2 vq [1521] (1,) int64 | |
| 2026-04-30 19:25:58.282 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-3 vq-rvq [[[1521 1408 1402 1979 1705 178 1776 359 174 1469 1000 434 686 1094 | |
| 801 413]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.282 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 40773 -> pending_tokens [np.int64(125107), np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 5 | |
| 2026-04-30 19:25:58.290 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-3 vq [1095] (1,) int64 | |
| 2026-04-30 19:25:58.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-4 vq-rvq [[[1095 682 581 1327 1706 2010 970 1984 1728 12 243 755 1321 1077 | |
| 1127 139]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 125107 -> pending_tokens [np.int64(52180), np.int64(57569), np.int64(13132), np.int64(13)] 4 | |
| 2026-04-30 19:25:58.325 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-4 vq [1985] (1,) int64 | |
| 2026-04-30 19:25:58.352 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-5 vq-rvq [[[1985 781 1586 1532 820 1763 338 1569 488 583 1265 1920 1329 286 | |
| 795 1066]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.352 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 52180 -> pending_tokens [np.int64(57569), np.int64(13132), np.int64(13)] 3 | |
| 2026-04-30 19:25:58.360 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-5 vq [251] (1,) int64 | |
| 2026-04-30 19:25:58.387 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-6 vq-rvq [[[ 251 563 1396 1805 1921 169 364 787 798 2019 413 820 1846 986 | |
| 2 1385]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.387 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 57569 -> pending_tokens [np.int64(13132), np.int64(13)] 2 | |
| 2026-04-30 19:25:58.395 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-6 vq [673] (1,) int64 | |
| 2026-04-30 19:25:58.421 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-7 vq-rvq [[[ 673 440 1750 570 1263 342 1539 694 1191 1567 651 322 1252 576 | |
| 129 271]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.422 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13132 -> pending_tokens [np.int64(13)] 1 | |
| 2026-04-30 19:25:58.430 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-7 vq [1850] (1,) int64 | |
| 2026-04-30 19:25:58.456 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-8 vq-rvq [[[1850 407 1614 1847 329 870 1376 609 3 499 592 1466 913 649 | |
| 595 612]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.457 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13 -> pending_tokens [] 0 | |
| 2026-04-30 19:25:58.465 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-8 vq [603] (1,) int64 | |
| 2026-04-30 19:25:58.491 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-9 vq-rvq [[[ 603 1713 74 7 1771 1121 147 1890 194 1143 86 16 950 590 | |
| 1359 1680]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.492 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 chunk_tokens [[[1995 215 1521 1095] | |
| [1534 911 1408 682] | |
| [ 69 373 1402 581] | |
| [ 156 270 1979 1327] | |
| [ 293 817 1705 1706] | |
| [ 871 1084 178 2010] | |
| [ 157 848 1776 970] | |
| [ 628 108 359 1984] | |
| [1976 510 174 1728] | |
| [ 836 68 1469 12] | |
| [ 35 1652 1000 243] | |
| [1264 886 434 755] | |
| [1174 1318 686 1321] | |
| [1903 224 1094 1077] | |
| [1360 247 801 1127] | |
| [1265 429 413 139]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:58.516 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 wav [[[-0.02139645 -0.0189162 -0.01778135 ... -0.00045287 -0.00059633 | |
| -0.00165827]]] -0.06060675159096718 -3.906790152541362e-05 0.0041542695835232735 0.03418533504009247 (1, 1, 7680) | |
| 2026-04-30 19:25:58.516 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 chunk_tokens [[[1985 251 673 1850] | |
| [ 781 563 440 407] | |
| [1586 1396 1750 1614] | |
| [1532 1805 570 1847] | |
| [ 820 1921 1263 329] | |
| [1763 169 342 870] | |
| [ 338 364 1539 1376] | |
| [1569 787 694 609] | |
| [ 488 798 1191 3] | |
| [ 583 2019 1567 499] | |
| [1265 413 651 592] | |
| [1920 820 322 1466] | |
| [1329 1846 1252 913] | |
| [ 286 986 576 649] | |
| [ 795 2 129 595] | |
| [1066 1385 271 612]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 wav [[[-0.00221966 -0.00138947 -0.000929 ... -0.1126425 -0.1338531 | |
| -0.13333385]]] -0.2866828441619873 -4.102538150618784e-05 0.053047213703393936 0.2836780846118927 (1, 1, 7680) | |
| 2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0 | |
| 2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:25:58.540 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0 | |
| 2026-04-30 19:25:58.548 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-9 vq [432] (1,) int64 | |
| 2026-04-30 19:25:58.575 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-10 vq-rvq [[[ 432 1513 844 1935 1769 1323 747 1096 107 666 1051 1541 1954 1701 | |
| 1444 257]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-10 vq [1566] (1,) int64 | |
| 2026-04-30 19:25:58.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-11 vq-rvq [[[1566 118 1365 36 1490 687 1060 445 1749 1948 352 1957 317 1583 | |
| 615 1817]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.618 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-11 vq [551] (1,) int64 | |
| 2026-04-30 19:25:58.646 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-12 vq-rvq [[[ 551 1354 65 1625 177 1876 155 817 1336 1556 715 447 486 1383 | |
| 754 369]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.654 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-12 vq [679] (1,) int64 | |
| 2026-04-30 19:25:58.681 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-13 vq-rvq [[[ 679 1116 189 576 1178 964 793 351 350 1506 21 461 985 1369 | |
| 329 864]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.689 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-13 vq [821] (1,) int64 | |
| 2026-04-30 19:25:58.716 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-14 vq-rvq [[[ 821 631 1332 2000 341 501 1972 1233 167 463 1411 1572 1943 472 | |
| 626 1278]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.724 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-14 vq [1265] (1,) int64 | |
| 2026-04-30 19:25:58.751 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-15 vq-rvq [[[1265 1024 72 631 929 1040 873 1303 1930 1404 883 1049 164 1184 | |
| 1829 1314]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.759 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-15 vq [1132] (1,) int64 | |
| 2026-04-30 19:25:58.786 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-16 vq-rvq [[[1132 181 0 120 1965 1999 630 1176 573 851 1001 1372 878 2005 | |
| 1340 1047]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.794 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-16 vq [1215] (1,) int64 | |
| 2026-04-30 19:25:58.821 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-17 vq-rvq [[[1215 1013 318 1970 330 831 524 1123 1494 243 597 412 1997 1590 | |
| 7 833]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.829 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-17 vq [1304] (1,) int64 | |
| 2026-04-30 19:25:58.856 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-18 vq-rvq [[[1304 1403 98 1347 426 1146 864 976 1752 74 643 150 980 1736 | |
| 1018 718]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.864 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-18 vq [1162] (1,) int64 | |
| 2026-04-30 19:25:58.891 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-19 vq-rvq [[[1162 714 1269 1043 159 1462 650 1709 1723 1418 636 19 186 1355 | |
| 1165 1277]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.899 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-19 vq [1363] (1,) int64 | |
| 2026-04-30 19:25:58.925 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-20 vq-rvq [[[1363 328 606 1060 758 424 1332 1605 587 870 1019 1865 515 175 | |
| 1953 341]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.933 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-20 vq [1947] (1,) int64 | |
| 2026-04-30 19:25:58.960 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-21 vq-rvq [[[1947 32 1351 790 299 1159 676 898 1925 797 271 1561 1161 1074 | |
| 123 1165]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:58.968 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-21 vq [2004] (1,) int64 | |
| 2026-04-30 19:25:58.995 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-22 vq-rvq [[[2004 1517 1142 1302 1919 812 1083 883 640 410 539 1327 1036 894 | |
| 1066 1681]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.003 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-22 vq [610] (1,) int64 | |
| 2026-04-30 19:25:59.029 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-23 vq-rvq [[[ 610 201 1667 1861 650 897 857 1105 1707 1696 1669 545 77 578 | |
| 249 428]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.037 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-23 vq [2150] (1,) int64 | |
| 2026-04-30 19:25:59.037 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 chunk_tokens [[[ 603 432 1566 551] | |
| [1713 1513 118 1354] | |
| [ 74 844 1365 65] | |
| [ 7 1935 36 1625] | |
| [1771 1769 1490 177] | |
| [1121 1323 687 1876] | |
| [ 147 747 1060 155] | |
| [1890 1096 445 817] | |
| [ 194 107 1749 1336] | |
| [1143 666 1948 1556] | |
| [ 86 1051 352 715] | |
| [ 16 1541 1957 447] | |
| [ 950 1954 317 486] | |
| [ 590 1701 1583 1383] | |
| [1359 1444 615 754] | |
| [1680 257 1817 369]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:59.062 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 wav [[[-0.10775348 -0.05212127 0.0396859 ... -0.04563401 -0.03402565 | |
| -0.03579839]]] -0.2528039216995239 0.00014185786130838096 0.08753377944231033 0.3491342067718506 (1, 1, 7680) | |
| 2026-04-30 19:25:59.062 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 chunk_tokens [[[ 679 821 1265 1132] | |
| [1116 631 1024 181] | |
| [ 189 1332 72 0] | |
| [ 576 2000 631 120] | |
| [1178 341 929 1965] | |
| [ 964 501 1040 1999] | |
| [ 793 1972 873 630] | |
| [ 351 1233 1303 1176] | |
| [ 350 167 1930 573] | |
| [1506 463 1404 851] | |
| [ 21 1411 883 1001] | |
| [ 461 1572 1049 1372] | |
| [ 985 1943 164 878] | |
| [1369 472 1184 2005] | |
| [ 329 626 1829 1340] | |
| [ 864 1278 1314 1047]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:59.086 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 wav [[[-0.03745677 -0.02658239 -0.02583151 ... -0.0121026 -0.00580872 | |
| -0.01895227]]] -0.3388431966304779 -5.873028840142069e-06 0.08189456164836884 0.3841433525085449 (1, 1, 7680) | |
| 2026-04-30 19:25:59.086 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 chunk_tokens [[[1215 1304 1162 1363] | |
| [1013 1403 714 328] | |
| [ 318 98 1269 606] | |
| [1970 1347 1043 1060] | |
| [ 330 426 159 758] | |
| [ 831 1146 1462 424] | |
| [ 524 864 650 1332] | |
| [1123 976 1709 1605] | |
| [1494 1752 1723 587] | |
| [ 243 74 1418 870] | |
| [ 597 643 636 1019] | |
| [ 412 150 19 1865] | |
| [1997 980 186 515] | |
| [1590 1736 1355 175] | |
| [ 7 1018 1165 1953] | |
| [ 833 718 1277 341]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:59.110 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 wav [[[-0.0263972 -0.01400574 -0.01092716 ... -0.00139586 0.00422512 | |
| 0.00643334]]] -0.3704526722431183 2.6455960323801264e-05 0.08883234858512878 0.43402376770973206 (1, 1, 7680) | |
| 2026-04-30 19:25:59.110 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 chunk_tokens [[[1947 2004 610] | |
| [ 32 1517 201] | |
| [1351 1142 1667] | |
| [ 790 1302 1861] | |
| [ 299 1919 650] | |
| [1159 812 897] | |
| [ 676 1083 857] | |
| [ 898 883 1105] | |
| [1925 640 1707] | |
| [ 797 410 1696] | |
| [ 271 539 1669] | |
| [1561 1327 545] | |
| [1161 1036 77] | |
| [1074 894 578] | |
| [ 123 1066 249] | |
| [1165 1681 428]]] (1, 16, 3) n_chunk_frames 3 | |
| 2026-04-30 19:25:59.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 wav [[[ 0.00588865 0.00345067 -0.00066399 ... 0.00632556 0.00391393 | |
| 0.00175216]]] -0.1507491022348404 1.726094342302531e-05 0.0315101258456707 0.2467532902956009 (1, 1, 5760) | |
| 2026-04-30 19:25:59.176 [INFO] __main__: Synthesising: 'Если это происходит не мгновенно,' | |
| 2026-04-30 19:25:59.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment Е -> text_cache Е | |
| 2026-04-30 19:25:59.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False | |
| 2026-04-30 19:25:59.179 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list [array([[[-0.01531982, -0.01760864, -0.02178955, ..., 0.02804565, | |
| 0.02838135, 0.02767944]]], shape=(1, 1, 7680), dtype=float32), array([[[0.02700806, 0.02609253, 0.02459717, ..., 0.02215576, | |
| 0.02230835, 0.02636719]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.03475952, 0.03826904, 0.02764893, ..., 0.01647949, | |
| -0.01455688, -0.00036621]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00704956, -0.03173828, -0.06103516, ..., 0.00976562, | |
| 0.01080322, 0.00741577]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00210571, -0.00189209, -0.00598145, ..., 0.0350647 , | |
| 0.03173828, 0.01358032]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00378418, -0.025177 , -0.04141235, ..., -0.00460815, | |
| 0.00967407, 0.01904297]]], shape=(1, 1, 7680), dtype=float32), array([[[ 2.5421143e-02, 3.4332275e-02, 4.8004150e-02, ..., | |
| 6.4086914e-04, 3.0517578e-05, -7.6293945e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.00106812, -0.00131226, -0.00180054, ..., -0.00238037, | |
| -0.00210571, -0.00195312]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00131226, -0.00048828, -0.00064087, ..., -0.12442017, | |
| -0.13143921, -0.15240479]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.17025757, -0.16925049, -0.14294434, ..., 0.00350952, | |
| 0.00283813, 0.00177002]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00201416, 0.003479 , 0.00323486, ..., -0.02636719, | |
| -0.02493286, 0.00787354]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04818726, 0.05957031, 0.03213501, ..., -0.11203003, | |
| -0.09613037, -0.09103394]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.09631348, -0.10897827, -0.12399292, ..., -0.00085449, | |
| -0.00091553, -0.00048828]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.0000000e+00, 6.1035156e-05, -1.2207031e-04, ..., | |
| 1.3381958e-01, 1.6635132e-01, 2.0919800e-01]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 2.3223877e-01, 2.0669556e-01, 1.3903809e-01, ..., | |
| -1.8310547e-04, -1.5258789e-04, -9.1552734e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-9.1552734e-05, -6.1035156e-05, -3.0517578e-05, ..., | |
| 0.0000000e+00, -3.0517578e-05, 0.0000000e+00]]], | |
| shape=(1, 1, 5339), dtype=float32), array([[[-0.02130234, -0.01856662, -0.01710658, ..., 0.00041982, | |
| 0.00062048, 0.0006307 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00029411, -0.00040776, -0.00044942, ..., -0.02424868, | |
| 0.02291245, 0.05937432]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.07660156, 0.07495726, 0.06135209, ..., -0.1206022 , | |
| -0.12184623, -0.1139332 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10050648, -0.08953431, -0.07884923, ..., -0.01869578, | |
| -0.0167346 , -0.01763956]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2177158e-02, -6.4980479e-05, 1.2000869e-02, ..., | |
| -4.9953014e-03, 2.0064995e-02, 8.1494255e-03]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03188938, -0.00509401, 0.04241933, ..., -0.09476525, | |
| -0.18832558, -0.23867904]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.2519588 , -0.24120857, -0.2249308 , ..., -0.00908731, | |
| -0.00565482, -0.00478506]]], shape=(1, 1, 7680), dtype=float32), array([[[-4.7078328e-03, 7.2684824e-03, 2.4840837e-02, ..., | |
| -1.4027000e-05, 1.5263325e-04, 1.7792435e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[1.19311335e-04, 2.77099258e-04, 4.16864146e-04, ..., | |
| 1.06179923e-05, 1.06252701e-05, 1.15810089e-05]]], | |
| shape=(1, 1, 3840), dtype=float32), array([[[ 1.2349803e-05, 1.2119761e-05, 2.1108619e-05, ..., | |
| -1.6870323e-01, -1.3621169e-01, -8.6433820e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03330091, 0.00856069, 0.03467582, ..., -0.04072727, | |
| -0.03181617, -0.00645593]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01122023, 0.00413963, -0.00393783, ..., -0.00029461, | |
| 0.00421931, -0.00251451]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0154132 , -0.02377532, -0.02271089, ..., 0.02933036, | |
| 0.023146 , 0.01213897]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00091471, -0.01367491, -0.02537205, ..., -0.00178504, | |
| 0.00290802, 0.00261759]]], shape=(1, 1, 7680), dtype=float32), array([[[-2.6994986e-03, -8.4007008e-04, 2.4883149e-03, ..., | |
| 1.0968803e-05, 1.0850177e-05, 1.1066140e-05]]], | |
| shape=(1, 1, 1920), dtype=float32), array([[[-0.02139645, -0.0189162 , -0.01778135, ..., -0.00045287, | |
| -0.00059633, -0.00165827]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00221966, -0.00138947, -0.000929 , ..., -0.1126425 , | |
| -0.1338531 , -0.13333385]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10775348, -0.05212127, 0.0396859 , ..., -0.04563401, | |
| -0.03402565, -0.03579839]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03745677, -0.02658239, -0.02583151, ..., -0.0121026 , | |
| -0.00580872, -0.01895227]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0263972 , -0.01400574, -0.01092716, ..., -0.00139586, | |
| 0.00422512, 0.00643334]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00588865, 0.00345067, -0.00066399, ..., 0.00632556, | |
| 0.00391393, 0.00175216]]], shape=(1, 1, 5760), dtype=float32)] 37 | |
| 2026-04-30 19:25:59.180 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history [-0.01531982 -0.01760864 -0.02178955 ... 0.00632556 0.00391393 | |
| 0.00175216] (270299,) float32 | |
| 2026-04-30 19:25:59.180 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history_after cut_idx 11 [0.04818726 0.05957031 0.03213501 ... 0.00632556 0.00391393 0.00175216] (185819,) float32 | |
| 2026-04-30 19:25:59.183 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list_after cut_idx 11 [array([[[ 0.04818726, 0.05957031, 0.03213501, ..., -0.11203003, | |
| -0.09613037, -0.09103394]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.09631348, -0.10897827, -0.12399292, ..., -0.00085449, | |
| -0.00091553, -0.00048828]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.0000000e+00, 6.1035156e-05, -1.2207031e-04, ..., | |
| 1.3381958e-01, 1.6635132e-01, 2.0919800e-01]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 2.3223877e-01, 2.0669556e-01, 1.3903809e-01, ..., | |
| -1.8310547e-04, -1.5258789e-04, -9.1552734e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-9.1552734e-05, -6.1035156e-05, -3.0517578e-05, ..., | |
| 0.0000000e+00, -3.0517578e-05, 0.0000000e+00]]], | |
| shape=(1, 1, 5339), dtype=float32), array([[[-0.02130234, -0.01856662, -0.01710658, ..., 0.00041982, | |
| 0.00062048, 0.0006307 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00029411, -0.00040776, -0.00044942, ..., -0.02424868, | |
| 0.02291245, 0.05937432]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.07660156, 0.07495726, 0.06135209, ..., -0.1206022 , | |
| -0.12184623, -0.1139332 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10050648, -0.08953431, -0.07884923, ..., -0.01869578, | |
| -0.0167346 , -0.01763956]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2177158e-02, -6.4980479e-05, 1.2000869e-02, ..., | |
| -4.9953014e-03, 2.0064995e-02, 8.1494255e-03]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03188938, -0.00509401, 0.04241933, ..., -0.09476525, | |
| -0.18832558, -0.23867904]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.2519588 , -0.24120857, -0.2249308 , ..., -0.00908731, | |
| -0.00565482, -0.00478506]]], shape=(1, 1, 7680), dtype=float32), array([[[-4.7078328e-03, 7.2684824e-03, 2.4840837e-02, ..., | |
| -1.4027000e-05, 1.5263325e-04, 1.7792435e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[1.19311335e-04, 2.77099258e-04, 4.16864146e-04, ..., | |
| 1.06179923e-05, 1.06252701e-05, 1.15810089e-05]]], | |
| shape=(1, 1, 3840), dtype=float32), array([[[ 1.2349803e-05, 1.2119761e-05, 2.1108619e-05, ..., | |
| -1.6870323e-01, -1.3621169e-01, -8.6433820e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03330091, 0.00856069, 0.03467582, ..., -0.04072727, | |
| -0.03181617, -0.00645593]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01122023, 0.00413963, -0.00393783, ..., -0.00029461, | |
| 0.00421931, -0.00251451]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0154132 , -0.02377532, -0.02271089, ..., 0.02933036, | |
| 0.023146 , 0.01213897]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00091471, -0.01367491, -0.02537205, ..., -0.00178504, | |
| 0.00290802, 0.00261759]]], shape=(1, 1, 7680), dtype=float32), array([[[-2.6994986e-03, -8.4007008e-04, 2.4883149e-03, ..., | |
| 1.0968803e-05, 1.0850177e-05, 1.1066140e-05]]], | |
| shape=(1, 1, 1920), dtype=float32), array([[[-0.02139645, -0.0189162 , -0.01778135, ..., -0.00045287, | |
| -0.00059633, -0.00165827]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00221966, -0.00138947, -0.000929 , ..., -0.1126425 , | |
| -0.1338531 , -0.13333385]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10775348, -0.05212127, 0.0396859 , ..., -0.04563401, | |
| -0.03402565, -0.03579839]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03745677, -0.02658239, -0.02583151, ..., -0.0121026 , | |
| -0.00580872, -0.01895227]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0263972 , -0.01400574, -0.01092716, ..., -0.00139586, | |
| 0.00422512, 0.00643334]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00588865, 0.00345067, -0.00066399, ..., 0.00632556, | |
| 0.00391393, 0.00175216]]], shape=(1, 1, 5760), dtype=float32)] 26 | |
| 2026-04-30 19:25:59.183 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069 | |
| 2026-04-30 19:25:59.255 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[ 0.04367745 0.0921593 -0.08114579 ... 0.15368369 0.03052648 | |
| 0.08212201]]] (1, 1, 1024) | |
| 2026-04-30 19:25:59.255 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]] | |
| 2026-04-30 19:25:59.256 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661]]] (1, 4, 1024) | |
| 2026-04-30 19:25:59.256 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 1, 1024) | |
| 2026-04-30 19:25:59.256 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661] | |
| [ 0.04367745 0.0921593 -0.08114579 ... 0.15368369 0.03052648 | |
| 0.08212201] | |
| [-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 6, 1024) | |
| 2026-04-30 19:25:59.256 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22 | |
| Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:25:59.257 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:25:59.257 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:25:59.257 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:25:59.257 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024) | |
| 2026-04-30 19:25:59.258 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036 | |
| -0.00767252]]] (1, 1, 1024) | |
| 2026-04-30 19:25:59.258 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528 | |
| 0.00424147]]] (1, 1, 1024) | |
| 2026-04-30 19:25:59.258 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724 | |
| -0.00170945] | |
| [ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198 | |
| 0.00132705] | |
| [ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966 | |
| 0.0080104 ] | |
| [ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711 | |
| 0.00252486] | |
| [ 0.04845563 0.08835331 -0.08284196 ... 0.14439934 0.03208176 | |
| 0.08636349] | |
| [ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459 | |
| -0.00718043]]] (1, 6, 1024) | |
| 2026-04-30 19:25:59.259 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03] | |
| ... | |
| [ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03 | |
| -2.0710612e-04 2.5248611e-03] | |
| [ 4.8455633e-02 8.8353314e-02 -8.2841955e-02 ... 1.4439934e-01 | |
| 3.2081764e-02 8.6363487e-02] | |
| [ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03 | |
| 3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024) | |
| 2026-04-30 19:25:59.304 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=42; step_idx=42 | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill cont done; talker_seq_len=42; step_idx=42 | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache Ес | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache Есл | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache Если | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.343 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache Если | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment э -> text_cache Если э | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache Если эт | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Если это | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache Если это | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment п -> text_cache Если это п | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache Если это пр | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Если это про | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache Если это прои | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache Если это проис | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment х -> text_cache Если это происх | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Если это происхо | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache Если это происход | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache Если это происходи | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache Если это происходит | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache Если это происходит | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Если это происходит н | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache Если это происходит не | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache Если это происходит не | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache Если это происходит не м | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache Если это происходит не мг | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Если это происходит не мгн | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Если это происходит не мгно | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache Если это происходит не мгнов | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache Если это происходит не мгнове | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Если это происходит не мгновен | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Если это происходит не мгновенн | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Если это происходит не мгновенно | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['Если это происходит не '] 23 | |
| Qwen3TTSProcessor __call__ text ['Если это происходит не '] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 55091, 32202, 67879, 136830, 18658, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:25:59.345 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 55091, 32202, 67879, 136830, 18658, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 55091 32202 67879 136830 18658 220]] (1, 6) | |
| 2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 55091 32202 67879 136830 18658 220]] (1, 6) | |
| 2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment Если это происходит не 23 -> tokenized_segment [np.int64(55091), np.int64(32202), np.int64(67879), np.int64(136830), np.int64(18658), np.int64(220)] 6 | |
| 2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(55091), np.int64(32202), np.int64(67879), np.int64(136830), np.int64(18658), np.int64(220)] | |
| 2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(55091), np.int64(32202), np.int64(67879), np.int64(136830), np.int64(18658), np.int64(220)] 6 | |
| 2026-04-30 19:25:59.346 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 55091 -> pending_tokens [np.int64(32202), np.int64(67879), np.int64(136830), np.int64(18658), np.int64(220)] 5 | |
| 2026-04-30 19:25:59.354 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-42 vq [1221] (1,) int64 | |
| 2026-04-30 19:25:59.381 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-43 vq-rvq [[[1221 1026 1890 308 1532 678 1353 147 750 1772 282 905 366 1437 | |
| 145 166]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.381 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 32202 -> pending_tokens [np.int64(67879), np.int64(136830), np.int64(18658), np.int64(220)] 4 | |
| 2026-04-30 19:25:59.389 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-43 vq [210] (1,) int64 | |
| 2026-04-30 19:25:59.417 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-44 vq-rvq [[[ 210 1184 1974 1382 427 74 1456 848 195 76 1522 31 588 671 | |
| 512 850]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.417 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 67879 -> pending_tokens [np.int64(136830), np.int64(18658), np.int64(220)] 3 | |
| 2026-04-30 19:25:59.425 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-44 vq [1494] (1,) int64 | |
| 2026-04-30 19:25:59.453 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-45 vq-rvq [[[1494 689 1062 1503 360 1143 242 1238 236 122 1449 1461 501 126 | |
| 566 297]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.453 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 136830 -> pending_tokens [np.int64(18658), np.int64(220)] 2 | |
| 2026-04-30 19:25:59.461 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-45 vq [964] (1,) int64 | |
| 2026-04-30 19:25:59.488 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-46 vq-rvq [[[ 964 1231 1955 1258 2036 1514 955 1727 885 1487 1034 1555 745 2040 | |
| 299 1266]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.488 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 18658 -> pending_tokens [np.int64(220)] 1 | |
| 2026-04-30 19:25:59.496 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-46 vq [1083] (1,) int64 | |
| 2026-04-30 19:25:59.524 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-47 vq-rvq [[[1083 1806 1104 404 250 212 523 1393 1886 1347 373 828 802 629 | |
| 58 1557]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.524 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 220 -> pending_tokens [] 0 | |
| 2026-04-30 19:25:59.532 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-47 vq [1932] (1,) int64 | |
| 2026-04-30 19:25:59.558 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-48 vq-rvq [[[1932 1698 349 71 1810 681 799 1316 1819 1021 2002 669 1540 587 | |
| 1688 1759]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.559 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-23 chunk_tokens [[[1221 210 1494 964] | |
| [1026 1184 689 1231] | |
| [1890 1974 1062 1955] | |
| [ 308 1382 1503 1258] | |
| [1532 427 360 2036] | |
| [ 678 74 1143 1514] | |
| [1353 1456 242 955] | |
| [ 147 848 1238 1727] | |
| [ 750 195 236 885] | |
| [1772 76 122 1487] | |
| [ 282 1522 1449 1034] | |
| [ 905 31 1461 1555] | |
| [ 366 588 501 745] | |
| [1437 671 126 2040] | |
| [ 145 512 566 299] | |
| [ 166 850 297 1266]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:59.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-23 wav [[[ 0.0010756 0.00117576 0.00123106 ... -0.04100708 -0.0458885 | |
| -0.04321691]]] -0.09460076689720154 3.915204797522165e-05 0.01097010262310505 0.10221011191606522 (1, 1, 7680) | |
| 2026-04-30 19:25:59.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment , -> text_cache мгновенно, | |
| 2026-04-30 19:25:59.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['мгновенно,'] 10 | |
| Qwen3TTSProcessor __call__ text ['мгновенно,'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 6442, 15390, 46705, 124448, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:25:59.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 6442, 15390, 46705, 124448, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:25:59.583 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 6442 15390 46705 124448 11]] (1, 5) | |
| 2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 6442 15390 46705 124448 11]] (1, 5) | |
| 2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment мгновенно, 10 -> tokenized_segment [np.int64(6442), np.int64(15390), np.int64(46705), np.int64(124448), np.int64(11)] 5 | |
| 2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(6442), np.int64(15390), np.int64(46705), np.int64(124448), np.int64(11)] | |
| 2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(6442), np.int64(15390), np.int64(46705), np.int64(124448), np.int64(11)] 5 | |
| 2026-04-30 19:25:59.584 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6442 -> pending_tokens [np.int64(15390), np.int64(46705), np.int64(124448), np.int64(11)] 4 | |
| 2026-04-30 19:25:59.592 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-48 vq [1785] (1,) int64 | |
| 2026-04-30 19:25:59.619 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-49 vq-rvq [[[1785 922 1304 1294 365 1930 1931 2015 205 1694 246 863 1104 841 | |
| 239 156]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.619 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 15390 -> pending_tokens [np.int64(46705), np.int64(124448), np.int64(11)] 3 | |
| 2026-04-30 19:25:59.627 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-49 vq [1209] (1,) int64 | |
| 2026-04-30 19:25:59.655 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-50 vq-rvq [[[1209 171 1926 1078 883 1696 896 727 1162 1659 85 1185 101 421 | |
| 781 1882]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.655 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 46705 -> pending_tokens [np.int64(124448), np.int64(11)] 2 | |
| 2026-04-30 19:25:59.663 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-50 vq [1917] (1,) int64 | |
| 2026-04-30 19:25:59.690 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-51 vq-rvq [[[1917 53 1520 1049 327 917 108 1955 366 354 1278 99 734 2021 | |
| 1469 59]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.690 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 124448 -> pending_tokens [np.int64(11)] 1 | |
| 2026-04-30 19:25:59.698 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-51 vq [1460] (1,) int64 | |
| 2026-04-30 19:25:59.726 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-52 vq-rvq [[[1460 1321 725 1366 936 685 1087 1513 833 1284 887 1580 1737 1858 | |
| 1839 625]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.726 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11 -> pending_tokens [] 0 | |
| 2026-04-30 19:25:59.734 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-52 vq [129] (1,) int64 | |
| 2026-04-30 19:25:59.761 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-53 vq-rvq [[[ 129 1709 120 871 67 1542 453 1787 421 259 1645 1131 310 700 | |
| 733 1444]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.761 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-27 chunk_tokens [[[1083 1932 1785 1209] | |
| [1806 1698 922 171] | |
| [1104 349 1304 1926] | |
| [ 404 71 1294 1078] | |
| [ 250 1810 365 883] | |
| [ 212 681 1930 1696] | |
| [ 523 799 1931 896] | |
| [1393 1316 2015 727] | |
| [1886 1819 205 1162] | |
| [1347 1021 1694 1659] | |
| [ 373 2002 246 85] | |
| [ 828 669 863 1185] | |
| [ 802 1540 1104 101] | |
| [ 629 587 841 421] | |
| [ 58 1688 239 781] | |
| [1557 1759 156 1882]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:59.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-27 wav [[[-0.05036464 -0.03583061 -0.00757636 ... 0.05205004 0.01185071 | |
| -0.03961121]]] -0.36656999588012695 -3.813831790466793e-05 0.10111234337091446 0.3662589490413666 (1, 1, 7680) | |
| 2026-04-30 19:25:59.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0 | |
| 2026-04-30 19:25:59.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:25:59.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:25:59.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:25:59.786 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0 | |
| 2026-04-30 19:25:59.793 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-53 vq [720] (1,) int64 | |
| 2026-04-30 19:25:59.820 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-54 vq-rvq [[[ 720 1183 1 289 525 1030 342 1728 23 1052 627 824 507 1306 | |
| 986 1273]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.820 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-31 chunk_tokens [[[1917 1460 129 720] | |
| [ 53 1321 1709 1183] | |
| [1520 725 120 1] | |
| [1049 1366 871 289] | |
| [ 327 936 67 525] | |
| [ 917 685 1542 1030] | |
| [ 108 1087 453 342] | |
| [1955 1513 1787 1728] | |
| [ 366 833 421 23] | |
| [ 354 1284 259 1052] | |
| [1278 887 1645 627] | |
| [ 99 1580 1131 824] | |
| [ 734 1737 310 507] | |
| [2021 1858 700 1306] | |
| [1469 1839 733 986] | |
| [ 59 625 1444 1273]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:25:59.845 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-31 wav [[[-0.08307496 -0.11176797 -0.1242267 ... -0.00193561 0.005123 | |
| 0.0037974 ]]] -0.2764914035797119 5.477688682731241e-05 0.06263019889593124 0.3027763068675995 (1, 1, 7680) | |
| 2026-04-30 19:25:59.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-54 vq [1041] (1,) int64 | |
| 2026-04-30 19:25:59.879 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-55 vq-rvq [[[1041 265 1891 1914 222 232 1531 1885 1029 1211 905 556 171 1073 | |
| 1403 1007]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.887 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-55 vq [339] (1,) int64 | |
| 2026-04-30 19:25:59.914 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-56 vq-rvq [[[ 339 1971 1436 1631 477 15 1466 1779 1709 538 525 191 1054 1160 | |
| 766 1207]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.922 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-56 vq [1249] (1,) int64 | |
| 2026-04-30 19:25:59.949 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-57 vq-rvq [[[1249 411 1545 1616 1062 717 1705 421 1286 143 1203 359 885 616 | |
| 1033 1564]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.957 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-57 vq [156] (1,) int64 | |
| 2026-04-30 19:25:59.984 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-58 vq-rvq [[[ 156 304 359 1040 992 1087 1099 113 289 1884 1015 546 106 1586 | |
| 1043 88]]] (1, 1, 16) int64 | |
| 2026-04-30 19:25:59.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-58 vq [1875] (1,) int64 | |
| 2026-04-30 19:26:00.018 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-59 vq-rvq [[[1875 337 1012 18 1120 1949 1411 1302 1350 677 674 1014 21 1196 | |
| 1362 434]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.026 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-59 vq [1772] (1,) int64 | |
| 2026-04-30 19:26:00.053 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-60 vq-rvq [[[1772 559 499 1788 591 446 1457 377 102 62 716 194 637 1734 | |
| 287 103]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.061 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-60 vq [689] (1,) int64 | |
| 2026-04-30 19:26:00.088 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-61 vq-rvq [[[ 689 633 702 657 479 134 1435 1547 878 1283 1297 610 414 1342 | |
| 1461 1396]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.096 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-61 vq [502] (1,) int64 | |
| 2026-04-30 19:26:00.123 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-62 vq-rvq [[[ 502 672 390 68 1863 1632 780 520 1989 334 169 342 982 994 | |
| 807 891]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.131 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-62 vq [1002] (1,) int64 | |
| 2026-04-30 19:26:00.158 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-63 vq-rvq [[[1002 669 578 1462 1360 312 73 964 882 475 1493 1240 1142 1319 | |
| 446 1922]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.166 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-63 vq [1907] (1,) int64 | |
| 2026-04-30 19:26:00.193 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-64 vq-rvq [[[1907 1588 1302 52 1987 1303 1989 149 1049 1247 703 1844 40 520 | |
| 851 1498]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.201 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-64 vq [1656] (1,) int64 | |
| 2026-04-30 19:26:00.227 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-65 vq-rvq [[[1656 30 1238 621 1683 291 75 563 973 149 1691 217 867 1223 | |
| 1481 858]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.235 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-65 vq [348] (1,) int64 | |
| 2026-04-30 19:26:00.262 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-66 vq-rvq [[[ 348 1915 1476 819 1468 1 2036 995 894 375 2001 1333 1091 707 | |
| 1699 1964]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.270 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-66 vq [906] (1,) int64 | |
| 2026-04-30 19:26:00.297 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-67 vq-rvq [[[ 906 1924 1085 1442 1671 343 312 1556 136 272 1289 613 1150 84 | |
| 1584 1462]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.305 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-67 vq [1126] (1,) int64 | |
| 2026-04-30 19:26:00.332 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-68 vq-rvq [[[1126 1363 1906 1497 475 654 667 395 701 1653 1566 677 75 321 | |
| 742 1225]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.340 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-68 vq [1621] (1,) int64 | |
| 2026-04-30 19:26:00.367 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-69 vq-rvq [[[1621 1174 1406 1613 38 153 32 317 1787 1457 442 1667 41 1218 | |
| 128 1289]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-69 vq [841] (1,) int64 | |
| 2026-04-30 19:26:00.402 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-70 vq-rvq [[[ 841 1389 88 1544 1331 1579 305 1644 256 1204 773 1022 453 68 | |
| 729 1508]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.411 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-70 vq [422] (1,) int64 | |
| 2026-04-30 19:26:00.438 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-71 vq-rvq [[[ 422 1768 816 1597 1721 963 226 1386 124 2009 1425 265 1878 552 | |
| 27 742]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.446 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-71 vq [396] (1,) int64 | |
| 2026-04-30 19:26:00.473 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-72 vq-rvq [[[ 396 183 290 2002 1107 1490 822 42 302 1662 1437 902 832 294 | |
| 791 1159]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.481 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-72 vq [832] (1,) int64 | |
| 2026-04-30 19:26:00.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-73 vq-rvq [[[ 832 552 626 1350 1752 341 1689 1514 216 418 997 392 144 823 | |
| 841 403]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.517 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-73 vq [1764] (1,) int64 | |
| 2026-04-30 19:26:00.544 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-74 vq-rvq [[[1764 359 514 1431 325 1338 1556 636 367 1697 1063 450 1109 565 | |
| 770 179]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.552 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-74 vq [1928] (1,) int64 | |
| 2026-04-30 19:26:00.579 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-75 vq-rvq [[[1928 28 735 1053 916 1787 661 606 985 182 1515 603 1685 1472 | |
| 1744 755]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.587 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-75 vq [1115] (1,) int64 | |
| 2026-04-30 19:26:00.614 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-76 vq-rvq [[[1115 155 82 671 1238 162 225 981 431 252 1404 218 71 918 | |
| 784 157]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.622 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-76 vq [21] (1,) int64 | |
| 2026-04-30 19:26:00.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-77 vq-rvq [[[ 21 299 571 489 1130 1742 1056 1497 1706 1537 114 980 872 284 | |
| 254 1843]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.658 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-77 vq [1906] (1,) int64 | |
| 2026-04-30 19:26:00.684 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-78 vq-rvq [[[1906 1654 1762 1483 1134 631 1116 835 755 1751 813 1739 93 81 | |
| 1842 593]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.692 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-78 vq [870] (1,) int64 | |
| 2026-04-30 19:26:00.719 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-79 vq-rvq [[[ 870 1465 1030 311 2002 143 350 1490 1313 1081 951 95 300 536 | |
| 693 2039]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.727 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-79 vq [447] (1,) int64 | |
| 2026-04-30 19:26:00.754 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-80 vq-rvq [[[ 447 1302 465 1712 935 221 1817 770 166 1747 36 840 1403 1 | |
| 577 678]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.762 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-80 vq [602] (1,) int64 | |
| 2026-04-30 19:26:00.789 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-81 vq-rvq [[[ 602 1329 634 1484 476 1992 480 1436 1758 390 1696 794 1427 106 | |
| 716 1658]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:00.797 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-81 vq [2150] (1,) int64 | |
| 2026-04-30 19:26:00.797 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-35 chunk_tokens [[[1041 339 1249 156] | |
| [ 265 1971 411 304] | |
| [1891 1436 1545 359] | |
| [1914 1631 1616 1040] | |
| [ 222 477 1062 992] | |
| [ 232 15 717 1087] | |
| [1531 1466 1705 1099] | |
| [1885 1779 421 113] | |
| [1029 1709 1286 289] | |
| [1211 538 143 1884] | |
| [ 905 525 1203 1015] | |
| [ 556 191 359 546] | |
| [ 171 1054 885 106] | |
| [1073 1160 616 1586] | |
| [1403 766 1033 1043] | |
| [1007 1207 1564 88]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:00.821 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-35 wav [[[-0.00899126 -0.00369494 0.00981118 ... -0.00399455 -0.00319744 | |
| -0.00289368]]] -0.278908371925354 4.246875687385909e-05 0.07475152611732483 0.38985109329223633 (1, 1, 7680) | |
| 2026-04-30 19:26:00.822 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-39 chunk_tokens [[[1875 1772 689 502] | |
| [ 337 559 633 672] | |
| [1012 499 702 390] | |
| [ 18 1788 657 68] | |
| [1120 591 479 1863] | |
| [1949 446 134 1632] | |
| [1411 1457 1435 780] | |
| [1302 377 1547 520] | |
| [1350 102 878 1989] | |
| [ 677 62 1283 334] | |
| [ 674 716 1297 169] | |
| [1014 194 610 342] | |
| [ 21 637 414 982] | |
| [1196 1734 1342 994] | |
| [1362 287 1461 807] | |
| [ 434 103 1396 891]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:00.846 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-39 wav [[[-0.00285673 -0.0034839 -0.00415278 ... 0.00778646 0.00595145 | |
| -0.0043805 ]]] -0.2765483260154724 9.143220268015284e-06 0.06062217429280281 0.3825187683105469 (1, 1, 7680) | |
| 2026-04-30 19:26:00.846 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-43 chunk_tokens [[[1002 1907 1656 348] | |
| [ 669 1588 30 1915] | |
| [ 578 1302 1238 1476] | |
| [1462 52 621 819] | |
| [1360 1987 1683 1468] | |
| [ 312 1303 291 1] | |
| [ 73 1989 75 2036] | |
| [ 964 149 563 995] | |
| [ 882 1049 973 894] | |
| [ 475 1247 149 375] | |
| [1493 703 1691 2001] | |
| [1240 1844 217 1333] | |
| [1142 40 867 1091] | |
| [1319 520 1223 707] | |
| [ 446 851 1481 1699] | |
| [1922 1498 858 1964]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:00.870 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-43 wav [[[-0.01552802 -0.01487012 -0.01219678 ... -0.00294759 0.00343194 | |
| 0.0008437 ]]] -0.2960159182548523 2.2809199435869232e-05 0.0668618455529213 0.3031485974788666 (1, 1, 7680) | |
| 2026-04-30 19:26:00.870 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-47 chunk_tokens [[[ 906 1126 1621 841] | |
| [1924 1363 1174 1389] | |
| [1085 1906 1406 88] | |
| [1442 1497 1613 1544] | |
| [1671 475 38 1331] | |
| [ 343 654 153 1579] | |
| [ 312 667 32 305] | |
| [1556 395 317 1644] | |
| [ 136 701 1787 256] | |
| [ 272 1653 1457 1204] | |
| [1289 1566 442 773] | |
| [ 613 677 1667 1022] | |
| [1150 75 41 453] | |
| [ 84 321 1218 68] | |
| [1584 742 128 729] | |
| [1462 1225 1289 1508]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:00.894 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-47 wav [[[-0.00404704 0.00067246 0.00399263 ... 0.09798931 0.20872854 | |
| 0.2311011 ]]] -0.25243639945983887 5.265988875180483e-05 0.049168795347213745 0.2518003284931183 (1, 1, 7680) | |
| 2026-04-30 19:26:00.895 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-51 chunk_tokens [[[ 422 396 832 1764] | |
| [1768 183 552 359] | |
| [ 816 290 626 514] | |
| [1597 2002 1350 1431] | |
| [1721 1107 1752 325] | |
| [ 963 1490 341 1338] | |
| [ 226 822 1689 1556] | |
| [1386 42 1514 636] | |
| [ 124 302 216 367] | |
| [2009 1662 418 1697] | |
| [1425 1437 997 1063] | |
| [ 265 902 392 450] | |
| [1878 832 144 1109] | |
| [ 552 294 823 565] | |
| [ 27 791 841 770] | |
| [ 742 1159 403 179]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:00.919 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-51 wav [[[ 0.14216125 0.06682034 0.02212509 ... 0.06106113 0.00223079 | |
| -0.05518628]]] -0.25642016530036926 -4.215189164824551e-06 0.07405433058738708 0.3941096067428589 (1, 1, 7680) | |
| 2026-04-30 19:26:00.919 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-55 chunk_tokens [[[1928 1115 21 1906] | |
| [ 28 155 299 1654] | |
| [ 735 82 571 1762] | |
| [1053 671 489 1483] | |
| [ 916 1238 1130 1134] | |
| [1787 162 1742 631] | |
| [ 661 225 1056 1116] | |
| [ 606 981 1497 835] | |
| [ 985 431 1706 755] | |
| [ 182 252 1537 1751] | |
| [1515 1404 114 813] | |
| [ 603 218 980 1739] | |
| [1685 71 872 93] | |
| [1472 918 284 81] | |
| [1744 784 254 1842] | |
| [ 755 157 1843 593]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:00.943 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-55 wav [[[-0.10738115 -0.11622868 -0.06752186 ... 0.03509749 0.03198082 | |
| 0.02877127]]] -0.2850886285305023 6.992658745730296e-05 0.08521004766225815 0.39866259694099426 (1, 1, 7680) | |
| 2026-04-30 19:26:00.943 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-59 chunk_tokens [[[ 870 447 602] | |
| [1465 1302 1329] | |
| [1030 465 634] | |
| [ 311 1712 1484] | |
| [2002 935 476] | |
| [ 143 221 1992] | |
| [ 350 1817 480] | |
| [1490 770 1436] | |
| [1313 166 1758] | |
| [1081 1747 390] | |
| [ 951 36 1696] | |
| [ 95 840 794] | |
| [ 300 1403 1427] | |
| [ 536 1 106] | |
| [ 693 577 716] | |
| [2039 678 1658]]] (1, 16, 3) n_chunk_frames 3 | |
| 2026-04-30 19:26:00.974 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-59 wav [[[2.69281808e-02 2.77648699e-02 3.07107549e-02 ... 1.15126495e-05 | |
| 1.21511912e-05 1.15567072e-05]]] -0.09340479224920273 -3.71767018805258e-05 0.025410572066903114 0.0996907576918602 (1, 1, 5760) | |
| 2026-04-30 19:26:00.974 [INFO] src.inference.qwen3_tts_inferencer_onnx: reset_turn reset_generation_state step-idx-82 | |
| 2026-04-30 19:26:00.992 [INFO] __main__: Synthesising: 'то теряется эффект живого общения.' | |
| 2026-04-30 19:26:00.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache т | |
| 2026-04-30 19:26:00.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False | |
| 2026-04-30 19:26:00.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069 | |
| 2026-04-30 19:26:01.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076 | |
| 0.08690926]]] (1, 1, 1024) | |
| 2026-04-30 19:26:01.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]] | |
| 2026-04-30 19:26:01.072 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661]]] (1, 4, 1024) | |
| 2026-04-30 19:26:01.072 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 1, 1024) | |
| 2026-04-30 19:26:01.072 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661] | |
| [-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076 | |
| 0.08690926] | |
| [-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 6, 1024) | |
| 2026-04-30 19:26:01.072 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22 | |
| Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:01.073 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:01.073 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:01.073 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:01.074 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024) | |
| 2026-04-30 19:26:01.074 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036 | |
| -0.00767252]]] (1, 1, 1024) | |
| 2026-04-30 19:26:01.074 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528 | |
| 0.00424147]]] (1, 1, 1024) | |
| 2026-04-30 19:26:01.074 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724 | |
| -0.00170945] | |
| [ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198 | |
| 0.00132705] | |
| [ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966 | |
| 0.0080104 ] | |
| [ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711 | |
| 0.00252486] | |
| [-0.02064589 0.05184897 0.01909059 ... 0.2070941 0.06416605 | |
| 0.09115074] | |
| [ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459 | |
| -0.00718043]]] (1, 6, 1024) | |
| 2026-04-30 19:26:01.075 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03] | |
| ... | |
| [ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03 | |
| -2.0710612e-04 2.5248611e-03] | |
| [-2.0645889e-02 5.1848970e-02 1.9090585e-02 ... 2.0709410e-01 | |
| 6.4166047e-02 9.1150738e-02] | |
| [ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03 | |
| 3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024) | |
| 2026-04-30 19:26:01.118 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=9; step_idx=0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache то т | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache то те | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache то тер | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache то теря | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache то теряе | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache то теряет | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache то теряетс | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache то теряется | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то теряется | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment э -> text_cache то теряется э | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ф -> text_cache то теряется эф | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ф -> text_cache то теряется эфф | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache то теряется эффе | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache то теряется эффек | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache то теряется эффект | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то теряется эффект | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.119 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ж -> text_cache то теряется эффект ж | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache то теряется эффект жи | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache то теряется эффект жив | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то теряется эффект живо | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache то теряется эффект живог | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то теряется эффект живого | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то теряется эффект живого | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то теряется эффект живого о | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment б -> text_cache то теряется эффект живого об | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment щ -> text_cache то теряется эффект живого общ | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache то теряется эффект живого обще | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache то теряется эффект живого общен | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache то теряется эффект живого общени | |
| 2026-04-30 19:26:01.120 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['то теряется эффект живого '] 26 | |
| Qwen3TTSProcessor __call__ text ['то теряется эффект живого '] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 24634, 135010, 4235, 49719, 132716, 29556, 134030, 22107, | |
| 220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 24634, 135010, 4235, 49719, 132716, 29556, 134030, 22107, | |
| 220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 24634 135010 4235 49719 132716 29556 134030 22107 220]] (1, 9) | |
| 2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 24634 135010 4235 49719 132716 29556 134030 22107 220]] (1, 9) | |
| 2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment то теряется эффект живого 26 -> tokenized_segment [np.int64(24634), np.int64(135010), np.int64(4235), np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 9 | |
| 2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(24634), np.int64(135010), np.int64(4235), np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] | |
| 2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(24634), np.int64(135010), np.int64(4235), np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 9 | |
| 2026-04-30 19:26:01.121 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 24634 -> pending_tokens [np.int64(135010), np.int64(4235), np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 8 | |
| 2026-04-30 19:26:01.129 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-0 vq [1995] (1,) int64 | |
| 2026-04-30 19:26:01.156 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-1 vq-rvq [[[1995 1159 0 22 2015 407 641 2008 1058 844 743 1603 706 1759 | |
| 1772 1435]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.156 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 135010 -> pending_tokens [np.int64(4235), np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 7 | |
| 2026-04-30 19:26:01.164 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-1 vq [215] (1,) int64 | |
| 2026-04-30 19:26:01.190 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-2 vq-rvq [[[ 215 1009 1093 310 1531 785 1751 1215 1304 905 1265 1382 783 781 | |
| 82 803]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.191 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 4235 -> pending_tokens [np.int64(49719), np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 6 | |
| 2026-04-30 19:26:01.199 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-2 vq [212] (1,) int64 | |
| 2026-04-30 19:26:01.225 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-3 vq-rvq [[[ 212 1134 730 1884 1430 698 274 1814 1728 38 1076 362 527 1529 | |
| 1213 1668]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.225 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 49719 -> pending_tokens [np.int64(132716), np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 5 | |
| 2026-04-30 19:26:01.233 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-3 vq [1181] (1,) int64 | |
| 2026-04-30 19:26:01.260 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-4 vq-rvq [[[1181 1722 1096 1458 243 1093 20 1902 930 2030 223 990 996 2027 | |
| 1008 901]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.260 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 132716 -> pending_tokens [np.int64(29556), np.int64(134030), np.int64(22107), np.int64(220)] 4 | |
| 2026-04-30 19:26:01.268 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-4 vq [462] (1,) int64 | |
| 2026-04-30 19:26:01.294 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-5 vq-rvq [[[ 462 284 1758 371 1210 406 55 1034 480 1584 255 146 729 1484 | |
| 586 1978]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.294 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 29556 -> pending_tokens [np.int64(134030), np.int64(22107), np.int64(220)] 3 | |
| 2026-04-30 19:26:01.302 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-5 vq [1225] (1,) int64 | |
| 2026-04-30 19:26:01.329 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-6 vq-rvq [[[1225 1534 373 1579 1286 601 206 1639 173 37 683 53 865 1556 | |
| 135 819]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.329 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 134030 -> pending_tokens [np.int64(22107), np.int64(220)] 2 | |
| 2026-04-30 19:26:01.337 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-6 vq [628] (1,) int64 | |
| 2026-04-30 19:26:01.364 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-7 vq-rvq [[[ 628 535 379 1374 645 161 1628 1218 627 860 1753 419 1304 637 | |
| 1926 536]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.364 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 22107 -> pending_tokens [np.int64(220)] 1 | |
| 2026-04-30 19:26:01.372 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-7 vq [606] (1,) int64 | |
| 2026-04-30 19:26:01.398 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-8 vq-rvq [[[ 606 940 1515 1822 70 745 1920 609 539 1185 1050 1869 503 1727 | |
| 821 1169]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.398 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 220 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:01.406 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-8 vq [828] (1,) int64 | |
| 2026-04-30 19:26:01.433 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-9 vq-rvq [[[ 828 1894 396 509 515 940 1416 1198 415 741 587 1989 1165 1918 | |
| 115 1532]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.433 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 chunk_tokens [[[1995 215 212 1181] | |
| [1159 1009 1134 1722] | |
| [ 0 1093 730 1096] | |
| [ 22 310 1884 1458] | |
| [2015 1531 1430 243] | |
| [ 407 785 698 1093] | |
| [ 641 1751 274 20] | |
| [2008 1215 1814 1902] | |
| [1058 1304 1728 930] | |
| [ 844 905 38 2030] | |
| [ 743 1265 1076 223] | |
| [1603 1382 362 990] | |
| [ 706 783 527 996] | |
| [1759 781 1529 2027] | |
| [1772 82 1213 1008] | |
| [1435 803 1668 901]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:01.458 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 wav [[[-2.0247478e-02 -1.6132748e-02 -1.4229195e-02 ... 1.1977663e-05 | |
| 1.1495073e-05 1.2644601e-05]]] -0.020247478038072586 -5.6528027926106006e-05 0.0009806811576709151 0.005252548027783632 (1, 1, 7680) | |
| 2026-04-30 19:26:01.458 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 chunk_tokens [[[ 462 1225 628 606] | |
| [ 284 1534 535 940] | |
| [1758 373 379 1515] | |
| [ 371 1579 1374 1822] | |
| [1210 1286 645 70] | |
| [ 406 601 161 745] | |
| [ 55 206 1628 1920] | |
| [1034 1639 1218 609] | |
| [ 480 173 627 539] | |
| [1584 37 860 1185] | |
| [ 255 683 1753 1050] | |
| [ 146 53 419 1869] | |
| [ 729 865 1304 503] | |
| [1484 1556 637 1727] | |
| [ 586 135 1926 821] | |
| [1978 819 536 1169]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 wav [[[ 1.2498698e-05 1.2433531e-05 1.1404698e-05 ... -5.8077216e-02 | |
| -5.1980902e-02 -5.0722528e-02]]] -0.2770718038082123 -0.00012726392014883459 0.06354878842830658 0.25196802616119385 (1, 1, 7680) | |
| 2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache общения | |
| 2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment . -> text_cache общения. | |
| 2026-04-30 19:26:01.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['общения.'] 8 | |
| Qwen3TTSProcessor __call__ text ['общения.'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[54157, 18492, 13]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[54157, 18492, 13]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[54157 18492 13]] (1, 3) | |
| 2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[54157 18492 13]] (1, 3) | |
| 2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment общения. 8 -> tokenized_segment [np.int64(54157), np.int64(18492), np.int64(13)] 3 | |
| 2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(54157), np.int64(18492), np.int64(13)] | |
| 2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(54157), np.int64(18492), np.int64(13)] 3 | |
| 2026-04-30 19:26:01.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 54157 -> pending_tokens [np.int64(18492), np.int64(13)] 2 | |
| 2026-04-30 19:26:01.491 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-9 vq [266] (1,) int64 | |
| 2026-04-30 19:26:01.518 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-10 vq-rvq [[[ 266 171 1379 7 639 1606 1087 778 568 830 1870 1207 677 926 | |
| 290 179]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.518 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 18492 -> pending_tokens [np.int64(13)] 1 | |
| 2026-04-30 19:26:01.526 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-10 vq [532] (1,) int64 | |
| 2026-04-30 19:26:01.553 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-11 vq-rvq [[[ 532 440 1567 379 1769 1572 939 1459 1246 959 1300 211 2019 1510 | |
| 701 924]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.553 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:01.561 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-11 vq [1212] (1,) int64 | |
| 2026-04-30 19:26:01.588 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-12 vq-rvq [[[1212 637 11 1218 770 342 1376 686 20 1263 430 1628 129 1950 | |
| 1018 341]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.588 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 chunk_tokens [[[ 828 266 532 1212] | |
| [1894 171 440 637] | |
| [ 396 1379 1567 11] | |
| [ 509 7 379 1218] | |
| [ 515 639 1769 770] | |
| [ 940 1606 1572 342] | |
| [1416 1087 939 1376] | |
| [1198 778 1459 686] | |
| [ 415 568 1246 20] | |
| [ 741 830 959 1263] | |
| [ 587 1870 1300 430] | |
| [1989 1207 211 1628] | |
| [1165 677 2019 129] | |
| [1918 926 1510 1950] | |
| [ 115 290 701 1018] | |
| [1532 179 924 341]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 wav [[[-0.05217085 -0.05058753 -0.03975262 ... 0.21015896 0.11327256 | |
| 0.02125037]]] -0.36741623282432556 0.00015898160927463323 0.09106618165969849 0.36809754371643066 (1, 1, 7680) | |
| 2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0 | |
| 2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:26:01.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:01.621 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-12 vq [23] (1,) int64 | |
| 2026-04-30 19:26:01.648 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-13 vq-rvq [[[ 23 1808 50 1594 1454 783 1352 1241 944 36 187 1728 756 1807 | |
| 333 896]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.656 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-13 vq [871] (1,) int64 | |
| 2026-04-30 19:26:01.683 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-14 vq-rvq [[[ 871 707 590 322 193 51 54 1780 1599 990 296 1425 832 1215 | |
| 464 897]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.691 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-14 vq [360] (1,) int64 | |
| 2026-04-30 19:26:01.718 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-15 vq-rvq [[[ 360 1553 617 1357 1716 919 2034 561 178 366 864 352 55 264 | |
| 504 1979]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.726 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-15 vq [1218] (1,) int64 | |
| 2026-04-30 19:26:01.753 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-16 vq-rvq [[[1218 1520 627 582 944 5 1996 488 878 1801 251 5 0 1016 | |
| 764 503]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.761 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-16 vq [1351] (1,) int64 | |
| 2026-04-30 19:26:01.788 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-17 vq-rvq [[[1351 927 1671 2003 1231 639 603 198 972 1611 213 522 1106 1997 | |
| 30 159]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.796 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-17 vq [1838] (1,) int64 | |
| 2026-04-30 19:26:01.823 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-18 vq-rvq [[[1838 1806 340 747 1372 143 523 993 1062 238 201 95 31 1176 | |
| 143 992]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.831 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-18 vq [1516] (1,) int64 | |
| 2026-04-30 19:26:01.858 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-19 vq-rvq [[[1516 1217 1088 947 906 2008 2026 325 315 1288 584 321 254 765 | |
| 258 1254]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.866 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-19 vq [1830] (1,) int64 | |
| 2026-04-30 19:26:01.893 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-20 vq-rvq [[[1830 1415 1448 673 64 179 1680 450 272 390 875 1963 480 119 | |
| 1269 101]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.901 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-20 vq [113] (1,) int64 | |
| 2026-04-30 19:26:01.928 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-21 vq-rvq [[[ 113 761 1217 1415 1019 1995 994 1297 792 362 853 912 525 613 | |
| 1332 288]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.936 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-21 vq [1250] (1,) int64 | |
| 2026-04-30 19:26:01.964 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-22 vq-rvq [[[1250 1392 741 1567 538 176 490 675 1905 358 883 956 474 69 | |
| 1829 1843]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:01.972 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-22 vq [103] (1,) int64 | |
| 2026-04-30 19:26:01.999 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-23 vq-rvq [[[ 103 257 1242 1241 648 96 688 1576 1291 20 576 322 1135 245 | |
| 595 126]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.008 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-23 vq [906] (1,) int64 | |
| 2026-04-30 19:26:02.035 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-24 vq-rvq [[[ 906 72 463 841 1401 189 339 1563 382 522 31 284 987 2040 | |
| 585 496]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.043 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-24 vq [180] (1,) int64 | |
| 2026-04-30 19:26:02.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-25 vq-rvq [[[ 180 16 474 588 846 1064 1623 1445 974 1820 1023 593 838 1533 | |
| 34 369]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-25 vq [1853] (1,) int64 | |
| 2026-04-30 19:26:02.105 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-26 vq-rvq [[[1853 1905 1087 1598 468 1159 738 1012 874 183 670 285 153 632 | |
| 1978 1748]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.113 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-26 vq [1462] (1,) int64 | |
| 2026-04-30 19:26:02.140 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-27 vq-rvq [[[1462 1477 1436 1987 869 676 90 700 670 1967 44 1578 567 814 | |
| 114 27]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.148 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-27 vq [51] (1,) int64 | |
| 2026-04-30 19:26:02.175 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-28 vq-rvq [[[ 51 1111 1263 928 1398 679 931 400 109 221 163 1290 666 1264 | |
| 1627 501]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.183 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-28 vq [1447] (1,) int64 | |
| 2026-04-30 19:26:02.210 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-29 vq-rvq [[[1447 373 471 1078 92 879 32 1773 209 1940 443 16 316 1128 | |
| 1306 1288]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.218 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-29 vq [784] (1,) int64 | |
| 2026-04-30 19:26:02.245 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-30 vq-rvq [[[ 784 1820 1478 606 1083 1982 1131 874 29 815 1000 1330 702 1980 | |
| 1339 232]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.253 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-30 vq [991] (1,) int64 | |
| 2026-04-30 19:26:02.280 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-31 vq-rvq [[[ 991 1001 640 799 188 1112 1323 876 223 1567 1582 1410 1886 1398 | |
| 956 1863]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.288 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-31 vq [1743] (1,) int64 | |
| 2026-04-30 19:26:02.316 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-32 vq-rvq [[[1743 860 1909 1197 102 1302 397 2003 743 121 218 1465 1630 364 | |
| 1455 1732]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.324 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-32 vq [610] (1,) int64 | |
| 2026-04-30 19:26:02.351 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-33 vq-rvq [[[ 610 1884 1904 345 1951 1868 1349 338 1930 250 87 1315 47 146 | |
| 1609 632]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.359 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-33 vq [1528] (1,) int64 | |
| 2026-04-30 19:26:02.386 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-34 vq-rvq [[[1528 740 1476 733 79 1693 1492 999 1151 478 1255 1042 676 412 | |
| 1066 1120]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.394 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-34 vq [1711] (1,) int64 | |
| 2026-04-30 19:26:02.421 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-35 vq-rvq [[[1711 1101 1554 671 447 476 1649 909 229 1549 373 962 863 794 | |
| 1395 472]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.429 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-35 vq [1500] (1,) int64 | |
| 2026-04-30 19:26:02.456 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-36 vq-rvq [[[1500 768 1272 1979 1193 1352 958 104 1203 640 1403 347 461 395 | |
| 1182 1753]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-36 vq [963] (1,) int64 | |
| 2026-04-30 19:26:02.490 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-37 vq-rvq [[[ 963 760 1691 1670 610 964 736 1428 1647 1943 421 1512 948 905 | |
| 1492 617]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.498 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-37 vq [743] (1,) int64 | |
| 2026-04-30 19:26:02.525 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-38 vq-rvq [[[ 743 1015 702 1294 106 709 491 1036 86 1162 1772 306 769 596 | |
| 519 236]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.533 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-38 vq [148] (1,) int64 | |
| 2026-04-30 19:26:02.560 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-39 vq-rvq [[[ 148 887 1970 849 916 1019 1129 302 1819 232 22 730 1918 1162 | |
| 1808 3]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.568 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-39 vq [908] (1,) int64 | |
| 2026-04-30 19:26:02.595 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-40 vq-rvq [[[ 908 1772 648 312 757 927 1060 233 202 927 448 1208 1350 117 | |
| 74 333]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.603 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-40 vq [1360] (1,) int64 | |
| 2026-04-30 19:26:02.629 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-41 vq-rvq [[[1360 1045 1978 1175 317 652 957 1326 1597 40 1037 57 1070 989 | |
| 1401 168]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.637 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-41 vq [1739] (1,) int64 | |
| 2026-04-30 19:26:02.664 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-42 vq-rvq [[[1739 844 679 962 583 1737 278 765 1010 1869 1088 553 546 341 | |
| 375 1067]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:02.672 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-42 vq [2150] (1,) int64 | |
| 2026-04-30 19:26:02.672 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 chunk_tokens [[[ 23 871 360 1218] | |
| [1808 707 1553 1520] | |
| [ 50 590 617 627] | |
| [1594 322 1357 582] | |
| [1454 193 1716 944] | |
| [ 783 51 919 5] | |
| [1352 54 2034 1996] | |
| [1241 1780 561 488] | |
| [ 944 1599 178 878] | |
| [ 36 990 366 1801] | |
| [ 187 296 864 251] | |
| [1728 1425 352 5] | |
| [ 756 832 55 0] | |
| [1807 1215 264 1016] | |
| [ 333 464 504 764] | |
| [ 896 897 1979 503]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:02.696 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 wav [[[-0.03852101 -0.06222959 -0.06324419 ... 0.00308757 0.01666446 | |
| 0.02635817]]] -0.3823830783367157 6.125232175691053e-05 0.09384987503290176 0.3529222905635834 (1, 1, 7680) | |
| 2026-04-30 19:26:02.696 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 chunk_tokens [[[1351 1838 1516 1830] | |
| [ 927 1806 1217 1415] | |
| [1671 340 1088 1448] | |
| [2003 747 947 673] | |
| [1231 1372 906 64] | |
| [ 639 143 2008 179] | |
| [ 603 523 2026 1680] | |
| [ 198 993 325 450] | |
| [ 972 1062 315 272] | |
| [1611 238 1288 390] | |
| [ 213 201 584 875] | |
| [ 522 95 321 1963] | |
| [1106 31 254 480] | |
| [1997 1176 765 119] | |
| [ 30 143 258 1269] | |
| [ 159 992 1254 101]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:02.721 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 wav [[[ 0.02811593 0.01903336 0.00181638 ... -0.00637799 -0.00625728 | |
| -0.01839462]]] -0.2889702618122101 -5.0208214815938845e-05 0.06494311988353729 0.2914096415042877 (1, 1, 7680) | |
| 2026-04-30 19:26:02.721 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 chunk_tokens [[[ 113 1250 103 906] | |
| [ 761 1392 257 72] | |
| [1217 741 1242 463] | |
| [1415 1567 1241 841] | |
| [1019 538 648 1401] | |
| [1995 176 96 189] | |
| [ 994 490 688 339] | |
| [1297 675 1576 1563] | |
| [ 792 1905 1291 382] | |
| [ 362 358 20 522] | |
| [ 853 883 576 31] | |
| [ 912 956 322 284] | |
| [ 525 474 1135 987] | |
| [ 613 69 245 2040] | |
| [1332 1829 595 585] | |
| [ 288 1843 126 496]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:02.745 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 wav [[[-3.6303084e-02 -4.4228390e-02 -4.6101980e-02 ... 4.6050473e-04 | |
| -4.0465111e-05 -2.4329145e-04]]] -0.36047816276550293 7.727897173026577e-05 0.07270871102809906 0.34643569588661194 (1, 1, 7680) | |
| 2026-04-30 19:26:02.745 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 chunk_tokens [[[ 180 1853 1462 51] | |
| [ 16 1905 1477 1111] | |
| [ 474 1087 1436 1263] | |
| [ 588 1598 1987 928] | |
| [ 846 468 869 1398] | |
| [1064 1159 676 679] | |
| [1623 738 90 931] | |
| [1445 1012 700 400] | |
| [ 974 874 670 109] | |
| [1820 183 1967 221] | |
| [1023 670 44 163] | |
| [ 593 285 1578 1290] | |
| [ 838 153 567 666] | |
| [1533 632 814 1264] | |
| [ 34 1978 114 1627] | |
| [ 369 1748 27 501]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:02.769 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 wav [[[7.2466741e-05 2.7459790e-04 3.0666371e-04 ... 8.0509745e-03 | |
| 1.3393108e-02 9.4361240e-03]]] -0.27722132205963135 1.9477576643112116e-05 0.06931047886610031 0.29797351360321045 (1, 1, 7680) | |
| 2026-04-30 19:26:02.769 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 chunk_tokens [[[1447 784 991 1743] | |
| [ 373 1820 1001 860] | |
| [ 471 1478 640 1909] | |
| [1078 606 799 1197] | |
| [ 92 1083 188 102] | |
| [ 879 1982 1112 1302] | |
| [ 32 1131 1323 397] | |
| [1773 874 876 2003] | |
| [ 209 29 223 743] | |
| [1940 815 1567 121] | |
| [ 443 1000 1582 218] | |
| [ 16 1330 1410 1465] | |
| [ 316 702 1886 1630] | |
| [1128 1980 1398 364] | |
| [1306 1339 956 1455] | |
| [1288 232 1863 1732]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:02.794 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 wav [[[ 0.00426391 0.00582221 0.00909369 ... -0.02768227 -0.02276854 | |
| -0.01686861]]] -0.36572250723838806 0.00010111744632013142 0.10399573296308517 0.36718446016311646 (1, 1, 7680) | |
| 2026-04-30 19:26:02.794 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 chunk_tokens [[[ 610 1528 1711 1500] | |
| [1884 740 1101 768] | |
| [1904 1476 1554 1272] | |
| [ 345 733 671 1979] | |
| [1951 79 447 1193] | |
| [1868 1693 476 1352] | |
| [1349 1492 1649 958] | |
| [ 338 999 909 104] | |
| [1930 1151 229 1203] | |
| [ 250 478 1549 640] | |
| [ 87 1255 373 1403] | |
| [1315 1042 962 347] | |
| [ 47 676 863 461] | |
| [ 146 412 794 395] | |
| [1609 1066 1395 1182] | |
| [ 632 1120 472 1753]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:02.818 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 wav [[[-0.01355644 -0.01526949 -0.01623942 ... 0.0395449 0.05279908 | |
| 0.00224491]]] -0.353689044713974 9.688013051345479e-06 0.06698057800531387 0.3341635763645172 (1, 1, 7680) | |
| 2026-04-30 19:26:02.818 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 chunk_tokens [[[ 963 743 148 908] | |
| [ 760 1015 887 1772] | |
| [1691 702 1970 648] | |
| [1670 1294 849 312] | |
| [ 610 106 916 757] | |
| [ 964 709 1019 927] | |
| [ 736 491 1129 1060] | |
| [1428 1036 302 233] | |
| [1647 86 1819 202] | |
| [1943 1162 232 927] | |
| [ 421 1772 22 448] | |
| [1512 306 730 1208] | |
| [ 948 769 1918 1350] | |
| [ 905 596 1162 117] | |
| [1492 519 1808 74] | |
| [ 617 236 3 333]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:02.843 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 wav [[[-0.01579052 0.00150335 -0.02962946 ... -0.00423873 -0.00033509 | |
| 0.00640968]]] -0.2924741506576538 -3.654159081634134e-05 0.07507737725973129 0.3149661123752594 (1, 1, 7680) | |
| 2026-04-30 19:26:02.843 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-40 chunk_tokens [[[1360 1739] | |
| [1045 844] | |
| [1978 679] | |
| [1175 962] | |
| [ 317 583] | |
| [ 652 1737] | |
| [ 957 278] | |
| [1326 765] | |
| [1597 1010] | |
| [ 40 1869] | |
| [1037 1088] | |
| [ 57 553] | |
| [1070 546] | |
| [ 989 341] | |
| [1401 375] | |
| [ 168 1067]]] (1, 16, 2) n_chunk_frames 2 | |
| 2026-04-30 19:26:02.908 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-40 wav [[[1.9390190e-02 3.0609204e-02 3.0704437e-02 ... 1.1317945e-05 | |
| 1.0956299e-05 1.1030028e-05]]] -0.13680139183998108 0.00013362053141463548 0.015219715423882008 0.1303817480802536 (1, 1, 3840) | |
| 2026-04-30 19:26:02.908 [INFO] __main__: Synthesising: 'Мы наконец-то достигли момента,' | |
| 2026-04-30 19:26:02.908 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment М -> text_cache М | |
| 2026-04-30 19:26:02.908 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False | |
| 2026-04-30 19:26:02.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list [array([[[ 0.04818726, 0.05957031, 0.03213501, ..., -0.11203003, | |
| -0.09613037, -0.09103394]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.09631348, -0.10897827, -0.12399292, ..., -0.00085449, | |
| -0.00091553, -0.00048828]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.0000000e+00, 6.1035156e-05, -1.2207031e-04, ..., | |
| 1.3381958e-01, 1.6635132e-01, 2.0919800e-01]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 2.3223877e-01, 2.0669556e-01, 1.3903809e-01, ..., | |
| -1.8310547e-04, -1.5258789e-04, -9.1552734e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-9.1552734e-05, -6.1035156e-05, -3.0517578e-05, ..., | |
| 0.0000000e+00, -3.0517578e-05, 0.0000000e+00]]], | |
| shape=(1, 1, 5339), dtype=float32), array([[[-0.02130234, -0.01856662, -0.01710658, ..., 0.00041982, | |
| 0.00062048, 0.0006307 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00029411, -0.00040776, -0.00044942, ..., -0.02424868, | |
| 0.02291245, 0.05937432]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.07660156, 0.07495726, 0.06135209, ..., -0.1206022 , | |
| -0.12184623, -0.1139332 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10050648, -0.08953431, -0.07884923, ..., -0.01869578, | |
| -0.0167346 , -0.01763956]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2177158e-02, -6.4980479e-05, 1.2000869e-02, ..., | |
| -4.9953014e-03, 2.0064995e-02, 8.1494255e-03]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03188938, -0.00509401, 0.04241933, ..., -0.09476525, | |
| -0.18832558, -0.23867904]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.2519588 , -0.24120857, -0.2249308 , ..., -0.00908731, | |
| -0.00565482, -0.00478506]]], shape=(1, 1, 7680), dtype=float32), array([[[-4.7078328e-03, 7.2684824e-03, 2.4840837e-02, ..., | |
| -1.4027000e-05, 1.5263325e-04, 1.7792435e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[1.19311335e-04, 2.77099258e-04, 4.16864146e-04, ..., | |
| 1.06179923e-05, 1.06252701e-05, 1.15810089e-05]]], | |
| shape=(1, 1, 3840), dtype=float32), array([[[ 1.2349803e-05, 1.2119761e-05, 2.1108619e-05, ..., | |
| -1.6870323e-01, -1.3621169e-01, -8.6433820e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03330091, 0.00856069, 0.03467582, ..., -0.04072727, | |
| -0.03181617, -0.00645593]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01122023, 0.00413963, -0.00393783, ..., -0.00029461, | |
| 0.00421931, -0.00251451]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0154132 , -0.02377532, -0.02271089, ..., 0.02933036, | |
| 0.023146 , 0.01213897]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00091471, -0.01367491, -0.02537205, ..., -0.00178504, | |
| 0.00290802, 0.00261759]]], shape=(1, 1, 7680), dtype=float32), array([[[-2.6994986e-03, -8.4007008e-04, 2.4883149e-03, ..., | |
| 1.0968803e-05, 1.0850177e-05, 1.1066140e-05]]], | |
| shape=(1, 1, 1920), dtype=float32), array([[[-0.02139645, -0.0189162 , -0.01778135, ..., -0.00045287, | |
| -0.00059633, -0.00165827]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00221966, -0.00138947, -0.000929 , ..., -0.1126425 , | |
| -0.1338531 , -0.13333385]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10775348, -0.05212127, 0.0396859 , ..., -0.04563401, | |
| -0.03402565, -0.03579839]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03745677, -0.02658239, -0.02583151, ..., -0.0121026 , | |
| -0.00580872, -0.01895227]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0263972 , -0.01400574, -0.01092716, ..., -0.00139586, | |
| 0.00422512, 0.00643334]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00588865, 0.00345067, -0.00066399, ..., 0.00632556, | |
| 0.00391393, 0.00175216]]], shape=(1, 1, 5760), dtype=float32), array([[[ 0.0010756 , 0.00117576, 0.00123106, ..., -0.04100708, | |
| -0.0458885 , -0.04321691]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.05036464, -0.03583061, -0.00757636, ..., 0.05205004, | |
| 0.01185071, -0.03961121]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.08307496, -0.11176797, -0.1242267 , ..., -0.00193561, | |
| 0.005123 , 0.0037974 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00899126, -0.00369494, 0.00981118, ..., -0.00399455, | |
| -0.00319744, -0.00289368]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00285673, -0.0034839 , -0.00415278, ..., 0.00778646, | |
| 0.00595145, -0.0043805 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01552802, -0.01487012, -0.01219678, ..., -0.00294759, | |
| 0.00343194, 0.0008437 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00404704, 0.00067246, 0.00399263, ..., 0.09798931, | |
| 0.20872854, 0.2311011 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.14216125, 0.06682034, 0.02212509, ..., 0.06106113, | |
| 0.00223079, -0.05518628]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10738115, -0.11622868, -0.06752186, ..., 0.03509749, | |
| 0.03198082, 0.02877127]]], shape=(1, 1, 7680), dtype=float32), array([[[2.69281808e-02, 2.77648699e-02, 3.07107549e-02, ..., | |
| 1.15126495e-05, 1.21511912e-05, 1.15567072e-05]]], | |
| shape=(1, 1, 5760), dtype=float32), array([[[-2.0247478e-02, -1.6132748e-02, -1.4229195e-02, ..., | |
| 1.1977663e-05, 1.1495073e-05, 1.2644601e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 1.2498698e-05, 1.2433531e-05, 1.1404698e-05, ..., | |
| -5.8077216e-02, -5.1980902e-02, -5.0722528e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.05217085, -0.05058753, -0.03975262, ..., 0.21015896, | |
| 0.11327256, 0.02125037]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03852101, -0.06222959, -0.06324419, ..., 0.00308757, | |
| 0.01666446, 0.02635817]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02811593, 0.01903336, 0.00181638, ..., -0.00637799, | |
| -0.00625728, -0.01839462]]], shape=(1, 1, 7680), dtype=float32), array([[[-3.6303084e-02, -4.4228390e-02, -4.6101980e-02, ..., | |
| 4.6050473e-04, -4.0465111e-05, -2.4329145e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[7.2466741e-05, 2.7459790e-04, 3.0666371e-04, ..., | |
| 8.0509745e-03, 1.3393108e-02, 9.4361240e-03]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 0.00426391, 0.00582221, 0.00909369, ..., -0.02768227, | |
| -0.02276854, -0.01686861]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01355644, -0.01526949, -0.01623942, ..., 0.0395449 , | |
| 0.05279908, 0.00224491]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01579052, 0.00150335, -0.02962946, ..., -0.00423873, | |
| -0.00033509, 0.00640968]]], shape=(1, 1, 7680), dtype=float32), array([[[1.9390190e-02, 3.0609204e-02, 3.0704437e-02, ..., | |
| 1.1317945e-05, 1.0956299e-05, 1.1030028e-05]]], | |
| shape=(1, 1, 3840), dtype=float32)] 47 | |
| 2026-04-30 19:26:02.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history [4.8187256e-02 5.9570312e-02 3.2135010e-02 ... 1.1317945e-05 1.0956299e-05 | |
| 1.1030028e-05] (341339,) float32 | |
| 2026-04-30 19:26:02.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history_after cut_idx 21 [-2.2196597e-03 -1.3894709e-03 -9.2900067e-04 ... 1.1317945e-05 | |
| 1.0956299e-05 1.1030028e-05] (192000,) float32 | |
| 2026-04-30 19:26:02.916 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list_after cut_idx 21 [array([[[-0.00221966, -0.00138947, -0.000929 , ..., -0.1126425 , | |
| -0.1338531 , -0.13333385]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10775348, -0.05212127, 0.0396859 , ..., -0.04563401, | |
| -0.03402565, -0.03579839]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03745677, -0.02658239, -0.02583151, ..., -0.0121026 , | |
| -0.00580872, -0.01895227]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0263972 , -0.01400574, -0.01092716, ..., -0.00139586, | |
| 0.00422512, 0.00643334]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00588865, 0.00345067, -0.00066399, ..., 0.00632556, | |
| 0.00391393, 0.00175216]]], shape=(1, 1, 5760), dtype=float32), array([[[ 0.0010756 , 0.00117576, 0.00123106, ..., -0.04100708, | |
| -0.0458885 , -0.04321691]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.05036464, -0.03583061, -0.00757636, ..., 0.05205004, | |
| 0.01185071, -0.03961121]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.08307496, -0.11176797, -0.1242267 , ..., -0.00193561, | |
| 0.005123 , 0.0037974 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00899126, -0.00369494, 0.00981118, ..., -0.00399455, | |
| -0.00319744, -0.00289368]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00285673, -0.0034839 , -0.00415278, ..., 0.00778646, | |
| 0.00595145, -0.0043805 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01552802, -0.01487012, -0.01219678, ..., -0.00294759, | |
| 0.00343194, 0.0008437 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00404704, 0.00067246, 0.00399263, ..., 0.09798931, | |
| 0.20872854, 0.2311011 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.14216125, 0.06682034, 0.02212509, ..., 0.06106113, | |
| 0.00223079, -0.05518628]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10738115, -0.11622868, -0.06752186, ..., 0.03509749, | |
| 0.03198082, 0.02877127]]], shape=(1, 1, 7680), dtype=float32), array([[[2.69281808e-02, 2.77648699e-02, 3.07107549e-02, ..., | |
| 1.15126495e-05, 1.21511912e-05, 1.15567072e-05]]], | |
| shape=(1, 1, 5760), dtype=float32), array([[[-2.0247478e-02, -1.6132748e-02, -1.4229195e-02, ..., | |
| 1.1977663e-05, 1.1495073e-05, 1.2644601e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 1.2498698e-05, 1.2433531e-05, 1.1404698e-05, ..., | |
| -5.8077216e-02, -5.1980902e-02, -5.0722528e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.05217085, -0.05058753, -0.03975262, ..., 0.21015896, | |
| 0.11327256, 0.02125037]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03852101, -0.06222959, -0.06324419, ..., 0.00308757, | |
| 0.01666446, 0.02635817]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02811593, 0.01903336, 0.00181638, ..., -0.00637799, | |
| -0.00625728, -0.01839462]]], shape=(1, 1, 7680), dtype=float32), array([[[-3.6303084e-02, -4.4228390e-02, -4.6101980e-02, ..., | |
| 4.6050473e-04, -4.0465111e-05, -2.4329145e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[7.2466741e-05, 2.7459790e-04, 3.0666371e-04, ..., | |
| 8.0509745e-03, 1.3393108e-02, 9.4361240e-03]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 0.00426391, 0.00582221, 0.00909369, ..., -0.02768227, | |
| -0.02276854, -0.01686861]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01355644, -0.01526949, -0.01623942, ..., 0.0395449 , | |
| 0.05279908, 0.00224491]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01579052, 0.00150335, -0.02962946, ..., -0.00423873, | |
| -0.00033509, 0.00640968]]], shape=(1, 1, 7680), dtype=float32), array([[[1.9390190e-02, 3.0609204e-02, 3.0704437e-02, ..., | |
| 1.1317945e-05, 1.0956299e-05, 1.1030028e-05]]], | |
| shape=(1, 1, 3840), dtype=float32)] 26 | |
| 2026-04-30 19:26:02.916 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069 | |
| 2026-04-30 19:26:02.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[ 0.04276081 0.10415712 -0.05638932 ... 0.12182362 0.07653181 | |
| 0.08928564]]] (1, 1, 1024) | |
| 2026-04-30 19:26:02.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]] | |
| 2026-04-30 19:26:02.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661]]] (1, 4, 1024) | |
| 2026-04-30 19:26:02.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 1, 1024) | |
| 2026-04-30 19:26:02.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661] | |
| [ 0.04276081 0.10415712 -0.05638932 ... 0.12182362 0.07653181 | |
| 0.08928564] | |
| [-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 6, 1024) | |
| 2026-04-30 19:26:02.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22 | |
| Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:02.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:02.992 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:02.993 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:02.993 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024) | |
| 2026-04-30 19:26:02.993 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036 | |
| -0.00767252]]] (1, 1, 1024) | |
| 2026-04-30 19:26:02.994 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528 | |
| 0.00424147]]] (1, 1, 1024) | |
| 2026-04-30 19:26:02.994 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724 | |
| -0.00170945] | |
| [ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198 | |
| 0.00132705] | |
| [ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966 | |
| 0.0080104 ] | |
| [ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711 | |
| 0.00252486] | |
| [ 0.047539 0.10035113 -0.05808548 ... 0.11253928 0.0780871 | |
| 0.09352712] | |
| [ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459 | |
| -0.00718043]]] (1, 6, 1024) | |
| 2026-04-30 19:26:02.994 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03] | |
| ... | |
| [ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03 | |
| -2.0710612e-04 2.5248611e-03] | |
| [ 4.7538996e-02 1.0035113e-01 -5.8085475e-02 ... 1.1253928e-01 | |
| 7.8087099e-02 9.3527116e-02] | |
| [ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03 | |
| 3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024) | |
| 2026-04-30 19:26:03.039 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=61; step_idx=61 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill cont done; talker_seq_len=61; step_idx=61 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ы -> text_cache Мы | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache Мы | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Мы н | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache Мы на | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache Мы нак | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache Мы нако | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache Мы након | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache Мы наконе | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ц -> text_cache Мы наконец | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment - -> text_cache Мы наконец- | |
| 2026-04-30 19:26:03.078 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['Мы наконец-'] 11 | |
| Qwen3TTSProcessor __call__ text ['Мы наконец-'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 37991, 4552, 6709, 15869, 17316, 126499, 12]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 37991, 4552, 6709, 15869, 17316, 126499, 12]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 37991 4552 6709 15869 17316 126499 12]] (1, 7) | |
| 2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 37991 4552 6709 15869 17316 126499 12]] (1, 7) | |
| 2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment Мы наконец- 11 -> tokenized_segment [np.int64(37991), np.int64(4552), np.int64(6709), np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)] 7 | |
| 2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(37991), np.int64(4552), np.int64(6709), np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)] | |
| 2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(37991), np.int64(4552), np.int64(6709), np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)] 7 | |
| 2026-04-30 19:26:03.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 37991 -> pending_tokens [np.int64(4552), np.int64(6709), np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)] 6 | |
| 2026-04-30 19:26:03.088 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-61 vq [1221] (1,) int64 | |
| 2026-04-30 19:26:03.115 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-62 vq-rvq [[[1221 1390 1612 91 1463 2030 1696 1369 334 995 264 1096 407 421 | |
| 142 428]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.115 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 4552 -> pending_tokens [np.int64(6709), np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)] 5 | |
| 2026-04-30 19:26:03.123 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-62 vq [2042] (1,) int64 | |
| 2026-04-30 19:26:03.149 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-63 vq-rvq [[[2042 412 818 532 1373 463 1718 435 887 1736 100 546 963 388 | |
| 651 742]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.150 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6709 -> pending_tokens [np.int64(15869), np.int64(17316), np.int64(126499), np.int64(12)] 4 | |
| 2026-04-30 19:26:03.158 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-63 vq [1707] (1,) int64 | |
| 2026-04-30 19:26:03.184 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-64 vq-rvq [[[1707 1243 1747 1575 1799 182 884 978 410 1721 1185 1055 672 1104 | |
| 833 1038]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.184 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 15869 -> pending_tokens [np.int64(17316), np.int64(126499), np.int64(12)] 3 | |
| 2026-04-30 19:26:03.192 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-64 vq [397] (1,) int64 | |
| 2026-04-30 19:26:03.219 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-65 vq-rvq [[[ 397 407 1310 595 542 294 284 519 1716 111 1610 1437 222 317 | |
| 860 156]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.219 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 17316 -> pending_tokens [np.int64(126499), np.int64(12)] 2 | |
| 2026-04-30 19:26:03.227 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-65 vq [830] (1,) int64 | |
| 2026-04-30 19:26:03.254 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-66 vq-rvq [[[ 830 299 2003 1215 927 982 1406 1676 773 768 2018 1447 1045 655 | |
| 1606 1336]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.254 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 126499 -> pending_tokens [np.int64(12)] 1 | |
| 2026-04-30 19:26:03.262 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-66 vq [1782] (1,) int64 | |
| 2026-04-30 19:26:03.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-67 vq-rvq [[[1782 1698 1787 277 1263 167 1388 134 1689 690 269 996 1069 706 | |
| 169 59]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 12 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:03.297 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-67 vq [287] (1,) int64 | |
| 2026-04-30 19:26:03.323 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-68 vq-rvq [[[ 287 1924 69 564 295 372 10 31 1047 512 386 96 343 530 | |
| 1351 17]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.324 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-42 chunk_tokens [[[1221 2042 1707 397] | |
| [1390 412 1243 407] | |
| [1612 818 1747 1310] | |
| [ 91 532 1575 595] | |
| [1463 1373 1799 542] | |
| [2030 463 182 294] | |
| [1696 1718 884 284] | |
| [1369 435 978 519] | |
| [ 334 887 410 1716] | |
| [ 995 1736 1721 111] | |
| [ 264 100 1185 1610] | |
| [1096 546 1055 1437] | |
| [ 407 963 672 222] | |
| [ 421 388 1104 317] | |
| [ 142 651 833 860] | |
| [ 428 742 1038 156]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-42 wav [[[ 1.1094540e-05 1.1138460e-05 1.1009237e-05 ... -2.2123540e-02 | |
| -2.2558490e-02 -1.9299621e-02]]] -0.3667455315589905 -8.192218228941783e-05 0.051546160131692886 0.37703007459640503 (1, 1, 7680) | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache т | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache то д | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то до | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache то дос | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache то дост | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache то дости | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache то достиг | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache то достигл | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.348 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache то достигли | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache то достигли | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache то достигли м | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache то достигли мо | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache то достигли мом | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache то достигли моме | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache то достигли момен | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache то достигли момент | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache то достигли момента | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment , -> text_cache то достигли момента, | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['то достигли момента,'] 20 | |
| Qwen3TTSProcessor __call__ text ['то достигли момента,'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 24634, 139062, 11073, 130485, 87731, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:03.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 24634, 139062, 11073, 130485, 87731, 11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 24634 139062 11073 130485 87731 11]] (1, 6) | |
| 2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 24634 139062 11073 130485 87731 11]] (1, 6) | |
| 2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment то достигли момента, 20 -> tokenized_segment [np.int64(24634), np.int64(139062), np.int64(11073), np.int64(130485), np.int64(87731), np.int64(11)] 6 | |
| 2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(24634), np.int64(139062), np.int64(11073), np.int64(130485), np.int64(87731), np.int64(11)] | |
| 2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(24634), np.int64(139062), np.int64(11073), np.int64(130485), np.int64(87731), np.int64(11)] 6 | |
| 2026-04-30 19:26:03.350 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 24634 -> pending_tokens [np.int64(139062), np.int64(11073), np.int64(130485), np.int64(87731), np.int64(11)] 5 | |
| 2026-04-30 19:26:03.358 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-68 vq [1621] (1,) int64 | |
| 2026-04-30 19:26:03.385 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-69 vq-rvq [[[1621 1082 448 400 1626 1338 1419 1179 489 1966 765 131 1689 553 | |
| 1068 619]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.385 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 139062 -> pending_tokens [np.int64(11073), np.int64(130485), np.int64(87731), np.int64(11)] 4 | |
| 2026-04-30 19:26:03.393 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-69 vq [1055] (1,) int64 | |
| 2026-04-30 19:26:03.420 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-70 vq-rvq [[[1055 149 569 1965 903 768 911 342 400 575 609 865 309 430 | |
| 1324 1061]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.420 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11073 -> pending_tokens [np.int64(130485), np.int64(87731), np.int64(11)] 3 | |
| 2026-04-30 19:26:03.428 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-70 vq [770] (1,) int64 | |
| 2026-04-30 19:26:03.456 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-71 vq-rvq [[[ 770 915 216 1366 1121 468 121 1709 1099 1134 1156 446 223 75 | |
| 891 1082]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.456 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 130485 -> pending_tokens [np.int64(87731), np.int64(11)] 2 | |
| 2026-04-30 19:26:03.464 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-71 vq [499] (1,) int64 | |
| 2026-04-30 19:26:03.491 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-72 vq-rvq [[[ 499 1532 110 382 941 1185 935 413 1541 25 799 1421 217 1037 | |
| 873 1002]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.491 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 87731 -> pending_tokens [np.int64(11)] 1 | |
| 2026-04-30 19:26:03.499 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-72 vq [935] (1,) int64 | |
| 2026-04-30 19:26:03.526 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-73 vq-rvq [[[ 935 1224 1429 1973 818 1914 275 103 1336 1327 352 289 387 205 | |
| 1188 1024]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.526 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:03.534 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-73 vq [402] (1,) int64 | |
| 2026-04-30 19:26:03.561 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-74 vq-rvq [[[ 402 1161 1269 319 119 975 602 1536 432 585 1617 853 560 417 | |
| 1681 1402]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.561 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-46 chunk_tokens [[[ 830 1782 287 1621] | |
| [ 299 1698 1924 1082] | |
| [2003 1787 69 448] | |
| [1215 277 564 400] | |
| [ 927 1263 295 1626] | |
| [ 982 167 372 1338] | |
| [1406 1388 10 1419] | |
| [1676 134 31 1179] | |
| [ 773 1689 1047 489] | |
| [ 768 690 512 1966] | |
| [2018 269 386 765] | |
| [1447 996 96 131] | |
| [1045 1069 343 1689] | |
| [ 655 706 530 553] | |
| [1606 169 1351 1068] | |
| [1336 59 17 619]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:03.585 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-46 wav [[[0.00221431 0.03934583 0.0700637 ... 0.01913414 0.04059763 0.06542776]]] -0.2998812198638916 0.0001630938786547631 0.07838644087314606 0.33400189876556396 (1, 1, 7680) | |
| 2026-04-30 19:26:03.586 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-50 chunk_tokens [[[1055 770 499 935] | |
| [ 149 915 1532 1224] | |
| [ 569 216 110 1429] | |
| [1965 1366 382 1973] | |
| [ 903 1121 941 818] | |
| [ 768 468 1185 1914] | |
| [ 911 121 935 275] | |
| [ 342 1709 413 103] | |
| [ 400 1099 1541 1336] | |
| [ 575 1134 25 1327] | |
| [ 609 1156 799 352] | |
| [ 865 446 1421 289] | |
| [ 309 223 217 387] | |
| [ 430 75 1037 205] | |
| [1324 891 873 1188] | |
| [1061 1082 1002 1024]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-50 wav [[[0.08465035 0.0946539 0.09328509 ... 0.0472551 0.05668663 0.05911173]]] -0.41971355676651 2.49695385718951e-05 0.07336953282356262 0.34725117683410645 (1, 1, 7680) | |
| 2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0 | |
| 2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:26:03.610 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:03.618 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-74 vq [1316] (1,) int64 | |
| 2026-04-30 19:26:03.645 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-75 vq-rvq [[[1316 1002 192 1761 1004 1542 70 1129 261 448 563 1222 100 276 | |
| 418 197]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.653 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-75 vq [177] (1,) int64 | |
| 2026-04-30 19:26:03.680 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-76 vq-rvq [[[ 177 1183 2028 633 1945 1051 1205 1143 62 705 1670 304 458 1590 | |
| 1 58]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.688 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-76 vq [1196] (1,) int64 | |
| 2026-04-30 19:26:03.715 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-77 vq-rvq [[[1196 87 658 1207 848 1837 1930 1811 643 814 81 820 1104 188 | |
| 134 219]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.723 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-77 vq [891] (1,) int64 | |
| 2026-04-30 19:26:03.749 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-78 vq-rvq [[[ 891 718 34 428 1484 1012 1968 1148 32 243 1480 378 1958 1327 | |
| 1280 1357]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.757 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-78 vq [777] (1,) int64 | |
| 2026-04-30 19:26:03.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-79 vq-rvq [[[ 777 1525 146 1201 588 403 1350 709 1866 1032 1990 190 1516 1789 | |
| 127 1094]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.792 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-79 vq [833] (1,) int64 | |
| 2026-04-30 19:26:03.819 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-80 vq-rvq [[[ 833 1377 609 549 708 1294 346 1289 1844 1398 641 1576 1876 1417 | |
| 71 996]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.827 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-80 vq [1559] (1,) int64 | |
| 2026-04-30 19:26:03.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-81 vq-rvq [[[1559 1378 2045 1595 3 246 970 952 186 212 678 1040 1932 1374 | |
| 953 823]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.861 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-81 vq [28] (1,) int64 | |
| 2026-04-30 19:26:03.888 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-82 vq-rvq [[[ 28 1354 153 367 360 1253 1037 1486 1162 488 319 253 1712 1897 | |
| 1347 1641]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.896 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-82 vq [158] (1,) int64 | |
| 2026-04-30 19:26:03.923 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-83 vq-rvq [[[ 158 1809 503 10 260 865 654 830 528 1684 1396 1636 878 402 | |
| 1138 694]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.931 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-83 vq [2030] (1,) int64 | |
| 2026-04-30 19:26:03.958 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-84 vq-rvq [[[2030 1971 1116 189 841 1694 183 182 350 617 297 1927 5 958 | |
| 537 198]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:03.966 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-84 vq [2020] (1,) int64 | |
| 2026-04-30 19:26:03.993 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-85 vq-rvq [[[2020 545 310 1224 39 1812 195 1521 435 1403 2007 1443 412 960 | |
| 1957 1595]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.001 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-85 vq [825] (1,) int64 | |
| 2026-04-30 19:26:04.028 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-86 vq-rvq [[[ 825 1821 1718 1989 1167 87 44 878 1228 1347 1997 1699 895 1 | |
| 1906 1385]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.036 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-86 vq [667] (1,) int64 | |
| 2026-04-30 19:26:04.063 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-87 vq-rvq [[[ 667 1058 1708 706 1493 1607 383 1441 1507 1330 206 17 1300 1449 | |
| 678 967]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-87 vq [1406] (1,) int64 | |
| 2026-04-30 19:26:04.098 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-88 vq-rvq [[[1406 834 28 30 704 25 710 174 834 1047 123 1992 261 19 | |
| 941 1345]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.106 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-88 vq [195] (1,) int64 | |
| 2026-04-30 19:26:04.133 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-89 vq-rvq [[[ 195 1175 1442 232 315 1465 547 1466 369 105 1720 676 716 1993 | |
| 66 1405]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.141 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-89 vq [1603] (1,) int64 | |
| 2026-04-30 19:26:04.168 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-90 vq-rvq [[[1603 1782 399 533 1579 1414 11 1620 1305 340 1136 1212 150 58 | |
| 1778 1622]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.176 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-90 vq [1106] (1,) int64 | |
| 2026-04-30 19:26:04.203 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-91 vq-rvq [[[1106 638 1001 1977 1680 1733 1512 1194 940 1471 713 123 394 754 | |
| 499 90]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.211 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-91 vq [1182] (1,) int64 | |
| 2026-04-30 19:26:04.238 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-92 vq-rvq [[[1182 1456 1273 1913 481 59 648 1517 1564 1235 1015 119 11 81 | |
| 721 206]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.246 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-92 vq [1958] (1,) int64 | |
| 2026-04-30 19:26:04.273 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-93 vq-rvq [[[1958 433 1937 494 884 174 1093 1061 52 1700 608 1185 199 72 | |
| 44 1706]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.281 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-93 vq [863] (1,) int64 | |
| 2026-04-30 19:26:04.308 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-94 vq-rvq [[[ 863 693 1454 750 625 634 1113 192 1442 850 1401 420 1675 872 | |
| 683 1036]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-94 vq [2150] (1,) int64 | |
| 2026-04-30 19:26:04.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-54 chunk_tokens [[[ 402 1316 177 1196] | |
| [1161 1002 1183 87] | |
| [1269 192 2028 658] | |
| [ 319 1761 633 1207] | |
| [ 119 1004 1945 848] | |
| [ 975 1542 1051 1837] | |
| [ 602 70 1205 1930] | |
| [1536 1129 1143 1811] | |
| [ 432 261 62 643] | |
| [ 585 448 705 814] | |
| [1617 563 1670 81] | |
| [ 853 1222 304 820] | |
| [ 560 100 458 1104] | |
| [ 417 276 1590 188] | |
| [1681 418 1 134] | |
| [1402 197 58 219]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:04.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-54 wav [[[ 0.04501721 0.0241992 0.01363233 ... -0.04057647 -0.05749581 | |
| -0.0651198 ]]] -0.4347250461578369 -4.3712687329389155e-05 0.0809682309627533 0.315145879983902 (1, 1, 7680) | |
| 2026-04-30 19:26:04.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-58 chunk_tokens [[[ 891 777 833 1559] | |
| [ 718 1525 1377 1378] | |
| [ 34 146 609 2045] | |
| [ 428 1201 549 1595] | |
| [1484 588 708 3] | |
| [1012 403 1294 246] | |
| [1968 1350 346 970] | |
| [1148 709 1289 952] | |
| [ 32 1866 1844 186] | |
| [ 243 1032 1398 212] | |
| [1480 1990 641 678] | |
| [ 378 190 1576 1040] | |
| [1958 1516 1876 1932] | |
| [1327 1789 1417 1374] | |
| [1280 127 71 953] | |
| [1357 1094 996 823]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:04.365 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-58 wav [[[-0.06861783 -0.06905188 -0.06281615 ... -0.00338598 0.00180774 | |
| 0.00092616]]] -0.39641478657722473 3.9381378883263096e-05 0.06513799726963043 0.28704598546028137 (1, 1, 7680) | |
| 2026-04-30 19:26:04.366 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-62 chunk_tokens [[[ 28 158 2030 2020] | |
| [1354 1809 1971 545] | |
| [ 153 503 1116 310] | |
| [ 367 10 189 1224] | |
| [ 360 260 841 39] | |
| [1253 865 1694 1812] | |
| [1037 654 183 195] | |
| [1486 830 182 1521] | |
| [1162 528 350 435] | |
| [ 488 1684 617 1403] | |
| [ 319 1396 297 2007] | |
| [ 253 1636 1927 1443] | |
| [1712 878 5 412] | |
| [1897 402 958 960] | |
| [1347 1138 537 1957] | |
| [1641 694 198 1595]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:04.390 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-62 wav [[[-0.00584421 -0.00096309 0.00632945 ... 0.00375346 0.00384357 | |
| 0.00217619]]] -0.3507983982563019 1.487454142079514e-06 0.07993330806493759 0.3479536771774292 (1, 1, 7680) | |
| 2026-04-30 19:26:04.390 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-66 chunk_tokens [[[ 825 667 1406 195] | |
| [1821 1058 834 1175] | |
| [1718 1708 28 1442] | |
| [1989 706 30 232] | |
| [1167 1493 704 315] | |
| [ 87 1607 25 1465] | |
| [ 44 383 710 547] | |
| [ 878 1441 174 1466] | |
| [1228 1507 834 369] | |
| [1347 1330 1047 105] | |
| [1997 206 123 1720] | |
| [1699 17 1992 676] | |
| [ 895 1300 261 716] | |
| [ 1 1449 19 1993] | |
| [1906 678 941 66] | |
| [1385 967 1345 1405]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:04.414 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-66 wav [[[-0.00579548 -0.01757104 -0.0243005 ... 0.00547749 0.00660871 | |
| 0.009783 ]]] -0.30730149149894714 7.387773075606674e-05 0.07454356551170349 0.42008545994758606 (1, 1, 7680) | |
| 2026-04-30 19:26:04.414 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-70 chunk_tokens [[[1603 1106 1182 1958] | |
| [1782 638 1456 433] | |
| [ 399 1001 1273 1937] | |
| [ 533 1977 1913 494] | |
| [1579 1680 481 884] | |
| [1414 1733 59 174] | |
| [ 11 1512 648 1093] | |
| [1620 1194 1517 1061] | |
| [1305 940 1564 52] | |
| [ 340 1471 1235 1700] | |
| [1136 713 1015 608] | |
| [1212 123 119 1185] | |
| [ 150 394 11 199] | |
| [ 58 754 81 72] | |
| [1778 499 721 44] | |
| [1622 90 206 1706]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:04.438 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-70 wav [[[ 0.01747901 0.02681293 0.03847475 ... -0.02004432 -0.02144283 | |
| -0.0218131 ]]] -0.4774703085422516 4.8207220970653e-05 0.07886362075805664 0.2929850220680237 (1, 1, 7680) | |
| 2026-04-30 19:26:04.438 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-74 chunk_tokens [[[ 863] | |
| [ 693] | |
| [1454] | |
| [ 750] | |
| [ 625] | |
| [ 634] | |
| [1113] | |
| [ 192] | |
| [1442] | |
| [ 850] | |
| [1401] | |
| [ 420] | |
| [1675] | |
| [ 872] | |
| [ 683] | |
| [1036]]] (1, 16, 1) n_chunk_frames 1 | |
| 2026-04-30 19:26:04.504 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-74 wav [[[-1.9715637e-02 -1.6528632e-02 -1.3177541e-02 ... 1.1422026e-05 | |
| 1.1317023e-05 1.1494269e-05]]] -0.031071737408638 -7.873835420468822e-05 0.008015702478587627 0.03967128321528435 (1, 1, 1920) | |
| 2026-04-30 19:26:04.505 [INFO] src.inference.qwen3_tts_inferencer_onnx: reset_turn reset_generation_state step-idx-95 | |
| 2026-04-30 19:26:04.522 [INFO] __main__: Synthesising: 'когда технологии стали достаточно быстрыми,' | |
| 2026-04-30 19:26:04.522 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment к -> text_cache к | |
| 2026-04-30 19:26:04.523 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False | |
| 2026-04-30 19:26:04.523 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069 | |
| 2026-04-30 19:26:04.602 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076 | |
| 0.08690926]]] (1, 1, 1024) | |
| 2026-04-30 19:26:04.602 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]] | |
| 2026-04-30 19:26:04.602 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661]]] (1, 4, 1024) | |
| 2026-04-30 19:26:04.603 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 1, 1024) | |
| 2026-04-30 19:26:04.603 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661] | |
| [-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076 | |
| 0.08690926] | |
| [-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 6, 1024) | |
| 2026-04-30 19:26:04.603 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22 | |
| Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:04.604 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:04.604 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:04.604 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:04.604 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024) | |
| 2026-04-30 19:26:04.605 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036 | |
| -0.00767252]]] (1, 1, 1024) | |
| 2026-04-30 19:26:04.605 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528 | |
| 0.00424147]]] (1, 1, 1024) | |
| 2026-04-30 19:26:04.605 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724 | |
| -0.00170945] | |
| [ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198 | |
| 0.00132705] | |
| [ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966 | |
| 0.0080104 ] | |
| [ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711 | |
| 0.00252486] | |
| [-0.02064589 0.05184897 0.01909059 ... 0.2070941 0.06416605 | |
| 0.09115074] | |
| [ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459 | |
| -0.00718043]]] (1, 6, 1024) | |
| 2026-04-30 19:26:04.606 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03] | |
| ... | |
| [ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03 | |
| -2.0710612e-04 2.5248611e-03] | |
| [-2.0645889e-02 5.1848970e-02 1.9090585e-02 ... 2.0709410e-01 | |
| 6.4166047e-02 9.1150738e-02] | |
| [ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03 | |
| 3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024) | |
| 2026-04-30 19:26:04.649 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=9; step_idx=0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache ко | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache ког | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache когд | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache когда | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache когда | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache когда т | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache когда те | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment х -> text_cache когда тех | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache когда техн | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache когда техно | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache когда технол | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache когда техноло | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache когда технолог | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache когда технологи | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache когда технологии | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache когда технологии | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache когда технологии с | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache когда технологии ст | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache когда технологии ста | |
| 2026-04-30 19:26:04.650 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache когда технологии стал | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache когда технологии стали | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache когда технологии стали | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache когда технологии стали д | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache когда технологии стали до | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache когда технологии стали дос | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache когда технологии стали дост | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache когда технологии стали доста | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache когда технологии стали достат | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache когда технологии стали достато | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ч -> text_cache когда технологии стали достаточ | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache когда технологии стали достаточн | |
| 2026-04-30 19:26:04.651 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['когда технологии стали '] 23 | |
| Qwen3TTSProcessor __call__ text ['когда технологии стали '] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 4793, 124846, 142651, 135906, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 4793, 124846, 142651, 135906, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 4793 124846 142651 135906 220]] (1, 5) | |
| 2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 4793 124846 142651 135906 220]] (1, 5) | |
| 2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment когда технологии стали 23 -> tokenized_segment [np.int64(4793), np.int64(124846), np.int64(142651), np.int64(135906), np.int64(220)] 5 | |
| 2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(4793), np.int64(124846), np.int64(142651), np.int64(135906), np.int64(220)] | |
| 2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(4793), np.int64(124846), np.int64(142651), np.int64(135906), np.int64(220)] 5 | |
| 2026-04-30 19:26:04.652 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 4793 -> pending_tokens [np.int64(124846), np.int64(142651), np.int64(135906), np.int64(220)] 4 | |
| 2026-04-30 19:26:04.660 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-0 vq [1995] (1,) int64 | |
| 2026-04-30 19:26:04.687 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-1 vq-rvq [[[1995 1221 283 22 107 69 1751 604 679 765 2009 1593 266 160 | |
| 1376 1058]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.687 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 124846 -> pending_tokens [np.int64(142651), np.int64(135906), np.int64(220)] 3 | |
| 2026-04-30 19:26:04.695 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-1 vq [215] (1,) int64 | |
| 2026-04-30 19:26:04.722 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-2 vq-rvq [[[ 215 1889 1402 238 914 219 1579 126 249 1179 400 256 965 144 | |
| 911 1023]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.722 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 142651 -> pending_tokens [np.int64(135906), np.int64(220)] 2 | |
| 2026-04-30 19:26:04.730 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-2 vq [212] (1,) int64 | |
| 2026-04-30 19:26:04.757 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-3 vq-rvq [[[ 212 1071 1054 282 610 1506 1148 2029 1242 1454 743 2034 1464 177 | |
| 126 1049]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.757 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 135906 -> pending_tokens [np.int64(220)] 1 | |
| 2026-04-30 19:26:04.765 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-3 vq [1181] (1,) int64 | |
| 2026-04-30 19:26:04.792 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-4 vq-rvq [[[1181 1704 928 354 947 785 1640 1641 705 1607 1652 796 783 818 | |
| 159 1764]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.792 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 220 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:04.800 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-4 vq [462] (1,) int64 | |
| 2026-04-30 19:26:04.827 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-5 vq-rvq [[[ 462 582 705 864 442 449 474 1777 1154 266 1702 1753 1160 237 | |
| 1837 161]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.828 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 chunk_tokens [[[1995 215 212 1181] | |
| [1221 1889 1071 1704] | |
| [ 283 1402 1054 928] | |
| [ 22 238 282 354] | |
| [ 107 914 610 947] | |
| [ 69 219 1506 785] | |
| [1751 1579 1148 1640] | |
| [ 604 126 2029 1641] | |
| [ 679 249 1242 705] | |
| [ 765 1179 1454 1607] | |
| [2009 400 743 1652] | |
| [1593 256 2034 796] | |
| [ 266 965 1464 783] | |
| [ 160 144 177 818] | |
| [1376 911 126 159] | |
| [1058 1023 1049 1764]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 wav [[[-2.06317715e-02 -1.67933665e-02 -1.47240255e-02 ... 6.64611871e-05 | |
| -4.19520393e-06 -7.44241624e-05]]] -0.03491878882050514 -5.533664079848677e-05 0.001796408905647695 0.0195828378200531 (1, 1, 7680) | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache достаточно | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache достаточно | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment б -> text_cache достаточно б | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ы -> text_cache достаточно бы | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache достаточно быс | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache достаточно быст | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache достаточно быстр | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ы -> text_cache достаточно быстры | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache достаточно быстрым | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache достаточно быстрыми | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment , -> text_cache достаточно быстрыми, | |
| 2026-04-30 19:26:04.852 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['достаточно быстрыми,'] 20 | |
| Qwen3TTSProcessor __call__ text ['достаточно быстрыми,'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 6949, 24276, 7972, 127310, 37660, 6597, 38003, 63780, | |
| 11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 6949, 24276, 7972, 127310, 37660, 6597, 38003, 63780, | |
| 11]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 6949 24276 7972 127310 37660 6597 38003 63780 11]] (1, 9) | |
| 2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 6949 24276 7972 127310 37660 6597 38003 63780 11]] (1, 9) | |
| 2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment достаточно быстрыми, 20 -> tokenized_segment [np.int64(6949), np.int64(24276), np.int64(7972), np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 9 | |
| 2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(6949), np.int64(24276), np.int64(7972), np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] | |
| 2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(6949), np.int64(24276), np.int64(7972), np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 9 | |
| 2026-04-30 19:26:04.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6949 -> pending_tokens [np.int64(24276), np.int64(7972), np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 8 | |
| 2026-04-30 19:26:04.861 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-5 vq [1225] (1,) int64 | |
| 2026-04-30 19:26:04.888 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-6 vq-rvq [[[1225 1825 534 2042 1456 412 1489 1182 1379 758 196 1170 520 1545 | |
| 1692 319]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.888 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 24276 -> pending_tokens [np.int64(7972), np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 7 | |
| 2026-04-30 19:26:04.896 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-6 vq [628] (1,) int64 | |
| 2026-04-30 19:26:04.924 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-7 vq-rvq [[[ 628 817 1643 77 2036 1890 1753 62 968 221 1153 454 811 80 | |
| 2041 295]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.924 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 7972 -> pending_tokens [np.int64(127310), np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 6 | |
| 2026-04-30 19:26:04.932 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-7 vq [499] (1,) int64 | |
| 2026-04-30 19:26:04.959 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-8 vq-rvq [[[ 499 1809 1734 36 380 736 1416 730 2004 797 609 195 883 252 | |
| 106 1160]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.959 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 127310 -> pending_tokens [np.int64(37660), np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 5 | |
| 2026-04-30 19:26:04.967 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-8 vq [1953] (1,) int64 | |
| 2026-04-30 19:26:04.993 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-9 vq-rvq [[[1953 1826 459 1987 661 333 410 1010 1836 768 299 1155 765 35 | |
| 858 113]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:04.994 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 37660 -> pending_tokens [np.int64(6597), np.int64(38003), np.int64(63780), np.int64(11)] 4 | |
| 2026-04-30 19:26:05.002 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-9 vq [777] (1,) int64 | |
| 2026-04-30 19:26:05.028 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-10 vq-rvq [[[ 777 1400 373 1850 841 1731 1929 122 647 189 121 321 1593 1692 | |
| 439 134]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.028 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6597 -> pending_tokens [np.int64(38003), np.int64(63780), np.int64(11)] 3 | |
| 2026-04-30 19:26:05.036 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-10 vq [297] (1,) int64 | |
| 2026-04-30 19:26:05.063 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-11 vq-rvq [[[ 297 1510 741 1241 1769 938 101 648 519 1125 2014 736 1689 780 | |
| 122 381]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.063 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 38003 -> pending_tokens [np.int64(63780), np.int64(11)] 2 | |
| 2026-04-30 19:26:05.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-11 vq [1145] (1,) int64 | |
| 2026-04-30 19:26:05.098 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-12 vq-rvq [[[1145 1696 1750 758 222 1793 458 367 202 100 473 1014 120 962 | |
| 637 1657]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.098 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 63780 -> pending_tokens [np.int64(11)] 1 | |
| 2026-04-30 19:26:05.106 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-12 vq [39] (1,) int64 | |
| 2026-04-30 19:26:05.133 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-13 vq-rvq [[[ 39 1021 837 277 1464 1807 294 1316 1706 447 1077 1055 1346 205 | |
| 665 632]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.133 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:05.141 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-13 vq [1845] (1,) int64 | |
| 2026-04-30 19:26:05.168 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-14 vq-rvq [[[1845 1165 394 146 159 1813 1216 1399 1678 149 1560 68 815 1 | |
| 1622 1235]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.169 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 chunk_tokens [[[ 462 1225 628 499] | |
| [ 582 1825 817 1809] | |
| [ 705 534 1643 1734] | |
| [ 864 2042 77 36] | |
| [ 442 1456 2036 380] | |
| [ 449 412 1890 736] | |
| [ 474 1489 1753 1416] | |
| [1777 1182 62 730] | |
| [1154 1379 968 2004] | |
| [ 266 758 221 797] | |
| [1702 196 1153 609] | |
| [1753 1170 454 195] | |
| [1160 520 811 883] | |
| [ 237 1545 80 252] | |
| [1837 1692 2041 106] | |
| [ 161 319 295 1160]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:05.193 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 wav [[[-8.0167578e-05 -4.1713702e-05 3.4347220e-05 ... 1.4899543e-02 | |
| 1.9630753e-02 2.1652387e-02]]] -0.24945759773254395 1.0724160347308498e-05 0.03428755700588226 0.3815094232559204 (1, 1, 7680) | |
| 2026-04-30 19:26:05.193 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 chunk_tokens [[[1953 777 297 1145] | |
| [1826 1400 1510 1696] | |
| [ 459 373 741 1750] | |
| [1987 1850 1241 758] | |
| [ 661 841 1769 222] | |
| [ 333 1731 938 1793] | |
| [ 410 1929 101 458] | |
| [1010 122 648 367] | |
| [1836 647 519 202] | |
| [ 768 189 1125 100] | |
| [ 299 121 2014 473] | |
| [1155 321 736 1014] | |
| [ 765 1593 1689 120] | |
| [ 35 1692 780 962] | |
| [ 858 439 122 637] | |
| [ 113 134 381 1657]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 wav [[[0.02029367 0.01627654 0.01006193 ... 0.06808572 0.06454458 0.05861032]]] -0.38842353224754333 5.7938919781008735e-05 0.05044485256075859 0.2728379964828491 (1, 1, 7680) | |
| 2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0 | |
| 2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:26:05.217 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:05.225 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-14 vq [477] (1,) int64 | |
| 2026-04-30 19:26:05.252 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-15 vq-rvq [[[ 477 1201 7 10 993 403 1457 169 1973 1347 354 546 759 166 | |
| 659 1732]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.260 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-15 vq [133] (1,) int64 | |
| 2026-04-30 19:26:05.287 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-16 vq-rvq [[[ 133 1501 1379 1860 690 1385 767 1818 1092 581 251 217 577 1691 | |
| 1062 438]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.295 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-16 vq [1634] (1,) int64 | |
| 2026-04-30 19:26:05.322 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-17 vq-rvq [[[1634 845 902 1438 63 763 750 709 1991 208 1886 720 1736 1325 | |
| 259 1079]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.330 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-17 vq [177] (1,) int64 | |
| 2026-04-30 19:26:05.358 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-18 vq-rvq [[[ 177 273 0 770 299 1944 1776 136 1351 1317 719 798 156 1221 | |
| 77 747]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.366 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-18 vq [1196] (1,) int64 | |
| 2026-04-30 19:26:05.393 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-19 vq-rvq [[[1196 1013 1029 663 1488 614 446 763 477 769 269 16 181 971 | |
| 1660 236]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.401 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-19 vq [506] (1,) int64 | |
| 2026-04-30 19:26:05.428 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-20 vq-rvq [[[ 506 1971 413 276 1512 1269 736 1679 1576 1804 1700 194 309 4 | |
| 451 1096]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.436 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-20 vq [532] (1,) int64 | |
| 2026-04-30 19:26:05.463 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-21 vq-rvq [[[ 532 1151 66 776 682 260 10 609 1044 947 739 2032 1070 1022 | |
| 2031 1559]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.471 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-21 vq [269] (1,) int64 | |
| 2026-04-30 19:26:05.498 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-22 vq-rvq [[[ 269 1892 1689 1288 1548 1981 94 640 281 830 12 739 548 979 | |
| 191 564]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.506 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-22 vq [1745] (1,) int64 | |
| 2026-04-30 19:26:05.533 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-23 vq-rvq [[[1745 1592 1688 155 1960 1876 1627 1058 894 568 922 1441 1101 1244 | |
| 281 940]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.541 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-23 vq [575] (1,) int64 | |
| 2026-04-30 19:26:05.568 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-24 vq-rvq [[[ 575 1371 1999 1593 1727 2011 1680 1650 1692 652 522 312 902 1124 | |
| 1453 510]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.577 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-24 vq [36] (1,) int64 | |
| 2026-04-30 19:26:05.604 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-25 vq-rvq [[[ 36 621 342 1557 1270 126 1376 1347 1012 702 156 1458 810 500 | |
| 645 540]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.612 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-25 vq [875] (1,) int64 | |
| 2026-04-30 19:26:05.639 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-26 vq-rvq [[[ 875 1588 385 692 732 573 254 400 792 1769 686 596 1820 389 | |
| 1910 179]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.647 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-26 vq [515] (1,) int64 | |
| 2026-04-30 19:26:05.674 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-27 vq-rvq [[[ 515 600 1231 489 627 1546 483 770 37 170 337 812 852 693 | |
| 1402 81]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.682 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-27 vq [1947] (1,) int64 | |
| 2026-04-30 19:26:05.710 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-28 vq-rvq [[[1947 32 1287 417 1117 1794 392 1055 984 1911 153 1031 438 1869 | |
| 217 626]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.718 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-28 vq [2004] (1,) int64 | |
| 2026-04-30 19:26:05.744 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-29 vq-rvq [[[2004 127 273 145 623 35 1583 1891 36 1998 531 1295 1175 1769 | |
| 1449 202]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.752 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-29 vq [156] (1,) int64 | |
| 2026-04-30 19:26:05.779 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-30 vq-rvq [[[ 156 1759 187 1642 1607 669 676 1769 856 375 1883 44 1062 674 | |
| 396 1680]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.787 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-30 vq [1743] (1,) int64 | |
| 2026-04-30 19:26:05.814 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-31 vq-rvq [[[1743 944 1095 2000 1054 1879 95 255 1024 988 167 964 314 936 | |
| 379 207]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.822 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-31 vq [496] (1,) int64 | |
| 2026-04-30 19:26:05.849 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-32 vq-rvq [[[ 496 1354 1942 1697 1263 229 544 498 1632 1007 373 81 1046 587 | |
| 1348 151]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.857 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-32 vq [679] (1,) int64 | |
| 2026-04-30 19:26:05.884 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-33 vq-rvq [[[ 679 1183 710 884 1983 1610 996 354 1542 1796 1666 924 934 496 | |
| 1152 1176]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.892 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-33 vq [1514] (1,) int64 | |
| 2026-04-30 19:26:05.918 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-34 vq-rvq [[[1514 1233 2007 621 779 189 150 1096 722 668 1616 178 507 869 | |
| 7 12]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.926 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-34 vq [982] (1,) int64 | |
| 2026-04-30 19:26:05.953 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-35 vq-rvq [[[ 982 1595 1770 370 1019 1659 256 1916 11 733 549 1659 1268 1757 | |
| 701 59]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.961 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-35 vq [1063] (1,) int64 | |
| 2026-04-30 19:26:05.988 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-36 vq-rvq [[[1063 1772 246 1417 1681 1494 832 342 1503 530 424 1676 1340 1327 | |
| 1571 687]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:05.996 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-36 vq [121] (1,) int64 | |
| 2026-04-30 19:26:06.023 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-37 vq-rvq [[[ 121 1042 1879 1782 1702 1511 364 1823 1269 1237 799 1076 809 1339 | |
| 420 1115]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.031 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-37 vq [2150] (1,) int64 | |
| 2026-04-30 19:26:06.031 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 chunk_tokens [[[ 39 1845 477 133] | |
| [1021 1165 1201 1501] | |
| [ 837 394 7 1379] | |
| [ 277 146 10 1860] | |
| [1464 159 993 690] | |
| [1807 1813 403 1385] | |
| [ 294 1216 1457 767] | |
| [1316 1399 169 1818] | |
| [1706 1678 1973 1092] | |
| [ 447 149 1347 581] | |
| [1077 1560 354 251] | |
| [1055 68 546 217] | |
| [1346 815 759 577] | |
| [ 205 1 166 1691] | |
| [ 665 1622 659 1062] | |
| [ 632 1235 1732 438]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:06.055 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 wav [[[ 0.05094757 0.04577596 0.04464076 ... -0.03615839 -0.03458475 | |
| 0.00780901]]] -0.38215261697769165 4.1282673919340596e-05 0.08734284341335297 0.27787166833877563 (1, 1, 7680) | |
| 2026-04-30 19:26:06.055 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 chunk_tokens [[[1634 177 1196 506] | |
| [ 845 273 1013 1971] | |
| [ 902 0 1029 413] | |
| [1438 770 663 276] | |
| [ 63 299 1488 1512] | |
| [ 763 1944 614 1269] | |
| [ 750 1776 446 736] | |
| [ 709 136 763 1679] | |
| [1991 1351 477 1576] | |
| [ 208 1317 769 1804] | |
| [1886 719 269 1700] | |
| [ 720 798 16 194] | |
| [1736 156 181 309] | |
| [1325 1221 971 4] | |
| [ 259 77 1660 451] | |
| [1079 747 236 1096]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:06.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 wav [[[0.05842641 0.09555472 0.10986558 ... 0.0013969 0.01872239 0.04114778]]] -0.3857892155647278 9.528391092317179e-05 0.06948209553956985 0.33023425936698914 (1, 1, 7680) | |
| 2026-04-30 19:26:06.080 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 chunk_tokens [[[ 532 269 1745 575] | |
| [1151 1892 1592 1371] | |
| [ 66 1689 1688 1999] | |
| [ 776 1288 155 1593] | |
| [ 682 1548 1960 1727] | |
| [ 260 1981 1876 2011] | |
| [ 10 94 1627 1680] | |
| [ 609 640 1058 1650] | |
| [1044 281 894 1692] | |
| [ 947 830 568 652] | |
| [ 739 12 922 522] | |
| [2032 739 1441 312] | |
| [1070 548 1101 902] | |
| [1022 979 1244 1124] | |
| [2031 191 281 1453] | |
| [1559 564 940 510]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:06.104 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 wav [[[ 0.05213842 0.05569138 0.06345794 ... -0.00115294 -0.00027638 | |
| -0.00037019]]] -0.3263360857963562 -0.0001289134524995461 0.06016819179058075 0.2761137783527374 (1, 1, 7680) | |
| 2026-04-30 19:26:06.104 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 chunk_tokens [[[ 36 875 515 1947] | |
| [ 621 1588 600 32] | |
| [ 342 385 1231 1287] | |
| [1557 692 489 417] | |
| [1270 732 627 1117] | |
| [ 126 573 1546 1794] | |
| [1376 254 483 392] | |
| [1347 400 770 1055] | |
| [1012 792 37 984] | |
| [ 702 1769 170 1911] | |
| [ 156 686 337 153] | |
| [1458 596 812 1031] | |
| [ 810 1820 852 438] | |
| [ 500 389 693 1869] | |
| [ 645 1910 1402 217] | |
| [ 540 179 81 626]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:06.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 wav [[[-1.2735376e-03 -7.3580118e-04 3.0488527e-05 ... 8.4239952e-03 | |
| 3.2757007e-02 1.1410726e-02]]] -0.3552726209163666 1.0374716111982707e-05 0.06672560423612595 0.2960858643054962 (1, 1, 7680) | |
| 2026-04-30 19:26:06.128 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 chunk_tokens [[[2004 156 1743 496] | |
| [ 127 1759 944 1354] | |
| [ 273 187 1095 1942] | |
| [ 145 1642 2000 1697] | |
| [ 623 1607 1054 1263] | |
| [ 35 669 1879 229] | |
| [1583 676 95 544] | |
| [1891 1769 255 498] | |
| [ 36 856 1024 1632] | |
| [1998 375 988 1007] | |
| [ 531 1883 167 373] | |
| [1295 44 964 81] | |
| [1175 1062 314 1046] | |
| [1769 674 936 587] | |
| [1449 396 379 1348] | |
| [ 202 1680 207 151]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:06.152 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 wav [[[-0.03925117 -0.01366347 0.03734893 ... -0.04557104 -0.04238814 | |
| -0.02026677]]] -0.3543156683444977 0.00015050903311930597 0.0831756666302681 0.2808587849140167 (1, 1, 7680) | |
| 2026-04-30 19:26:06.153 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 chunk_tokens [[[ 679 1514 982 1063] | |
| [1183 1233 1595 1772] | |
| [ 710 2007 1770 246] | |
| [ 884 621 370 1417] | |
| [1983 779 1019 1681] | |
| [1610 189 1659 1494] | |
| [ 996 150 256 832] | |
| [ 354 1096 1916 342] | |
| [1542 722 11 1503] | |
| [1796 668 733 530] | |
| [1666 1616 549 424] | |
| [ 924 178 1659 1676] | |
| [ 934 507 1268 1340] | |
| [ 496 869 1757 1327] | |
| [1152 7 701 1571] | |
| [1176 12 59 687]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:06.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 wav [[[ 0.02351574 0.06001395 0.05978361 ... 0.00261743 -0.03956862 | |
| -0.06221673]]] -0.3753751516342163 -0.00010315112012904137 0.05548836290836334 0.26587414741516113 (1, 1, 7680) | |
| 2026-04-30 19:26:06.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 chunk_tokens [[[ 121] | |
| [1042] | |
| [1879] | |
| [1782] | |
| [1702] | |
| [1511] | |
| [ 364] | |
| [1823] | |
| [1269] | |
| [1237] | |
| [ 799] | |
| [1076] | |
| [ 809] | |
| [1339] | |
| [ 420] | |
| [1115]]] (1, 16, 1) n_chunk_frames 1 | |
| 2026-04-30 19:26:06.206 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 wav [[[-6.3454241e-02 -3.5933349e-02 1.2640217e-03 ... 1.9708219e-05 | |
| 1.7832308e-05 1.5235857e-05]]] -0.10036860406398773 -5.3411822591442615e-05 0.011042192578315735 0.08905704319477081 (1, 1, 1920) | |
| 2026-04-30 19:26:06.206 [INFO] __main__: Synthesising: 'чтобы люди могли просто общаться.' | |
| 2026-04-30 19:26:06.206 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ч -> text_cache ч | |
| 2026-04-30 19:26:06.206 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False | |
| 2026-04-30 19:26:06.211 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list [array([[[-0.00221966, -0.00138947, -0.000929 , ..., -0.1126425 , | |
| -0.1338531 , -0.13333385]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10775348, -0.05212127, 0.0396859 , ..., -0.04563401, | |
| -0.03402565, -0.03579839]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03745677, -0.02658239, -0.02583151, ..., -0.0121026 , | |
| -0.00580872, -0.01895227]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.0263972 , -0.01400574, -0.01092716, ..., -0.00139586, | |
| 0.00422512, 0.00643334]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00588865, 0.00345067, -0.00066399, ..., 0.00632556, | |
| 0.00391393, 0.00175216]]], shape=(1, 1, 5760), dtype=float32), array([[[ 0.0010756 , 0.00117576, 0.00123106, ..., -0.04100708, | |
| -0.0458885 , -0.04321691]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.05036464, -0.03583061, -0.00757636, ..., 0.05205004, | |
| 0.01185071, -0.03961121]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.08307496, -0.11176797, -0.1242267 , ..., -0.00193561, | |
| 0.005123 , 0.0037974 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00899126, -0.00369494, 0.00981118, ..., -0.00399455, | |
| -0.00319744, -0.00289368]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00285673, -0.0034839 , -0.00415278, ..., 0.00778646, | |
| 0.00595145, -0.0043805 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01552802, -0.01487012, -0.01219678, ..., -0.00294759, | |
| 0.00343194, 0.0008437 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00404704, 0.00067246, 0.00399263, ..., 0.09798931, | |
| 0.20872854, 0.2311011 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.14216125, 0.06682034, 0.02212509, ..., 0.06106113, | |
| 0.00223079, -0.05518628]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.10738115, -0.11622868, -0.06752186, ..., 0.03509749, | |
| 0.03198082, 0.02877127]]], shape=(1, 1, 7680), dtype=float32), array([[[2.69281808e-02, 2.77648699e-02, 3.07107549e-02, ..., | |
| 1.15126495e-05, 1.21511912e-05, 1.15567072e-05]]], | |
| shape=(1, 1, 5760), dtype=float32), array([[[-2.0247478e-02, -1.6132748e-02, -1.4229195e-02, ..., | |
| 1.1977663e-05, 1.1495073e-05, 1.2644601e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 1.2498698e-05, 1.2433531e-05, 1.1404698e-05, ..., | |
| -5.8077216e-02, -5.1980902e-02, -5.0722528e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.05217085, -0.05058753, -0.03975262, ..., 0.21015896, | |
| 0.11327256, 0.02125037]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.03852101, -0.06222959, -0.06324419, ..., 0.00308757, | |
| 0.01666446, 0.02635817]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02811593, 0.01903336, 0.00181638, ..., -0.00637799, | |
| -0.00625728, -0.01839462]]], shape=(1, 1, 7680), dtype=float32), array([[[-3.6303084e-02, -4.4228390e-02, -4.6101980e-02, ..., | |
| 4.6050473e-04, -4.0465111e-05, -2.4329145e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[7.2466741e-05, 2.7459790e-04, 3.0666371e-04, ..., | |
| 8.0509745e-03, 1.3393108e-02, 9.4361240e-03]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 0.00426391, 0.00582221, 0.00909369, ..., -0.02768227, | |
| -0.02276854, -0.01686861]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01355644, -0.01526949, -0.01623942, ..., 0.0395449 , | |
| 0.05279908, 0.00224491]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01579052, 0.00150335, -0.02962946, ..., -0.00423873, | |
| -0.00033509, 0.00640968]]], shape=(1, 1, 7680), dtype=float32), array([[[1.9390190e-02, 3.0609204e-02, 3.0704437e-02, ..., | |
| 1.1317945e-05, 1.0956299e-05, 1.1030028e-05]]], | |
| shape=(1, 1, 3840), dtype=float32), array([[[ 1.1094540e-05, 1.1138460e-05, 1.1009237e-05, ..., | |
| -2.2123540e-02, -2.2558490e-02, -1.9299621e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[0.00221431, 0.03934583, 0.0700637 , ..., 0.01913414, | |
| 0.04059763, 0.06542776]]], shape=(1, 1, 7680), dtype=float32), array([[[0.08465035, 0.0946539 , 0.09328509, ..., 0.0472551 , | |
| 0.05668663, 0.05911173]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04501721, 0.0241992 , 0.01363233, ..., -0.04057647, | |
| -0.05749581, -0.0651198 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.06861783, -0.06905188, -0.06281615, ..., -0.00338598, | |
| 0.00180774, 0.00092616]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00584421, -0.00096309, 0.00632945, ..., 0.00375346, | |
| 0.00384357, 0.00217619]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00579548, -0.01757104, -0.0243005 , ..., 0.00547749, | |
| 0.00660871, 0.009783 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01747901, 0.02681293, 0.03847475, ..., -0.02004432, | |
| -0.02144283, -0.0218131 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.9715637e-02, -1.6528632e-02, -1.3177541e-02, ..., | |
| 1.1422026e-05, 1.1317023e-05, 1.1494269e-05]]], | |
| shape=(1, 1, 1920), dtype=float32), array([[[-2.06317715e-02, -1.67933665e-02, -1.47240255e-02, ..., | |
| 6.64611871e-05, -4.19520393e-06, -7.44241624e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-8.0167578e-05, -4.1713702e-05, 3.4347220e-05, ..., | |
| 1.4899543e-02, 1.9630753e-02, 2.1652387e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[0.02029367, 0.01627654, 0.01006193, ..., 0.06808572, | |
| 0.06454458, 0.05861032]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05094757, 0.04577596, 0.04464076, ..., -0.03615839, | |
| -0.03458475, 0.00780901]]], shape=(1, 1, 7680), dtype=float32), array([[[0.05842641, 0.09555472, 0.10986558, ..., 0.0013969 , | |
| 0.01872239, 0.04114778]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05213842, 0.05569138, 0.06345794, ..., -0.00115294, | |
| -0.00027638, -0.00037019]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2735376e-03, -7.3580118e-04, 3.0488527e-05, ..., | |
| 8.4239952e-03, 3.2757007e-02, 1.1410726e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03925117, -0.01366347, 0.03734893, ..., -0.04557104, | |
| -0.04238814, -0.02026677]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02351574, 0.06001395, 0.05978361, ..., 0.00261743, | |
| -0.03956862, -0.06221673]]], shape=(1, 1, 7680), dtype=float32), array([[[-6.3454241e-02, -3.5933349e-02, 1.2640217e-03, ..., | |
| 1.9708219e-05, 1.7832308e-05, 1.5235857e-05]]], | |
| shape=(1, 1, 1920), dtype=float32)] 45 | |
| 2026-04-30 19:26:06.211 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history [-2.2196597e-03 -1.3894709e-03 -9.2900067e-04 ... 1.9708219e-05 | |
| 1.7832308e-05 1.5235857e-05] (326400,) float32 | |
| 2026-04-30 19:26:06.211 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history_after cut_idx 18 [-3.8521007e-02 -6.2229592e-02 -6.3244194e-02 ... 1.9708219e-05 | |
| 1.7832308e-05 1.5235857e-05] (192000,) float32 | |
| 2026-04-30 19:26:06.214 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list_after cut_idx 18 [array([[[-0.03852101, -0.06222959, -0.06324419, ..., 0.00308757, | |
| 0.01666446, 0.02635817]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02811593, 0.01903336, 0.00181638, ..., -0.00637799, | |
| -0.00625728, -0.01839462]]], shape=(1, 1, 7680), dtype=float32), array([[[-3.6303084e-02, -4.4228390e-02, -4.6101980e-02, ..., | |
| 4.6050473e-04, -4.0465111e-05, -2.4329145e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[7.2466741e-05, 2.7459790e-04, 3.0666371e-04, ..., | |
| 8.0509745e-03, 1.3393108e-02, 9.4361240e-03]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 0.00426391, 0.00582221, 0.00909369, ..., -0.02768227, | |
| -0.02276854, -0.01686861]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01355644, -0.01526949, -0.01623942, ..., 0.0395449 , | |
| 0.05279908, 0.00224491]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01579052, 0.00150335, -0.02962946, ..., -0.00423873, | |
| -0.00033509, 0.00640968]]], shape=(1, 1, 7680), dtype=float32), array([[[1.9390190e-02, 3.0609204e-02, 3.0704437e-02, ..., | |
| 1.1317945e-05, 1.0956299e-05, 1.1030028e-05]]], | |
| shape=(1, 1, 3840), dtype=float32), array([[[ 1.1094540e-05, 1.1138460e-05, 1.1009237e-05, ..., | |
| -2.2123540e-02, -2.2558490e-02, -1.9299621e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[0.00221431, 0.03934583, 0.0700637 , ..., 0.01913414, | |
| 0.04059763, 0.06542776]]], shape=(1, 1, 7680), dtype=float32), array([[[0.08465035, 0.0946539 , 0.09328509, ..., 0.0472551 , | |
| 0.05668663, 0.05911173]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04501721, 0.0241992 , 0.01363233, ..., -0.04057647, | |
| -0.05749581, -0.0651198 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.06861783, -0.06905188, -0.06281615, ..., -0.00338598, | |
| 0.00180774, 0.00092616]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00584421, -0.00096309, 0.00632945, ..., 0.00375346, | |
| 0.00384357, 0.00217619]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00579548, -0.01757104, -0.0243005 , ..., 0.00547749, | |
| 0.00660871, 0.009783 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01747901, 0.02681293, 0.03847475, ..., -0.02004432, | |
| -0.02144283, -0.0218131 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.9715637e-02, -1.6528632e-02, -1.3177541e-02, ..., | |
| 1.1422026e-05, 1.1317023e-05, 1.1494269e-05]]], | |
| shape=(1, 1, 1920), dtype=float32), array([[[-2.06317715e-02, -1.67933665e-02, -1.47240255e-02, ..., | |
| 6.64611871e-05, -4.19520393e-06, -7.44241624e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-8.0167578e-05, -4.1713702e-05, 3.4347220e-05, ..., | |
| 1.4899543e-02, 1.9630753e-02, 2.1652387e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[0.02029367, 0.01627654, 0.01006193, ..., 0.06808572, | |
| 0.06454458, 0.05861032]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05094757, 0.04577596, 0.04464076, ..., -0.03615839, | |
| -0.03458475, 0.00780901]]], shape=(1, 1, 7680), dtype=float32), array([[[0.05842641, 0.09555472, 0.10986558, ..., 0.0013969 , | |
| 0.01872239, 0.04114778]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05213842, 0.05569138, 0.06345794, ..., -0.00115294, | |
| -0.00027638, -0.00037019]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2735376e-03, -7.3580118e-04, 3.0488527e-05, ..., | |
| 8.4239952e-03, 3.2757007e-02, 1.1410726e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03925117, -0.01366347, 0.03734893, ..., -0.04557104, | |
| -0.04238814, -0.02026677]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02351574, 0.06001395, 0.05978361, ..., 0.00261743, | |
| -0.03956862, -0.06221673]]], shape=(1, 1, 7680), dtype=float32), array([[[-6.3454241e-02, -3.5933349e-02, 1.2640217e-03, ..., | |
| 1.9708219e-05, 1.7832308e-05, 1.5235857e-05]]], | |
| shape=(1, 1, 1920), dtype=float32)] 27 | |
| 2026-04-30 19:26:06.215 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069 | |
| 2026-04-30 19:26:06.287 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[ 0.00079289 0.06733401 -0.0398349 ... 0.18074517 0.0866328 | |
| 0.04901728]]] (1, 1, 1024) | |
| 2026-04-30 19:26:06.288 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]] | |
| 2026-04-30 19:26:06.288 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661]]] (1, 4, 1024) | |
| 2026-04-30 19:26:06.288 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 1, 1024) | |
| 2026-04-30 19:26:06.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661] | |
| [ 0.00079289 0.06733401 -0.0398349 ... 0.18074517 0.0866328 | |
| 0.04901728] | |
| [-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 6, 1024) | |
| 2026-04-30 19:26:06.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22 | |
| Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:06.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:06.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:06.289 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:06.290 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024) | |
| 2026-04-30 19:26:06.290 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036 | |
| -0.00767252]]] (1, 1, 1024) | |
| 2026-04-30 19:26:06.290 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528 | |
| 0.00424147]]] (1, 1, 1024) | |
| 2026-04-30 19:26:06.291 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724 | |
| -0.00170945] | |
| [ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198 | |
| 0.00132705] | |
| [ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966 | |
| 0.0080104 ] | |
| [ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711 | |
| 0.00252486] | |
| [ 0.00557107 0.06352802 -0.04153106 ... 0.17146082 0.08818809 | |
| 0.05325875] | |
| [ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459 | |
| -0.00718043]]] (1, 6, 1024) | |
| 2026-04-30 19:26:06.291 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03] | |
| ... | |
| [ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03 | |
| -2.0710612e-04 2.5248611e-03] | |
| [ 5.5710729e-03 6.3528024e-02 -4.1531056e-02 ... 1.7146082e-01 | |
| 8.8188089e-02 5.3258754e-02] | |
| [ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03 | |
| 3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024) | |
| 2026-04-30 19:26:06.335 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=56; step_idx=56 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill cont done; talker_seq_len=56; step_idx=56 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache чт | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache что | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment б -> text_cache чтоб | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ы -> text_cache чтобы | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache чтобы | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache чтобы л | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ю -> text_cache чтобы лю | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache чтобы люд | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache чтобы люди | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache чтобы люди | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.374 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache чтобы люди м | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache чтобы люди мо | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache чтобы люди мог | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache чтобы люди могл | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache чтобы люди могли | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache чтобы люди могли | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment п -> text_cache чтобы люди могли п | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache чтобы люди могли пр | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache чтобы люди могли про | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache чтобы люди могли прос | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache чтобы люди могли прост | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache чтобы люди могли просто | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache чтобы люди могли просто | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache чтобы люди могли просто о | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment б -> text_cache чтобы люди могли просто об | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment щ -> text_cache чтобы люди могли просто общ | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache чтобы люди могли просто обща | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache чтобы люди могли просто общат | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ь -> text_cache чтобы люди могли просто общать | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache чтобы люди могли просто общатьс | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:06.375 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache чтобы люди могли просто общаться | |
| 2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['чтобы люди могли просто '] 24 | |
| Qwen3TTSProcessor __call__ text ['чтобы люди могли просто '] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 6020, 1792, 50873, 132782, 125649, 11073, 129021, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 6020, 1792, 50873, 132782, 125649, 11073, 129021, 220]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 6020 1792 50873 132782 125649 11073 129021 220]] (1, 8) | |
| 2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 6020 1792 50873 132782 125649 11073 129021 220]] (1, 8) | |
| 2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment чтобы люди могли просто 24 -> tokenized_segment [np.int64(6020), np.int64(1792), np.int64(50873), np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 8 | |
| 2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(6020), np.int64(1792), np.int64(50873), np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] | |
| 2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.376 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(6020), np.int64(1792), np.int64(50873), np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 8 | |
| 2026-04-30 19:26:06.377 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6020 -> pending_tokens [np.int64(1792), np.int64(50873), np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 7 | |
| 2026-04-30 19:26:06.385 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-56 vq [1221] (1,) int64 | |
| 2026-04-30 19:26:06.412 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-57 vq-rvq [[[1221 1026 69 1258 1894 1085 687 1569 711 836 1831 1044 1256 222 | |
| 846 782]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.412 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 1792 -> pending_tokens [np.int64(50873), np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 6 | |
| 2026-04-30 19:26:06.420 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-57 vq [2042] (1,) int64 | |
| 2026-04-30 19:26:06.447 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-58 vq-rvq [[[2042 1095 608 1765 103 616 1203 1595 276 462 896 704 76 264 | |
| 300 593]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.447 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 50873 -> pending_tokens [np.int64(132782), np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 5 | |
| 2026-04-30 19:26:06.455 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-58 vq [14] (1,) int64 | |
| 2026-04-30 19:26:06.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-59 vq-rvq [[[ 14 1168 1214 249 280 1328 1028 465 108 1404 690 285 1785 628 | |
| 1299 153]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.482 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 132782 -> pending_tokens [np.int64(125649), np.int64(11073), np.int64(129021), np.int64(220)] 4 | |
| 2026-04-30 19:26:06.490 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-59 vq [1228] (1,) int64 | |
| 2026-04-30 19:26:06.517 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-60 vq-rvq [[[1228 317 331 926 846 342 1080 1884 272 132 915 1254 720 1902 | |
| 614 1777]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.517 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 125649 -> pending_tokens [np.int64(11073), np.int64(129021), np.int64(220)] 3 | |
| 2026-04-30 19:26:06.525 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-60 vq [159] (1,) int64 | |
| 2026-04-30 19:26:06.552 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-61 vq-rvq [[[ 159 758 350 158 1102 142 59 1648 1663 1682 157 580 1798 685 | |
| 715 664]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.552 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 11073 -> pending_tokens [np.int64(129021), np.int64(220)] 2 | |
| 2026-04-30 19:26:06.560 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-61 vq [1091] (1,) int64 | |
| 2026-04-30 19:26:06.587 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-62 vq-rvq [[[1091 55 1747 1494 944 294 1380 534 951 735 1266 13 1085 517 | |
| 397 985]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.587 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 129021 -> pending_tokens [np.int64(220)] 1 | |
| 2026-04-30 19:26:06.595 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-62 vq [1976] (1,) int64 | |
| 2026-04-30 19:26:06.622 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-63 vq-rvq [[[1976 1243 1615 919 50 1403 619 1348 62 499 1452 1098 1894 1579 | |
| 364 1723]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.622 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 220 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:06.630 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-63 vq [1248] (1,) int64 | |
| 2026-04-30 19:26:06.657 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-64 vq-rvq [[[1248 615 563 1474 470 612 1730 931 277 1572 1691 790 1436 1886 | |
| 1240 1220]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.657 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-37 chunk_tokens [[[1221 2042 14 1228] | |
| [1026 1095 1168 317] | |
| [ 69 608 1214 331] | |
| [1258 1765 249 926] | |
| [1894 103 280 846] | |
| [1085 616 1328 342] | |
| [ 687 1203 1028 1080] | |
| [1569 1595 465 1884] | |
| [ 711 276 108 272] | |
| [ 836 462 1404 132] | |
| [1831 896 690 915] | |
| [1044 704 285 1254] | |
| [1256 76 1785 720] | |
| [ 222 264 628 1902] | |
| [ 846 300 1299 614] | |
| [ 782 593 153 1777]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:06.681 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-37 wav [[[6.4516030e-06 3.8836665e-06 3.5758250e-05 ... 2.0419013e-02 | |
| 5.6000661e-02 7.9175197e-02]]] -0.39740338921546936 0.00012032289669150487 0.057172417640686035 0.32271844148635864 (1, 1, 7680) | |
| 2026-04-30 19:26:06.682 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-41 chunk_tokens [[[ 159 1091 1976 1248] | |
| [ 758 55 1243 615] | |
| [ 350 1747 1615 563] | |
| [ 158 1494 919 1474] | |
| [1102 944 50 470] | |
| [ 142 294 1403 612] | |
| [ 59 1380 619 1730] | |
| [1648 534 1348 931] | |
| [1663 951 62 277] | |
| [1682 735 499 1572] | |
| [ 157 1266 1452 1691] | |
| [ 580 13 1098 790] | |
| [1798 1085 1894 1436] | |
| [ 685 517 1579 1886] | |
| [ 715 397 364 1240] | |
| [ 664 985 1723 1220]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-41 wav [[[0.07597505 0.05851083 0.06002833 ... 0.07287683 0.04599379 0.01605063]]] -0.2856764495372772 9.037656855070964e-05 0.06580641865730286 0.25454413890838623 (1, 1, 7680) | |
| 2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment . -> text_cache общаться. | |
| 2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['общаться.'] 9 | |
| Qwen3TTSProcessor __call__ text ['общаться.'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[54157, 97681, 13]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[54157, 97681, 13]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[54157 97681 13]] (1, 3) | |
| 2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[54157 97681 13]] (1, 3) | |
| 2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment общаться. 9 -> tokenized_segment [np.int64(54157), np.int64(97681), np.int64(13)] 3 | |
| 2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(54157), np.int64(97681), np.int64(13)] | |
| 2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(54157), np.int64(97681), np.int64(13)] 3 | |
| 2026-04-30 19:26:06.706 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 54157 -> pending_tokens [np.int64(97681), np.int64(13)] 2 | |
| 2026-04-30 19:26:06.715 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-64 vq [51] (1,) int64 | |
| 2026-04-30 19:26:06.742 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-65 vq-rvq [[[ 51 836 265 1485 1394 1865 571 1917 1099 496 561 227 602 221 | |
| 10 188]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.742 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 97681 -> pending_tokens [np.int64(13)] 1 | |
| 2026-04-30 19:26:06.750 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-65 vq [434] (1,) int64 | |
| 2026-04-30 19:26:06.777 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-66 vq-rvq [[[ 434 1217 503 2003 1926 2016 630 1801 1382 404 1596 480 848 1558 | |
| 654 270]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.777 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:06.785 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-66 vq [1644] (1,) int64 | |
| 2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-67 vq-rvq [[[1644 1808 735 1710 1282 288 1087 806 998 59 177 19 51 1767 | |
| 460 1207]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0 | |
| 2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:26:06.812 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:06.820 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-67 vq [383] (1,) int64 | |
| 2026-04-30 19:26:06.847 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-68 vq-rvq [[[ 383 1746 1031 1633 797 85 166 274 1976 1525 789 338 223 361 | |
| 1277 536]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.847 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-45 chunk_tokens [[[ 51 434 1644 383] | |
| [ 836 1217 1808 1746] | |
| [ 265 503 735 1031] | |
| [1485 2003 1710 1633] | |
| [1394 1926 1282 797] | |
| [1865 2016 288 85] | |
| [ 571 630 1087 166] | |
| [1917 1801 806 274] | |
| [1099 1382 998 1976] | |
| [ 496 404 59 1525] | |
| [ 561 1596 177 789] | |
| [ 227 480 19 338] | |
| [ 602 848 51 223] | |
| [ 221 1558 1767 361] | |
| [ 10 654 460 1277] | |
| [ 188 270 1207 536]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:06.871 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-45 wav [[[0.00099137 0.00403599 0.01846475 ... 0.02468315 0.01271362 0.00035484]]] -0.3146056532859802 -0.0002403859980404377 0.07929908484220505 0.37690261006355286 (1, 1, 7680) | |
| 2026-04-30 19:26:06.879 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-68 vq [825] (1,) int64 | |
| 2026-04-30 19:26:06.906 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-69 vq-rvq [[[ 825 371 1395 1038 953 1384 906 810 330 550 1607 1673 802 1334 | |
| 1169 552]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.914 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-69 vq [851] (1,) int64 | |
| 2026-04-30 19:26:06.941 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-70 vq-rvq [[[ 851 1209 1426 671 1434 344 974 1051 205 111 615 416 876 488 | |
| 129 25]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.949 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-70 vq [1460] (1,) int64 | |
| 2026-04-30 19:26:06.976 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-71 vq-rvq [[[1460 1698 2033 189 1405 522 1672 519 1096 1097 1152 1037 1808 895 | |
| 729 367]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:06.984 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-71 vq [912] (1,) int64 | |
| 2026-04-30 19:26:07.011 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-72 vq-rvq [[[ 912 1195 533 818 967 20 250 1275 482 1635 502 882 1288 1779 | |
| 1502 1923]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.019 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-72 vq [1358] (1,) int64 | |
| 2026-04-30 19:26:07.046 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-73 vq-rvq [[[1358 781 1896 1979 229 335 187 1497 428 1351 359 1350 1629 508 | |
| 1070 1512]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.054 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-73 vq [1935] (1,) int64 | |
| 2026-04-30 19:26:07.081 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-74 vq-rvq [[[1935 695 264 2009 1148 113 377 460 100 1768 2006 352 1112 404 | |
| 693 612]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.089 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-74 vq [1980] (1,) int64 | |
| 2026-04-30 19:26:07.116 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-75 vq-rvq [[[1980 1577 789 86 867 535 1850 1404 876 11 1493 1667 218 1618 | |
| 1334 959]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.124 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-75 vq [967] (1,) int64 | |
| 2026-04-30 19:26:07.151 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-76 vq-rvq [[[ 967 438 707 1129 844 14 1817 581 309 352 725 1207 257 467 | |
| 476 583]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.159 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-76 vq [1559] (1,) int64 | |
| 2026-04-30 19:26:07.186 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-77 vq-rvq [[[1559 1651 80 1399 474 174 1402 371 2017 1357 1057 66 387 1744 | |
| 374 813]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.194 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-77 vq [272] (1,) int64 | |
| 2026-04-30 19:26:07.221 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-78 vq-rvq [[[ 272 1148 431 143 492 750 631 1319 1241 1232 415 1498 236 763 | |
| 1323 174]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.229 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-78 vq [1528] (1,) int64 | |
| 2026-04-30 19:26:07.256 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-79 vq-rvq [[[1528 736 1490 1256 479 90 1389 1402 1087 345 1 662 364 711 | |
| 435 504]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.264 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-79 vq [1808] (1,) int64 | |
| 2026-04-30 19:26:07.291 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-80 vq-rvq [[[1808 1574 580 441 1368 963 1097 386 2010 833 209 1198 1627 476 | |
| 649 1381]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.299 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-80 vq [1500] (1,) int64 | |
| 2026-04-30 19:26:07.326 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-81 vq-rvq [[[1500 1319 430 1363 1863 632 1065 1634 159 656 119 1425 1327 27 | |
| 1708 962]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.334 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-81 vq [1168] (1,) int64 | |
| 2026-04-30 19:26:07.361 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-82 vq-rvq [[[1168 1807 1429 1791 242 1248 1069 1012 886 826 1227 169 1159 1853 | |
| 859 1620]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.369 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-82 vq [963] (1,) int64 | |
| 2026-04-30 19:26:07.396 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-83 vq-rvq [[[ 963 1660 1471 507 1900 176 2042 41 1151 1252 1427 723 563 558 | |
| 793 759]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.404 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-83 vq [743] (1,) int64 | |
| 2026-04-30 19:26:07.431 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-84 vq-rvq [[[ 743 816 1848 2030 1953 24 5 1416 1451 1403 319 1319 1199 1260 | |
| 937 1408]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.439 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-84 vq [417] (1,) int64 | |
| 2026-04-30 19:26:07.466 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-85 vq-rvq [[[ 417 443 41 747 1865 240 1662 1409 926 358 636 238 659 684 | |
| 1249 1416]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.474 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-85 vq [1407] (1,) int64 | |
| 2026-04-30 19:26:07.501 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-86 vq-rvq [[[1407 340 1840 66 1115 774 296 1653 813 1176 809 1392 1106 1039 | |
| 1141 1878]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.509 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-86 vq [204] (1,) int64 | |
| 2026-04-30 19:26:07.536 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-87 vq-rvq [[[ 204 1858 604 252 1430 915 1309 370 1653 1362 246 460 1230 382 | |
| 273 1167]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.544 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-87 vq [381] (1,) int64 | |
| 2026-04-30 19:26:07.571 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-88 vq-rvq [[[ 381 201 1237 787 1026 115 678 499 1175 493 349 96 1641 256 | |
| 1516 1499]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.579 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-88 vq [863] (1,) int64 | |
| 2026-04-30 19:26:07.606 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-89 vq-rvq [[[ 863 1875 706 1628 390 1575 1770 318 248 1285 195 183 822 123 | |
| 503 467]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.614 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-89 vq [2150] (1,) int64 | |
| 2026-04-30 19:26:07.615 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-49 chunk_tokens [[[ 825 851 1460 912] | |
| [ 371 1209 1698 1195] | |
| [1395 1426 2033 533] | |
| [1038 671 189 818] | |
| [ 953 1434 1405 967] | |
| [1384 344 522 20] | |
| [ 906 974 1672 250] | |
| [ 810 1051 519 1275] | |
| [ 330 205 1096 482] | |
| [ 550 111 1097 1635] | |
| [1607 615 1152 502] | |
| [1673 416 1037 882] | |
| [ 802 876 1808 1288] | |
| [1334 488 895 1779] | |
| [1169 129 729 1502] | |
| [ 552 25 367 1923]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:07.639 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-49 wav [[[-0.00084715 0.01164515 0.02932669 ... 0.00305634 0.002376 | |
| 0.00176231]]] -0.30304887890815735 0.00018249574350193143 0.0709570050239563 0.35016027092933655 (1, 1, 7680) | |
| 2026-04-30 19:26:07.639 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-53 chunk_tokens [[[1358 1935 1980 967] | |
| [ 781 695 1577 438] | |
| [1896 264 789 707] | |
| [1979 2009 86 1129] | |
| [ 229 1148 867 844] | |
| [ 335 113 535 14] | |
| [ 187 377 1850 1817] | |
| [1497 460 1404 581] | |
| [ 428 100 876 309] | |
| [1351 1768 11 352] | |
| [ 359 2006 1493 725] | |
| [1350 352 1667 1207] | |
| [1629 1112 218 257] | |
| [ 508 404 1618 467] | |
| [1070 693 1334 476] | |
| [1512 612 959 583]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:07.663 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-53 wav [[[ 0.00133303 0.00114176 0.00112796 ... -0.03397415 0.03560583 | |
| 0.00734547]]] -0.3596225678920746 -7.715798346907832e-06 0.08781254291534424 0.30450180172920227 (1, 1, 7680) | |
| 2026-04-30 19:26:07.663 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-57 chunk_tokens [[[1559 272 1528 1808] | |
| [1651 1148 736 1574] | |
| [ 80 431 1490 580] | |
| [1399 143 1256 441] | |
| [ 474 492 479 1368] | |
| [ 174 750 90 963] | |
| [1402 631 1389 1097] | |
| [ 371 1319 1402 386] | |
| [2017 1241 1087 2010] | |
| [1357 1232 345 833] | |
| [1057 415 1 209] | |
| [ 66 1498 662 1198] | |
| [ 387 236 364 1627] | |
| [1744 763 711 476] | |
| [ 374 1323 435 649] | |
| [ 813 174 504 1381]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:07.687 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-57 wav [[[-0.04759482 0.00231559 0.03089104 ... 0.18176867 0.13269146 | |
| 0.06594509]]] -0.4350372850894928 0.00012260368384886533 0.05727505311369896 0.3781623840332031 (1, 1, 7680) | |
| 2026-04-30 19:26:07.688 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-61 chunk_tokens [[[1500 1168 963 743] | |
| [1319 1807 1660 816] | |
| [ 430 1429 1471 1848] | |
| [1363 1791 507 2030] | |
| [1863 242 1900 1953] | |
| [ 632 1248 176 24] | |
| [1065 1069 2042 5] | |
| [1634 1012 41 1416] | |
| [ 159 886 1151 1451] | |
| [ 656 826 1252 1403] | |
| [ 119 1227 1427 319] | |
| [1425 169 723 1319] | |
| [1327 1159 563 1199] | |
| [ 27 1853 558 1260] | |
| [1708 859 793 937] | |
| [ 962 1620 759 1408]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:07.712 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-61 wav [[[-0.00594246 -0.07083042 -0.11743579 ... -0.01224556 -0.0012733 | |
| 0.00776599]]] -0.35602352023124695 -9.005195897771046e-05 0.06507798284292221 0.2743745744228363 (1, 1, 7680) | |
| 2026-04-30 19:26:07.712 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-65 chunk_tokens [[[ 417 1407 204 381] | |
| [ 443 340 1858 201] | |
| [ 41 1840 604 1237] | |
| [ 747 66 252 787] | |
| [1865 1115 1430 1026] | |
| [ 240 774 915 115] | |
| [1662 296 1309 678] | |
| [1409 1653 370 499] | |
| [ 926 813 1653 1175] | |
| [ 358 1176 1362 493] | |
| [ 636 809 246 349] | |
| [ 238 1392 460 96] | |
| [ 659 1106 1230 1641] | |
| [ 684 1039 382 256] | |
| [1249 1141 273 1516] | |
| [1416 1878 1167 1499]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:07.736 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-65 wav [[[ 0.00711998 -0.00636461 -0.02865032 ... 0.01531223 0.02133005 | |
| 0.02612119]]] -0.3169194757938385 4.87714605696965e-05 0.04392051696777344 0.18612053990364075 (1, 1, 7680) | |
| 2026-04-30 19:26:07.736 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-69 chunk_tokens [[[ 863] | |
| [1875] | |
| [ 706] | |
| [1628] | |
| [ 390] | |
| [1575] | |
| [1770] | |
| [ 318] | |
| [ 248] | |
| [1285] | |
| [ 195] | |
| [ 183] | |
| [ 822] | |
| [ 123] | |
| [ 503] | |
| [ 467]]] (1, 16, 1) n_chunk_frames 1 | |
| 2026-04-30 19:26:07.766 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-69 wav [[[2.5798496e-02 2.0124789e-02 9.4997659e-03 ... 1.0540312e-05 | |
| 1.0445123e-05 1.0610051e-05]]] -0.06146857514977455 -9.881023288471624e-05 0.006389988120645285 0.028675077483057976 (1, 1, 1920) | |
| 2026-04-30 19:26:07.766 [INFO] src.inference.qwen3_tts_inferencer_onnx: reset_turn reset_generation_state step-idx-90 | |
| 2026-04-30 19:26:07.784 [INFO] __main__: Synthesising: 'И это огромный сдвиг' | |
| 2026-04-30 19:26:07.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment И -> text_cache И | |
| 2026-04-30 19:26:07.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False | |
| 2026-04-30 19:26:07.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069 | |
| 2026-04-30 19:26:07.864 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076 | |
| 0.08690926]]] (1, 1, 1024) | |
| 2026-04-30 19:26:07.864 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]] | |
| 2026-04-30 19:26:07.864 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661]]] (1, 4, 1024) | |
| 2026-04-30 19:26:07.864 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 1, 1024) | |
| 2026-04-30 19:26:07.865 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661] | |
| [-0.02542407 0.05565496 0.02078674 ... 0.21637845 0.06261076 | |
| 0.08690926] | |
| [-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 6, 1024) | |
| 2026-04-30 19:26:07.865 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22 | |
| Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:07.865 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:07.865 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:07.865 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:07.866 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024) | |
| 2026-04-30 19:26:07.866 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036 | |
| -0.00767252]]] (1, 1, 1024) | |
| 2026-04-30 19:26:07.866 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528 | |
| 0.00424147]]] (1, 1, 1024) | |
| 2026-04-30 19:26:07.867 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724 | |
| -0.00170945] | |
| [ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198 | |
| 0.00132705] | |
| [ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966 | |
| 0.0080104 ] | |
| [ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711 | |
| 0.00252486] | |
| [-0.02064589 0.05184897 0.01909059 ... 0.2070941 0.06416605 | |
| 0.09115074] | |
| [ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459 | |
| -0.00718043]]] (1, 6, 1024) | |
| 2026-04-30 19:26:07.867 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03] | |
| ... | |
| [ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03 | |
| -2.0710612e-04 2.5248611e-03] | |
| [-2.0645889e-02 5.1848970e-02 1.9090585e-02 ... 2.0709410e-01 | |
| 6.4166047e-02 9.1150738e-02] | |
| [ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03 | |
| 3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024) | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=9; step_idx=0 | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache И | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment э -> text_cache И э | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment т -> text_cache И эт | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache И это | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache И это | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache И это о | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache И это ог | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache И это огр | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache И это огро | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache И это огром | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache И это огромн | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment ы -> text_cache И это огромны | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment й -> text_cache И это огромный | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache И это огромный | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache И это огромный с | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache И это огромный сд | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache И это огромный сдв | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache И это огромный сдви | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache И это огромный сдвиг | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache И это огромный сдвиг 20 | |
| 2026-04-30 19:26:07.912 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['И это огромный сдвиг'] 20 | |
| Qwen3TTSProcessor __call__ text ['И это огромный сдвиг'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 30174, 67879, 127776, 12228, 33513, 5409, 140179]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 30174, 67879, 127776, 12228, 33513, 5409, 140179]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 30174 67879 127776 12228 33513 5409 140179]] (1, 7) | |
| 2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 30174 67879 127776 12228 33513 5409 140179]] (1, 7) | |
| 2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(30174), np.int64(67879), np.int64(127776), np.int64(12228), np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 8 | |
| 2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:07.913 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(30174), np.int64(67879), np.int64(127776), np.int64(12228), np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 8 | |
| 2026-04-30 19:26:07.914 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 30174 -> pending_tokens [np.int64(67879), np.int64(127776), np.int64(12228), np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 7 | |
| 2026-04-30 19:26:07.922 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-0 vq [1995] (1,) int64 | |
| 2026-04-30 19:26:07.948 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-1 vq-rvq [[[1995 1159 0 22 247 69 1579 426 853 312 1358 969 1956 118 | |
| 224 419]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.949 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 67879 -> pending_tokens [np.int64(127776), np.int64(12228), np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 6 | |
| 2026-04-30 19:26:07.957 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-1 vq [215] (1,) int64 | |
| 2026-04-30 19:26:07.983 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-2 vq-rvq [[[ 215 1134 933 371 243 1748 55 1641 1253 38 743 823 527 1529 | |
| 82 901]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:07.983 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 127776 -> pending_tokens [np.int64(12228), np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 5 | |
| 2026-04-30 19:26:07.991 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-2 vq [212] (1,) int64 | |
| 2026-04-30 19:26:08.018 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-3 vq-rvq [[[ 212 1666 771 1670 1210 1347 310 1034 241 455 2040 175 1677 1422 | |
| 1213 1668]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.018 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 12228 -> pending_tokens [np.int64(33513), np.int64(5409), np.int64(140179), np.int64(151673)] 4 | |
| 2026-04-30 19:26:08.026 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-3 vq [1181] (1,) int64 | |
| 2026-04-30 19:26:08.053 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-4 vq-rvq [[[1181 957 1093 515 909 407 1841 486 564 1974 1657 362 1851 1654 | |
| 273 129]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.053 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 33513 -> pending_tokens [np.int64(5409), np.int64(140179), np.int64(151673)] 3 | |
| 2026-04-30 19:26:08.061 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-4 vq [462] (1,) int64 | |
| 2026-04-30 19:26:08.087 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-5 vq-rvq [[[ 462 1809 1975 1363 1648 497 1751 668 1242 1462 876 124 1779 1366 | |
| 647 223]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.087 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 5409 -> pending_tokens [np.int64(140179), np.int64(151673)] 2 | |
| 2026-04-30 19:26:08.095 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-5 vq [1225] (1,) int64 | |
| 2026-04-30 19:26:08.122 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-6 vq-rvq [[[1225 636 1104 1192 537 1880 1811 1688 1551 412 512 1644 924 1326 | |
| 398 1689]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.122 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 140179 -> pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:26:08.130 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-6 vq [333] (1,) int64 | |
| 2026-04-30 19:26:08.157 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-7 vq-rvq [[[ 333 597 1277 77 1155 1861 1097 931 202 904 1616 1985 396 1554 | |
| 487 144]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.157 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:08.165 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-7 vq [948] (1,) int64 | |
| 2026-04-30 19:26:08.191 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-8 vq-rvq [[[ 948 1698 1396 1783 1769 1801 1352 359 1673 252 993 1509 2030 536 | |
| 744 80]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.191 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 chunk_tokens [[[1995 215 212 1181] | |
| [1159 1134 1666 957] | |
| [ 0 933 771 1093] | |
| [ 22 371 1670 515] | |
| [ 247 243 1210 909] | |
| [ 69 1748 1347 407] | |
| [1579 55 310 1841] | |
| [ 426 1641 1034 486] | |
| [ 853 1253 241 564] | |
| [ 312 38 455 1974] | |
| [1358 743 2040 1657] | |
| [ 969 823 175 362] | |
| [1956 527 1677 1851] | |
| [ 118 1529 1422 1654] | |
| [ 224 82 1213 273] | |
| [ 419 901 1668 129]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:08.216 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-0 wav [[[-2.0183910e-02 -1.5937209e-02 -1.3884507e-02 ... 5.7107034e-05 | |
| 3.8642902e-05 1.1677517e-05]]] -0.02084321156144142 -5.6190634495578706e-05 0.0011370863066986203 0.010447698645293713 (1, 1, 7680) | |
| 2026-04-30 19:26:08.216 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 chunk_tokens [[[ 462 1225 333 948] | |
| [1809 636 597 1698] | |
| [1975 1104 1277 1396] | |
| [1363 1192 77 1783] | |
| [1648 537 1155 1769] | |
| [ 497 1880 1861 1801] | |
| [1751 1811 1097 1352] | |
| [ 668 1688 931 359] | |
| [1242 1551 202 1673] | |
| [1462 412 904 252] | |
| [ 876 512 1616 993] | |
| [ 124 1644 1985 1509] | |
| [1779 924 396 2030] | |
| [1366 1326 1554 536] | |
| [ 647 398 487 744] | |
| [ 223 1689 144 80]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:08.240 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-4 wav [[[-3.8887060e-06 -1.9734021e-05 -8.4024796e-06 ... 1.1066332e-01 | |
| 8.8470802e-02 5.8433518e-02]]] -0.2045511156320572 0.00010347345232730731 0.04608716815710068 0.2536100447177887 (1, 1, 7680) | |
| 2026-04-30 19:26:08.248 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-8 vq [1363] (1,) int64 | |
| 2026-04-30 19:26:08.275 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-9 vq-rvq [[[1363 328 30 2009 440 765 864 886 1632 43 2006 294 816 209 | |
| 823 344]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.282 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-9 vq [1249] (1,) int64 | |
| 2026-04-30 19:26:08.309 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-10 vq-rvq [[[1249 721 1687 1092 644 1303 206 609 1173 1791 883 300 263 848 | |
| 516 1515]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-10 vq [269] (1,) int64 | |
| 2026-04-30 19:26:08.344 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-11 vq-rvq [[[ 269 1888 1100 1053 690 1010 1545 127 968 383 1355 468 1277 1149 | |
| 731 960]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.352 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-11 vq [1532] (1,) int64 | |
| 2026-04-30 19:26:08.378 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-12 vq-rvq [[[1532 875 725 489 529 1434 45 1699 959 830 346 1625 283 377 | |
| 764 1410]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.386 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-12 vq [1769] (1,) int64 | |
| 2026-04-30 19:26:08.413 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-13 vq-rvq [[[1769 1355 1072 189 1547 539 135 1611 162 1585 1264 522 376 1524 | |
| 942 850]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.421 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-13 vq [1105] (1,) int64 | |
| 2026-04-30 19:26:08.448 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-14 vq-rvq [[[1105 1323 1391 1513 1852 412 69 1605 1449 1172 1315 1040 1366 350 | |
| 1910 848]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.456 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-14 vq [22] (1,) int64 | |
| 2026-04-30 19:26:08.483 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-15 vq-rvq [[[ 22 172 582 909 445 46 1860 1124 568 749 265 16 22 908 | |
| 531 1437]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.491 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-15 vq [1919] (1,) int64 | |
| 2026-04-30 19:26:08.517 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-16 vq-rvq [[[1919 443 63 146 1844 614 1670 1079 1298 1028 52 853 1060 2044 | |
| 222 310]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.525 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-16 vq [1699] (1,) int64 | |
| 2026-04-30 19:26:08.552 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-17 vq-rvq [[[1699 1113 1827 606 296 1641 863 787 606 229 318 676 1853 840 | |
| 3 2019]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.560 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-17 vq [1401] (1,) int64 | |
| 2026-04-30 19:26:08.587 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-18 vq-rvq [[[1401 208 1794 492 1434 724 457 1495 1339 414 1528 236 69 929 | |
| 1685 546]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.595 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-18 vq [1759] (1,) int64 | |
| 2026-04-30 19:26:08.622 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-19 vq-rvq [[[1759 739 856 1366 1098 1511 1682 1510 263 1214 2025 178 1321 64 | |
| 1935 1128]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.630 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-19 vq [1509] (1,) int64 | |
| 2026-04-30 19:26:08.657 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-20 vq-rvq [[[1509 386 878 633 1868 1350 870 1086 186 212 935 332 498 1710 | |
| 526 1358]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.665 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-20 vq [101] (1,) int64 | |
| 2026-04-30 19:26:08.692 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-21 vq-rvq [[[ 101 552 1643 545 1294 1302 1408 367 1252 690 191 220 447 1324 | |
| 1752 1497]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.700 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-21 vq [1786] (1,) int64 | |
| 2026-04-30 19:26:08.727 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-22 vq-rvq [[[1786 1361 1196 7 1118 1365 651 183 563 1655 958 1061 4 1886 | |
| 344 1724]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.735 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-22 vq [510] (1,) int64 | |
| 2026-04-30 19:26:08.762 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-23 vq-rvq [[[ 510 72 1471 343 377 1026 15 1466 67 565 2028 536 106 1209 | |
| 944 1218]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.770 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-23 vq [759] (1,) int64 | |
| 2026-04-30 19:26:08.797 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-24 vq-rvq [[[ 759 844 679 60 229 1985 970 998 1037 1221 198 1952 1520 847 | |
| 1541 1195]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:08.805 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-24 vq [2150] (1,) int64 | |
| 2026-04-30 19:26:08.805 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 chunk_tokens [[[1363 1249 269 1532] | |
| [ 328 721 1888 875] | |
| [ 30 1687 1100 725] | |
| [2009 1092 1053 489] | |
| [ 440 644 690 529] | |
| [ 765 1303 1010 1434] | |
| [ 864 206 1545 45] | |
| [ 886 609 127 1699] | |
| [1632 1173 968 959] | |
| [ 43 1791 383 830] | |
| [2006 883 1355 346] | |
| [ 294 300 468 1625] | |
| [ 816 263 1277 283] | |
| [ 209 848 1149 377] | |
| [ 823 516 731 764] | |
| [ 344 1515 960 1410]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:08.829 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-8 wav [[[ 0.03129857 0.00853362 -0.01033144 ... 0.09652691 0.09359639 | |
| 0.08388945]]] -0.2293231338262558 -5.644173143082298e-05 0.0785219594836235 0.3838101625442505 (1, 1, 7680) | |
| 2026-04-30 19:26:08.829 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 chunk_tokens [[[1769 1105 22 1919] | |
| [1355 1323 172 443] | |
| [1072 1391 582 63] | |
| [ 189 1513 909 146] | |
| [1547 1852 445 1844] | |
| [ 539 412 46 614] | |
| [ 135 69 1860 1670] | |
| [1611 1605 1124 1079] | |
| [ 162 1449 568 1298] | |
| [1585 1172 749 1028] | |
| [1264 1315 265 52] | |
| [ 522 1040 16 853] | |
| [ 376 1366 22 1060] | |
| [1524 350 908 2044] | |
| [ 942 1910 531 222] | |
| [ 850 848 1437 310]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:08.853 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-12 wav [[[ 0.05809088 0.02357002 -0.00454529 ... -0.0498165 -0.04576993 | |
| -0.03763081]]] -0.3089529573917389 -3.526918703755655e-07 0.09083333611488342 0.3005658984184265 (1, 1, 7680) | |
| 2026-04-30 19:26:08.854 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 chunk_tokens [[[1699 1401 1759 1509] | |
| [1113 208 739 386] | |
| [1827 1794 856 878] | |
| [ 606 492 1366 633] | |
| [ 296 1434 1098 1868] | |
| [1641 724 1511 1350] | |
| [ 863 457 1682 870] | |
| [ 787 1495 1510 1086] | |
| [ 606 1339 263 186] | |
| [ 229 414 1214 212] | |
| [ 318 1528 2025 935] | |
| [ 676 236 178 332] | |
| [1853 69 1321 498] | |
| [ 840 929 64 1710] | |
| [ 3 1685 1935 526] | |
| [2019 546 1128 1358]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:08.878 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-16 wav [[[-2.2946877e-02 -2.3201210e-03 2.1217730e-02 ... 1.0006299e-05 | |
| -3.3452941e-04 -1.9635350e-04]]] -0.24175524711608887 3.526797809172422e-05 0.053924478590488434 0.29685649275779724 (1, 1, 7680) | |
| 2026-04-30 19:26:08.878 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 chunk_tokens [[[ 101 1786 510 759] | |
| [ 552 1361 72 844] | |
| [1643 1196 1471 679] | |
| [ 545 7 343 60] | |
| [1294 1118 377 229] | |
| [1302 1365 1026 1985] | |
| [1408 651 15 970] | |
| [ 367 183 1466 998] | |
| [1252 563 67 1037] | |
| [ 690 1655 565 1221] | |
| [ 191 958 2028 198] | |
| [ 220 1061 536 1952] | |
| [ 447 4 106 1520] | |
| [1324 1886 1209 847] | |
| [1752 344 944 1541] | |
| [1497 1724 1218 1195]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:08.902 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-20 wav [[[5.07825869e-04 1.12122181e-03 5.06746350e-04 ... 1.08543572e-05 | |
| 1.14508384e-05 1.15422645e-05]]] -0.25886231660842896 9.83110749075422e-06 0.04671125486493111 0.2909148931503296 (1, 1, 7680) | |
| 2026-04-30 19:26:08.902 [INFO] __main__: Synthesising: 'для мирового бизнеса.' | |
| 2026-04-30 19:26:08.902 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment д -> text_cache д | |
| 2026-04-30 19:26:08.902 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled False is_finished False | |
| 2026-04-30 19:26:08.907 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list [array([[[-0.03852101, -0.06222959, -0.06324419, ..., 0.00308757, | |
| 0.01666446, 0.02635817]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02811593, 0.01903336, 0.00181638, ..., -0.00637799, | |
| -0.00625728, -0.01839462]]], shape=(1, 1, 7680), dtype=float32), array([[[-3.6303084e-02, -4.4228390e-02, -4.6101980e-02, ..., | |
| 4.6050473e-04, -4.0465111e-05, -2.4329145e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[7.2466741e-05, 2.7459790e-04, 3.0666371e-04, ..., | |
| 8.0509745e-03, 1.3393108e-02, 9.4361240e-03]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 0.00426391, 0.00582221, 0.00909369, ..., -0.02768227, | |
| -0.02276854, -0.01686861]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01355644, -0.01526949, -0.01623942, ..., 0.0395449 , | |
| 0.05279908, 0.00224491]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.01579052, 0.00150335, -0.02962946, ..., -0.00423873, | |
| -0.00033509, 0.00640968]]], shape=(1, 1, 7680), dtype=float32), array([[[1.9390190e-02, 3.0609204e-02, 3.0704437e-02, ..., | |
| 1.1317945e-05, 1.0956299e-05, 1.1030028e-05]]], | |
| shape=(1, 1, 3840), dtype=float32), array([[[ 1.1094540e-05, 1.1138460e-05, 1.1009237e-05, ..., | |
| -2.2123540e-02, -2.2558490e-02, -1.9299621e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[0.00221431, 0.03934583, 0.0700637 , ..., 0.01913414, | |
| 0.04059763, 0.06542776]]], shape=(1, 1, 7680), dtype=float32), array([[[0.08465035, 0.0946539 , 0.09328509, ..., 0.0472551 , | |
| 0.05668663, 0.05911173]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.04501721, 0.0241992 , 0.01363233, ..., -0.04057647, | |
| -0.05749581, -0.0651198 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.06861783, -0.06905188, -0.06281615, ..., -0.00338598, | |
| 0.00180774, 0.00092616]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00584421, -0.00096309, 0.00632945, ..., 0.00375346, | |
| 0.00384357, 0.00217619]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00579548, -0.01757104, -0.0243005 , ..., 0.00547749, | |
| 0.00660871, 0.009783 ]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.01747901, 0.02681293, 0.03847475, ..., -0.02004432, | |
| -0.02144283, -0.0218131 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.9715637e-02, -1.6528632e-02, -1.3177541e-02, ..., | |
| 1.1422026e-05, 1.1317023e-05, 1.1494269e-05]]], | |
| shape=(1, 1, 1920), dtype=float32), array([[[-2.06317715e-02, -1.67933665e-02, -1.47240255e-02, ..., | |
| 6.64611871e-05, -4.19520393e-06, -7.44241624e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-8.0167578e-05, -4.1713702e-05, 3.4347220e-05, ..., | |
| 1.4899543e-02, 1.9630753e-02, 2.1652387e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[0.02029367, 0.01627654, 0.01006193, ..., 0.06808572, | |
| 0.06454458, 0.05861032]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05094757, 0.04577596, 0.04464076, ..., -0.03615839, | |
| -0.03458475, 0.00780901]]], shape=(1, 1, 7680), dtype=float32), array([[[0.05842641, 0.09555472, 0.10986558, ..., 0.0013969 , | |
| 0.01872239, 0.04114778]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05213842, 0.05569138, 0.06345794, ..., -0.00115294, | |
| -0.00027638, -0.00037019]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2735376e-03, -7.3580118e-04, 3.0488527e-05, ..., | |
| 8.4239952e-03, 3.2757007e-02, 1.1410726e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03925117, -0.01366347, 0.03734893, ..., -0.04557104, | |
| -0.04238814, -0.02026677]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02351574, 0.06001395, 0.05978361, ..., 0.00261743, | |
| -0.03956862, -0.06221673]]], shape=(1, 1, 7680), dtype=float32), array([[[-6.3454241e-02, -3.5933349e-02, 1.2640217e-03, ..., | |
| 1.9708219e-05, 1.7832308e-05, 1.5235857e-05]]], | |
| shape=(1, 1, 1920), dtype=float32), array([[[6.4516030e-06, 3.8836665e-06, 3.5758250e-05, ..., | |
| 2.0419013e-02, 5.6000661e-02, 7.9175197e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[0.07597505, 0.05851083, 0.06002833, ..., 0.07287683, | |
| 0.04599379, 0.01605063]]], shape=(1, 1, 7680), dtype=float32), array([[[0.00099137, 0.00403599, 0.01846475, ..., 0.02468315, | |
| 0.01271362, 0.00035484]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00084715, 0.01164515, 0.02932669, ..., 0.00305634, | |
| 0.002376 , 0.00176231]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00133303, 0.00114176, 0.00112796, ..., -0.03397415, | |
| 0.03560583, 0.00734547]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.04759482, 0.00231559, 0.03089104, ..., 0.18176867, | |
| 0.13269146, 0.06594509]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00594246, -0.07083042, -0.11743579, ..., -0.01224556, | |
| -0.0012733 , 0.00776599]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00711998, -0.00636461, -0.02865032, ..., 0.01531223, | |
| 0.02133005, 0.02612119]]], shape=(1, 1, 7680), dtype=float32), array([[[2.5798496e-02, 2.0124789e-02, 9.4997659e-03, ..., | |
| 1.0540312e-05, 1.0445123e-05, 1.0610051e-05]]], | |
| shape=(1, 1, 1920), dtype=float32), array([[[-2.0183910e-02, -1.5937209e-02, -1.3884507e-02, ..., | |
| 5.7107034e-05, 3.8642902e-05, 1.1677517e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-3.8887060e-06, -1.9734021e-05, -8.4024796e-06, ..., | |
| 1.1066332e-01, 8.8470802e-02, 5.8433518e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 0.03129857, 0.00853362, -0.01033144, ..., 0.09652691, | |
| 0.09359639, 0.08388945]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05809088, 0.02357002, -0.00454529, ..., -0.0498165 , | |
| -0.04576993, -0.03763081]]], shape=(1, 1, 7680), dtype=float32), array([[[-2.2946877e-02, -2.3201210e-03, 2.1217730e-02, ..., | |
| 1.0006299e-05, -3.3452941e-04, -1.9635350e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[5.07825869e-04, 1.12122181e-03, 5.06746350e-04, ..., | |
| 1.08543572e-05, 1.14508384e-05, 1.15422645e-05]]], | |
| shape=(1, 1, 7680), dtype=float32)] 42 | |
| 2026-04-30 19:26:08.907 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history [-3.85210067e-02 -6.22295924e-02 -6.32441938e-02 ... 1.08543572e-05 | |
| 1.14508384e-05 1.15422645e-05] (301440,) float32 | |
| 2026-04-30 19:26:08.908 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont wav_history_after cut_idx 15 [1.74790137e-02 2.68129278e-02 3.84747460e-02 ... 1.08543572e-05 | |
| 1.14508384e-05 1.15422645e-05] (190080,) float32 | |
| 2026-04-30 19:26:08.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: prefill cont ref_wav_history_list_after cut_idx 15 [array([[[ 0.01747901, 0.02681293, 0.03847475, ..., -0.02004432, | |
| -0.02144283, -0.0218131 ]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.9715637e-02, -1.6528632e-02, -1.3177541e-02, ..., | |
| 1.1422026e-05, 1.1317023e-05, 1.1494269e-05]]], | |
| shape=(1, 1, 1920), dtype=float32), array([[[-2.06317715e-02, -1.67933665e-02, -1.47240255e-02, ..., | |
| 6.64611871e-05, -4.19520393e-06, -7.44241624e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-8.0167578e-05, -4.1713702e-05, 3.4347220e-05, ..., | |
| 1.4899543e-02, 1.9630753e-02, 2.1652387e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[0.02029367, 0.01627654, 0.01006193, ..., 0.06808572, | |
| 0.06454458, 0.05861032]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05094757, 0.04577596, 0.04464076, ..., -0.03615839, | |
| -0.03458475, 0.00780901]]], shape=(1, 1, 7680), dtype=float32), array([[[0.05842641, 0.09555472, 0.10986558, ..., 0.0013969 , | |
| 0.01872239, 0.04114778]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05213842, 0.05569138, 0.06345794, ..., -0.00115294, | |
| -0.00027638, -0.00037019]]], shape=(1, 1, 7680), dtype=float32), array([[[-1.2735376e-03, -7.3580118e-04, 3.0488527e-05, ..., | |
| 8.4239952e-03, 3.2757007e-02, 1.1410726e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-0.03925117, -0.01366347, 0.03734893, ..., -0.04557104, | |
| -0.04238814, -0.02026677]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.02351574, 0.06001395, 0.05978361, ..., 0.00261743, | |
| -0.03956862, -0.06221673]]], shape=(1, 1, 7680), dtype=float32), array([[[-6.3454241e-02, -3.5933349e-02, 1.2640217e-03, ..., | |
| 1.9708219e-05, 1.7832308e-05, 1.5235857e-05]]], | |
| shape=(1, 1, 1920), dtype=float32), array([[[6.4516030e-06, 3.8836665e-06, 3.5758250e-05, ..., | |
| 2.0419013e-02, 5.6000661e-02, 7.9175197e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[0.07597505, 0.05851083, 0.06002833, ..., 0.07287683, | |
| 0.04599379, 0.01605063]]], shape=(1, 1, 7680), dtype=float32), array([[[0.00099137, 0.00403599, 0.01846475, ..., 0.02468315, | |
| 0.01271362, 0.00035484]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00084715, 0.01164515, 0.02932669, ..., 0.00305634, | |
| 0.002376 , 0.00176231]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00133303, 0.00114176, 0.00112796, ..., -0.03397415, | |
| 0.03560583, 0.00734547]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.04759482, 0.00231559, 0.03089104, ..., 0.18176867, | |
| 0.13269146, 0.06594509]]], shape=(1, 1, 7680), dtype=float32), array([[[-0.00594246, -0.07083042, -0.11743579, ..., -0.01224556, | |
| -0.0012733 , 0.00776599]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.00711998, -0.00636461, -0.02865032, ..., 0.01531223, | |
| 0.02133005, 0.02612119]]], shape=(1, 1, 7680), dtype=float32), array([[[2.5798496e-02, 2.0124789e-02, 9.4997659e-03, ..., | |
| 1.0540312e-05, 1.0445123e-05, 1.0610051e-05]]], | |
| shape=(1, 1, 1920), dtype=float32), array([[[-2.0183910e-02, -1.5937209e-02, -1.3884507e-02, ..., | |
| 5.7107034e-05, 3.8642902e-05, 1.1677517e-05]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[-3.8887060e-06, -1.9734021e-05, -8.4024796e-06, ..., | |
| 1.1066332e-01, 8.8470802e-02, 5.8433518e-02]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[ 0.03129857, 0.00853362, -0.01033144, ..., 0.09652691, | |
| 0.09359639, 0.08388945]]], shape=(1, 1, 7680), dtype=float32), array([[[ 0.05809088, 0.02357002, -0.00454529, ..., -0.0498165 , | |
| -0.04576993, -0.03763081]]], shape=(1, 1, 7680), dtype=float32), array([[[-2.2946877e-02, -2.3201210e-03, 2.1217730e-02, ..., | |
| 1.0006299e-05, -3.3452941e-04, -1.9635350e-04]]], | |
| shape=(1, 1, 7680), dtype=float32), array([[[5.07825869e-04, 1.12122181e-03, 5.06746350e-04, ..., | |
| 1.08543572e-05, 1.14508384e-05, 1.15422645e-05]]], | |
| shape=(1, 1, 7680), dtype=float32)] 27 | |
| 2026-04-30 19:26:08.911 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds language_id 2069 | |
| 2026-04-30 19:26:08.985 [INFO] src.inference.qwen3_tts_inferencer_onnx: _prefill_embeds speaker_embed [[[-0.02861767 0.04147377 -0.04973026 ... 0.1851612 0.07234052 | |
| 0.06604917]]] (1, 1, 1024) | |
| 2026-04-30 19:26:08.985 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_prefill_list [[2154 2156 2069 2157]] | |
| 2026-04-30 19:26:08.986 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_0 [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661]]] (1, 4, 1024) | |
| 2026-04-30 19:26:08.986 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding_1 [[[-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 1, 1024) | |
| 2026-04-30 19:26:08.986 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate codec_input_embedding [[[-0.00662231 0.00408936 0.00294495 ... 0.0111084 -0.00221252 | |
| -0.00595093] | |
| [-0.00418091 0.00317383 0.0004921 ... 0.00231934 -0.00219727 | |
| -0.00291443] | |
| [ 0.00360107 -0.0201416 0.01098633 ... -0.03833008 0.05273438 | |
| 0.00376892] | |
| [-0.00294495 0.00515747 0.00060272 ... 0.01647949 -0.00176239 | |
| -0.00171661] | |
| [-0.02861767 0.04147377 -0.04973026 ... 0.1851612 0.07234052 | |
| 0.06604917] | |
| [-0.00190735 -0.00424194 -0.00109863 ... 0.00312805 0.00408936 | |
| 0.0004921 ]]] (1, 6, 1024) | |
| 2026-04-30 19:26:08.986 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['<|im_start|>assistant\n'] 22 | |
| Qwen3TTSProcessor __call__ text ['<|im_start|>assistant\n'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:08.987 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[151644, 77091, 198]]), 'attention_mask': array([[1, 1, 1]])} | |
| 2026-04-30 19:26:08.987 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:08.987 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[151644 77091 198]] (1, 3) | |
| 2026-04-30 19:26:08.987 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed_role [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03]]] (1, 3, 1024) | |
| 2026-04-30 19:26:08.988 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_bos_embed [[[ 0.00610207 -0.00173687 0.00627419 ... -0.0001377 -0.00063036 | |
| -0.00767252]]] (1, 1, 1024) | |
| 2026-04-30 19:26:08.988 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate tts_pad_embed [[[ 0.00477818 -0.00380599 -0.00169616 ... -0.00928435 0.00155528 | |
| 0.00424147]]] (1, 1, 1024) | |
| 2026-04-30 19:26:08.988 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate _talker_input_embed [[[-0.00184413 0.00028337 0.00124879 ... 0.00182405 -0.00065724 | |
| -0.00170945] | |
| [ 0.00059727 -0.00063216 -0.00120406 ... -0.00696501 -0.00064198 | |
| 0.00132705] | |
| [ 0.00837926 -0.02394759 0.00929017 ... -0.04761443 0.05428966 | |
| 0.0080104 ] | |
| [ 0.00183324 0.00135149 -0.00109344 ... 0.00719514 -0.00020711 | |
| 0.00252486] | |
| [-0.02383949 0.03766778 -0.05142642 ... 0.17587686 0.0738958 | |
| 0.07029065] | |
| [ 0.00419472 -0.00597882 0.00517556 ... 0.00299035 0.003459 | |
| -0.00718043]]] (1, 6, 1024) | |
| 2026-04-30 19:26:08.989 [INFO] src.inference.qwen3_tts_inferencer_onnx: generate talker_input_embed [[[-3.1760857e-03 3.4366560e-04 -6.5541547e-04 ... 6.8441611e-03 | |
| 1.6852217e-03 -3.0699652e-04] | |
| [-5.0306484e-02 4.0557664e-03 1.8289866e-02 ... -5.6887679e-02 | |
| 1.0521024e-02 -2.8837420e-02] | |
| [ 1.9569334e-03 -6.3376268e-05 1.1566407e-03 ... 2.7661016e-03 | |
| 4.2793620e-04 -2.2229077e-03] | |
| ... | |
| [ 1.8332358e-03 1.3514850e-03 -1.0934370e-03 ... 7.1951421e-03 | |
| -2.0710612e-04 2.5248611e-03] | |
| [-2.3839490e-02 3.7667781e-02 -5.1426422e-02 ... 1.7587686e-01 | |
| 7.3895805e-02 7.0290647e-02] | |
| [ 4.1947225e-03 -5.9788167e-03 5.1755565e-03 ... 2.9903483e-03 | |
| 3.4589968e-03 -7.1804281e-03]]] (1, 9, 1024) | |
| 2026-04-30 19:26:09.033 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill done; talker_seq_len=43; step_idx=43 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: Prefill cont done; talker_seq_len=43; step_idx=43 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment л -> text_cache дл | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment я -> text_cache для | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache для | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment м -> text_cache для м | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache для ми | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment р -> text_cache для мир | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache для миро | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment в -> text_cache для миров | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache для мирово | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment г -> text_cache для мировог | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment о -> text_cache для мирового | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment -> text_cache для мирового | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment б -> text_cache для мирового б | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment и -> text_cache для мирового би | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment з -> text_cache для мирового биз | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment н -> text_cache для мирового бизн | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.069 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment е -> text_cache для мирового бизне | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment с -> text_cache для мирового бизнес | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment а -> text_cache для мирового бизнеса | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [] 0 | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text text_fragment . -> text_cache для мирового бизнеса. | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts text ['для мирового бизнеса.'] 21 | |
| Qwen3TTSProcessor __call__ text ['для мирового бизнеса.'] | |
| Qwen3TTSProcessor __call__ output_kwargs[text_kwargs] {'padding': True, 'padding_side': 'left', 'return_tensors': 'np'} | |
| Qwen3TTSProcessor __call__ texts_inputs {'input_ids': array([[ 6949, 13695, 138061, 22107, 132199, 1478, 13]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_dict {'input_ids': array([[ 6949, 13695, 138061, 22107, 132199, 1478, 13]]), 'attention_mask': array([[1, 1, 1, 1, 1, 1, 1]])} | |
| 2026-04-30 19:26:09.070 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids [[ 6949 13695 138061 22107 132199 1478 13]] (1, 7) | |
| 2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: _tokenize_texts input_ids_ [[ 6949 13695 138061 22107 132199 1478 13]] (1, 7) | |
| 2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text segment для мирового бизнеса. 21 -> tokenized_segment [np.int64(6949), np.int64(13695), np.int64(138061), np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)] 7 | |
| 2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: push_text pending_tokens [np.int64(6949), np.int64(13695), np.int64(138061), np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)] | |
| 2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(6949), np.int64(13695), np.int64(138061), np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)] 7 | |
| 2026-04-30 19:26:09.071 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 6949 -> pending_tokens [np.int64(13695), np.int64(138061), np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)] 6 | |
| 2026-04-30 19:26:09.079 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-43 vq [1221] (1,) int64 | |
| 2026-04-30 19:26:09.106 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-44 vq-rvq [[[1221 1889 373 973 111 736 1204 188 1653 1305 1538 411 196 1583 | |
| 305 770]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.106 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13695 -> pending_tokens [np.int64(138061), np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)] 5 | |
| 2026-04-30 19:26:09.114 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-44 vq [2042] (1,) int64 | |
| 2026-04-30 19:26:09.141 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-45 vq-rvq [[[2042 277 1038 252 360 1876 303 1648 107 736 88 126 866 1973 | |
| 477 624]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.142 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 138061 -> pending_tokens [np.int64(22107), np.int64(132199), np.int64(1478), np.int64(13)] 4 | |
| 2026-04-30 19:26:09.150 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-45 vq [1812] (1,) int64 | |
| 2026-04-30 19:26:09.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-46 vq-rvq [[[1812 1975 702 912 1514 1129 1098 275 591 465 1421 412 503 465 | |
| 1096 1053]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.177 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 22107 -> pending_tokens [np.int64(132199), np.int64(1478), np.int64(13)] 3 | |
| 2026-04-30 19:26:09.185 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-46 vq [905] (1,) int64 | |
| 2026-04-30 19:26:09.212 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-47 vq-rvq [[[ 905 637 1379 1325 70 445 1987 864 975 1721 701 956 1358 3 | |
| 133 1381]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.212 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 132199 -> pending_tokens [np.int64(1478), np.int64(13)] 2 | |
| 2026-04-30 19:26:09.220 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-47 vq [1406] (1,) int64 | |
| 2026-04-30 19:26:09.247 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-48 vq-rvq [[[1406 1561 216 71 1606 523 1920 203 17 1284 86 1733 688 1115 | |
| 77 785]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.247 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 1478 -> pending_tokens [np.int64(13)] 1 | |
| 2026-04-30 19:26:09.255 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-48 vq [1804] (1,) int64 | |
| 2026-04-30 19:26:09.282 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-49 vq-rvq [[[1804 1175 1088 319 846 1810 75 1281 1823 375 1998 959 674 2042 | |
| 73 627]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.282 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 13 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:09.290 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-49 vq [1239] (1,) int64 | |
| 2026-04-30 19:26:09.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-50 vq-rvq [[[1239 1155 11 777 39 731 1286 1608 925 730 683 987 417 2043 | |
| 1169 2031]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.317 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 chunk_tokens [[[1221 2042 1812 905] | |
| [1889 277 1975 637] | |
| [ 373 1038 702 1379] | |
| [ 973 252 912 1325] | |
| [ 111 360 1514 70] | |
| [ 736 1876 1129 445] | |
| [1204 303 1098 1987] | |
| [ 188 1648 275 864] | |
| [1653 107 591 975] | |
| [1305 736 465 1721] | |
| [1538 88 1421 701] | |
| [ 411 126 412 956] | |
| [ 196 866 503 1358] | |
| [1583 1973 465 3] | |
| [ 305 477 1096 133] | |
| [ 770 624 1053 1381]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-24 wav [[[1.0586618e-05 1.0957512e-05 1.1577104e-05 ... 1.7860198e-01 | |
| 2.2454987e-01 2.2613712e-01]]] -0.2697470486164093 2.8067548555554822e-05 0.06279374659061432 0.29932451248168945 (1, 1, 7680) | |
| 2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text text_cache 0 | |
| 2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: end_text pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens is_prefilled True is_finished False | |
| 2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens pending_tokens [np.int64(151673)] 1 | |
| 2026-04-30 19:26:09.341 [INFO] src.inference.qwen3_tts_inferencer_onnx: drain_pending_tokens token 151673 -> pending_tokens [] 0 | |
| 2026-04-30 19:26:09.349 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-50 vq [613] (1,) int64 | |
| 2026-04-30 19:26:09.377 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-51 vq-rvq [[[ 613 248 443 533 466 1474 204 1818 719 581 802 141 784 1918 | |
| 1958 766]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.377 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 chunk_tokens [[[1406 1804 1239 613] | |
| [1561 1175 1155 248] | |
| [ 216 1088 11 443] | |
| [ 71 319 777 533] | |
| [1606 846 39 466] | |
| [ 523 1810 731 1474] | |
| [1920 75 1286 204] | |
| [ 203 1281 1608 1818] | |
| [ 17 1823 925 719] | |
| [1284 375 730 581] | |
| [ 86 1998 683 802] | |
| [1733 959 987 141] | |
| [ 688 674 417 784] | |
| [1115 2042 2043 1918] | |
| [ 77 73 1169 1958] | |
| [ 785 627 2031 766]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:09.401 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-28 wav [[[ 0.18334845 0.09610437 -0.00970795 ... -0.14953831 -0.13082638 | |
| -0.10510523]]] -0.3167853057384491 -6.515438872156665e-05 0.08525040000677109 0.3474375605583191 (1, 1, 7680) | |
| 2026-04-30 19:26:09.409 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-51 vq [1845] (1,) int64 | |
| 2026-04-30 19:26:09.436 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-52 vq-rvq [[[1845 1716 2038 1642 825 1307 1284 751 1099 1860 596 77 1422 923 | |
| 730 593]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.445 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-52 vq [1053] (1,) int64 | |
| 2026-04-30 19:26:09.472 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-53 vq-rvq [[[1053 1199 861 1987 457 294 523 727 1090 125 1080 885 746 922 | |
| 1087 207]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.480 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-53 vq [1032] (1,) int64 | |
| 2026-04-30 19:26:09.507 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-54 vq-rvq [[[1032 409 801 1855 1183 553 1931 498 305 1226 1015 1981 584 1033 | |
| 365 1428]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.515 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-54 vq [919] (1,) int64 | |
| 2026-04-30 19:26:09.542 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-55 vq-rvq [[[ 919 1330 1787 884 491 15 1583 778 410 1142 549 404 855 1867 | |
| 1089 1882]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.551 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-55 vq [868] (1,) int64 | |
| 2026-04-30 19:26:09.578 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-56 vq-rvq [[[ 868 151 1170 94 967 1177 10 1010 1639 76 273 892 1009 605 | |
| 1758 1864]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.586 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-56 vq [1809] (1,) int64 | |
| 2026-04-30 19:26:09.613 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-57 vq-rvq [[[1809 727 1843 955 328 791 155 832 827 1421 1138 750 1211 599 | |
| 1106 137]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.621 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-57 vq [1677] (1,) int64 | |
| 2026-04-30 19:26:09.647 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-58 vq-rvq [[[1677 823 434 27 1196 1210 291 1787 283 744 1796 174 125 102 | |
| 1249 1014]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.655 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-58 vq [1922] (1,) int64 | |
| 2026-04-30 19:26:09.682 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-59 vq-rvq [[[1922 1116 581 812 299 514 695 633 1190 1884 477 561 948 560 | |
| 350 200]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.690 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-59 vq [1036] (1,) int64 | |
| 2026-04-30 19:26:09.717 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-60 vq-rvq [[[1036 1302 555 102 254 2009 804 750 260 355 1752 874 77 335 | |
| 158 1042]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.725 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-60 vq [1739] (1,) int64 | |
| 2026-04-30 19:26:09.752 [INFO] src.inference.qwen3_tts_inferencer_onnx: local-step-idx-61 vq-rvq [[[1739 614 139 589 937 390 1428 1264 1149 1208 385 1302 52 1617 | |
| 132 123]]] (1, 1, 16) int64 | |
| 2026-04-30 19:26:09.760 [INFO] src.inference.qwen3_tts_inferencer_onnx: step-idx-61 vq [2150] (1,) int64 | |
| 2026-04-30 19:26:09.760 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 chunk_tokens [[[1845 1053 1032 919] | |
| [1716 1199 409 1330] | |
| [2038 861 801 1787] | |
| [1642 1987 1855 884] | |
| [ 825 457 1183 491] | |
| [1307 294 553 15] | |
| [1284 523 1931 1583] | |
| [ 751 727 498 778] | |
| [1099 1090 305 410] | |
| [1860 125 1226 1142] | |
| [ 596 1080 1015 549] | |
| [ 77 885 1981 404] | |
| [1422 746 584 855] | |
| [ 923 922 1033 1867] | |
| [ 730 1087 365 1089] | |
| [ 593 207 1428 1882]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:09.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-32 wav [[[-0.07561389 -0.03827108 0.00077153 ... 0.05170149 0.01008281 | |
| -0.01854178]]] -0.3299378752708435 6.148191459942609e-05 0.0932779535651207 0.4610540270805359 (1, 1, 7680) | |
| 2026-04-30 19:26:09.784 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 chunk_tokens [[[ 868 1809 1677 1922] | |
| [ 151 727 823 1116] | |
| [1170 1843 434 581] | |
| [ 94 955 27 812] | |
| [ 967 328 1196 299] | |
| [1177 791 1210 514] | |
| [ 10 155 291 695] | |
| [1010 832 1787 633] | |
| [1639 827 283 1190] | |
| [ 76 1421 744 1884] | |
| [ 273 1138 1796 477] | |
| [ 892 750 174 561] | |
| [1009 1211 125 948] | |
| [ 605 599 102 560] | |
| [1758 1106 1249 350] | |
| [1864 137 1014 200]]] (1, 16, 4) n_chunk_frames 4 | |
| 2026-04-30 19:26:09.808 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-36 wav [[[-0.01794823 0.02109164 0.07580939 ... -0.00013498 0.00663236 | |
| -0.00233094]]] -0.24763914942741394 6.338774983305484e-05 0.05173063650727272 0.2930958867073059 (1, 1, 7680) | |
| 2026-04-30 19:26:09.808 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-40 chunk_tokens [[[1036 1739] | |
| [1302 614] | |
| [ 555 139] | |
| [ 102 589] | |
| [ 254 937] | |
| [2009 390] | |
| [ 804 1428] | |
| [ 750 1264] | |
| [ 260 1149] | |
| [ 355 1208] | |
| [1752 385] | |
| [ 874 1302] | |
| [ 77 52] | |
| [ 335 1617] | |
| [ 158 132] | |
| [1042 123]]] (1, 16, 2) n_chunk_frames 2 | |
| 2026-04-30 19:26:09.874 [INFO] src.inference.qwen3_tts_inferencer_onnx: codec-idx-40 wav [[[-1.92377660e-02 -3.73278069e-03 1.66180078e-02 ... 1.14267914e-05 | |
| 1.12166836e-05 1.08007425e-05]]] -0.08614496886730194 9.791910088097211e-06 0.01625766046345234 0.1096140667796135 (1, 1, 3840) | |
| 2026-04-30 19:26:09.874 [INFO] __main__: Synthesis complete: 24.32 s audio in 14.51 s (RTF=0.597) | |
| 2026-04-30 19:26:09.876 [INFO] __main__: Wrote audio_synth/output_1777577155.366709.wav (24.32 s, 24000 Hz) | |