0.00.120.044 W Setting 'enable_thinking' via --chat-template-kwargs is deprecated. Use --reasoning on / --reasoning off instead.
0.00.163.630 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
0.00.163.643 I device_info:
0.00.163.785 I - ROCm0 : AMD Radeon Graphics (131072 MiB, 123858 MiB free)
0.00.163.974 I - Vulkan0 : AMD Radeon Graphics (RADV GFX1151) (132096 MiB, 131922 MiB free)
0.00.163.982 I - CPU : AMD RYZEN AI MAX+ 395 w/ Radeon 8060S (127438 MiB, 127438 MiB free)
0.00.164.078 I system_info: n_threads = 16 (n_threads_batch = 16) / 32 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | FA_ALL_QUANTS = 1 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
0.00.164.142 I srv init: running without SSL
0.00.164.166 I srv init: using 31 threads for HTTP server
0.00.164.167 I srv init: the WebUI is disabled
0.00.164.248 I srv start: binding port with default address family
0.00.165.500 I srv main: loading model
0.00.165.507 I srv load_model: loading model '/mnt/models/nex-n2.5-mini/out/Nex-N2.5-mini-Q4_0_ROCMFP4_STRIX_LEAN.gguf'
0.00.216.012 W llama_model_loader: direct I/O is enabled, disabling mmap
0.22.544.117 W llama_context: n_ctx_seq (65536) < n_ctx_train (262144) -- the full capacity of the model will not be utilized
0.22.849.861 W common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
0.23.278.480 I srv load_model: initializing slots, n_slots = 1
0.23.567.593 W srv load_model: speculative decoding will use checkpoints
0.23.567.602 W common_speculative_init: no implementations specified for speculative decoding
0.23.567.605 I slot load_model: id 0 | task -1 | new slot, n_ctx = 65536
0.23.567.670 I srv load_model: prompt cache RAM enabled: limit_mib=8192
0.23.567.688 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
0.23.567.709 I srv init: idle slots will be saved to prompt cache upon starting a new task
0.23.579.583 I init: chat template, example_format: '<|im_start|>system
You are a helpful assistant<|im_end|>
<|im_start|>user
Hello<|im_end|>
<|im_start|>assistant
Hi there<|im_end|>
<|im_start|>user
How are you?<|im_end|>
<|im_start|>assistant
'
0.23.587.209 I srv init: init: chat template, thinking = 1
0.23.587.253 I srv main: model loaded
0.23.587.256 I srv main: server is listening on http://127.0.0.1:18600
0.23.587.260 I srv update_slots: all slots are idle
0.24.570.949 I srv params_from_: Chat format: peg-native
0.24.571.406 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = -1
0.24.571.411 I srv get_availabl: updating prompt cache
0.24.571.419 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
0.24.571.426 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 65536 tokens, 8589934592 est)
0.24.571.428 I srv get_availabl: prompt cache update took 0.01 ms
0.24.571.805 I reasoning-budget: activated, budget=2147483647 tokens
0.24.571.827 I slot launch_slot_: id 0 | task 0 | processing task, is_child = 0
0.25.235.195 I slot create_check: id 0 | task 0 | created context checkpoint 1 of 32 (pos_min = 417, pos_max = 417, n_tokens = 418, size = 62.813 MiB)
0.25.806.187 I reasoning-budget: deactivated (natural end)
0.26.650.056 I slot print_timing: id 0 | task 0 |
prompt eval time = 715.70 ms / 422 tokens ( 1.70 ms per token, 589.63 tokens per second)
eval time = 1362.48 ms / 60 tokens ( 22.71 ms per token, 44.04 tokens per second)
total time = 2078.18 ms / 482 tokens
0.26.650.247 I slot release: id 0 | task 0 | stop processing: n_tokens = 481, truncated = 0
0.26.650.264 I srv update_slots: all slots are idle
0.26.675.130 I srv params_from_: Chat format: peg-native
0.26.675.629 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.906 (> 0.100 thold), f_keep = 0.842
0.26.676.106 I reasoning-budget: activated, budget=2147483647 tokens
0.26.676.196 I slot launch_slot_: id 0 | task 62 | processing task, is_child = 0
0.26.676.216 W slot update_slots: id 0 | task 62 | n_past = 405, slot.prompt.tokens.size() = 481, seq_id = 0, pos_min = 480, n_swa = 0
0.26.676.222 I slot update_slots: id 0 | task 62 | Checking checkpoint with [417, 417] against 405...
0.26.676.224 W slot update_slots: id 0 | task 62 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.26.676.229 W slot update_slots: id 0 | task 62 | erased invalidated context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.27.231.790 I slot create_check: id 0 | task 62 | created context checkpoint 1 of 32 (pos_min = 442, pos_max = 442, n_tokens = 443, size = 62.813 MiB)
0.27.733.232 I reasoning-budget: deactivated (natural end)
0.28.618.139 I slot print_timing: id 0 | task 62 |
prompt eval time = 593.45 ms / 447 tokens ( 1.33 ms per token, 753.22 tokens per second)
eval time = 1348.46 ms / 65 tokens ( 20.75 ms per token, 48.20 tokens per second)
total time = 1941.91 ms / 512 tokens
0.28.618.225 I slot release: id 0 | task 62 | stop processing: n_tokens = 511, truncated = 0
0.28.618.260 I srv update_slots: all slots are idle
0.28.632.505 I srv params_from_: Chat format: peg-native
0.28.632.871 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.953 (> 0.100 thold), f_keep = 0.793
0.28.633.063 I reasoning-budget: activated, budget=2147483647 tokens
0.28.633.092 I slot launch_slot_: id 0 | task 129 | processing task, is_child = 0
0.28.633.101 W slot update_slots: id 0 | task 129 | n_past = 405, slot.prompt.tokens.size() = 511, seq_id = 0, pos_min = 510, n_swa = 0
0.28.633.102 I slot update_slots: id 0 | task 129 | Checking checkpoint with [442, 442] against 405...
0.28.633.103 W slot update_slots: id 0 | task 129 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.28.633.104 W slot update_slots: id 0 | task 129 | erased invalidated context checkpoint (pos_min = 442, pos_max = 442, n_tokens = 443, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.29.161.759 I slot create_check: id 0 | task 129 | created context checkpoint 1 of 32 (pos_min = 420, pos_max = 420, n_tokens = 421, size = 62.813 MiB)
0.29.478.654 I reasoning-budget: deactivated (natural end)
0.30.331.330 I slot print_timing: id 0 | task 129 |
prompt eval time = 580.01 ms / 425 tokens ( 1.36 ms per token, 732.75 tokens per second)
eval time = 1118.18 ms / 52 tokens ( 21.50 ms per token, 46.50 tokens per second)
total time = 1698.19 ms / 477 tokens
0.30.331.521 I slot release: id 0 | task 129 | stop processing: n_tokens = 476, truncated = 0
0.30.331.586 I srv update_slots: all slots are idle
0.30.386.522 I srv params_from_: Chat format: peg-native
0.30.388.735 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.953 (> 0.100 thold), f_keep = 0.851
0.30.389.319 I reasoning-budget: activated, budget=2147483647 tokens
0.30.389.437 I slot launch_slot_: id 0 | task 183 | processing task, is_child = 0
0.30.389.465 W slot update_slots: id 0 | task 183 | n_past = 405, slot.prompt.tokens.size() = 476, seq_id = 0, pos_min = 475, n_swa = 0
0.30.389.469 I slot update_slots: id 0 | task 183 | Checking checkpoint with [420, 420] against 405...
0.30.389.471 W slot update_slots: id 0 | task 183 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.30.389.478 W slot update_slots: id 0 | task 183 | erased invalidated context checkpoint (pos_min = 420, pos_max = 420, n_tokens = 421, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.30.972.513 I slot create_check: id 0 | task 183 | created context checkpoint 1 of 32 (pos_min = 420, pos_max = 420, n_tokens = 421, size = 62.813 MiB)
0.31.338.635 I reasoning-budget: deactivated (natural end)
0.31.461.621 I slot print_timing: id 0 | task 183 |
prompt eval time = 630.63 ms / 425 tokens ( 1.48 ms per token, 673.92 tokens per second)
eval time = 441.50 ms / 17 tokens ( 25.97 ms per token, 38.51 tokens per second)
total time = 1072.13 ms / 442 tokens
0.31.461.844 I slot release: id 0 | task 183 | stop processing: n_tokens = 441, truncated = 0
0.31.461.907 I srv update_slots: all slots are idle
0.31.524.318 I srv params_from_: Chat format: peg-native
0.31.526.203 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.962 (> 0.100 thold), f_keep = 0.921
0.31.526.820 I reasoning-budget: activated, budget=2147483647 tokens
0.31.526.906 I slot launch_slot_: id 0 | task 202 | processing task, is_child = 0
0.31.526.929 W slot update_slots: id 0 | task 202 | n_past = 406, slot.prompt.tokens.size() = 441, seq_id = 0, pos_min = 440, n_swa = 0
0.31.526.933 I slot update_slots: id 0 | task 202 | Checking checkpoint with [420, 420] against 406...
0.31.526.935 W slot update_slots: id 0 | task 202 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.31.526.940 W slot update_slots: id 0 | task 202 | erased invalidated context checkpoint (pos_min = 420, pos_max = 420, n_tokens = 421, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.32.129.825 I slot create_check: id 0 | task 202 | created context checkpoint 1 of 32 (pos_min = 417, pos_max = 417, n_tokens = 418, size = 62.813 MiB)
0.32.519.469 I reasoning-budget: deactivated (natural end)
0.33.361.317 I slot print_timing: id 0 | task 202 |
prompt eval time = 645.36 ms / 422 tokens ( 1.53 ms per token, 653.90 tokens per second)
eval time = 1189.02 ms / 55 tokens ( 21.62 ms per token, 46.26 tokens per second)
total time = 1834.38 ms / 477 tokens
0.33.361.399 I slot release: id 0 | task 202 | stop processing: n_tokens = 476, truncated = 0
0.33.361.431 I srv update_slots: all slots are idle
0.33.406.059 I srv params_from_: Chat format: peg-native
0.33.406.536 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.854 (> 0.100 thold), f_keep = 0.884
0.33.406.842 I reasoning-budget: activated, budget=2147483647 tokens
0.33.406.887 I slot launch_slot_: id 0 | task 259 | processing task, is_child = 0
0.33.406.903 W slot update_slots: id 0 | task 259 | n_past = 421, slot.prompt.tokens.size() = 476, seq_id = 0, pos_min = 475, n_swa = 0
0.33.406.904 I slot update_slots: id 0 | task 259 | Checking checkpoint with [417, 417] against 421...
0.33.410.865 W slot update_slots: id 0 | task 259 | restored context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_past = 418, size = 62.813 MiB)
0.33.668.081 I slot create_check: id 0 | task 259 | created context checkpoint 2 of 32 (pos_min = 488, pos_max = 488, n_tokens = 489, size = 62.813 MiB)
0.34.301.983 I reasoning-budget: deactivated (natural end)
0.34.590.965 I slot print_timing: id 0 | task 259 |
prompt eval time = 311.59 ms / 75 tokens ( 4.15 ms per token, 240.70 tokens per second)
eval time = 872.45 ms / 38 tokens ( 22.96 ms per token, 43.56 tokens per second)
total time = 1184.04 ms / 113 tokens
0.34.591.058 I slot release: id 0 | task 259 | stop processing: n_tokens = 530, truncated = 0
0.34.591.093 I srv update_slots: all slots are idle
0.34.626.053 I srv params_from_: Chat format: peg-native
0.34.626.459 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.972 (> 0.100 thold), f_keep = 0.774
0.34.626.655 I reasoning-budget: activated, budget=2147483647 tokens
0.34.626.694 I slot launch_slot_: id 0 | task 299 | processing task, is_child = 0
0.34.626.705 W slot update_slots: id 0 | task 299 | n_past = 410, slot.prompt.tokens.size() = 530, seq_id = 0, pos_min = 529, n_swa = 0
0.34.626.705 I slot update_slots: id 0 | task 299 | Checking checkpoint with [488, 488] against 410...
0.34.626.706 I slot update_slots: id 0 | task 299 | Checking checkpoint with [417, 417] against 410...
0.34.626.706 W slot update_slots: id 0 | task 299 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.34.626.709 W slot update_slots: id 0 | task 299 | erased invalidated context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.34.627.674 W slot update_slots: id 0 | task 299 | erased invalidated context checkpoint (pos_min = 488, pos_max = 488, n_tokens = 489, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.35.160.501 I slot create_check: id 0 | task 299 | created context checkpoint 1 of 32 (pos_min = 417, pos_max = 417, n_tokens = 418, size = 62.813 MiB)
0.35.462.626 I reasoning-budget: deactivated (natural end)
0.36.334.370 I slot print_timing: id 0 | task 299 |
prompt eval time = 570.77 ms / 422 tokens ( 1.35 ms per token, 739.35 tokens per second)
eval time = 1136.85 ms / 53 tokens ( 21.45 ms per token, 46.62 tokens per second)
total time = 1707.63 ms / 475 tokens
0.36.334.535 I slot release: id 0 | task 299 | stop processing: n_tokens = 474, truncated = 0
0.36.334.587 I srv update_slots: all slots are idle
0.36.346.401 I srv params_from_: Chat format: peg-native
0.36.346.871 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.935 (> 0.100 thold), f_keep = 0.854
0.36.347.275 I reasoning-budget: activated, budget=2147483647 tokens
0.36.347.355 I slot launch_slot_: id 0 | task 354 | processing task, is_child = 0
0.36.347.371 W slot update_slots: id 0 | task 354 | n_past = 405, slot.prompt.tokens.size() = 474, seq_id = 0, pos_min = 473, n_swa = 0
0.36.347.374 I slot update_slots: id 0 | task 354 | Checking checkpoint with [417, 417] against 405...
0.36.347.376 W slot update_slots: id 0 | task 354 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.36.347.381 W slot update_slots: id 0 | task 354 | erased invalidated context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.36.950.505 I slot create_check: id 0 | task 354 | created context checkpoint 1 of 32 (pos_min = 428, pos_max = 428, n_tokens = 429, size = 62.813 MiB)
0.37.901.136 I reasoning-budget: deactivated (natural end)
0.39.133.735 I slot print_timing: id 0 | task 354 | n_decoded = 100, tg = 46.90 t/s
0.39.607.166 I slot print_timing: id 0 | task 354 |
prompt eval time = 653.96 ms / 433 tokens ( 1.51 ms per token, 662.12 tokens per second)
eval time = 2605.80 ms / 123 tokens ( 21.19 ms per token, 47.20 tokens per second)
total time = 3259.76 ms / 556 tokens
0.39.607.372 I slot release: id 0 | task 354 | stop processing: n_tokens = 555, truncated = 0
0.39.607.435 I srv update_slots: all slots are idle
0.39.655.799 I srv params_from_: Chat format: peg-native
0.39.656.354 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.955 (> 0.100 thold), f_keep = 0.730
0.39.656.713 I reasoning-budget: activated, budget=2147483647 tokens
0.39.656.717 I reasoning-budget: deactivated (natural end)
0.39.656.803 I slot launch_slot_: id 0 | task 479 | processing task, is_child = 0
0.39.656.826 W slot update_slots: id 0 | task 479 | n_past = 405, slot.prompt.tokens.size() = 555, seq_id = 0, pos_min = 554, n_swa = 0
0.39.656.828 I slot update_slots: id 0 | task 479 | Checking checkpoint with [428, 428] against 405...
0.39.656.830 W slot update_slots: id 0 | task 479 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.39.656.835 W slot update_slots: id 0 | task 479 | erased invalidated context checkpoint (pos_min = 428, pos_max = 428, n_tokens = 429, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.40.205.076 I slot create_check: id 0 | task 479 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB)
0.41.065.168 I slot print_timing: id 0 | task 479 |
prompt eval time = 582.67 ms / 424 tokens ( 1.37 ms per token, 727.68 tokens per second)
eval time = 825.66 ms / 39 tokens ( 21.17 ms per token, 47.23 tokens per second)
total time = 1408.33 ms / 463 tokens
0.41.065.250 I slot release: id 0 | task 479 | stop processing: n_tokens = 462, truncated = 0
0.41.065.277 I srv update_slots: all slots are idle
0.41.077.853 I srv params_from_: Chat format: peg-native
0.41.078.228 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.902 (> 0.100 thold), f_keep = 0.877
0.41.078.482 I reasoning-budget: activated, budget=2147483647 tokens
0.41.078.484 I reasoning-budget: deactivated (natural end)
0.41.078.524 I slot launch_slot_: id 0 | task 520 | processing task, is_child = 0
0.41.078.534 W slot update_slots: id 0 | task 520 | n_past = 405, slot.prompt.tokens.size() = 462, seq_id = 0, pos_min = 461, n_swa = 0
0.41.078.535 I slot update_slots: id 0 | task 520 | Checking checkpoint with [419, 419] against 405...
0.41.078.536 W slot update_slots: id 0 | task 520 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.41.078.537 W slot update_slots: id 0 | task 520 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.41.589.485 I slot create_check: id 0 | task 520 | created context checkpoint 1 of 32 (pos_min = 444, pos_max = 444, n_tokens = 445, size = 62.813 MiB)
0.43.355.441 I slot print_timing: id 0 | task 520 |
prompt eval time = 549.58 ms / 449 tokens ( 1.22 ms per token, 816.99 tokens per second)
eval time = 1727.31 ms / 86 tokens ( 20.09 ms per token, 49.79 tokens per second)
total time = 2276.89 ms / 535 tokens
0.43.355.528 I slot release: id 0 | task 520 | stop processing: n_tokens = 534, truncated = 0
0.43.355.559 I srv update_slots: all slots are idle
0.43.407.484 I srv params_from_: Chat format: peg-native
0.43.408.099 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.948 (> 0.100 thold), f_keep = 0.758
0.43.408.372 I reasoning-budget: activated, budget=2147483647 tokens
0.43.408.374 I reasoning-budget: deactivated (natural end)
0.43.408.422 I slot launch_slot_: id 0 | task 608 | processing task, is_child = 0
0.43.408.434 W slot update_slots: id 0 | task 608 | n_past = 405, slot.prompt.tokens.size() = 534, seq_id = 0, pos_min = 533, n_swa = 0
0.43.408.435 I slot update_slots: id 0 | task 608 | Checking checkpoint with [444, 444] against 405...
0.43.408.437 W slot update_slots: id 0 | task 608 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.43.408.440 W slot update_slots: id 0 | task 608 | erased invalidated context checkpoint (pos_min = 444, pos_max = 444, n_tokens = 445, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.43.970.219 I slot create_check: id 0 | task 608 | created context checkpoint 1 of 32 (pos_min = 422, pos_max = 422, n_tokens = 423, size = 62.813 MiB)
0.44.791.545 I slot print_timing: id 0 | task 608 |
prompt eval time = 601.11 ms / 427 tokens ( 1.41 ms per token, 710.35 tokens per second)
eval time = 781.99 ms / 39 tokens ( 20.05 ms per token, 49.87 tokens per second)
total time = 1383.10 ms / 466 tokens
0.44.791.624 I slot release: id 0 | task 608 | stop processing: n_tokens = 465, truncated = 0
0.44.791.654 I srv update_slots: all slots are idle
0.44.833.558 I srv params_from_: Chat format: peg-native
0.44.834.049 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.948 (> 0.100 thold), f_keep = 0.871
0.44.834.271 I reasoning-budget: activated, budget=2147483647 tokens
0.44.834.272 I reasoning-budget: deactivated (natural end)
0.44.834.315 I slot launch_slot_: id 0 | task 649 | processing task, is_child = 0
0.44.834.326 W slot update_slots: id 0 | task 649 | n_past = 405, slot.prompt.tokens.size() = 465, seq_id = 0, pos_min = 464, n_swa = 0
0.44.834.327 I slot update_slots: id 0 | task 649 | Checking checkpoint with [422, 422] against 405...
0.44.834.328 W slot update_slots: id 0 | task 649 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.44.834.332 W slot update_slots: id 0 | task 649 | erased invalidated context checkpoint (pos_min = 422, pos_max = 422, n_tokens = 423, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.45.316.040 I slot create_check: id 0 | task 649 | created context checkpoint 1 of 32 (pos_min = 422, pos_max = 422, n_tokens = 423, size = 62.813 MiB)
0.45.454.550 I slot print_timing: id 0 | task 649 |
prompt eval time = 522.74 ms / 427 tokens ( 1.22 ms per token, 816.85 tokens per second)
eval time = 97.47 ms / 4 tokens ( 24.37 ms per token, 41.04 tokens per second)
total time = 620.21 ms / 431 tokens
0.45.454.641 I slot release: id 0 | task 649 | stop processing: n_tokens = 430, truncated = 0
0.45.454.670 I srv update_slots: all slots are idle
0.45.491.620 I srv params_from_: Chat format: peg-native
0.45.492.052 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.958 (> 0.100 thold), f_keep = 0.944
0.45.492.301 I reasoning-budget: activated, budget=2147483647 tokens
0.45.492.303 I reasoning-budget: deactivated (natural end)
0.45.492.343 I slot launch_slot_: id 0 | task 655 | processing task, is_child = 0
0.45.492.355 W slot update_slots: id 0 | task 655 | n_past = 406, slot.prompt.tokens.size() = 430, seq_id = 0, pos_min = 429, n_swa = 0
0.45.492.357 I slot update_slots: id 0 | task 655 | Checking checkpoint with [422, 422] against 406...
0.45.492.358 W slot update_slots: id 0 | task 655 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.45.492.362 W slot update_slots: id 0 | task 655 | erased invalidated context checkpoint (pos_min = 422, pos_max = 422, n_tokens = 423, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.46.038.260 I slot create_check: id 0 | task 655 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB)
0.46.950.011 I slot print_timing: id 0 | task 655 |
prompt eval time = 592.07 ms / 424 tokens ( 1.40 ms per token, 716.14 tokens per second)
eval time = 865.56 ms / 40 tokens ( 21.64 ms per token, 46.21 tokens per second)
total time = 1457.62 ms / 464 tokens
0.46.950.215 I slot release: id 0 | task 655 | stop processing: n_tokens = 463, truncated = 0
0.46.950.270 I srv update_slots: all slots are idle
0.46.968.851 I srv params_from_: Chat format: peg-native
0.46.969.311 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.935 (> 0.100 thold), f_keep = 1.000
0.46.969.946 I reasoning-budget: activated, budget=2147483647 tokens
0.46.969.951 I reasoning-budget: deactivated (natural end)
0.46.970.047 I slot launch_slot_: id 0 | task 697 | processing task, is_child = 0
0.47.121.064 I slot create_check: id 0 | task 697 | created context checkpoint 2 of 32 (pos_min = 490, pos_max = 490, n_tokens = 491, size = 62.813 MiB)
0.47.570.159 I slot print_timing: id 0 | task 697 |
prompt eval time = 211.63 ms / 32 tokens ( 6.61 ms per token, 151.21 tokens per second)
eval time = 388.43 ms / 15 tokens ( 25.90 ms per token, 38.62 tokens per second)
total time = 600.06 ms / 47 tokens
0.47.570.388 I slot release: id 0 | task 697 | stop processing: n_tokens = 509, truncated = 0
0.47.570.448 I srv update_slots: all slots are idle
0.47.607.526 I srv params_from_: Chat format: peg-native
0.47.608.040 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.967 (> 0.100 thold), f_keep = 0.806
0.47.608.345 I reasoning-budget: activated, budget=2147483647 tokens
0.47.608.347 I reasoning-budget: deactivated (natural end)
0.47.608.398 I slot launch_slot_: id 0 | task 714 | processing task, is_child = 0
0.47.608.410 W slot update_slots: id 0 | task 714 | n_past = 410, slot.prompt.tokens.size() = 509, seq_id = 0, pos_min = 508, n_swa = 0
0.47.608.412 I slot update_slots: id 0 | task 714 | Checking checkpoint with [490, 490] against 410...
0.47.608.412 I slot update_slots: id 0 | task 714 | Checking checkpoint with [419, 419] against 410...
0.47.608.413 W slot update_slots: id 0 | task 714 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.47.608.416 W slot update_slots: id 0 | task 714 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.47.609.303 W slot update_slots: id 0 | task 714 | erased invalidated context checkpoint (pos_min = 490, pos_max = 490, n_tokens = 491, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.48.271.002 I slot create_check: id 0 | task 714 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB)
0.49.108.254 I slot print_timing: id 0 | task 714 |
prompt eval time = 731.88 ms / 424 tokens ( 1.73 ms per token, 579.33 tokens per second)
eval time = 767.92 ms / 40 tokens ( 19.20 ms per token, 52.09 tokens per second)
total time = 1499.80 ms / 464 tokens
0.49.108.437 I slot release: id 0 | task 714 | stop processing: n_tokens = 463, truncated = 0
0.49.108.493 I srv update_slots: all slots are idle
0.49.161.163 I srv params_from_: Chat format: peg-native
0.49.163.186 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.931 (> 0.100 thold), f_keep = 0.875
0.49.163.878 I reasoning-budget: activated, budget=2147483647 tokens
0.49.163.884 I reasoning-budget: deactivated (natural end)
0.49.163.990 I slot launch_slot_: id 0 | task 756 | processing task, is_child = 0
0.49.164.016 W slot update_slots: id 0 | task 756 | n_past = 405, slot.prompt.tokens.size() = 463, seq_id = 0, pos_min = 462, n_swa = 0
0.49.164.018 I slot update_slots: id 0 | task 756 | Checking checkpoint with [419, 419] against 405...
0.49.164.020 W slot update_slots: id 0 | task 756 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
0.49.164.027 W slot update_slots: id 0 | task 756 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB)
0.49.744.671 I slot create_check: id 0 | task 756 | created context checkpoint 1 of 32 (pos_min = 430, pos_max = 430, n_tokens = 431, size = 62.813 MiB)
0.51.381.802 I slot print_timing: id 0 | task 756 |
prompt eval time = 632.00 ms / 435 tokens ( 1.45 ms per token, 688.30 tokens per second)
eval time = 1585.77 ms / 80 tokens ( 19.82 ms per token, 50.45 tokens per second)
total time = 2217.77 ms / 515 tokens
0.51.382.017 I slot release: id 0 | task 756 | stop processing: n_tokens = 514, truncated = 0
0.51.382.050 I srv update_slots: all slots are idle
0.51.383.517 I srv operator(): operator(): cleaning up before exit...