| 0.00.077.092 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg) |
| 0.00.077.102 I device_info: |
| 0.00.077.242 I - ROCm0 : AMD Radeon Graphics (131072 MiB, 123819 MiB free) |
| 0.00.077.530 I - Vulkan0 : AMD Radeon Graphics (RADV GFX1151) (132096 MiB, 131922 MiB free) |
| 0.00.077.538 I - CPU : AMD RYZEN AI MAX+ 395 w/ Radeon 8060S (127438 MiB, 127438 MiB free) |
| 0.00.077.648 I system_info: n_threads = 16 (n_threads_batch = 16) / 32 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | FA_ALL_QUANTS = 1 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | |
| 0.00.077.722 I srv init: running without SSL |
| 0.00.077.768 I srv init: using 31 threads for HTTP server |
| 0.00.077.770 I srv init: the WebUI is disabled |
| 0.00.077.863 I srv start: binding port with default address family |
| 0.00.079.093 I srv main: loading model |
| 0.00.079.096 I srv load_model: loading model '/mnt/models/nex-n2.5-mini/out/Nex-N2.5-mini-Q4_0_ROCMFP4_STRIX_LEAN.gguf' |
| 0.00.120.315 W llama_model_loader: direct I/O is enabled, disabling mmap |
| 0.21.810.861 W llama_context: n_ctx_seq (65536) < n_ctx_train (262144) -- the full capacity of the model will not be utilized |
| 0.22.004.505 W common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) |
| 0.22.307.874 I srv load_model: initializing slots, n_slots = 1 |
| 0.22.526.550 W srv load_model: speculative decoding will use checkpoints |
| 0.22.526.576 W common_speculative_init: no implementations specified for speculative decoding |
| 0.22.526.584 I slot load_model: id 0 | task -1 | new slot, n_ctx = 65536 |
| 0.22.526.740 I srv load_model: prompt cache RAM enabled: limit_mib=8192 |
| 0.22.526.745 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391 |
| 0.22.526.855 I srv init: idle slots will be saved to prompt cache upon starting a new task |
| 0.22.576.014 I init: chat template, example_format: '<|im_start|>system |
| You are a helpful assistant<|im_end|> |
| <|im_start|>user |
| Hello<|im_end|> |
| <|im_start|>assistant |
| <think> |
|
|
| </think> |
|
|
| Hi there<|im_end|> |
| <|im_start|>user |
| How are you?<|im_end|> |
| <|im_start|>assistant |
| <think> |
|
|
| </think> |
|
|
| ' |
| 0.22.604.308 I srv init: init: chat template, thinking = 0 |
| 0.22.604.360 I srv main: model loaded |
| 0.22.604.364 I srv main: server is listening on http://127.0.0.1:18600 |
| 0.22.604.370 I srv update_slots: all slots are idle |
| 0.24.142.693 I srv params_from_: Chat format: peg-native |
| 0.24.143.568 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = -1 |
| 0.24.143.571 I srv get_availabl: updating prompt cache |
| 0.24.143.578 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 |
| 0.24.143.583 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 65536 tokens, 8589934592 est) |
| 0.24.143.585 I srv get_availabl: prompt cache update took 0.01 ms |
| 0.24.143.943 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.24.143.962 I slot launch_slot_: id 0 | task 0 | processing task, is_child = 0 |
| 0.24.903.283 I slot create_check: id 0 | task 0 | created context checkpoint 1 of 32 (pos_min = 417, pos_max = 417, n_tokens = 418, size = 62.813 MiB) |
| 0.25.273.393 I reasoning-budget: deactivated (natural end) |
| 0.26.099.925 I slot print_timing: id 0 | task 0 | |
| prompt eval time = 810.27 ms / 422 tokens ( 1.92 ms per token, 520.81 tokens per second) |
| eval time = 1145.63 ms / 51 tokens ( 22.46 ms per token, 44.52 tokens per second) |
| total time = 1955.91 ms / 473 tokens |
| 0.26.100.146 I slot release: id 0 | task 0 | stop processing: n_tokens = 472, truncated = 0 |
| 0.26.100.163 I srv update_slots: all slots are idle |
| 0.26.148.514 I srv params_from_: Chat format: peg-native |
| 0.26.149.069 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.906 (> 0.100 thold), f_keep = 0.858 |
| 0.26.149.246 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.26.149.294 I slot launch_slot_: id 0 | task 53 | processing task, is_child = 0 |
| 0.26.149.305 W slot update_slots: id 0 | task 53 | n_past = 405, slot.prompt.tokens.size() = 472, seq_id = 0, pos_min = 471, n_swa = 0 |
| 0.26.149.306 I slot update_slots: id 0 | task 53 | Checking checkpoint with [417, 417] against 405... |
| 0.26.149.307 W slot update_slots: id 0 | task 53 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.26.149.310 W slot update_slots: id 0 | task 53 | erased invalidated context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.26.723.793 I slot create_check: id 0 | task 53 | created context checkpoint 1 of 32 (pos_min = 442, pos_max = 442, n_tokens = 443, size = 62.813 MiB) |
| 0.27.315.116 I reasoning-budget: deactivated (natural end) |
| 0.28.126.542 I slot print_timing: id 0 | task 53 | |
| prompt eval time = 626.21 ms / 447 tokens ( 1.40 ms per token, 713.82 tokens per second) |
| eval time = 1350.95 ms / 68 tokens ( 19.87 ms per token, 50.34 tokens per second) |
| total time = 1977.16 ms / 515 tokens |
| 0.28.126.747 I slot release: id 0 | task 53 | stop processing: n_tokens = 514, truncated = 0 |
| 0.28.126.781 I srv update_slots: all slots are idle |
| 0.28.164.510 I srv params_from_: Chat format: peg-native |
| 0.28.166.615 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.953 (> 0.100 thold), f_keep = 0.788 |
| 0.28.167.130 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.28.167.205 I slot launch_slot_: id 0 | task 123 | processing task, is_child = 0 |
| 0.28.167.226 W slot update_slots: id 0 | task 123 | n_past = 405, slot.prompt.tokens.size() = 514, seq_id = 0, pos_min = 513, n_swa = 0 |
| 0.28.167.229 I slot update_slots: id 0 | task 123 | Checking checkpoint with [442, 442] against 405... |
| 0.28.167.232 W slot update_slots: id 0 | task 123 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.28.167.239 W slot update_slots: id 0 | task 123 | erased invalidated context checkpoint (pos_min = 442, pos_max = 442, n_tokens = 443, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.28.745.049 I slot create_check: id 0 | task 123 | created context checkpoint 1 of 32 (pos_min = 420, pos_max = 420, n_tokens = 421, size = 62.813 MiB) |
| 0.28.952.307 I reasoning-budget: deactivated (natural end) |
| 0.29.756.441 I slot print_timing: id 0 | task 123 | |
| prompt eval time = 613.73 ms / 425 tokens ( 1.44 ms per token, 692.49 tokens per second) |
| eval time = 975.48 ms / 48 tokens ( 20.32 ms per token, 49.21 tokens per second) |
| total time = 1589.20 ms / 473 tokens |
| 0.29.756.519 I slot release: id 0 | task 123 | stop processing: n_tokens = 472, truncated = 0 |
| 0.29.756.549 I srv update_slots: all slots are idle |
| 0.29.771.836 I srv params_from_: Chat format: peg-native |
| 0.29.772.265 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.953 (> 0.100 thold), f_keep = 0.858 |
| 0.29.772.460 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.29.772.502 I slot launch_slot_: id 0 | task 173 | processing task, is_child = 0 |
| 0.29.772.513 W slot update_slots: id 0 | task 173 | n_past = 405, slot.prompt.tokens.size() = 472, seq_id = 0, pos_min = 471, n_swa = 0 |
| 0.29.772.513 I slot update_slots: id 0 | task 173 | Checking checkpoint with [420, 420] against 405... |
| 0.29.772.514 W slot update_slots: id 0 | task 173 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.29.772.518 W slot update_slots: id 0 | task 173 | erased invalidated context checkpoint (pos_min = 420, pos_max = 420, n_tokens = 421, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.30.386.059 I slot create_check: id 0 | task 173 | created context checkpoint 1 of 32 (pos_min = 420, pos_max = 420, n_tokens = 421, size = 62.813 MiB) |
| 0.30.672.836 I reasoning-budget: deactivated (natural end) |
| 0.30.764.932 I slot print_timing: id 0 | task 173 | |
| prompt eval time = 647.59 ms / 425 tokens ( 1.52 ms per token, 656.28 tokens per second) |
| eval time = 344.81 ms / 17 tokens ( 20.28 ms per token, 49.30 tokens per second) |
| total time = 992.40 ms / 442 tokens |
| 0.30.765.023 I slot release: id 0 | task 173 | stop processing: n_tokens = 441, truncated = 0 |
| 0.30.765.050 I srv update_slots: all slots are idle |
| 0.30.804.618 I srv params_from_: Chat format: peg-native |
| 0.30.806.300 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.962 (> 0.100 thold), f_keep = 0.921 |
| 0.30.806.744 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.30.806.810 I slot launch_slot_: id 0 | task 192 | processing task, is_child = 0 |
| 0.30.806.826 W slot update_slots: id 0 | task 192 | n_past = 406, slot.prompt.tokens.size() = 441, seq_id = 0, pos_min = 440, n_swa = 0 |
| 0.30.806.829 I slot update_slots: id 0 | task 192 | Checking checkpoint with [420, 420] against 406... |
| 0.30.806.830 W slot update_slots: id 0 | task 192 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.30.806.835 W slot update_slots: id 0 | task 192 | erased invalidated context checkpoint (pos_min = 420, pos_max = 420, n_tokens = 421, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.31.351.459 I slot create_check: id 0 | task 192 | created context checkpoint 1 of 32 (pos_min = 417, pos_max = 417, n_tokens = 418, size = 62.813 MiB) |
| 0.31.884.045 I reasoning-budget: deactivated (natural end) |
| 0.32.727.839 I slot print_timing: id 0 | task 192 | |
| prompt eval time = 584.38 ms / 422 tokens ( 1.38 ms per token, 722.13 tokens per second) |
| eval time = 1336.62 ms / 62 tokens ( 21.56 ms per token, 46.39 tokens per second) |
| total time = 1921.00 ms / 484 tokens |
| 0.32.727.928 I slot release: id 0 | task 192 | stop processing: n_tokens = 483, truncated = 0 |
| 0.32.727.959 I srv update_slots: all slots are idle |
| 0.32.742.237 I srv params_from_: Chat format: peg-native |
| 0.32.742.652 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.854 (> 0.100 thold), f_keep = 0.872 |
| 0.32.743.158 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.32.743.231 I slot launch_slot_: id 0 | task 256 | processing task, is_child = 0 |
| 0.32.743.251 W slot update_slots: id 0 | task 256 | n_past = 421, slot.prompt.tokens.size() = 483, seq_id = 0, pos_min = 482, n_swa = 0 |
| 0.32.743.254 I slot update_slots: id 0 | task 256 | Checking checkpoint with [417, 417] against 421... |
| 0.32.748.604 W slot update_slots: id 0 | task 256 | restored context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_past = 418, size = 62.813 MiB) |
| 0.32.958.098 I slot create_check: id 0 | task 256 | created context checkpoint 2 of 32 (pos_min = 488, pos_max = 488, n_tokens = 489, size = 62.813 MiB) |
| 0.33.556.876 I reasoning-budget: deactivated (natural end) |
| 0.33.886.761 I slot print_timing: id 0 | task 256 | |
| prompt eval time = 258.37 ms / 75 tokens ( 3.44 ms per token, 290.28 tokens per second) |
| eval time = 885.13 ms / 42 tokens ( 21.07 ms per token, 47.45 tokens per second) |
| total time = 1143.50 ms / 117 tokens |
| 0.33.886.848 I slot release: id 0 | task 256 | stop processing: n_tokens = 534, truncated = 0 |
| 0.33.886.880 I srv update_slots: all slots are idle |
| 0.33.924.683 I srv params_from_: Chat format: peg-native |
| 0.33.925.111 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.972 (> 0.100 thold), f_keep = 0.768 |
| 0.33.925.551 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.33.925.629 I slot launch_slot_: id 0 | task 300 | processing task, is_child = 0 |
| 0.33.925.649 W slot update_slots: id 0 | task 300 | n_past = 410, slot.prompt.tokens.size() = 534, seq_id = 0, pos_min = 533, n_swa = 0 |
| 0.33.925.650 I slot update_slots: id 0 | task 300 | Checking checkpoint with [488, 488] against 410... |
| 0.33.925.652 I slot update_slots: id 0 | task 300 | Checking checkpoint with [417, 417] against 410... |
| 0.33.925.653 W slot update_slots: id 0 | task 300 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.33.925.658 W slot update_slots: id 0 | task 300 | erased invalidated context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.33.927.212 W slot update_slots: id 0 | task 300 | erased invalidated context checkpoint (pos_min = 488, pos_max = 488, n_tokens = 489, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.34.478.068 I slot create_check: id 0 | task 300 | created context checkpoint 1 of 32 (pos_min = 417, pos_max = 417, n_tokens = 418, size = 62.813 MiB) |
| 0.34.936.115 I reasoning-budget: deactivated (natural end) |
| 0.35.820.698 I slot print_timing: id 0 | task 300 | |
| prompt eval time = 590.50 ms / 422 tokens ( 1.40 ms per token, 714.65 tokens per second) |
| eval time = 1304.53 ms / 61 tokens ( 21.39 ms per token, 46.76 tokens per second) |
| total time = 1895.03 ms / 483 tokens |
| 0.35.820.771 I slot release: id 0 | task 300 | stop processing: n_tokens = 482, truncated = 0 |
| 0.35.820.802 I srv update_slots: all slots are idle |
| 0.35.833.343 I srv params_from_: Chat format: peg-native |
| 0.35.833.721 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.935 (> 0.100 thold), f_keep = 0.840 |
| 0.35.833.997 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.35.834.089 I slot launch_slot_: id 0 | task 363 | processing task, is_child = 0 |
| 0.35.834.109 W slot update_slots: id 0 | task 363 | n_past = 405, slot.prompt.tokens.size() = 482, seq_id = 0, pos_min = 481, n_swa = 0 |
| 0.35.834.109 I slot update_slots: id 0 | task 363 | Checking checkpoint with [417, 417] against 405... |
| 0.35.834.111 W slot update_slots: id 0 | task 363 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.35.834.118 W slot update_slots: id 0 | task 363 | erased invalidated context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.36.300.366 I slot create_check: id 0 | task 363 | created context checkpoint 1 of 32 (pos_min = 428, pos_max = 428, n_tokens = 429, size = 62.813 MiB) |
| 0.36.903.862 I reasoning-budget: deactivated (natural end) |
| 0.38.352.136 I slot print_timing: id 0 | task 363 | n_decoded = 100, tg = 49.65 t/s |
| 0.38.552.887 I slot print_timing: id 0 | task 363 | |
| prompt eval time = 504.10 ms / 433 tokens ( 1.16 ms per token, 858.96 tokens per second) |
| eval time = 2214.64 ms / 109 tokens ( 20.32 ms per token, 49.22 tokens per second) |
| total time = 2718.74 ms / 542 tokens |
| 0.38.553.137 I slot release: id 0 | task 363 | stop processing: n_tokens = 541, truncated = 0 |
| 0.38.553.221 I srv update_slots: all slots are idle |
| 0.38.576.788 I srv params_from_: Chat format: peg-native |
| 0.38.577.342 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.955 (> 0.100 thold), f_keep = 0.749 |
| 0.38.577.906 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.38.577.907 I reasoning-budget: deactivated (natural end) |
| 0.38.577.985 I slot launch_slot_: id 0 | task 474 | processing task, is_child = 0 |
| 0.38.578.015 W slot update_slots: id 0 | task 474 | n_past = 405, slot.prompt.tokens.size() = 541, seq_id = 0, pos_min = 540, n_swa = 0 |
| 0.38.578.016 I slot update_slots: id 0 | task 474 | Checking checkpoint with [428, 428] against 405... |
| 0.38.578.018 W slot update_slots: id 0 | task 474 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.38.578.022 W slot update_slots: id 0 | task 474 | erased invalidated context checkpoint (pos_min = 428, pos_max = 428, n_tokens = 429, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.39.129.005 I slot create_check: id 0 | task 474 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB) |
| 0.40.014.664 I slot print_timing: id 0 | task 474 | |
| prompt eval time = 601.68 ms / 424 tokens ( 1.42 ms per token, 704.69 tokens per second) |
| eval time = 834.95 ms / 39 tokens ( 21.41 ms per token, 46.71 tokens per second) |
| total time = 1436.64 ms / 463 tokens |
| 0.40.014.755 I slot release: id 0 | task 474 | stop processing: n_tokens = 462, truncated = 0 |
| 0.40.014.785 I srv update_slots: all slots are idle |
| 0.40.063.657 I srv params_from_: Chat format: peg-native |
| 0.40.065.988 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.902 (> 0.100 thold), f_keep = 0.877 |
| 0.40.066.550 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.40.066.555 I reasoning-budget: deactivated (natural end) |
| 0.40.066.646 I slot launch_slot_: id 0 | task 515 | processing task, is_child = 0 |
| 0.40.066.666 W slot update_slots: id 0 | task 515 | n_past = 405, slot.prompt.tokens.size() = 462, seq_id = 0, pos_min = 461, n_swa = 0 |
| 0.40.066.671 I slot update_slots: id 0 | task 515 | Checking checkpoint with [419, 419] against 405... |
| 0.40.066.673 W slot update_slots: id 0 | task 515 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.40.066.679 W slot update_slots: id 0 | task 515 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.40.651.450 I slot create_check: id 0 | task 515 | created context checkpoint 1 of 32 (pos_min = 444, pos_max = 444, n_tokens = 445, size = 62.813 MiB) |
| 0.42.596.129 I slot print_timing: id 0 | task 515 | |
| prompt eval time = 621.59 ms / 449 tokens ( 1.38 ms per token, 722.34 tokens per second) |
| eval time = 1907.84 ms / 86 tokens ( 22.18 ms per token, 45.08 tokens per second) |
| total time = 2529.43 ms / 535 tokens |
| 0.42.596.351 I slot release: id 0 | task 515 | stop processing: n_tokens = 534, truncated = 0 |
| 0.42.596.411 I srv update_slots: all slots are idle |
| 0.42.613.151 I srv params_from_: Chat format: peg-native |
| 0.42.613.661 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.948 (> 0.100 thold), f_keep = 0.758 |
| 0.42.613.938 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.42.613.941 I reasoning-budget: deactivated (natural end) |
| 0.42.613.986 I slot launch_slot_: id 0 | task 603 | processing task, is_child = 0 |
| 0.42.614.003 W slot update_slots: id 0 | task 603 | n_past = 405, slot.prompt.tokens.size() = 534, seq_id = 0, pos_min = 533, n_swa = 0 |
| 0.42.614.004 I slot update_slots: id 0 | task 603 | Checking checkpoint with [444, 444] against 405... |
| 0.42.614.006 W slot update_slots: id 0 | task 603 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.42.614.008 W slot update_slots: id 0 | task 603 | erased invalidated context checkpoint (pos_min = 444, pos_max = 444, n_tokens = 445, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.43.137.655 I slot create_check: id 0 | task 603 | created context checkpoint 1 of 32 (pos_min = 422, pos_max = 422, n_tokens = 423, size = 62.813 MiB) |
| 0.44.068.310 I slot print_timing: id 0 | task 603 | |
| prompt eval time = 589.04 ms / 427 tokens ( 1.38 ms per token, 724.90 tokens per second) |
| eval time = 865.23 ms / 39 tokens ( 22.19 ms per token, 45.07 tokens per second) |
| total time = 1454.27 ms / 466 tokens |
| 0.44.068.519 I slot release: id 0 | task 603 | stop processing: n_tokens = 465, truncated = 0 |
| 0.44.068.586 I srv update_slots: all slots are idle |
| 0.44.108.932 I srv params_from_: Chat format: peg-native |
| 0.44.109.519 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.948 (> 0.100 thold), f_keep = 0.871 |
| 0.44.109.808 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.44.109.810 I reasoning-budget: deactivated (natural end) |
| 0.44.109.863 I slot launch_slot_: id 0 | task 644 | processing task, is_child = 0 |
| 0.44.109.876 W slot update_slots: id 0 | task 644 | n_past = 405, slot.prompt.tokens.size() = 465, seq_id = 0, pos_min = 464, n_swa = 0 |
| 0.44.109.878 I slot update_slots: id 0 | task 644 | Checking checkpoint with [422, 422] against 405... |
| 0.44.109.879 W slot update_slots: id 0 | task 644 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.44.109.881 W slot update_slots: id 0 | task 644 | erased invalidated context checkpoint (pos_min = 422, pos_max = 422, n_tokens = 423, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.44.678.393 I slot create_check: id 0 | task 644 | created context checkpoint 1 of 32 (pos_min = 422, pos_max = 422, n_tokens = 423, size = 62.813 MiB) |
| 0.44.867.520 I slot print_timing: id 0 | task 644 | |
| prompt eval time = 621.79 ms / 427 tokens ( 1.46 ms per token, 686.72 tokens per second) |
| eval time = 135.82 ms / 4 tokens ( 33.96 ms per token, 29.45 tokens per second) |
| total time = 757.61 ms / 431 tokens |
| 0.44.867.722 I slot release: id 0 | task 644 | stop processing: n_tokens = 430, truncated = 0 |
| 0.44.867.777 I srv update_slots: all slots are idle |
| 0.44.920.558 I srv params_from_: Chat format: peg-native |
| 0.44.922.823 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.958 (> 0.100 thold), f_keep = 0.944 |
| 0.44.923.382 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.44.923.386 I reasoning-budget: deactivated (natural end) |
| 0.44.923.473 I slot launch_slot_: id 0 | task 650 | processing task, is_child = 0 |
| 0.44.923.490 W slot update_slots: id 0 | task 650 | n_past = 406, slot.prompt.tokens.size() = 430, seq_id = 0, pos_min = 429, n_swa = 0 |
| 0.44.923.492 I slot update_slots: id 0 | task 650 | Checking checkpoint with [422, 422] against 406... |
| 0.44.923.496 W slot update_slots: id 0 | task 650 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.44.923.503 W slot update_slots: id 0 | task 650 | erased invalidated context checkpoint (pos_min = 422, pos_max = 422, n_tokens = 423, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.45.494.241 I slot create_check: id 0 | task 650 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB) |
| 0.46.360.864 I slot print_timing: id 0 | task 650 | |
| prompt eval time = 619.67 ms / 424 tokens ( 1.46 ms per token, 684.24 tokens per second) |
| eval time = 817.69 ms / 40 tokens ( 20.44 ms per token, 48.92 tokens per second) |
| total time = 1437.36 ms / 464 tokens |
| 0.46.360.962 I slot release: id 0 | task 650 | stop processing: n_tokens = 463, truncated = 0 |
| 0.46.360.994 I srv update_slots: all slots are idle |
| 0.46.376.404 I srv params_from_: Chat format: peg-native |
| 0.46.376.859 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.935 (> 0.100 thold), f_keep = 1.000 |
| 0.46.377.382 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.46.377.385 I reasoning-budget: deactivated (natural end) |
| 0.46.377.478 I slot launch_slot_: id 0 | task 692 | processing task, is_child = 0 |
| 0.46.580.028 I slot create_check: id 0 | task 692 | created context checkpoint 2 of 32 (pos_min = 490, pos_max = 490, n_tokens = 491, size = 62.813 MiB) |
| 0.46.886.342 I slot print_timing: id 0 | task 692 | |
| prompt eval time = 260.43 ms / 32 tokens ( 8.14 ms per token, 122.87 tokens per second) |
| eval time = 248.41 ms / 13 tokens ( 19.11 ms per token, 52.33 tokens per second) |
| total time = 508.84 ms / 45 tokens |
| 0.46.886.415 I slot release: id 0 | task 692 | stop processing: n_tokens = 507, truncated = 0 |
| 0.46.886.437 I srv update_slots: all slots are idle |
| 0.46.902.435 I srv params_from_: Chat format: peg-native |
| 0.46.903.190 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.967 (> 0.100 thold), f_keep = 0.809 |
| 0.46.903.420 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.46.903.422 I reasoning-budget: deactivated (natural end) |
| 0.46.903.471 I slot launch_slot_: id 0 | task 707 | processing task, is_child = 0 |
| 0.46.903.481 W slot update_slots: id 0 | task 707 | n_past = 410, slot.prompt.tokens.size() = 507, seq_id = 0, pos_min = 506, n_swa = 0 |
| 0.46.903.483 I slot update_slots: id 0 | task 707 | Checking checkpoint with [490, 490] against 410... |
| 0.46.903.484 I slot update_slots: id 0 | task 707 | Checking checkpoint with [419, 419] against 410... |
| 0.46.903.485 W slot update_slots: id 0 | task 707 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.46.903.488 W slot update_slots: id 0 | task 707 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.46.904.537 W slot update_slots: id 0 | task 707 | erased invalidated context checkpoint (pos_min = 490, pos_max = 490, n_tokens = 491, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.47.441.027 I slot create_check: id 0 | task 707 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB) |
| 0.48.289.348 I slot print_timing: id 0 | task 707 | |
| prompt eval time = 577.77 ms / 424 tokens ( 1.36 ms per token, 733.85 tokens per second) |
| eval time = 808.09 ms / 40 tokens ( 20.20 ms per token, 49.50 tokens per second) |
| total time = 1385.86 ms / 464 tokens |
| 0.48.289.404 I slot release: id 0 | task 707 | stop processing: n_tokens = 463, truncated = 0 |
| 0.48.289.426 I srv update_slots: all slots are idle |
| 0.48.302.317 I srv params_from_: Chat format: peg-native |
| 0.48.302.639 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.931 (> 0.100 thold), f_keep = 0.875 |
| 0.48.302.821 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.48.302.822 I reasoning-budget: deactivated (natural end) |
| 0.48.302.871 I slot launch_slot_: id 0 | task 749 | processing task, is_child = 0 |
| 0.48.302.880 W slot update_slots: id 0 | task 749 | n_past = 405, slot.prompt.tokens.size() = 463, seq_id = 0, pos_min = 462, n_swa = 0 |
| 0.48.302.881 I slot update_slots: id 0 | task 749 | Checking checkpoint with [419, 419] against 405... |
| 0.48.302.882 W slot update_slots: id 0 | task 749 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.48.302.884 W slot update_slots: id 0 | task 749 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.48.829.428 I slot create_check: id 0 | task 749 | created context checkpoint 1 of 32 (pos_min = 430, pos_max = 430, n_tokens = 431, size = 62.813 MiB) |
| 0.50.509.107 I slot print_timing: id 0 | task 749 | |
| prompt eval time = 572.46 ms / 435 tokens ( 1.32 ms per token, 759.87 tokens per second) |
| eval time = 1633.74 ms / 80 tokens ( 20.42 ms per token, 48.97 tokens per second) |
| total time = 2206.20 ms / 515 tokens |
| 0.50.509.286 I slot release: id 0 | task 749 | stop processing: n_tokens = 514, truncated = 0 |
| 0.50.509.314 I srv update_slots: all slots are idle |
| 0.50.510.178 I srv operator(): operator(): cleaning up before exit... |
|
|
