| 0.00.115.039 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg) |
| 0.00.115.043 I device_info: |
| 0.00.115.119 I - ROCm0 : AMD Radeon Graphics (131072 MiB, 123866 MiB free) |
| 0.00.115.243 I - Vulkan0 : AMD Radeon Graphics (RADV GFX1151) (132096 MiB, 131922 MiB free) |
| 0.00.115.248 I - CPU : AMD RYZEN AI MAX+ 395 w/ Radeon 8060S (127438 MiB, 127438 MiB free) |
| 0.00.115.311 I system_info: n_threads = 16 (n_threads_batch = 16) / 32 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | FA_ALL_QUANTS = 1 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | |
| 0.00.115.325 I srv init: running without SSL |
| 0.00.115.360 I srv init: using 31 threads for HTTP server |
| 0.00.115.361 I srv init: the WebUI is disabled |
| 0.00.115.422 I srv start: binding port with default address family |
| 0.00.116.607 I srv main: loading model |
| 0.00.116.616 I srv load_model: loading model '/mnt/models/nex-n2.5-mini/out/Nex-N2.5-mini-Q4_0_ROCMFP4_STRIX_LEAN.gguf' |
| 0.00.167.815 W llama_model_loader: direct I/O is enabled, disabling mmap |
| 0.22.638.462 W llama_context: n_ctx_seq (65536) < n_ctx_train (262144) -- the full capacity of the model will not be utilized |
| 0.22.931.507 W common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) |
| 0.23.329.767 I srv load_model: initializing slots, n_slots = 1 |
| 0.23.568.311 W srv load_model: speculative decoding will use checkpoints |
| 0.23.568.330 W common_speculative_init: no implementations specified for speculative decoding |
| 0.23.568.334 I slot load_model: id 0 | task -1 | new slot, n_ctx = 65536 |
| 0.23.568.522 I srv load_model: prompt cache RAM enabled: limit_mib=8192 |
| 0.23.568.527 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391 |
| 0.23.568.581 I srv init: idle slots will be saved to prompt cache upon starting a new task |
| 0.23.617.611 I init: chat template, example_format: '<|im_start|>system |
| You are a helpful assistant<|im_end|> |
| <|im_start|>user |
| Hello<|im_end|> |
| <|im_start|>assistant |
| <think> |
|
|
| </think> |
|
|
| Hi there<|im_end|> |
| <|im_start|>user |
| How are you?<|im_end|> |
| <|im_start|>assistant |
| <think> |
|
|
| </think> |
|
|
| ' |
| 0.23.662.046 I srv init: init: chat template, thinking = 0 |
| 0.23.662.133 I srv main: model loaded |
| 0.23.662.139 I srv main: server is listening on http://127.0.0.1:18600 |
| 0.23.662.179 I srv update_slots: all slots are idle |
| 0.24.822.880 I srv params_from_: Chat format: peg-native |
| 0.24.825.218 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = -1 |
| 0.24.825.223 I srv get_availabl: updating prompt cache |
| 0.24.825.232 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 |
| 0.24.825.240 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 65536 tokens, 8589934592 est) |
| 0.24.825.243 I srv get_availabl: prompt cache update took 0.02 ms |
| 0.24.825.968 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.24.825.999 I slot launch_slot_: id 0 | task 0 | processing task, is_child = 0 |
| 0.25.491.127 I slot create_check: id 0 | task 0 | created context checkpoint 1 of 32 (pos_min = 417, pos_max = 417, n_tokens = 418, size = 62.813 MiB) |
| 0.25.806.479 I reasoning-budget: deactivated (natural end) |
| 0.26.592.455 I slot print_timing: id 0 | task 0 | |
| prompt eval time = 699.89 ms / 422 tokens ( 1.66 ms per token, 602.95 tokens per second) |
| eval time = 1066.52 ms / 52 tokens ( 20.51 ms per token, 48.76 tokens per second) |
| total time = 1766.41 ms / 474 tokens |
| 0.26.592.534 I slot release: id 0 | task 0 | stop processing: n_tokens = 473, truncated = 0 |
| 0.26.592.543 I srv update_slots: all slots are idle |
| 0.26.605.042 I srv params_from_: Chat format: peg-native |
| 0.26.605.398 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.906 (> 0.100 thold), f_keep = 0.856 |
| 0.26.605.730 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.26.605.800 I slot launch_slot_: id 0 | task 54 | processing task, is_child = 0 |
| 0.26.605.816 W slot update_slots: id 0 | task 54 | n_past = 405, slot.prompt.tokens.size() = 473, seq_id = 0, pos_min = 472, n_swa = 0 |
| 0.26.605.818 I slot update_slots: id 0 | task 54 | Checking checkpoint with [417, 417] against 405... |
| 0.26.605.820 W slot update_slots: id 0 | task 54 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.26.605.826 W slot update_slots: id 0 | task 54 | erased invalidated context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.27.159.769 I slot create_check: id 0 | task 54 | created context checkpoint 1 of 32 (pos_min = 442, pos_max = 442, n_tokens = 443, size = 62.813 MiB) |
| 0.27.788.657 I reasoning-budget: deactivated (natural end) |
| 0.29.292.130 I slot print_timing: id 0 | task 54 | n_decoded = 100, tg = 47.73 t/s |
| 0.29.582.323 I slot print_timing: id 0 | task 54 | |
| prompt eval time = 591.18 ms / 447 tokens ( 1.32 ms per token, 756.11 tokens per second) |
| eval time = 2385.31 ms / 115 tokens ( 20.74 ms per token, 48.21 tokens per second) |
| total time = 2976.49 ms / 562 tokens |
| 0.29.582.414 I slot release: id 0 | task 54 | stop processing: n_tokens = 561, truncated = 0 |
| 0.29.582.457 I srv update_slots: all slots are idle |
| 0.29.597.465 I srv params_from_: Chat format: peg-native |
| 0.29.597.831 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.953 (> 0.100 thold), f_keep = 0.722 |
| 0.29.598.059 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.29.598.094 I slot launch_slot_: id 0 | task 171 | processing task, is_child = 0 |
| 0.29.598.104 W slot update_slots: id 0 | task 171 | n_past = 405, slot.prompt.tokens.size() = 561, seq_id = 0, pos_min = 560, n_swa = 0 |
| 0.29.598.104 I slot update_slots: id 0 | task 171 | Checking checkpoint with [442, 442] against 405... |
| 0.29.598.105 W slot update_slots: id 0 | task 171 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.29.598.107 W slot update_slots: id 0 | task 171 | erased invalidated context checkpoint (pos_min = 442, pos_max = 442, n_tokens = 443, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.30.126.859 I slot create_check: id 0 | task 171 | created context checkpoint 1 of 32 (pos_min = 420, pos_max = 420, n_tokens = 421, size = 62.813 MiB) |
| 0.30.663.476 I reasoning-budget: deactivated (natural end) |
| 0.31.461.262 I slot print_timing: id 0 | task 171 | |
| prompt eval time = 582.92 ms / 425 tokens ( 1.37 ms per token, 729.09 tokens per second) |
| eval time = 1280.22 ms / 63 tokens ( 20.32 ms per token, 49.21 tokens per second) |
| total time = 1863.14 ms / 488 tokens |
| 0.31.461.343 I slot release: id 0 | task 171 | stop processing: n_tokens = 487, truncated = 0 |
| 0.31.461.374 I srv update_slots: all slots are idle |
| 0.31.475.859 I srv params_from_: Chat format: peg-native |
| 0.31.476.263 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.953 (> 0.100 thold), f_keep = 0.832 |
| 0.31.476.455 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.31.476.489 I slot launch_slot_: id 0 | task 236 | processing task, is_child = 0 |
| 0.31.476.500 W slot update_slots: id 0 | task 236 | n_past = 405, slot.prompt.tokens.size() = 487, seq_id = 0, pos_min = 486, n_swa = 0 |
| 0.31.476.501 I slot update_slots: id 0 | task 236 | Checking checkpoint with [420, 420] against 405... |
| 0.31.476.502 W slot update_slots: id 0 | task 236 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.31.476.505 W slot update_slots: id 0 | task 236 | erased invalidated context checkpoint (pos_min = 420, pos_max = 420, n_tokens = 421, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.32.014.645 I slot create_check: id 0 | task 236 | created context checkpoint 1 of 32 (pos_min = 420, pos_max = 420, n_tokens = 421, size = 62.813 MiB) |
| 0.32.309.451 I reasoning-budget: deactivated (natural end) |
| 0.32.409.234 I slot print_timing: id 0 | task 236 | |
| prompt eval time = 590.97 ms / 425 tokens ( 1.39 ms per token, 719.16 tokens per second) |
| eval time = 341.75 ms / 17 tokens ( 20.10 ms per token, 49.74 tokens per second) |
| total time = 932.72 ms / 442 tokens |
| 0.32.409.323 I slot release: id 0 | task 236 | stop processing: n_tokens = 441, truncated = 0 |
| 0.32.409.352 I srv update_slots: all slots are idle |
| 0.32.432.559 I srv params_from_: Chat format: peg-native |
| 0.32.432.999 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.962 (> 0.100 thold), f_keep = 0.921 |
| 0.32.433.226 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.32.433.266 I slot launch_slot_: id 0 | task 255 | processing task, is_child = 0 |
| 0.32.433.278 W slot update_slots: id 0 | task 255 | n_past = 406, slot.prompt.tokens.size() = 441, seq_id = 0, pos_min = 440, n_swa = 0 |
| 0.32.433.279 I slot update_slots: id 0 | task 255 | Checking checkpoint with [420, 420] against 406... |
| 0.32.433.280 W slot update_slots: id 0 | task 255 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.32.433.284 W slot update_slots: id 0 | task 255 | erased invalidated context checkpoint (pos_min = 420, pos_max = 420, n_tokens = 421, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.32.967.808 I slot create_check: id 0 | task 255 | created context checkpoint 1 of 32 (pos_min = 417, pos_max = 417, n_tokens = 418, size = 62.813 MiB) |
| 0.33.683.392 I reasoning-budget: deactivated (natural end) |
| 0.34.620.880 I slot print_timing: id 0 | task 255 | |
| prompt eval time = 589.92 ms / 422 tokens ( 1.40 ms per token, 715.35 tokens per second) |
| eval time = 1597.65 ms / 69 tokens ( 23.15 ms per token, 43.19 tokens per second) |
| total time = 2187.57 ms / 491 tokens |
| 0.34.621.091 I slot release: id 0 | task 255 | stop processing: n_tokens = 490, truncated = 0 |
| 0.34.621.151 I srv update_slots: all slots are idle |
| 0.34.685.806 I srv params_from_: Chat format: peg-native |
| 0.34.687.624 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.854 (> 0.100 thold), f_keep = 0.859 |
| 0.34.688.188 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.34.688.287 I slot launch_slot_: id 0 | task 326 | processing task, is_child = 0 |
| 0.34.688.310 W slot update_slots: id 0 | task 326 | n_past = 421, slot.prompt.tokens.size() = 490, seq_id = 0, pos_min = 489, n_swa = 0 |
| 0.34.688.313 I slot update_slots: id 0 | task 326 | Checking checkpoint with [417, 417] against 421... |
| 0.34.696.358 W slot update_slots: id 0 | task 326 | restored context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_past = 418, size = 62.813 MiB) |
| 0.34.932.382 I slot create_check: id 0 | task 326 | created context checkpoint 2 of 32 (pos_min = 488, pos_max = 488, n_tokens = 489, size = 62.813 MiB) |
| 0.35.494.281 I reasoning-budget: deactivated (natural end) |
| 0.35.771.860 I slot print_timing: id 0 | task 326 | |
| prompt eval time = 289.45 ms / 75 tokens ( 3.86 ms per token, 259.11 tokens per second) |
| eval time = 794.07 ms / 36 tokens ( 22.06 ms per token, 45.34 tokens per second) |
| total time = 1083.52 ms / 111 tokens |
| 0.35.772.048 I slot release: id 0 | task 326 | stop processing: n_tokens = 528, truncated = 0 |
| 0.35.772.102 I srv update_slots: all slots are idle |
| 0.35.790.981 I srv params_from_: Chat format: peg-native |
| 0.35.791.515 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.972 (> 0.100 thold), f_keep = 0.777 |
| 0.35.792.014 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.35.792.106 I slot launch_slot_: id 0 | task 364 | processing task, is_child = 0 |
| 0.35.792.127 W slot update_slots: id 0 | task 364 | n_past = 410, slot.prompt.tokens.size() = 528, seq_id = 0, pos_min = 527, n_swa = 0 |
| 0.35.792.130 I slot update_slots: id 0 | task 364 | Checking checkpoint with [488, 488] against 410... |
| 0.35.792.132 I slot update_slots: id 0 | task 364 | Checking checkpoint with [417, 417] against 410... |
| 0.35.792.133 W slot update_slots: id 0 | task 364 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.35.792.140 W slot update_slots: id 0 | task 364 | erased invalidated context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.35.793.559 W slot update_slots: id 0 | task 364 | erased invalidated context checkpoint (pos_min = 488, pos_max = 488, n_tokens = 489, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.36.350.507 I slot create_check: id 0 | task 364 | created context checkpoint 1 of 32 (pos_min = 417, pos_max = 417, n_tokens = 418, size = 62.813 MiB) |
| 0.36.640.348 I reasoning-budget: deactivated (natural end) |
| 0.37.440.104 I slot print_timing: id 0 | task 364 | |
| prompt eval time = 591.78 ms / 422 tokens ( 1.40 ms per token, 713.10 tokens per second) |
| eval time = 1056.18 ms / 52 tokens ( 20.31 ms per token, 49.23 tokens per second) |
| total time = 1647.97 ms / 474 tokens |
| 0.37.440.166 I slot release: id 0 | task 364 | stop processing: n_tokens = 473, truncated = 0 |
| 0.37.440.190 I srv update_slots: all slots are idle |
| 0.37.456.395 I srv params_from_: Chat format: peg-native |
| 0.37.456.822 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.935 (> 0.100 thold), f_keep = 0.856 |
| 0.37.457.040 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.37.457.081 I slot launch_slot_: id 0 | task 418 | processing task, is_child = 0 |
| 0.37.457.090 W slot update_slots: id 0 | task 418 | n_past = 405, slot.prompt.tokens.size() = 473, seq_id = 0, pos_min = 472, n_swa = 0 |
| 0.37.457.092 I slot update_slots: id 0 | task 418 | Checking checkpoint with [417, 417] against 405... |
| 0.37.457.092 W slot update_slots: id 0 | task 418 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.37.457.095 W slot update_slots: id 0 | task 418 | erased invalidated context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.37.989.158 I slot create_check: id 0 | task 418 | created context checkpoint 1 of 32 (pos_min = 428, pos_max = 428, n_tokens = 429, size = 62.813 MiB) |
| 0.39.035.888 I reasoning-budget: deactivated (natural end) |
| 0.39.898.949 I slot print_timing: id 0 | task 418 | |
| prompt eval time = 571.43 ms / 433 tokens ( 1.32 ms per token, 757.75 tokens per second) |
| eval time = 1870.42 ms / 92 tokens ( 20.33 ms per token, 49.19 tokens per second) |
| total time = 2441.84 ms / 525 tokens |
| 0.39.899.036 I slot release: id 0 | task 418 | stop processing: n_tokens = 524, truncated = 0 |
| 0.39.899.069 I srv update_slots: all slots are idle |
| 0.39.931.009 I srv params_from_: Chat format: peg-native |
| 0.39.931.485 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.955 (> 0.100 thold), f_keep = 0.773 |
| 0.39.932.043 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.39.932.046 I reasoning-budget: deactivated (natural end) |
| 0.39.932.130 I slot launch_slot_: id 0 | task 512 | processing task, is_child = 0 |
| 0.39.932.153 W slot update_slots: id 0 | task 512 | n_past = 405, slot.prompt.tokens.size() = 524, seq_id = 0, pos_min = 523, n_swa = 0 |
| 0.39.932.156 I slot update_slots: id 0 | task 512 | Checking checkpoint with [428, 428] against 405... |
| 0.39.932.157 W slot update_slots: id 0 | task 512 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.39.932.162 W slot update_slots: id 0 | task 512 | erased invalidated context checkpoint (pos_min = 428, pos_max = 428, n_tokens = 429, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.40.516.543 I slot create_check: id 0 | task 512 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB) |
| 0.41.428.023 I slot print_timing: id 0 | task 512 | |
| prompt eval time = 630.82 ms / 424 tokens ( 1.49 ms per token, 672.15 tokens per second) |
| eval time = 865.02 ms / 39 tokens ( 22.18 ms per token, 45.09 tokens per second) |
| total time = 1495.84 ms / 463 tokens |
| 0.41.428.279 I slot release: id 0 | task 512 | stop processing: n_tokens = 462, truncated = 0 |
| 0.41.428.346 I srv update_slots: all slots are idle |
| 0.41.471.490 I srv params_from_: Chat format: peg-native |
| 0.41.472.003 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.902 (> 0.100 thold), f_keep = 0.877 |
| 0.41.472.302 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.41.472.304 I reasoning-budget: deactivated (natural end) |
| 0.41.472.355 I slot launch_slot_: id 0 | task 553 | processing task, is_child = 0 |
| 0.41.472.368 W slot update_slots: id 0 | task 553 | n_past = 405, slot.prompt.tokens.size() = 462, seq_id = 0, pos_min = 461, n_swa = 0 |
| 0.41.472.369 I slot update_slots: id 0 | task 553 | Checking checkpoint with [419, 419] against 405... |
| 0.41.472.370 W slot update_slots: id 0 | task 553 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.41.472.373 W slot update_slots: id 0 | task 553 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.42.065.024 I slot create_check: id 0 | task 553 | created context checkpoint 1 of 32 (pos_min = 444, pos_max = 444, n_tokens = 445, size = 62.813 MiB) |
| 0.44.104.338 I slot print_timing: id 0 | task 553 | |
| prompt eval time = 633.39 ms / 449 tokens ( 1.41 ms per token, 708.88 tokens per second) |
| eval time = 1998.54 ms / 86 tokens ( 23.24 ms per token, 43.03 tokens per second) |
| total time = 2631.93 ms / 535 tokens |
| 0.44.104.526 I slot release: id 0 | task 553 | stop processing: n_tokens = 534, truncated = 0 |
| 0.44.104.644 I srv update_slots: all slots are idle |
| 0.44.130.603 I srv params_from_: Chat format: peg-native |
| 0.44.130.995 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.948 (> 0.100 thold), f_keep = 0.758 |
| 0.44.131.303 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.44.131.305 I reasoning-budget: deactivated (natural end) |
| 0.44.131.351 I slot launch_slot_: id 0 | task 641 | processing task, is_child = 0 |
| 0.44.131.364 W slot update_slots: id 0 | task 641 | n_past = 405, slot.prompt.tokens.size() = 534, seq_id = 0, pos_min = 533, n_swa = 0 |
| 0.44.131.365 I slot update_slots: id 0 | task 641 | Checking checkpoint with [444, 444] against 405... |
| 0.44.131.366 W slot update_slots: id 0 | task 641 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.44.131.369 W slot update_slots: id 0 | task 641 | erased invalidated context checkpoint (pos_min = 444, pos_max = 444, n_tokens = 445, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.44.685.484 I slot create_check: id 0 | task 641 | created context checkpoint 1 of 32 (pos_min = 422, pos_max = 422, n_tokens = 423, size = 62.813 MiB) |
| 0.45.671.889 I slot print_timing: id 0 | task 641 | |
| prompt eval time = 602.32 ms / 427 tokens ( 1.41 ms per token, 708.93 tokens per second) |
| eval time = 938.19 ms / 39 tokens ( 24.06 ms per token, 41.57 tokens per second) |
| total time = 1540.51 ms / 466 tokens |
| 0.45.671.971 I slot release: id 0 | task 641 | stop processing: n_tokens = 465, truncated = 0 |
| 0.45.671.999 I srv update_slots: all slots are idle |
| 0.45.686.558 I srv params_from_: Chat format: peg-native |
| 0.45.686.878 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.948 (> 0.100 thold), f_keep = 0.871 |
| 0.45.687.125 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.45.687.126 I reasoning-budget: deactivated (natural end) |
| 0.45.687.183 I slot launch_slot_: id 0 | task 682 | processing task, is_child = 0 |
| 0.45.687.196 W slot update_slots: id 0 | task 682 | n_past = 405, slot.prompt.tokens.size() = 465, seq_id = 0, pos_min = 464, n_swa = 0 |
| 0.45.687.197 I slot update_slots: id 0 | task 682 | Checking checkpoint with [422, 422] against 405... |
| 0.45.687.199 W slot update_slots: id 0 | task 682 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.45.687.202 W slot update_slots: id 0 | task 682 | erased invalidated context checkpoint (pos_min = 422, pos_max = 422, n_tokens = 423, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.46.216.440 I slot create_check: id 0 | task 682 | created context checkpoint 1 of 32 (pos_min = 422, pos_max = 422, n_tokens = 423, size = 62.813 MiB) |
| 0.46.339.458 I slot print_timing: id 0 | task 682 | |
| prompt eval time = 571.41 ms / 427 tokens ( 1.34 ms per token, 747.28 tokens per second) |
| eval time = 80.84 ms / 4 tokens ( 20.21 ms per token, 49.48 tokens per second) |
| total time = 652.25 ms / 431 tokens |
| 0.46.339.548 I slot release: id 0 | task 682 | stop processing: n_tokens = 430, truncated = 0 |
| 0.46.339.578 I srv update_slots: all slots are idle |
| 0.46.360.275 I srv params_from_: Chat format: peg-native |
| 0.46.360.733 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.958 (> 0.100 thold), f_keep = 0.944 |
| 0.46.361.269 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.46.361.274 I reasoning-budget: deactivated (natural end) |
| 0.46.361.357 I slot launch_slot_: id 0 | task 688 | processing task, is_child = 0 |
| 0.46.361.380 W slot update_slots: id 0 | task 688 | n_past = 406, slot.prompt.tokens.size() = 430, seq_id = 0, pos_min = 429, n_swa = 0 |
| 0.46.361.383 I slot update_slots: id 0 | task 688 | Checking checkpoint with [422, 422] against 406... |
| 0.46.361.385 W slot update_slots: id 0 | task 688 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.46.361.392 W slot update_slots: id 0 | task 688 | erased invalidated context checkpoint (pos_min = 422, pos_max = 422, n_tokens = 423, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.46.930.125 I slot create_check: id 0 | task 688 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB) |
| 0.47.764.185 I slot print_timing: id 0 | task 688 | |
| prompt eval time = 611.34 ms / 424 tokens ( 1.44 ms per token, 693.56 tokens per second) |
| eval time = 791.43 ms / 40 tokens ( 19.79 ms per token, 50.54 tokens per second) |
| total time = 1402.77 ms / 464 tokens |
| 0.47.764.366 I slot release: id 0 | task 688 | stop processing: n_tokens = 463, truncated = 0 |
| 0.47.764.400 I srv update_slots: all slots are idle |
| 0.47.803.235 I srv params_from_: Chat format: peg-native |
| 0.47.803.673 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.935 (> 0.100 thold), f_keep = 1.000 |
| 0.47.804.329 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.47.804.335 I reasoning-budget: deactivated (natural end) |
| 0.47.804.467 I slot launch_slot_: id 0 | task 730 | processing task, is_child = 0 |
| 0.48.002.540 I slot create_check: id 0 | task 730 | created context checkpoint 2 of 32 (pos_min = 490, pos_max = 490, n_tokens = 491, size = 62.813 MiB) |
| 0.48.372.317 I slot print_timing: id 0 | task 730 | |
| prompt eval time = 256.59 ms / 32 tokens ( 8.02 ms per token, 124.71 tokens per second) |
| eval time = 311.22 ms / 14 tokens ( 22.23 ms per token, 44.98 tokens per second) |
| total time = 567.81 ms / 46 tokens |
| 0.48.372.410 I slot release: id 0 | task 730 | stop processing: n_tokens = 508, truncated = 0 |
| 0.48.372.439 I srv update_slots: all slots are idle |
| 0.48.412.286 I srv params_from_: Chat format: peg-native |
| 0.48.412.805 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.967 (> 0.100 thold), f_keep = 0.807 |
| 0.48.413.102 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.48.413.104 I reasoning-budget: deactivated (natural end) |
| 0.48.413.157 I slot launch_slot_: id 0 | task 746 | processing task, is_child = 0 |
| 0.48.413.170 W slot update_slots: id 0 | task 746 | n_past = 410, slot.prompt.tokens.size() = 508, seq_id = 0, pos_min = 507, n_swa = 0 |
| 0.48.413.172 I slot update_slots: id 0 | task 746 | Checking checkpoint with [490, 490] against 410... |
| 0.48.413.172 I slot update_slots: id 0 | task 746 | Checking checkpoint with [419, 419] against 410... |
| 0.48.413.173 W slot update_slots: id 0 | task 746 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.48.413.176 W slot update_slots: id 0 | task 746 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.48.414.558 W slot update_slots: id 0 | task 746 | erased invalidated context checkpoint (pos_min = 490, pos_max = 490, n_tokens = 491, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.48.958.571 I slot create_check: id 0 | task 746 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB) |
| 0.49.822.447 I slot print_timing: id 0 | task 746 | |
| prompt eval time = 585.25 ms / 424 tokens ( 1.38 ms per token, 724.47 tokens per second) |
| eval time = 824.00 ms / 40 tokens ( 20.60 ms per token, 48.54 tokens per second) |
| total time = 1409.26 ms / 464 tokens |
| 0.49.822.516 I slot release: id 0 | task 746 | stop processing: n_tokens = 463, truncated = 0 |
| 0.49.822.541 I srv update_slots: all slots are idle |
| 0.49.837.403 I srv params_from_: Chat format: peg-native |
| 0.49.837.865 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.931 (> 0.100 thold), f_keep = 0.875 |
| 0.49.838.376 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.49.838.380 I reasoning-budget: deactivated (natural end) |
| 0.49.838.465 I slot launch_slot_: id 0 | task 788 | processing task, is_child = 0 |
| 0.49.838.487 W slot update_slots: id 0 | task 788 | n_past = 405, slot.prompt.tokens.size() = 463, seq_id = 0, pos_min = 462, n_swa = 0 |
| 0.49.838.490 I slot update_slots: id 0 | task 788 | Checking checkpoint with [419, 419] against 405... |
| 0.49.838.491 W slot update_slots: id 0 | task 788 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.49.838.496 W slot update_slots: id 0 | task 788 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.50.402.186 I slot create_check: id 0 | task 788 | created context checkpoint 1 of 32 (pos_min = 430, pos_max = 430, n_tokens = 431, size = 62.813 MiB) |
| 0.52.152.175 I slot print_timing: id 0 | task 788 | |
| prompt eval time = 613.67 ms / 435 tokens ( 1.41 ms per token, 708.85 tokens per second) |
| eval time = 1699.98 ms / 80 tokens ( 21.25 ms per token, 47.06 tokens per second) |
| total time = 2313.65 ms / 515 tokens |
| 0.52.152.608 I slot release: id 0 | task 788 | stop processing: n_tokens = 514, truncated = 0 |
| 0.52.152.669 I srv update_slots: all slots are idle |
| 0.52.154.330 I srv operator(): operator(): cleaning up before exit... |
|
|
