| 0.00.129.990 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg) |
| 0.00.129.993 I device_info: |
| 0.00.130.113 I - ROCm0 : AMD Radeon Graphics (131072 MiB, 122319 MiB free) |
| 0.00.130.278 I - Vulkan0 : AMD Radeon Graphics (RADV GFX1151) (132096 MiB, 131922 MiB free) |
| 0.00.130.286 I - CPU : AMD RYZEN AI MAX+ 395 w/ Radeon 8060S (127438 MiB, 127438 MiB free) |
| 0.00.130.376 I system_info: n_threads = 16 (n_threads_batch = 16) / 32 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | FA_ALL_QUANTS = 1 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | |
| 0.00.130.453 I srv init: running without SSL |
| 0.00.130.481 I srv init: using 31 threads for HTTP server |
| 0.00.130.482 I srv init: the WebUI is disabled |
| 0.00.130.551 I srv start: binding port with default address family |
| 0.00.131.742 I srv main: loading model |
| 0.00.131.749 I srv load_model: loading model '/mnt/models/nex-n2.5-mini/out/Nex-N2.5-mini-Q4_0_ROCMFP4_STRIX_LEAN.gguf' |
| 0.00.190.887 W llama_model_loader: direct I/O is enabled, disabling mmap |
| 0.23.864.154 W llama_context: n_ctx_seq (65536) < n_ctx_train (262144) -- the full capacity of the model will not be utilized |
| 0.24.195.940 W common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) |
| 0.24.556.150 I srv load_model: initializing slots, n_slots = 1 |
| 0.24.849.854 W srv load_model: speculative decoding will use checkpoints |
| 0.24.849.866 W common_speculative_init: no implementations specified for speculative decoding |
| 0.24.849.870 I slot load_model: id 0 | task -1 | new slot, n_ctx = 65536 |
| 0.24.849.977 I srv load_model: prompt cache RAM enabled: limit_mib=8192 |
| 0.24.849.981 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391 |
| 0.24.850.006 I srv init: idle slots will be saved to prompt cache upon starting a new task |
| 0.24.907.565 I init: chat template, example_format: '<|im_start|>system |
| You are a helpful assistant<|im_end|> |
| <|im_start|>user |
| Hello<|im_end|> |
| <|im_start|>assistant |
| <think> |
|
|
| </think> |
|
|
| Hi there<|im_end|> |
| <|im_start|>user |
| How are you?<|im_end|> |
| <|im_start|>assistant |
| <think>' |
| 0.24.952.737 I srv init: init: chat template, thinking = 1 |
| 0.24.952.792 I srv main: model loaded |
| 0.24.952.798 I srv main: server is listening on http://127.0.0.1:18652 |
| 0.24.952.803 I srv update_slots: all slots are idle |
| 0.26.377.211 I srv params_from_: Chat format: peg-native |
| 0.26.379.299 I slot get_availabl: id 0 | task -1 | selected slot by LRU, t_last = -1 |
| 0.26.379.305 I srv get_availabl: updating prompt cache |
| 0.26.379.315 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 |
| 0.26.379.323 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 65536 tokens, 8589934592 est) |
| 0.26.379.326 I srv get_availabl: prompt cache update took 0.02 ms |
| 0.26.380.071 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.26.380.099 I slot launch_slot_: id 0 | task 0 | processing task, is_child = 0 |
| 0.27.073.027 I slot create_check: id 0 | task 0 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB) |
| 0.27.138.087 I reasoning-budget: deactivated (natural end) |
| 0.27.269.343 I slot print_timing: id 0 | task 0 | |
| prompt eval time = 728.42 ms / 424 tokens ( 1.72 ms per token, 582.08 tokens per second) |
| eval time = 160.80 ms / 7 tokens ( 22.97 ms per token, 43.53 tokens per second) |
| total time = 889.21 ms / 431 tokens |
| 0.27.269.422 I slot release: id 0 | task 0 | stop processing: n_tokens = 430, truncated = 0 |
| 0.27.269.432 I srv update_slots: all slots are idle |
| 0.27.299.600 I srv params_from_: Chat format: peg-native |
| 0.27.300.148 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.969 (> 0.100 thold), f_keep = 0.942 |
| 0.27.300.612 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.27.300.707 I slot launch_slot_: id 0 | task 9 | processing task, is_child = 0 |
| 0.27.300.733 W slot update_slots: id 0 | task 9 | n_past = 405, slot.prompt.tokens.size() = 430, seq_id = 0, pos_min = 429, n_swa = 0 |
| 0.27.300.737 I slot update_slots: id 0 | task 9 | Checking checkpoint with [419, 419] against 405... |
| 0.27.300.739 W slot update_slots: id 0 | task 9 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.27.300.746 W slot update_slots: id 0 | task 9 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.27.937.713 I slot create_check: id 0 | task 9 | created context checkpoint 1 of 32 (pos_min = 413, pos_max = 413, n_tokens = 414, size = 62.813 MiB) |
| 0.28.043.202 I reasoning-budget: deactivated (natural end) |
| 0.28.142.801 I slot print_timing: id 0 | task 9 | |
| prompt eval time = 701.16 ms / 418 tokens ( 1.68 ms per token, 596.15 tokens per second) |
| eval time = 140.89 ms / 5 tokens ( 28.18 ms per token, 35.49 tokens per second) |
| total time = 842.06 ms / 423 tokens |
| 0.28.142.910 I slot release: id 0 | task 9 | stop processing: n_tokens = 422, truncated = 0 |
| 0.28.142.959 I srv update_slots: all slots are idle |
| 0.28.158.005 I srv params_from_: Chat format: peg-native |
| 0.28.158.364 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.962 (> 0.100 thold), f_keep = 0.960 |
| 0.28.158.578 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.28.158.608 I slot launch_slot_: id 0 | task 16 | processing task, is_child = 0 |
| 0.28.158.616 W slot update_slots: id 0 | task 16 | n_past = 405, slot.prompt.tokens.size() = 422, seq_id = 0, pos_min = 421, n_swa = 0 |
| 0.28.158.617 I slot update_slots: id 0 | task 16 | Checking checkpoint with [413, 413] against 405... |
| 0.28.158.618 W slot update_slots: id 0 | task 16 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.28.158.620 W slot update_slots: id 0 | task 16 | erased invalidated context checkpoint (pos_min = 413, pos_max = 413, n_tokens = 414, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.28.549.814 I slot create_check: id 0 | task 16 | created context checkpoint 1 of 32 (pos_min = 416, pos_max = 416, n_tokens = 417, size = 62.813 MiB) |
| 0.28.603.918 I reasoning-budget: deactivated (natural end) |
| 0.29.232.552 I slot print_timing: id 0 | task 16 | |
| prompt eval time = 422.03 ms / 421 tokens ( 1.00 ms per token, 997.56 tokens per second) |
| eval time = 651.88 ms / 42 tokens ( 15.52 ms per token, 64.43 tokens per second) |
| total time = 1073.91 ms / 463 tokens |
| 0.29.232.642 I slot release: id 0 | task 16 | stop processing: n_tokens = 462, truncated = 0 |
| 0.29.232.679 I srv update_slots: all slots are idle |
| 0.29.259.355 I srv params_from_: Chat format: peg-native |
| 0.29.259.776 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.951 (> 0.100 thold), f_keep = 0.879 |
| 0.29.259.946 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.29.259.949 I reasoning-budget: deactivated (natural end) |
| 0.29.259.987 I slot launch_slot_: id 0 | task 60 | processing task, is_child = 0 |
| 0.29.259.997 W slot update_slots: id 0 | task 60 | n_past = 406, slot.prompt.tokens.size() = 462, seq_id = 0, pos_min = 461, n_swa = 0 |
| 0.29.259.998 I slot update_slots: id 0 | task 60 | Checking checkpoint with [416, 416] against 406... |
| 0.29.260.000 W slot update_slots: id 0 | task 60 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.29.260.002 W slot update_slots: id 0 | task 60 | erased invalidated context checkpoint (pos_min = 416, pos_max = 416, n_tokens = 417, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.29.608.781 I slot create_check: id 0 | task 60 | created context checkpoint 1 of 32 (pos_min = 422, pos_max = 422, n_tokens = 423, size = 62.813 MiB) |
| 0.29.705.934 I slot print_timing: id 0 | task 60 | |
| prompt eval time = 378.91 ms / 427 tokens ( 0.89 ms per token, 1126.93 tokens per second) |
| eval time = 67.01 ms / 4 tokens ( 16.75 ms per token, 59.69 tokens per second) |
| total time = 445.92 ms / 431 tokens |
| 0.29.706.025 I slot release: id 0 | task 60 | stop processing: n_tokens = 430, truncated = 0 |
| 0.29.706.063 I srv update_slots: all slots are idle |
| 0.29.723.346 I srv params_from_: Chat format: peg-native |
| 0.29.723.698 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.962 (> 0.100 thold), f_keep = 0.942 |
| 0.29.723.878 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.29.723.880 I reasoning-budget: deactivated (natural end) |
| 0.29.723.911 I slot launch_slot_: id 0 | task 66 | processing task, is_child = 0 |
| 0.29.723.921 W slot update_slots: id 0 | task 66 | n_past = 405, slot.prompt.tokens.size() = 430, seq_id = 0, pos_min = 429, n_swa = 0 |
| 0.29.723.922 I slot update_slots: id 0 | task 66 | Checking checkpoint with [422, 422] against 405... |
| 0.29.723.924 W slot update_slots: id 0 | task 66 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.29.723.926 W slot update_slots: id 0 | task 66 | erased invalidated context checkpoint (pos_min = 422, pos_max = 422, n_tokens = 423, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.30.074.713 I slot create_check: id 0 | task 66 | created context checkpoint 1 of 32 (pos_min = 416, pos_max = 416, n_tokens = 417, size = 62.813 MiB) |
| 0.30.128.419 I slot print_timing: id 0 | task 66 | |
| prompt eval time = 380.89 ms / 421 tokens ( 0.90 ms per token, 1105.32 tokens per second) |
| eval time = 23.59 ms / 2 tokens ( 11.79 ms per token, 84.79 tokens per second) |
| total time = 404.48 ms / 423 tokens |
| 0.30.128.524 I slot release: id 0 | task 66 | stop processing: n_tokens = 422, truncated = 0 |
| 0.30.128.572 I srv update_slots: all slots are idle |
| 0.30.150.200 I srv params_from_: Chat format: peg-native |
| 0.30.150.557 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.955 (> 0.100 thold), f_keep = 0.960 |
| 0.30.150.711 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.30.150.713 I reasoning-budget: deactivated (natural end) |
| 0.30.150.739 I slot launch_slot_: id 0 | task 70 | processing task, is_child = 0 |
| 0.30.150.744 W slot update_slots: id 0 | task 70 | n_past = 405, slot.prompt.tokens.size() = 422, seq_id = 0, pos_min = 421, n_swa = 0 |
| 0.30.150.745 I slot update_slots: id 0 | task 70 | Checking checkpoint with [416, 416] against 405... |
| 0.30.150.746 W slot update_slots: id 0 | task 70 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.30.150.752 W slot update_slots: id 0 | task 70 | erased invalidated context checkpoint (pos_min = 416, pos_max = 416, n_tokens = 417, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.30.504.785 I slot create_check: id 0 | task 70 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB) |
| 0.31.192.911 I slot print_timing: id 0 | task 70 | |
| prompt eval time = 383.87 ms / 424 tokens ( 0.91 ms per token, 1104.53 tokens per second) |
| eval time = 658.28 ms / 39 tokens ( 16.88 ms per token, 59.25 tokens per second) |
| total time = 1042.15 ms / 463 tokens |
| 0.31.192.995 I slot release: id 0 | task 70 | stop processing: n_tokens = 462, truncated = 0 |
| 0.31.193.032 I srv update_slots: all slots are idle |
| 0.31.213.646 I srv params_from_: Chat format: peg-native |
| 0.31.213.997 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.955 (> 0.100 thold), f_keep = 0.879 |
| 0.31.214.182 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.31.214.218 I slot launch_slot_: id 0 | task 111 | processing task, is_child = 0 |
| 0.31.214.228 W slot update_slots: id 0 | task 111 | n_past = 406, slot.prompt.tokens.size() = 462, seq_id = 0, pos_min = 461, n_swa = 0 |
| 0.31.214.230 I slot update_slots: id 0 | task 111 | Checking checkpoint with [419, 419] against 406... |
| 0.31.214.231 W slot update_slots: id 0 | task 111 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.31.214.234 W slot update_slots: id 0 | task 111 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.31.741.413 I slot create_check: id 0 | task 111 | created context checkpoint 1 of 32 (pos_min = 420, pos_max = 420, n_tokens = 421, size = 62.813 MiB) |
| 0.32.002.855 I reasoning-budget: deactivated (natural end) |
| 0.32.103.990 I slot print_timing: id 0 | task 111 | |
| prompt eval time = 558.28 ms / 425 tokens ( 1.31 ms per token, 761.27 tokens per second) |
| eval time = 331.47 ms / 17 tokens ( 19.50 ms per token, 51.29 tokens per second) |
| total time = 889.75 ms / 442 tokens |
| 0.32.104.074 I slot release: id 0 | task 111 | stop processing: n_tokens = 441, truncated = 0 |
| 0.32.104.109 I srv update_slots: all slots are idle |
| 0.32.155.224 I srv params_from_: Chat format: peg-native |
| 0.32.157.476 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.967 (> 0.100 thold), f_keep = 0.918 |
| 0.32.157.999 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.32.158.095 I slot launch_slot_: id 0 | task 130 | processing task, is_child = 0 |
| 0.32.158.121 W slot update_slots: id 0 | task 130 | n_past = 405, slot.prompt.tokens.size() = 441, seq_id = 0, pos_min = 440, n_swa = 0 |
| 0.32.158.123 I slot update_slots: id 0 | task 130 | Checking checkpoint with [420, 420] against 405... |
| 0.32.158.124 W slot update_slots: id 0 | task 130 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.32.158.130 W slot update_slots: id 0 | task 130 | erased invalidated context checkpoint (pos_min = 420, pos_max = 420, n_tokens = 421, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.32.714.547 I slot create_check: id 0 | task 130 | created context checkpoint 1 of 32 (pos_min = 414, pos_max = 414, n_tokens = 415, size = 62.813 MiB) |
| 0.32.960.511 I reasoning-budget: deactivated (natural end) |
| 0.33.017.861 I slot print_timing: id 0 | task 130 | |
| prompt eval time = 601.42 ms / 419 tokens ( 1.44 ms per token, 696.69 tokens per second) |
| eval time = 258.30 ms / 12 tokens ( 21.53 ms per token, 46.46 tokens per second) |
| total time = 859.72 ms / 431 tokens |
| 0.33.018.052 I slot release: id 0 | task 130 | stop processing: n_tokens = 430, truncated = 0 |
| 0.33.018.108 I srv update_slots: all slots are idle |
| 0.33.050.367 I srv params_from_: Chat format: peg-native |
| 0.33.050.835 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.960 (> 0.100 thold), f_keep = 0.942 |
| 0.33.051.413 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.33.051.498 I slot launch_slot_: id 0 | task 144 | processing task, is_child = 0 |
| 0.33.051.517 W slot update_slots: id 0 | task 144 | n_past = 405, slot.prompt.tokens.size() = 430, seq_id = 0, pos_min = 429, n_swa = 0 |
| 0.33.051.521 I slot update_slots: id 0 | task 144 | Checking checkpoint with [414, 414] against 405... |
| 0.33.051.522 W slot update_slots: id 0 | task 144 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.33.051.528 W slot update_slots: id 0 | task 144 | erased invalidated context checkpoint (pos_min = 414, pos_max = 414, n_tokens = 415, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.33.615.892 I slot create_check: id 0 | task 144 | created context checkpoint 1 of 32 (pos_min = 417, pos_max = 417, n_tokens = 418, size = 62.813 MiB) |
| 0.33.916.408 I reasoning-budget: deactivated (natural end) |
| 0.34.765.727 I slot print_timing: id 0 | task 144 | |
| prompt eval time = 597.52 ms / 422 tokens ( 1.42 ms per token, 706.25 tokens per second) |
| eval time = 1116.68 ms / 53 tokens ( 21.07 ms per token, 47.46 tokens per second) |
| total time = 1714.20 ms / 475 tokens |
| 0.34.765.808 I slot release: id 0 | task 144 | stop processing: n_tokens = 474, truncated = 0 |
| 0.34.765.835 I srv update_slots: all slots are idle |
| 0.34.781.504 I srv params_from_: Chat format: peg-native |
| 0.34.781.937 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.958 (> 0.100 thold), f_keep = 0.857 |
| 0.34.782.155 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.34.782.201 I slot launch_slot_: id 0 | task 199 | processing task, is_child = 0 |
| 0.34.782.213 W slot update_slots: id 0 | task 199 | n_past = 406, slot.prompt.tokens.size() = 474, seq_id = 0, pos_min = 473, n_swa = 0 |
| 0.34.782.213 I slot update_slots: id 0 | task 199 | Checking checkpoint with [417, 417] against 406... |
| 0.34.782.214 W slot update_slots: id 0 | task 199 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.34.782.218 W slot update_slots: id 0 | task 199 | erased invalidated context checkpoint (pos_min = 417, pos_max = 417, n_tokens = 418, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.35.312.464 I slot create_check: id 0 | task 199 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB) |
| 0.35.382.494 I reasoning-budget: deactivated (natural end) |
| 0.35.500.672 I slot print_timing: id 0 | task 199 | |
| prompt eval time = 569.17 ms / 424 tokens ( 1.34 ms per token, 744.95 tokens per second) |
| eval time = 149.28 ms / 7 tokens ( 21.33 ms per token, 46.89 tokens per second) |
| total time = 718.45 ms / 431 tokens |
| 0.35.500.758 I slot release: id 0 | task 199 | stop processing: n_tokens = 430, truncated = 0 |
| 0.35.500.792 I srv update_slots: all slots are idle |
| 0.35.523.836 I srv params_from_: Chat format: peg-native |
| 0.35.524.275 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.969 (> 0.100 thold), f_keep = 0.942 |
| 0.35.524.794 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.35.524.873 I slot launch_slot_: id 0 | task 208 | processing task, is_child = 0 |
| 0.35.524.891 W slot update_slots: id 0 | task 208 | n_past = 405, slot.prompt.tokens.size() = 430, seq_id = 0, pos_min = 429, n_swa = 0 |
| 0.35.524.892 I slot update_slots: id 0 | task 208 | Checking checkpoint with [419, 419] against 405... |
| 0.35.524.894 W slot update_slots: id 0 | task 208 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.35.524.899 W slot update_slots: id 0 | task 208 | erased invalidated context checkpoint (pos_min = 419, pos_max = 419, n_tokens = 420, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.36.142.960 I slot create_check: id 0 | task 208 | created context checkpoint 1 of 32 (pos_min = 413, pos_max = 413, n_tokens = 414, size = 62.813 MiB) |
| 0.36.260.514 I reasoning-budget: deactivated (natural end) |
| 0.36.391.695 I slot print_timing: id 0 | task 208 | |
| prompt eval time = 684.84 ms / 418 tokens ( 1.64 ms per token, 610.36 tokens per second) |
| eval time = 181.96 ms / 5 tokens ( 36.39 ms per token, 27.48 tokens per second) |
| total time = 866.79 ms / 423 tokens |
| 0.36.391.789 I slot release: id 0 | task 208 | stop processing: n_tokens = 422, truncated = 0 |
| 0.36.391.820 I srv update_slots: all slots are idle |
| 0.36.404.024 I srv params_from_: Chat format: peg-native |
| 0.36.404.587 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.962 (> 0.100 thold), f_keep = 0.960 |
| 0.36.404.848 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.36.404.897 I slot launch_slot_: id 0 | task 215 | processing task, is_child = 0 |
| 0.36.404.910 W slot update_slots: id 0 | task 215 | n_past = 405, slot.prompt.tokens.size() = 422, seq_id = 0, pos_min = 421, n_swa = 0 |
| 0.36.404.912 I slot update_slots: id 0 | task 215 | Checking checkpoint with [413, 413] against 405... |
| 0.36.404.913 W slot update_slots: id 0 | task 215 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.36.404.916 W slot update_slots: id 0 | task 215 | erased invalidated context checkpoint (pos_min = 413, pos_max = 413, n_tokens = 414, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.36.899.390 I slot create_check: id 0 | task 215 | created context checkpoint 1 of 32 (pos_min = 416, pos_max = 416, n_tokens = 417, size = 62.813 MiB) |
| 0.37.012.108 I reasoning-budget: deactivated (natural end) |
| 0.37.909.549 I slot print_timing: id 0 | task 215 | |
| prompt eval time = 555.94 ms / 421 tokens ( 1.32 ms per token, 757.28 tokens per second) |
| eval time = 948.68 ms / 42 tokens ( 22.59 ms per token, 44.27 tokens per second) |
| total time = 1504.62 ms / 463 tokens |
| 0.37.909.654 I slot release: id 0 | task 215 | stop processing: n_tokens = 462, truncated = 0 |
| 0.37.909.691 I srv update_slots: all slots are idle |
| 0.37.937.856 I srv params_from_: Chat format: peg-native |
| 0.37.938.240 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.951 (> 0.100 thold), f_keep = 0.879 |
| 0.37.938.471 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.37.938.517 I slot launch_slot_: id 0 | task 259 | processing task, is_child = 0 |
| 0.37.938.529 W slot update_slots: id 0 | task 259 | n_past = 406, slot.prompt.tokens.size() = 462, seq_id = 0, pos_min = 461, n_swa = 0 |
| 0.37.938.531 I slot update_slots: id 0 | task 259 | Checking checkpoint with [416, 416] against 406... |
| 0.37.938.532 W slot update_slots: id 0 | task 259 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.37.938.535 W slot update_slots: id 0 | task 259 | erased invalidated context checkpoint (pos_min = 416, pos_max = 416, n_tokens = 417, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.38.478.969 I slot create_check: id 0 | task 259 | created context checkpoint 1 of 32 (pos_min = 422, pos_max = 422, n_tokens = 423, size = 62.813 MiB) |
| 0.38.599.473 I slot print_timing: id 0 | task 259 | |
| prompt eval time = 580.20 ms / 427 tokens ( 1.36 ms per token, 735.95 tokens per second) |
| eval time = 80.65 ms / 4 tokens ( 20.16 ms per token, 49.60 tokens per second) |
| total time = 660.85 ms / 431 tokens |
| 0.38.599.762 I slot release: id 0 | task 259 | stop processing: n_tokens = 430, truncated = 0 |
| 0.38.599.853 I srv update_slots: all slots are idle |
| 0.38.629.562 I srv params_from_: Chat format: peg-native |
| 0.38.630.012 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.962 (> 0.100 thold), f_keep = 0.942 |
| 0.38.630.609 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.38.630.693 I slot launch_slot_: id 0 | task 265 | processing task, is_child = 0 |
| 0.38.630.711 W slot update_slots: id 0 | task 265 | n_past = 405, slot.prompt.tokens.size() = 430, seq_id = 0, pos_min = 429, n_swa = 0 |
| 0.38.630.716 I slot update_slots: id 0 | task 265 | Checking checkpoint with [422, 422] against 405... |
| 0.38.630.719 W slot update_slots: id 0 | task 265 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.38.630.724 W slot update_slots: id 0 | task 265 | erased invalidated context checkpoint (pos_min = 422, pos_max = 422, n_tokens = 423, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.39.188.051 I slot create_check: id 0 | task 265 | created context checkpoint 1 of 32 (pos_min = 416, pos_max = 416, n_tokens = 417, size = 62.813 MiB) |
| 0.39.260.024 I slot print_timing: id 0 | task 265 | |
| prompt eval time = 591.28 ms / 421 tokens ( 1.40 ms per token, 712.01 tokens per second) |
| eval time = 37.99 ms / 2 tokens ( 19.00 ms per token, 52.64 tokens per second) |
| total time = 629.28 ms / 423 tokens |
| 0.39.260.276 I slot release: id 0 | task 265 | stop processing: n_tokens = 422, truncated = 0 |
| 0.39.260.338 I srv update_slots: all slots are idle |
| 0.39.312.544 I srv params_from_: Chat format: peg-native |
| 0.39.314.833 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, sim_best = 0.955 (> 0.100 thold), f_keep = 0.960 |
| 0.39.315.431 I reasoning-budget: activated, budget=2147483647 tokens |
| 0.39.315.516 I slot launch_slot_: id 0 | task 269 | processing task, is_child = 0 |
| 0.39.315.539 W slot update_slots: id 0 | task 269 | n_past = 405, slot.prompt.tokens.size() = 422, seq_id = 0, pos_min = 421, n_swa = 0 |
| 0.39.315.543 I slot update_slots: id 0 | task 269 | Checking checkpoint with [416, 416] against 405... |
| 0.39.315.545 W slot update_slots: id 0 | task 269 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055) |
| 0.39.315.552 W slot update_slots: id 0 | task 269 | erased invalidated context checkpoint (pos_min = 416, pos_max = 416, n_tokens = 417, n_swa = 0, pos_next = 0, size = 62.813 MiB) |
| 0.39.893.482 I slot create_check: id 0 | task 269 | created context checkpoint 1 of 32 (pos_min = 419, pos_max = 419, n_tokens = 420, size = 62.813 MiB) |
| 0.40.793.357 I slot print_timing: id 0 | task 269 | |
| prompt eval time = 633.79 ms / 424 tokens ( 1.49 ms per token, 668.99 tokens per second) |
| eval time = 844.02 ms / 39 tokens ( 21.64 ms per token, 46.21 tokens per second) |
| total time = 1477.81 ms / 463 tokens |
| 0.40.793.457 I slot release: id 0 | task 269 | stop processing: n_tokens = 462, truncated = 0 |
| 0.40.793.487 I srv update_slots: all slots are idle |
| 0.40.794.731 I srv operator(): operator(): cleaning up before exit... |
|
|
