| 0.00.033.687 I common_init_result: fitting params to device memory ... |
| 0.00.033.690 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) |
| 0.00.365.970 W llama_model_loader: direct I/O is enabled, disabling mmap |
| 0.01.319.923 W read_raw_unsafe: Falling back to buffered IO due to Bad address |
| 0.19.602.693 W llama_context: n_ctx_seq (2048) < n_ctx_train (262144) -- the full capacity of the model will not be utilized |
| 0.19.656.222 W common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) |
| 0.19.834.989 I |
| 0.19.835.081 I system_info: n_threads = 16 (n_threads_batch = 16) / 32 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | FA_ALL_QUANTS = 1 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | |
| 0.19.951.235 I kl_divergence: computing over 40 chunks, n_ctx=2048, batch_size=2048, n_seq=1 |
| 0.22.342.997 I kl_divergence: 2.39 seconds per pass - ETA 1.58 minutes |
|
|
| chunk PPL ln(PPL(Q)/PPL(base)) KL Divergence Δp RMS Same top p |
| 1 5.6983 ± 0.4331 0.00085 ± 0.01708 0.10779 ± 0.00685 10.030 ± 0.635 % 86.217 ± 1.078 % |
| 2 6.7307 ± 0.3660 0.00982 ± 0.01106 0.08982 ± 0.00389 8.657 ± 0.431 % 86.950 ± 0.745 % |
| 3 7.1804 ± 0.3254 0.02094 ± 0.00857 0.08982 ± 0.00369 8.264 ± 0.335 % 87.260 ± 0.602 % |
| 4 7.4637 ± 0.3024 0.02393 ± 0.00766 0.09566 ± 0.00581 8.559 ± 0.352 % 87.732 ± 0.513 % |
| 5 7.3233 ± 0.2674 0.02505 ± 0.00682 0.09342 ± 0.00473 8.497 ± 0.302 % 87.977 ± 0.455 % |
| 6 6.3148 ± 0.2036 0.02684 ± 0.00631 0.09237 ± 0.00410 8.998 ± 0.290 % 88.368 ± 0.409 % |
| 7 5.8753 ± 0.1731 0.02333 ± 0.00607 0.09805 ± 0.00414 9.342 ± 0.282 % 88.479 ± 0.377 % |
| 8 5.8033 ± 0.1588 0.02333 ± 0.00556 0.09655 ± 0.00369 9.256 ± 0.258 % 88.331 ± 0.355 % |
| 9 6.1048 ± 0.1583 0.02143 ± 0.00523 0.09704 ± 0.00332 9.085 ± 0.238 % 87.846 ± 0.341 % |
| 10 6.2216 ± 0.1541 0.02196 ± 0.00487 0.09358 ± 0.00301 8.857 ± 0.221 % 87.869 ± 0.323 % |
| 11 6.2877 ± 0.1481 0.02373 ± 0.00459 0.09124 ± 0.00277 8.771 ± 0.212 % 87.914 ± 0.307 % |
| 12 6.5381 ± 0.1489 0.02446 ± 0.00432 0.08825 ± 0.00255 8.571 ± 0.200 % 87.854 ± 0.295 % |
| 13 6.5779 ± 0.1436 0.02363 ± 0.00412 0.08706 ± 0.00237 8.553 ± 0.189 % 87.796 ± 0.284 % |
| 14 6.6420 ± 0.1396 0.02456 ± 0.00395 0.08566 ± 0.00221 8.419 ± 0.180 % 87.767 ± 0.274 % |
| 15 6.6847 ± 0.1359 0.02475 ± 0.00380 0.08492 ± 0.00208 8.367 ± 0.171 % 87.683 ± 0.265 % |
| 16 6.8394 ± 0.1348 0.02090 ± 0.00368 0.08419 ± 0.00198 8.280 ± 0.165 % 87.616 ± 0.257 % |
| 17 6.8859 ± 0.1312 0.02070 ± 0.00355 0.08311 ± 0.00187 8.185 ± 0.158 % 87.695 ± 0.249 % |
| 18 6.9788 ± 0.1294 0.02093 ± 0.00343 0.08257 ± 0.00178 8.136 ± 0.151 % 87.640 ± 0.243 % |
| 19 6.9229 ± 0.1253 0.01979 ± 0.00332 0.08171 ± 0.00170 8.036 ± 0.146 % 87.647 ± 0.236 % |
| 20 6.6565 ± 0.1166 0.01988 ± 0.00330 0.08616 ± 0.00169 8.356 ± 0.141 % 87.542 ± 0.231 % |
| 21 6.6723 ± 0.1139 0.01975 ± 0.00323 0.08644 ± 0.00162 8.308 ± 0.137 % 87.488 ± 0.226 % |
| 22 6.6896 ± 0.1116 0.02034 ± 0.00316 0.08711 ± 0.00160 8.355 ± 0.137 % 87.514 ± 0.220 % |
| 23 6.7506 ± 0.1102 0.02201 ± 0.00309 0.08713 ± 0.00156 8.332 ± 0.134 % 87.479 ± 0.216 % |
| 24 6.7515 ± 0.1077 0.02210 ± 0.00303 0.08701 ± 0.00153 8.313 ± 0.132 % 87.553 ± 0.211 % |
| 25 6.7898 ± 0.1062 0.02305 ± 0.00295 0.08650 ± 0.00148 8.258 ± 0.129 % 87.464 ± 0.207 % |
| 26 6.7594 ± 0.1035 0.02304 ± 0.00290 0.08694 ± 0.00146 8.287 ± 0.127 % 87.540 ± 0.203 % |
| 27 6.9231 ± 0.1046 0.02264 ± 0.00283 0.08601 ± 0.00141 8.197 ± 0.124 % 87.553 ± 0.199 % |
| 28 7.0130 ± 0.1044 0.02268 ± 0.00277 0.08539 ± 0.00138 8.177 ± 0.123 % 87.586 ± 0.195 % |
| 29 7.0144 ± 0.1026 0.02374 ± 0.00273 0.08551 ± 0.00135 8.241 ± 0.122 % 87.569 ± 0.192 % |
| 30 6.9699 ± 0.1001 0.02537 ± 0.00270 0.08585 ± 0.00132 8.254 ± 0.120 % 87.563 ± 0.188 % |
| 31 6.8694 ± 0.0967 0.02536 ± 0.00264 0.08520 ± 0.00128 8.219 ± 0.117 % 87.668 ± 0.185 % |
| 32 6.7608 ± 0.0936 0.02369 ± 0.00262 0.08761 ± 0.00146 8.350 ± 0.118 % 87.662 ± 0.182 % |
| 33 6.6975 ± 0.0910 0.02416 ± 0.00258 0.08714 ± 0.00143 8.347 ± 0.117 % 87.704 ± 0.179 % |
| 34 6.6852 ± 0.0894 0.02449 ± 0.00252 0.08623 ± 0.00139 8.290 ± 0.114 % 87.775 ± 0.176 % |
| 35 6.6941 ± 0.0882 0.02401 ± 0.00247 0.08558 ± 0.00135 8.241 ± 0.112 % 87.845 ± 0.173 % |
| 36 6.7094 ± 0.0873 0.02381 ± 0.00243 0.08528 ± 0.00132 8.207 ± 0.110 % 87.846 ± 0.170 % |
| 37 6.6134 ± 0.0846 0.02319 ± 0.00240 0.08448 ± 0.00129 8.182 ± 0.108 % 87.852 ± 0.168 % |
| 38 6.5369 ± 0.0822 0.02208 ± 0.00237 0.08434 ± 0.00126 8.180 ± 0.106 % 87.897 ± 0.165 % |
| 39 6.4545 ± 0.0798 0.02173 ± 0.00234 0.08418 ± 0.00123 8.209 ± 0.105 % 87.896 ± 0.163 % |
| 40 6.3642 ± 0.0773 0.02147 ± 0.00231 0.08356 ± 0.00121 8.201 ± 0.103 % 87.903 ± 0.161 % |
|
|
| ====== Perplexity statistics ====== |
| Mean PPL(Q) : 6.364168 ± 0.077334 |
| Mean PPL(base) : 6.228979 ± 0.075322 |
| Cor(ln(PPL(Q)), ln(PPL(base))): 98.19% |
| Mean ln(PPL(Q)/PPL(base)) : 0.021471 ± 0.002306 |
| Mean PPL(Q)/PPL(base) : 1.021703 ± 0.002356 |
| Mean PPL(Q)-PPL(base) : 0.135189 ± 0.014650 |
|
|
| ====== KL divergence statistics ====== |
| Mean KLD: 0.083563 ± 0.001206 |
| Maximum KLD: 15.989422 |
| 99.9% KLD: 2.686481 |
| 99.0% KLD: 0.713036 |
| 95.0% KLD: 0.286778 |
| 90.0% KLD: 0.180925 |
| Median KLD: 0.038000 |
| 10.0% KLD: 0.000531 |
| 5.0% KLD: 0.000125 |
| 1.0% KLD: -0.000041 |
| 0.1% KLD: -0.000270 |
| Minimum KLD: -0.000789 |
|
|
| ====== Token probability statistics ====== |
| Mean Δp: -0.435 ± 0.040 % |
| Maximum Δp: 99.469% |
| 99.9% Δp: 52.136% |
| 99.0% Δp: 22.860% |
| 95.0% Δp: 9.882% |
| 90.0% Δp: 5.626% |
| 75.0% Δp: 1.034% |
| Median Δp: -0.004% |
| 25.0% Δp: -1.525% |
| 10.0% Δp: -6.894% |
| 5.0% Δp: -11.769% |
| 1.0% Δp: -27.478% |
| 0.1% Δp: -66.247% |
| Minimum Δp: -99.814% |
| RMS Δp : 8.201 ± 0.103 % |
| Same top p: 87.903 ± 0.161 % |
|
|
|
|
