| 0.00.033.949 I common_init_result: fitting params to device memory ... |
| 0.00.033.953 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) |
| 0.00.371.029 W llama_model_loader: direct I/O is enabled, disabling mmap |
| 0.01.312.258 W read_raw_unsafe: Falling back to buffered IO due to Bad address |
| 0.19.504.583 W llama_context: n_ctx_seq (2048) < n_ctx_train (262144) -- the full capacity of the model will not be utilized |
| 0.19.553.410 W common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) |
| 0.19.731.487 I |
| 0.19.731.587 I system_info: n_threads = 16 (n_threads_batch = 16) / 32 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | FA_ALL_QUANTS = 1 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | |
| 0.19.847.243 I kl_divergence: computing over 40 chunks, n_ctx=2048, batch_size=2048, n_seq=1 |
| 0.22.241.158 I kl_divergence: 2.39 seconds per pass - ETA 1.58 minutes |
|
|
| chunk PPL ln(PPL(Q)/PPL(base)) KL Divergence Δp RMS Same top p |
| 1 5.7501 ± 0.4413 0.00989 ± 0.01572 0.10954 ± 0.00645 9.805 ± 0.583 % 85.630 ± 1.097 % |
| 2 6.7714 ± 0.3709 0.01585 ± 0.01070 0.09308 ± 0.00377 8.559 ± 0.392 % 86.706 ± 0.751 % |
| 3 7.1773 ± 0.3266 0.02051 ± 0.00847 0.09216 ± 0.00368 7.997 ± 0.296 % 86.934 ± 0.608 % |
| 4 7.4782 ± 0.3040 0.02587 ± 0.00786 0.09738 ± 0.00472 8.531 ± 0.336 % 87.341 ± 0.520 % |
| 5 7.3506 ± 0.2694 0.02877 ± 0.00704 0.09557 ± 0.00398 8.489 ± 0.308 % 87.468 ± 0.463 % |
| 6 6.3429 ± 0.2051 0.03128 ± 0.00664 0.09662 ± 0.00373 9.145 ± 0.308 % 87.781 ± 0.418 % |
| 7 5.9472 ± 0.1761 0.03550 ± 0.00668 0.10791 ± 0.00462 9.889 ± 0.320 % 87.795 ± 0.387 % |
| 8 5.8786 ± 0.1618 0.03622 ± 0.00612 0.10626 ± 0.00411 9.788 ± 0.292 % 87.683 ± 0.363 % |
| 9 6.1674 ± 0.1605 0.03164 ± 0.00571 0.10586 ± 0.00370 9.627 ± 0.271 % 87.227 ± 0.348 % |
| 10 6.2930 ± 0.1566 0.03336 ± 0.00529 0.10181 ± 0.00335 9.388 ± 0.252 % 87.390 ± 0.328 % |
| 11 6.3574 ± 0.1505 0.03475 ± 0.00499 0.09913 ± 0.00308 9.301 ± 0.238 % 87.292 ± 0.314 % |
| 12 6.6087 ± 0.1511 0.03519 ± 0.00469 0.09595 ± 0.00284 9.076 ± 0.225 % 87.317 ± 0.300 % |
| 13 6.6444 ± 0.1456 0.03370 ± 0.00446 0.09418 ± 0.00263 8.998 ± 0.213 % 87.367 ± 0.288 % |
| 14 6.6988 ± 0.1413 0.03307 ± 0.00425 0.09228 ± 0.00246 8.826 ± 0.202 % 87.467 ± 0.277 % |
| 15 6.7357 ± 0.1373 0.03235 ± 0.00408 0.09142 ± 0.00231 8.745 ± 0.192 % 87.488 ± 0.267 % |
| 16 6.8972 ± 0.1363 0.02932 ± 0.00393 0.09032 ± 0.00219 8.621 ± 0.183 % 87.390 ± 0.259 % |
| 17 6.9396 ± 0.1326 0.02848 ± 0.00379 0.08911 ± 0.00207 8.521 ± 0.175 % 87.436 ± 0.251 % |
| 18 7.0315 ± 0.1308 0.02845 ± 0.00366 0.08879 ± 0.00197 8.486 ± 0.168 % 87.374 ± 0.245 % |
| 19 6.9777 ± 0.1268 0.02767 ± 0.00353 0.08759 ± 0.00188 8.384 ± 0.163 % 87.385 ± 0.238 % |
| 20 6.7038 ± 0.1178 0.02695 ± 0.00352 0.09228 ± 0.00186 8.685 ± 0.156 % 87.273 ± 0.233 % |
| 21 6.7149 ± 0.1149 0.02612 ± 0.00345 0.09269 ± 0.00179 8.668 ± 0.151 % 87.162 ± 0.228 % |
| 22 6.7275 ± 0.1124 0.02599 ± 0.00339 0.09343 ± 0.00179 8.678 ± 0.150 % 87.186 ± 0.223 % |
| 23 6.7910 ± 0.1111 0.02798 ± 0.00333 0.09354 ± 0.00176 8.670 ± 0.147 % 87.080 ± 0.219 % |
| 24 6.7874 ± 0.1085 0.02741 ± 0.00325 0.09330 ± 0.00171 8.652 ± 0.144 % 87.097 ± 0.214 % |
| 25 6.8244 ± 0.1069 0.02813 ± 0.00316 0.09247 ± 0.00164 8.585 ± 0.140 % 87.077 ± 0.210 % |
| 26 6.7976 ± 0.1043 0.02868 ± 0.00310 0.09292 ± 0.00161 8.642 ± 0.138 % 87.142 ± 0.205 % |
| 27 6.9623 ± 0.1055 0.02829 ± 0.00303 0.09202 ± 0.00157 8.538 ± 0.135 % 87.129 ± 0.201 % |
| 28 7.0526 ± 0.1053 0.02832 ± 0.00296 0.09127 ± 0.00153 8.496 ± 0.133 % 87.149 ± 0.198 % |
| 29 7.0500 ± 0.1034 0.02880 ± 0.00292 0.09137 ± 0.00149 8.557 ± 0.131 % 87.191 ± 0.194 % |
| 30 7.0006 ± 0.1008 0.02977 ± 0.00287 0.09152 ± 0.00145 8.567 ± 0.129 % 87.165 ± 0.191 % |
| 31 6.9004 ± 0.0974 0.02987 ± 0.00281 0.09083 ± 0.00141 8.530 ± 0.126 % 87.251 ± 0.187 % |
| 32 6.7986 ± 0.0943 0.02926 ± 0.00280 0.09330 ± 0.00152 8.688 ± 0.125 % 87.225 ± 0.184 % |
| 33 6.7336 ± 0.0917 0.02953 ± 0.00275 0.09274 ± 0.00149 8.677 ± 0.123 % 87.266 ± 0.181 % |
| 34 6.7179 ± 0.0899 0.02937 ± 0.00268 0.09177 ± 0.00145 8.617 ± 0.121 % 87.333 ± 0.178 % |
| 35 6.7270 ± 0.0888 0.02891 ± 0.00263 0.09111 ± 0.00141 8.570 ± 0.118 % 87.398 ± 0.175 % |
| 36 6.7405 ± 0.0878 0.02844 ± 0.00259 0.09075 ± 0.00138 8.522 ± 0.116 % 87.414 ± 0.173 % |
| 37 6.6432 ± 0.0851 0.02769 ± 0.00255 0.08997 ± 0.00135 8.495 ± 0.114 % 87.409 ± 0.171 % |
| 38 6.5666 ± 0.0827 0.02662 ± 0.00252 0.09001 ± 0.00132 8.514 ± 0.112 % 87.434 ± 0.168 % |
| 39 6.4867 ± 0.0803 0.02671 ± 0.00249 0.08987 ± 0.00130 8.528 ± 0.111 % 87.408 ± 0.166 % |
| 40 6.3929 ± 0.0779 0.02598 ± 0.00245 0.08915 ± 0.00127 8.509 ± 0.109 % 87.424 ± 0.164 % |
|
|
| ====== Perplexity statistics ====== |
| Mean PPL(Q) : 6.392929 ± 0.077851 |
| Mean PPL(base) : 6.228979 ± 0.075322 |
| Cor(ln(PPL(Q)), ln(PPL(base))): 97.97% |
| Mean ln(PPL(Q)/PPL(base)) : 0.025980 ± 0.002447 |
| Mean PPL(Q)/PPL(base) : 1.026321 ± 0.002511 |
| Mean PPL(Q)-PPL(base) : 0.163950 ± 0.015638 |
|
|
| ====== KL divergence statistics ====== |
| Mean KLD: 0.089150 ± 0.001266 |
| Maximum KLD: 13.245127 |
| 99.9% KLD: 3.279078 |
| 99.0% KLD: 0.784911 |
| 95.0% KLD: 0.302743 |
| 90.0% KLD: 0.190118 |
| Median KLD: 0.039583 |
| 10.0% KLD: 0.000539 |
| 5.0% KLD: 0.000127 |
| 1.0% KLD: -0.000056 |
| 0.1% KLD: -0.000311 |
| Minimum KLD: -0.000916 |
|
|
| ====== Token probability statistics ====== |
| Mean Δp: -0.437 ± 0.042 % |
| Maximum Δp: 97.638% |
| 99.9% Δp: 52.324% |
| 99.0% Δp: 22.989% |
| 95.0% Δp: 10.252% |
| 90.0% Δp: 5.909% |
| 75.0% Δp: 1.135% |
| Median Δp: -0.001% |
| 25.0% Δp: -1.497% |
| 10.0% Δp: -6.935% |
| 5.0% Δp: -12.278% |
| 1.0% Δp: -29.036% |
| 0.1% Δp: -71.577% |
| Minimum Δp: -99.874% |
| RMS Δp : 8.509 ± 0.109 % |
| Same top p: 87.424 ± 0.164 % |
|
|
|
|
