| 0.00.046.192 I common_init_result: fitting params to device memory ... |
| 0.00.046.197 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) |
| 0.00.468.601 W llama_model_loader: direct I/O is enabled, disabling mmap |
| 0.26.097.875 W llama_context: n_ctx_seq (2048) < n_ctx_train (262144) -- the full capacity of the model will not be utilized |
| 0.26.161.936 W common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) |
| 0.26.456.383 I |
| 0.26.456.524 I system_info: n_threads = 16 (n_threads_batch = 16) / 32 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | FA_ALL_QUANTS = 1 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | |
| 0.26.593.623 I kl_divergence: computing over 40 chunks, n_ctx=2048, batch_size=2048, n_seq=1 |
| 0.29.575.306 I kl_divergence: 2.98 seconds per pass - ETA 1.98 minutes |
|
|
| chunk PPL ln(PPL(Q)/PPL(base)) KL Divergence Δp RMS Same top p |
| 1 5.9944 ± 0.4685 0.05151 ± 0.01742 0.11333 ± 0.00681 10.320 ± 0.638 % 87.390 ± 1.038 % |
| 2 6.9832 ± 0.3895 0.04665 ± 0.01189 0.09838 ± 0.00400 8.897 ± 0.415 % 87.048 ± 0.743 % |
| 3 7.5417 ± 0.3512 0.07003 ± 0.00990 0.10487 ± 0.00406 9.267 ± 0.393 % 87.195 ± 0.603 % |
| 4 7.8954 ± 0.3289 0.08016 ± 0.00897 0.11061 ± 0.00503 9.327 ± 0.343 % 86.901 ± 0.527 % |
| 5 7.6999 ± 0.2880 0.07519 ± 0.00798 0.10848 ± 0.00428 9.187 ± 0.313 % 87.097 ± 0.469 % |
| 6 6.6265 ± 0.2194 0.07502 ± 0.00740 0.11000 ± 0.00421 9.941 ± 0.317 % 87.455 ± 0.423 % |
| 7 6.1509 ± 0.1859 0.06918 ± 0.00711 0.11837 ± 0.00459 10.426 ± 0.309 % 87.530 ± 0.390 % |
| 8 6.0395 ± 0.1692 0.06322 ± 0.00648 0.11517 ± 0.00408 10.254 ± 0.281 % 87.476 ± 0.366 % |
| 9 6.3422 ± 0.1682 0.05959 ± 0.00609 0.11478 ± 0.00370 10.054 ± 0.261 % 87.216 ± 0.348 % |
| 10 6.4559 ± 0.1635 0.05892 ± 0.00570 0.11065 ± 0.00337 9.793 ± 0.242 % 87.243 ± 0.330 % |
| 11 6.5040 ± 0.1565 0.05755 ± 0.00536 0.10715 ± 0.00309 9.593 ± 0.227 % 87.283 ± 0.314 % |
| 12 6.7574 ± 0.1569 0.05744 ± 0.00504 0.10450 ± 0.00284 9.400 ± 0.214 % 87.211 ± 0.301 % |
| 13 6.8020 ± 0.1514 0.05713 ± 0.00478 0.10247 ± 0.00264 9.285 ± 0.203 % 87.232 ± 0.289 % |
| 14 6.8553 ± 0.1467 0.05617 ± 0.00457 0.10045 ± 0.00247 9.123 ± 0.192 % 87.236 ± 0.279 % |
| 15 6.8957 ± 0.1427 0.05582 ± 0.00438 0.09956 ± 0.00232 9.076 ± 0.184 % 87.247 ± 0.269 % |
| 16 7.0571 ± 0.1415 0.05224 ± 0.00422 0.09847 ± 0.00219 8.961 ± 0.175 % 87.243 ± 0.261 % |
| 17 7.0917 ± 0.1375 0.05016 ± 0.00405 0.09704 ± 0.00208 8.871 ± 0.169 % 87.281 ± 0.253 % |
| 18 7.1772 ± 0.1353 0.04896 ± 0.00392 0.09635 ± 0.00198 8.799 ± 0.162 % 87.243 ± 0.246 % |
| 19 7.1236 ± 0.1311 0.04836 ± 0.00378 0.09524 ± 0.00190 8.763 ± 0.159 % 87.303 ± 0.239 % |
| 20 6.8769 ± 0.1227 0.05245 ± 0.00378 0.10018 ± 0.00190 9.053 ± 0.155 % 87.175 ± 0.234 % |
| 21 6.8931 ± 0.1198 0.05231 ± 0.00368 0.10066 ± 0.00184 9.029 ± 0.150 % 87.120 ± 0.229 % |
| 22 6.9236 ± 0.1178 0.05472 ± 0.00363 0.10218 ± 0.00181 9.063 ± 0.147 % 87.168 ± 0.223 % |
| 23 6.9807 ± 0.1162 0.05553 ± 0.00354 0.10187 ± 0.00175 9.045 ± 0.143 % 87.131 ± 0.218 % |
| 24 6.9769 ± 0.1134 0.05494 ± 0.00347 0.10222 ± 0.00175 9.051 ± 0.143 % 87.093 ± 0.214 % |
| 25 7.0111 ± 0.1117 0.05513 ± 0.00339 0.10169 ± 0.00169 8.997 ± 0.139 % 87.015 ± 0.210 % |
| 26 6.9763 ± 0.1088 0.05463 ± 0.00332 0.10165 ± 0.00165 9.014 ± 0.137 % 87.055 ± 0.206 % |
| 27 7.1528 ± 0.1102 0.05528 ± 0.00326 0.10141 ± 0.00162 8.950 ± 0.134 % 87.079 ± 0.202 % |
| 28 7.2365 ± 0.1098 0.05405 ± 0.00318 0.10027 ± 0.00157 8.866 ± 0.131 % 87.118 ± 0.198 % |
| 29 7.2391 ± 0.1079 0.05527 ± 0.00313 0.10044 ± 0.00154 8.907 ± 0.129 % 87.077 ± 0.195 % |
| 30 7.1873 ± 0.1051 0.05609 ± 0.00307 0.10003 ± 0.00150 8.887 ± 0.126 % 87.061 ± 0.192 % |
| 31 7.0778 ± 0.1015 0.05524 ± 0.00300 0.09893 ± 0.00145 8.840 ± 0.123 % 87.154 ± 0.188 % |
| 32 6.9728 ± 0.0983 0.05456 ± 0.00300 0.10164 ± 0.00161 8.995 ± 0.124 % 87.121 ± 0.185 % |
| 33 6.9098 ± 0.0957 0.05537 ± 0.00295 0.10136 ± 0.00157 8.987 ± 0.122 % 87.153 ± 0.182 % |
| 34 6.8891 ± 0.0938 0.05453 ± 0.00288 0.10042 ± 0.00153 8.943 ± 0.120 % 87.154 ± 0.179 % |
| 35 6.9008 ± 0.0926 0.05442 ± 0.00283 0.09974 ± 0.00149 8.883 ± 0.118 % 87.214 ± 0.176 % |
| 36 6.9190 ± 0.0917 0.05458 ± 0.00279 0.09958 ± 0.00146 8.857 ± 0.116 % 87.197 ± 0.174 % |
| 37 6.8168 ± 0.0888 0.05349 ± 0.00273 0.09856 ± 0.00142 8.817 ± 0.113 % 87.242 ± 0.171 % |
| 38 6.7442 ± 0.0864 0.05330 ± 0.00269 0.09804 ± 0.00139 8.824 ± 0.112 % 87.277 ± 0.169 % |
| 39 6.6583 ± 0.0839 0.05282 ± 0.00265 0.09776 ± 0.00137 8.827 ± 0.110 % 87.247 ± 0.167 % |
| 40 6.5617 ± 0.0812 0.05204 ± 0.00261 0.09707 ± 0.00134 8.800 ± 0.108 % 87.287 ± 0.165 % |
|
|
| ====== Perplexity statistics ====== |
| Mean PPL(Q) : 6.561727 ± 0.081240 |
| Mean PPL(base) : 6.228979 ± 0.075322 |
| Cor(ln(PPL(Q)), ln(PPL(base))): 97.76% |
| Mean ln(PPL(Q)/PPL(base)) : 0.052041 ± 0.002607 |
| Mean PPL(Q)/PPL(base) : 1.053419 ± 0.002746 |
| Mean PPL(Q)-PPL(base) : 0.332749 ± 0.017588 |
|
|
| ====== KL divergence statistics ====== |
| Mean KLD: 0.097071 ± 0.001342 |
| Maximum KLD: 12.257548 |
| 99.9% KLD: 3.289070 |
| 99.0% KLD: 0.874485 |
| 95.0% KLD: 0.332573 |
| 90.0% KLD: 0.209309 |
| Median KLD: 0.043524 |
| 10.0% KLD: 0.000605 |
| 5.0% KLD: 0.000161 |
| 1.0% KLD: -0.000023 |
| 0.1% KLD: -0.000269 |
| Minimum KLD: -0.000603 |
|
|
| ====== Token probability statistics ====== |
| Mean Δp: -0.366 ± 0.043 % |
| Maximum Δp: 99.335% |
| 99.9% Δp: 53.261% |
| 99.0% Δp: 23.761% |
| 95.0% Δp: 10.784% |
| 90.0% Δp: 6.407% |
| 75.0% Δp: 1.292% |
| Median Δp: -0.004% |
| 25.0% Δp: -1.463% |
| 10.0% Δp: -6.895% |
| 5.0% Δp: -12.449% |
| 1.0% Δp: -30.951% |
| 0.1% Δp: -71.092% |
| Minimum Δp: -99.867% |
| RMS Δp : 8.800 ± 0.108 % |
| Same top p: 87.287 ± 0.165 % |
|
|
|
|
