| 0.00.061.730 I common_init_result: fitting params to device memory ... |
| 0.00.061.734 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) |
| 0.00.418.389 W llama_model_loader: direct I/O is enabled, disabling mmap |
| 0.21.286.189 W llama_context: n_ctx_seq (2048) < n_ctx_train (262144) -- the full capacity of the model will not be utilized |
| 0.21.331.409 W common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) |
| 0.21.529.206 I |
| 0.21.529.313 I system_info: n_threads = 16 (n_threads_batch = 16) / 32 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | FA_ALL_QUANTS = 1 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | |
| 0.21.655.658 I kl_divergence: computing over 40 chunks, n_ctx=2048, batch_size=2048, n_seq=1 |
| 0.23.558.651 I kl_divergence: 1.90 seconds per pass - ETA 1.27 minutes |
|
|
| chunk PPL ln(PPL(Q)/PPL(base)) KL Divergence Δp RMS Same top p |
| 1 5.7279 ± 0.4388 0.00602 ± 0.01614 0.10315 ± 0.00583 9.735 ± 0.571 % 85.924 ± 1.088 % |
| 2 6.7923 ± 0.3712 0.01894 ± 0.01065 0.08743 ± 0.00335 8.343 ± 0.375 % 86.413 ± 0.758 % |
| 3 7.2151 ± 0.3282 0.02577 ± 0.00843 0.08904 ± 0.00386 8.063 ± 0.325 % 86.999 ± 0.607 % |
| 4 7.4647 ± 0.3021 0.02405 ± 0.00738 0.09108 ± 0.00535 8.270 ± 0.318 % 87.634 ± 0.515 % |
| 5 7.3108 ± 0.2664 0.02334 ± 0.00659 0.08904 ± 0.00437 8.208 ± 0.278 % 87.801 ± 0.458 % |
| 6 6.2917 ± 0.2025 0.02318 ± 0.00607 0.08932 ± 0.00383 8.727 ± 0.274 % 88.237 ± 0.411 % |
| 7 5.8298 ± 0.1710 0.01556 ± 0.00599 0.09705 ± 0.00425 9.211 ± 0.278 % 88.242 ± 0.381 % |
| 8 5.7710 ± 0.1572 0.01775 ± 0.00555 0.09614 ± 0.00379 9.187 ± 0.255 % 88.038 ± 0.359 % |
| 9 6.0701 ± 0.1567 0.01574 ± 0.00523 0.09667 ± 0.00342 9.059 ± 0.236 % 87.553 ± 0.344 % |
| 10 6.1910 ± 0.1528 0.01702 ± 0.00487 0.09332 ± 0.00310 8.829 ± 0.220 % 87.625 ± 0.326 % |
| 11 6.2600 ± 0.1469 0.01931 ± 0.00460 0.09110 ± 0.00284 8.756 ± 0.210 % 87.630 ± 0.310 % |
| 12 6.5141 ± 0.1478 0.02077 ± 0.00433 0.08827 ± 0.00261 8.573 ± 0.198 % 87.569 ± 0.298 % |
| 13 6.5510 ± 0.1424 0.01954 ± 0.00414 0.08704 ± 0.00243 8.533 ± 0.188 % 87.533 ± 0.286 % |
| 14 6.6159 ± 0.1386 0.02062 ± 0.00397 0.08562 ± 0.00227 8.395 ± 0.178 % 87.565 ± 0.276 % |
| 15 6.6597 ± 0.1349 0.02101 ± 0.00382 0.08498 ± 0.00213 8.353 ± 0.170 % 87.481 ± 0.267 % |
| 16 6.8126 ± 0.1337 0.01697 ± 0.00370 0.08434 ± 0.00203 8.278 ± 0.164 % 87.390 ± 0.259 % |
| 17 6.8618 ± 0.1303 0.01721 ± 0.00357 0.08322 ± 0.00192 8.183 ± 0.157 % 87.511 ± 0.251 % |
| 18 6.9534 ± 0.1285 0.01728 ± 0.00345 0.08273 ± 0.00182 8.130 ± 0.150 % 87.471 ± 0.244 % |
| 19 6.9010 ± 0.1245 0.01662 ± 0.00334 0.08204 ± 0.00175 8.059 ± 0.147 % 87.508 ± 0.237 % |
| 20 6.6434 ± 0.1160 0.01790 ± 0.00333 0.08651 ± 0.00173 8.357 ± 0.142 % 87.454 ± 0.232 % |
| 21 6.6543 ± 0.1132 0.01704 ± 0.00325 0.08675 ± 0.00166 8.313 ± 0.137 % 87.399 ± 0.226 % |
| 22 6.6714 ± 0.1109 0.01762 ± 0.00322 0.08786 ± 0.00171 8.337 ± 0.136 % 87.412 ± 0.221 % |
| 23 6.7286 ± 0.1095 0.01874 ± 0.00316 0.08790 ± 0.00167 8.321 ± 0.134 % 87.390 ± 0.216 % |
| 24 6.7323 ± 0.1070 0.01926 ± 0.00310 0.08781 ± 0.00164 8.305 ± 0.133 % 87.447 ± 0.211 % |
| 25 6.7692 ± 0.1055 0.02001 ± 0.00302 0.08721 ± 0.00158 8.253 ± 0.129 % 87.457 ± 0.207 % |
| 26 6.7420 ± 0.1029 0.02046 ± 0.00296 0.08758 ± 0.00155 8.276 ± 0.128 % 87.522 ± 0.203 % |
| 27 6.9087 ± 0.1041 0.02056 ± 0.00290 0.08699 ± 0.00151 8.214 ± 0.125 % 87.520 ± 0.199 % |
| 28 6.9975 ± 0.1039 0.02047 ± 0.00285 0.08640 ± 0.00147 8.197 ± 0.124 % 87.558 ± 0.195 % |
| 29 6.9967 ± 0.1020 0.02121 ± 0.00280 0.08643 ± 0.00144 8.249 ± 0.123 % 87.538 ± 0.192 % |
| 30 6.9524 ± 0.0996 0.02286 ± 0.00276 0.08671 ± 0.00140 8.260 ± 0.120 % 87.511 ± 0.189 % |
| 31 6.8530 ± 0.0962 0.02296 ± 0.00270 0.08616 ± 0.00136 8.244 ± 0.118 % 87.623 ± 0.185 % |
| 32 6.7437 ± 0.0931 0.02116 ± 0.00271 0.08891 ± 0.00158 8.411 ± 0.120 % 87.628 ± 0.182 % |
| 33 6.6801 ± 0.0905 0.02156 ± 0.00266 0.08849 ± 0.00154 8.418 ± 0.119 % 87.666 ± 0.179 % |
| 34 6.6705 ± 0.0889 0.02230 ± 0.00261 0.08778 ± 0.00150 8.378 ± 0.117 % 87.715 ± 0.176 % |
| 35 6.6811 ± 0.0878 0.02207 ± 0.00255 0.08711 ± 0.00147 8.332 ± 0.115 % 87.792 ± 0.173 % |
| 36 6.6976 ± 0.0869 0.02206 ± 0.00252 0.08700 ± 0.00143 8.296 ± 0.113 % 87.814 ± 0.170 % |
| 37 6.6017 ± 0.0842 0.02143 ± 0.00248 0.08616 ± 0.00140 8.262 ± 0.111 % 87.823 ± 0.168 % |
| 38 6.5268 ± 0.0818 0.02054 ± 0.00245 0.08605 ± 0.00137 8.265 ± 0.109 % 87.853 ± 0.166 % |
| 39 6.4448 ± 0.0795 0.02022 ± 0.00241 0.08583 ± 0.00134 8.292 ± 0.107 % 87.829 ± 0.164 % |
| 40 6.3536 ± 0.0770 0.01981 ± 0.00238 0.08516 ± 0.00131 8.281 ± 0.106 % 87.849 ± 0.162 % |
|
|
| ====== Perplexity statistics ====== |
| Mean PPL(Q) : 6.353616 ± 0.077001 |
| Mean PPL(base) : 6.228979 ± 0.075322 |
| Cor(ln(PPL(Q)), ln(PPL(base))): 98.08% |
| Mean ln(PPL(Q)/PPL(base)) : 0.019812 ± 0.002375 |
| Mean PPL(Q)/PPL(base) : 1.020009 ± 0.002423 |
| Mean PPL(Q)-PPL(base) : 0.124637 ± 0.015034 |
|
|
| ====== KL divergence statistics ====== |
| Mean KLD: 0.085158 ± 0.001309 |
| Maximum KLD: 16.350994 |
| 99.9% KLD: 2.569785 |
| 99.0% KLD: 0.737186 |
| 95.0% KLD: 0.287234 |
| 90.0% KLD: 0.182120 |
| Median KLD: 0.038436 |
| 10.0% KLD: 0.000529 |
| 5.0% KLD: 0.000132 |
| 1.0% KLD: -0.000040 |
| 0.1% KLD: -0.000280 |
| Minimum KLD: -0.000917 |
|
|
| ====== Token probability statistics ====== |
| Mean Δp: -0.453 ± 0.041 % |
| Maximum Δp: 99.545% |
| 99.9% Δp: 55.136% |
| 99.0% Δp: 23.249% |
| 95.0% Δp: 9.945% |
| 90.0% Δp: 5.745% |
| 75.0% Δp: 0.987% |
| Median Δp: -0.006% |
| 25.0% Δp: -1.591% |
| 10.0% Δp: -7.009% |
| 5.0% Δp: -11.986% |
| 1.0% Δp: -27.836% |
| 0.1% Δp: -65.986% |
| Minimum Δp: -99.892% |
| RMS Δp : 8.281 ± 0.106 % |
| Same top p: 87.849 ± 0.162 % |
|
|
|
|
