| 0.00.042.882 I common_init_result: fitting params to device memory ... |
| 0.00.042.887 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) |
| 0.00.541.611 W llama_model_loader: direct I/O is enabled, disabling mmap |
| 0.22.255.822 W llama_context: n_ctx_seq (2048) < n_ctx_train (262144) -- the full capacity of the model will not be utilized |
| 0.22.359.058 W common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) |
| 0.22.643.059 I |
| 0.22.643.196 I system_info: n_threads = 16 (n_threads_batch = 16) / 32 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | FA_ALL_QUANTS = 1 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | |
| 0.22.776.319 I kl_divergence: computing over 40 chunks, n_ctx=2048, batch_size=2048, n_seq=1 |
| 0.25.307.079 I kl_divergence: 2.53 seconds per pass - ETA 1.68 minutes |
|
|
| chunk PPL ln(PPL(Q)/PPL(base)) KL Divergence Δp RMS Same top p |
| 1 6.2617 ± 0.5005 0.09513 ± 0.01958 0.13331 ± 0.00723 11.273 ± 0.670 % 85.728 ± 1.094 % |
| 2 7.1013 ± 0.3976 0.06343 ± 0.01246 0.11005 ± 0.00427 9.422 ± 0.440 % 86.413 ± 0.758 % |
| 3 7.5058 ± 0.3468 0.06527 ± 0.01057 0.11313 ± 0.00423 9.250 ± 0.346 % 86.022 ± 0.626 % |
| 4 7.7849 ± 0.3204 0.06605 ± 0.00908 0.11249 ± 0.00383 9.264 ± 0.306 % 86.388 ± 0.536 % |
| 5 7.5801 ± 0.2810 0.05952 ± 0.00798 0.11043 ± 0.00322 9.087 ± 0.266 % 86.725 ± 0.474 % |
| 6 6.5014 ± 0.2131 0.05596 ± 0.00724 0.11026 ± 0.00320 9.619 ± 0.279 % 87.178 ± 0.427 % |
| 7 6.0313 ± 0.1806 0.04953 ± 0.00696 0.12172 ± 0.00436 10.069 ± 0.275 % 87.236 ± 0.394 % |
| 8 5.9472 ± 0.1655 0.04783 ± 0.00647 0.12058 ± 0.00391 9.949 ± 0.252 % 87.121 ± 0.370 % |
| 9 6.2446 ± 0.1643 0.04408 ± 0.00605 0.12012 ± 0.00353 9.791 ± 0.233 % 86.597 ± 0.355 % |
| 10 6.3764 ± 0.1603 0.04654 ± 0.00565 0.11624 ± 0.00321 9.609 ± 0.217 % 86.588 ± 0.337 % |
| 11 6.4374 ± 0.1538 0.04726 ± 0.00530 0.11268 ± 0.00294 9.442 ± 0.204 % 86.484 ± 0.322 % |
| 12 6.6950 ± 0.1547 0.04816 ± 0.00499 0.10924 ± 0.00271 9.238 ± 0.193 % 86.388 ± 0.310 % |
| 13 6.7262 ± 0.1490 0.04592 ± 0.00474 0.10773 ± 0.00253 9.174 ± 0.183 % 86.413 ± 0.297 % |
| 14 6.7857 ± 0.1447 0.04595 ± 0.00454 0.10583 ± 0.00237 9.050 ± 0.174 % 86.426 ± 0.286 % |
| 15 6.8279 ± 0.1408 0.04594 ± 0.00437 0.10522 ± 0.00224 9.021 ± 0.166 % 86.419 ± 0.277 % |
| 16 6.9800 ± 0.1394 0.04125 ± 0.00424 0.10488 ± 0.00213 8.960 ± 0.160 % 86.339 ± 0.268 % |
| 17 7.0246 ± 0.1356 0.04064 ± 0.00408 0.10348 ± 0.00202 8.863 ± 0.153 % 86.424 ± 0.260 % |
| 18 7.1128 ± 0.1335 0.03994 ± 0.00395 0.10297 ± 0.00192 8.819 ± 0.147 % 86.385 ± 0.253 % |
| 19 7.0597 ± 0.1294 0.03935 ± 0.00383 0.10135 ± 0.00184 8.726 ± 0.143 % 86.474 ± 0.245 % |
| 20 6.7990 ± 0.1207 0.04105 ± 0.00383 0.10693 ± 0.00185 9.139 ± 0.143 % 86.393 ± 0.240 % |
| 21 6.8267 ± 0.1182 0.04262 ± 0.00375 0.10765 ± 0.00179 9.144 ± 0.139 % 86.375 ± 0.234 % |
| 22 6.8456 ± 0.1159 0.04339 ± 0.00369 0.10893 ± 0.00181 9.184 ± 0.137 % 86.417 ± 0.228 % |
| 23 6.9000 ± 0.1143 0.04390 ± 0.00360 0.10839 ± 0.00175 9.147 ± 0.133 % 86.383 ± 0.224 % |
| 24 6.8942 ± 0.1115 0.04302 ± 0.00351 0.10851 ± 0.00171 9.165 ± 0.132 % 86.376 ± 0.219 % |
| 25 6.9297 ± 0.1099 0.04345 ± 0.00344 0.10819 ± 0.00165 9.128 ± 0.128 % 86.334 ± 0.215 % |
| 26 6.8989 ± 0.1072 0.04347 ± 0.00338 0.10899 ± 0.00166 9.185 ± 0.127 % 86.371 ± 0.210 % |
| 27 7.0668 ± 0.1084 0.04318 ± 0.00330 0.10805 ± 0.00160 9.103 ± 0.124 % 86.384 ± 0.206 % |
| 28 7.1505 ± 0.1080 0.04210 ± 0.00321 0.10685 ± 0.00155 9.028 ± 0.122 % 86.395 ± 0.203 % |
| 29 7.1560 ± 0.1063 0.04372 ± 0.00317 0.10671 ± 0.00152 9.048 ± 0.120 % 86.392 ± 0.199 % |
| 30 7.0985 ± 0.1034 0.04365 ± 0.00312 0.10649 ± 0.00148 9.044 ± 0.118 % 86.341 ± 0.196 % |
| 31 6.9900 ± 0.0998 0.04276 ± 0.00305 0.10563 ± 0.00144 9.018 ± 0.116 % 86.444 ± 0.192 % |
| 32 6.8747 ± 0.0965 0.04039 ± 0.00305 0.10917 ± 0.00170 9.201 ± 0.119 % 86.416 ± 0.189 % |
| 33 6.8130 ± 0.0939 0.04125 ± 0.00301 0.10876 ± 0.00166 9.199 ± 0.117 % 86.457 ± 0.186 % |
| 34 6.7927 ± 0.0920 0.04044 ± 0.00294 0.10768 ± 0.00161 9.128 ± 0.115 % 86.441 ± 0.184 % |
| 35 6.8056 ± 0.0909 0.04054 ± 0.00288 0.10692 ± 0.00157 9.083 ± 0.113 % 86.494 ± 0.181 % |
| 36 6.8222 ± 0.0899 0.04049 ± 0.00284 0.10659 ± 0.00154 9.060 ± 0.111 % 86.546 ± 0.178 % |
| 37 6.7263 ± 0.0872 0.04013 ± 0.00279 0.10571 ± 0.00150 9.033 ± 0.109 % 86.566 ± 0.175 % |
| 38 6.6472 ± 0.0847 0.03882 ± 0.00275 0.10525 ± 0.00147 9.020 ± 0.107 % 86.621 ± 0.173 % |
| 39 6.5675 ± 0.0823 0.03909 ± 0.00271 0.10501 ± 0.00144 9.022 ± 0.106 % 86.638 ± 0.170 % |
| 40 6.4740 ± 0.0798 0.03858 ± 0.00267 0.10444 ± 0.00141 9.028 ± 0.105 % 86.659 ± 0.168 % |
|
|
| ====== Perplexity statistics ====== |
| Mean PPL(Q) : 6.473964 ± 0.079799 |
| Mean PPL(base) : 6.228979 ± 0.075322 |
| Cor(ln(PPL(Q)), ln(PPL(base))): 97.63% |
| Mean ln(PPL(Q)/PPL(base)) : 0.038576 ± 0.002667 |
| Mean PPL(Q)/PPL(base) : 1.039330 ± 0.002772 |
| Mean PPL(Q)-PPL(base) : 0.244985 ± 0.017453 |
|
|
| ====== KL divergence statistics ====== |
| Mean KLD: 0.104436 ± 0.001413 |
| Maximum KLD: 13.909879 |
| 99.9% KLD: 3.189192 |
| 99.0% KLD: 0.926687 |
| 95.0% KLD: 0.354656 |
| 90.0% KLD: 0.225739 |
| Median KLD: 0.047702 |
| 10.0% KLD: 0.000698 |
| 5.0% KLD: 0.000183 |
| 1.0% KLD: -0.000033 |
| 0.1% KLD: -0.000321 |
| Minimum KLD: -0.000718 |
|
|
| ====== Token probability statistics ====== |
| Mean Δp: -0.244 ± 0.045 % |
| Maximum Δp: 99.706% |
| 99.9% Δp: 59.493% |
| 99.0% Δp: 25.100% |
| 95.0% Δp: 11.707% |
| 90.0% Δp: 6.963% |
| 75.0% Δp: 1.453% |
| Median Δp: -0.001% |
| 25.0% Δp: -1.479% |
| 10.0% Δp: -7.240% |
| 5.0% Δp: -12.992% |
| 1.0% Δp: -31.268% |
| 0.1% Δp: -68.467% |
| Minimum Δp: -98.412% |
| RMS Δp : 9.028 ± 0.105 % |
| Same top p: 86.659 ± 0.168 % |
|
|
|
|
