File size: 7,563 Bytes
27a5002 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 | 0.00.042.882 I common_init_result: fitting params to device memory ...
0.00.042.887 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
0.00.541.611 W llama_model_loader: direct I/O is enabled, disabling mmap
0.22.255.822 W llama_context: n_ctx_seq (2048) < n_ctx_train (262144) -- the full capacity of the model will not be utilized
0.22.359.058 W common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
0.22.643.059 I
0.22.643.196 I system_info: n_threads = 16 (n_threads_batch = 16) / 32 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | FA_ALL_QUANTS = 1 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
0.22.776.319 I kl_divergence: computing over 40 chunks, n_ctx=2048, batch_size=2048, n_seq=1
0.25.307.079 I kl_divergence: 2.53 seconds per pass - ETA 1.68 minutes
chunk PPL ln(PPL(Q)/PPL(base)) KL Divergence Δp RMS Same top p
1 6.2617 ± 0.5005 0.09513 ± 0.01958 0.13331 ± 0.00723 11.273 ± 0.670 % 85.728 ± 1.094 %
2 7.1013 ± 0.3976 0.06343 ± 0.01246 0.11005 ± 0.00427 9.422 ± 0.440 % 86.413 ± 0.758 %
3 7.5058 ± 0.3468 0.06527 ± 0.01057 0.11313 ± 0.00423 9.250 ± 0.346 % 86.022 ± 0.626 %
4 7.7849 ± 0.3204 0.06605 ± 0.00908 0.11249 ± 0.00383 9.264 ± 0.306 % 86.388 ± 0.536 %
5 7.5801 ± 0.2810 0.05952 ± 0.00798 0.11043 ± 0.00322 9.087 ± 0.266 % 86.725 ± 0.474 %
6 6.5014 ± 0.2131 0.05596 ± 0.00724 0.11026 ± 0.00320 9.619 ± 0.279 % 87.178 ± 0.427 %
7 6.0313 ± 0.1806 0.04953 ± 0.00696 0.12172 ± 0.00436 10.069 ± 0.275 % 87.236 ± 0.394 %
8 5.9472 ± 0.1655 0.04783 ± 0.00647 0.12058 ± 0.00391 9.949 ± 0.252 % 87.121 ± 0.370 %
9 6.2446 ± 0.1643 0.04408 ± 0.00605 0.12012 ± 0.00353 9.791 ± 0.233 % 86.597 ± 0.355 %
10 6.3764 ± 0.1603 0.04654 ± 0.00565 0.11624 ± 0.00321 9.609 ± 0.217 % 86.588 ± 0.337 %
11 6.4374 ± 0.1538 0.04726 ± 0.00530 0.11268 ± 0.00294 9.442 ± 0.204 % 86.484 ± 0.322 %
12 6.6950 ± 0.1547 0.04816 ± 0.00499 0.10924 ± 0.00271 9.238 ± 0.193 % 86.388 ± 0.310 %
13 6.7262 ± 0.1490 0.04592 ± 0.00474 0.10773 ± 0.00253 9.174 ± 0.183 % 86.413 ± 0.297 %
14 6.7857 ± 0.1447 0.04595 ± 0.00454 0.10583 ± 0.00237 9.050 ± 0.174 % 86.426 ± 0.286 %
15 6.8279 ± 0.1408 0.04594 ± 0.00437 0.10522 ± 0.00224 9.021 ± 0.166 % 86.419 ± 0.277 %
16 6.9800 ± 0.1394 0.04125 ± 0.00424 0.10488 ± 0.00213 8.960 ± 0.160 % 86.339 ± 0.268 %
17 7.0246 ± 0.1356 0.04064 ± 0.00408 0.10348 ± 0.00202 8.863 ± 0.153 % 86.424 ± 0.260 %
18 7.1128 ± 0.1335 0.03994 ± 0.00395 0.10297 ± 0.00192 8.819 ± 0.147 % 86.385 ± 0.253 %
19 7.0597 ± 0.1294 0.03935 ± 0.00383 0.10135 ± 0.00184 8.726 ± 0.143 % 86.474 ± 0.245 %
20 6.7990 ± 0.1207 0.04105 ± 0.00383 0.10693 ± 0.00185 9.139 ± 0.143 % 86.393 ± 0.240 %
21 6.8267 ± 0.1182 0.04262 ± 0.00375 0.10765 ± 0.00179 9.144 ± 0.139 % 86.375 ± 0.234 %
22 6.8456 ± 0.1159 0.04339 ± 0.00369 0.10893 ± 0.00181 9.184 ± 0.137 % 86.417 ± 0.228 %
23 6.9000 ± 0.1143 0.04390 ± 0.00360 0.10839 ± 0.00175 9.147 ± 0.133 % 86.383 ± 0.224 %
24 6.8942 ± 0.1115 0.04302 ± 0.00351 0.10851 ± 0.00171 9.165 ± 0.132 % 86.376 ± 0.219 %
25 6.9297 ± 0.1099 0.04345 ± 0.00344 0.10819 ± 0.00165 9.128 ± 0.128 % 86.334 ± 0.215 %
26 6.8989 ± 0.1072 0.04347 ± 0.00338 0.10899 ± 0.00166 9.185 ± 0.127 % 86.371 ± 0.210 %
27 7.0668 ± 0.1084 0.04318 ± 0.00330 0.10805 ± 0.00160 9.103 ± 0.124 % 86.384 ± 0.206 %
28 7.1505 ± 0.1080 0.04210 ± 0.00321 0.10685 ± 0.00155 9.028 ± 0.122 % 86.395 ± 0.203 %
29 7.1560 ± 0.1063 0.04372 ± 0.00317 0.10671 ± 0.00152 9.048 ± 0.120 % 86.392 ± 0.199 %
30 7.0985 ± 0.1034 0.04365 ± 0.00312 0.10649 ± 0.00148 9.044 ± 0.118 % 86.341 ± 0.196 %
31 6.9900 ± 0.0998 0.04276 ± 0.00305 0.10563 ± 0.00144 9.018 ± 0.116 % 86.444 ± 0.192 %
32 6.8747 ± 0.0965 0.04039 ± 0.00305 0.10917 ± 0.00170 9.201 ± 0.119 % 86.416 ± 0.189 %
33 6.8130 ± 0.0939 0.04125 ± 0.00301 0.10876 ± 0.00166 9.199 ± 0.117 % 86.457 ± 0.186 %
34 6.7927 ± 0.0920 0.04044 ± 0.00294 0.10768 ± 0.00161 9.128 ± 0.115 % 86.441 ± 0.184 %
35 6.8056 ± 0.0909 0.04054 ± 0.00288 0.10692 ± 0.00157 9.083 ± 0.113 % 86.494 ± 0.181 %
36 6.8222 ± 0.0899 0.04049 ± 0.00284 0.10659 ± 0.00154 9.060 ± 0.111 % 86.546 ± 0.178 %
37 6.7263 ± 0.0872 0.04013 ± 0.00279 0.10571 ± 0.00150 9.033 ± 0.109 % 86.566 ± 0.175 %
38 6.6472 ± 0.0847 0.03882 ± 0.00275 0.10525 ± 0.00147 9.020 ± 0.107 % 86.621 ± 0.173 %
39 6.5675 ± 0.0823 0.03909 ± 0.00271 0.10501 ± 0.00144 9.022 ± 0.106 % 86.638 ± 0.170 %
40 6.4740 ± 0.0798 0.03858 ± 0.00267 0.10444 ± 0.00141 9.028 ± 0.105 % 86.659 ± 0.168 %
====== Perplexity statistics ======
Mean PPL(Q) : 6.473964 ± 0.079799
Mean PPL(base) : 6.228979 ± 0.075322
Cor(ln(PPL(Q)), ln(PPL(base))): 97.63%
Mean ln(PPL(Q)/PPL(base)) : 0.038576 ± 0.002667
Mean PPL(Q)/PPL(base) : 1.039330 ± 0.002772
Mean PPL(Q)-PPL(base) : 0.244985 ± 0.017453
====== KL divergence statistics ======
Mean KLD: 0.104436 ± 0.001413
Maximum KLD: 13.909879
99.9% KLD: 3.189192
99.0% KLD: 0.926687
95.0% KLD: 0.354656
90.0% KLD: 0.225739
Median KLD: 0.047702
10.0% KLD: 0.000698
5.0% KLD: 0.000183
1.0% KLD: -0.000033
0.1% KLD: -0.000321
Minimum KLD: -0.000718
====== Token probability statistics ======
Mean Δp: -0.244 ± 0.045 %
Maximum Δp: 99.706%
99.9% Δp: 59.493%
99.0% Δp: 25.100%
95.0% Δp: 11.707%
90.0% Δp: 6.963%
75.0% Δp: 1.453%
Median Δp: -0.001%
25.0% Δp: -1.479%
10.0% Δp: -7.240%
5.0% Δp: -12.992%
1.0% Δp: -31.268%
0.1% Δp: -68.467%
Minimum Δp: -98.412%
RMS Δp : 9.028 ± 0.105 %
Same top p: 86.659 ± 0.168 %
|