====== Perplexity statistics ======
Mean PPL(Q)                   :  14.243482 ±   0.113690
Mean PPL(base)                :  13.052024 ±   0.108483
Cor(ln(PPL(Q)), ln(PPL(base))):  96.12%
Mean ln(PPL(Q)/PPL(base))     :   0.087356 ±   0.002292
Mean PPL(Q)/PPL(base)         :   1.091285 ±   0.002502
Mean PPL(Q)-PPL(base)         :   1.191458 ±   0.031368

====== KL divergence statistics ======
Mean    KLD:   0.240811 ±   0.001175
Maximum KLD:  14.633161
99.9%   KLD:   4.552272
99.0%   KLD:   2.206026
99.0%   KLD:   2.206026
Median  KLD:   0.107760
10.0%   KLD:   0.005211
 5.0%   KLD:   0.001413
 1.0%   KLD:   0.000154
Minimum KLD:  -0.000001

====== Token probability statistics ======
Mean    Δp: -4.129 ± 0.033 %
Maximum Δp: 97.466%
99.9%   Δp: 52.946%
99.0%   Δp: 23.458%
95.0%   Δp:  8.259%
90.0%   Δp:  3.367%
75.0%   Δp:  0.105%
Median  Δp: -0.402%
25.0%   Δp: -5.853%
10.0%   Δp: -17.104%
 5.0%   Δp: -27.264%
 1.0%   Δp: -55.844%
 0.1%   Δp: -87.698%
Minimum Δp: -99.895%
RMS Δp    : 13.331 ± 0.064 %
Same top p: 79.968 ± 0.105 %