====== Perplexity statistics ======
Mean PPL(Q)                   :  18.199918 ±   0.142513
Mean PPL(base)                :   6.180577 ±   0.041038
Cor(ln(PPL(Q)), ln(PPL(base))):  75.20%
Mean ln(PPL(Q)/PPL(base))     :   1.080005 ±   0.005216
Mean PPL(Q)/PPL(base)         :   2.944695 ±   0.015358
Mean PPL(Q)-PPL(base)         :  12.019340 ±   0.114880

====== KL divergence statistics ======
Mean    KLD:   1.160040 ±   0.004229
Maximum KLD:  27.444889
99.9%   KLD:  14.604442
99.0%   KLD:   8.763094
99.0%   KLD:   8.763094
Median  KLD:   0.682655
10.0%   KLD:   0.066186
 5.0%   KLD:   0.023837
 1.0%   KLD:   0.004326
Minimum KLD:   0.000148

====== Token probability statistics ======
Mean    Δp: -16.565 ± 0.083 %
Maximum Δp: 94.238%
99.9%   Δp: 72.114%
99.0%   Δp: 47.597%
95.0%   Δp: 23.064%
90.0%   Δp: 10.544%
75.0%   Δp:  0.030%
Median  Δp: -4.020%
25.0%   Δp: -29.497%
10.0%   Δp: -70.424%
 5.0%   Δp: -90.053%
 1.0%   Δp: -99.759%
 0.1%   Δp: -99.965%
Minimum Δp: -99.998%
RMS Δp    : 36.220 ± 0.088 %
Same top p: 64.431 ± 0.123 %