====== Perplexity statistics ======
Mean PPL(Q)                   :   9.529467 ±   0.067693
Mean PPL(base)                :   9.366577 ±   0.066397
Cor(ln(PPL(Q)), ln(PPL(base))):  99.53%
Mean ln(PPL(Q)/PPL(base))     :   0.017241 ±   0.000692
Mean PPL(Q)/PPL(base)         :   1.017391 ±   0.000704
Mean PPL(Q)-PPL(base)         :   0.162890 ±   0.006661

====== KL divergence statistics ======
Mean    KLD:   0.025429 ±   0.000116
Maximum KLD:   6.250518
99.9%   KLD:   0.457138
99.0%   KLD:   0.169697
99.0%   KLD:   0.169697
Median  KLD:   0.015727
10.0%   KLD:   0.000429
 5.0%   KLD:   0.000085
 1.0%   KLD:   0.000006
Minimum KLD:  -0.000044

====== Token probability statistics ======
Mean    Δp: -0.378 ± 0.011 %
Maximum Δp: 64.248%
99.9%   Δp: 23.260%
99.0%   Δp: 11.368%
95.0%   Δp:  5.279%
90.0%   Δp:  2.904%
75.0%   Δp:  0.455%
Median  Δp: -0.010%
25.0%   Δp: -1.037%
10.0%   Δp: -4.112%
 5.0%   Δp: -6.788%
 1.0%   Δp: -14.402%
 0.1%   Δp: -30.405%
Minimum Δp: -91.281%
RMS Δp    :  4.191 ± 0.026 %
Same top p: 91.792 ± 0.071 %