====== Perplexity statistics ======
Mean PPL(Q)                   :  34.029948 ±   0.376082
Mean PPL(base)                :   9.042786 ±   0.071503
Cor(ln(PPL(Q)), ln(PPL(base))):  78.62%
Mean ln(PPL(Q)/PPL(base))     :   1.325274 ±   0.006875
Mean PPL(Q)/PPL(base)         :   3.763215 ±   0.025870
Mean PPL(Q)-PPL(base)         :  24.987163 ±   0.322907

====== KL divergence statistics ======
Mean    KLD:   1.300974 ±   0.004321
Maximum KLD:  23.795326
99.9%   KLD:  12.854443
99.0%   KLD:   8.215378
99.0%   KLD:   8.215378
Median  KLD:   0.782525
10.0%   KLD:   0.019878
 5.0%   KLD:   0.004841
 1.0%   KLD:   0.000391
Minimum KLD:  -0.000001

====== Token probability statistics ======
Mean    Δp: -8.606 ± 0.079 %
Maximum Δp: 99.896%
99.9%   Δp: 91.072%
99.0%   Δp: 67.090%
95.0%   Δp: 34.759%
90.0%   Δp: 16.501%
75.0%   Δp:  0.726%
Median  Δp: -0.601%
25.0%   Δp: -13.523%
10.0%   Δp: -52.748%
 5.0%   Δp: -79.067%
 1.0%   Δp: -98.555%
 0.1%   Δp: -99.990%
Minimum Δp: -100.000%
RMS Δp    : 31.537 ± 0.088 %
Same top p: 61.420 ± 0.127 %