====== Perplexity statistics ======
Mean PPL(Q)                   :  32.557804 ±   0.369351
Mean PPL(base)                :   9.042786 ±   0.071503
Cor(ln(PPL(Q)), ln(PPL(base))):  80.53%
Mean ln(PPL(Q)/PPL(base))     :   1.281050 ±   0.006837
Mean PPL(Q)/PPL(base)         :   3.600418 ±   0.024617
Mean PPL(Q)-PPL(base)         :  23.515018 ±   0.314640

====== KL divergence statistics ======
Mean    KLD:   1.196823 ±   0.004146
Maximum KLD:  24.545359
99.9%   KLD:  12.464450
99.0%   KLD:   8.054839
99.0%   KLD:   8.054839
Median  KLD:   0.702317
10.0%   KLD:   0.019899
 5.0%   KLD:   0.004923
 1.0%   KLD:   0.000363
Minimum KLD:  -0.000003

====== Token probability statistics ======
Mean    Δp: -6.314 ± 0.076 %
Maximum Δp: 99.585%
99.9%   Δp: 90.128%
99.0%   Δp: 66.718%
95.0%   Δp: 36.821%
90.0%   Δp: 19.531%
75.0%   Δp:  1.614%
Median  Δp: -0.338%
25.0%   Δp: -9.890%
10.0%   Δp: -44.374%
 5.0%   Δp: -73.795%
 1.0%   Δp: -98.369%
 0.1%   Δp: -99.991%
Minimum Δp: -100.000%
RMS Δp    : 29.810 ± 0.088 %
Same top p: 65.550 ± 0.124 %