====== Perplexity statistics ======
Mean PPL(Q)                   :   9.827809 ±   0.071236
Mean PPL(base)                :   9.366577 ±   0.066397
Cor(ln(PPL(Q)), ln(PPL(base))):  98.97%
Mean ln(PPL(Q)/PPL(base))     :   0.048068 ±   0.001042
Mean PPL(Q)/PPL(base)         :   1.049242 ±   0.001093
Mean PPL(Q)-PPL(base)         :   0.461232 ±   0.011000

====== KL divergence statistics ======
Mean    KLD:   0.059970 ±   0.000226
Maximum KLD:   5.830572
99.9%   KLD:   0.899464
99.0%   KLD:   0.388867
99.0%   KLD:   0.388867
Median  KLD:   0.039933
10.0%   KLD:   0.000901
 5.0%   KLD:   0.000182
 1.0%   KLD:   0.000013
Minimum KLD:  -0.000098

====== Token probability statistics ======
Mean    Δp: -0.217 ± 0.017 %
Maximum Δp: 90.326%
99.9%   Δp: 34.151%
99.0%   Δp: 18.912%
95.0%   Δp:  9.734%
90.0%   Δp:  5.703%
75.0%   Δp:  1.068%
Median  Δp: -0.002%
25.0%   Δp: -1.292%
10.0%   Δp: -6.110%
 5.0%   Δp: -10.513%
 1.0%   Δp: -22.188%
 0.1%   Δp: -43.583%
Minimum Δp: -81.978%
RMS Δp    :  6.574 ± 0.032 %
Same top p: 87.097 ± 0.087 %