====== Perplexity statistics ======
Mean PPL(Q)                   :   9.411472 ±   0.066924
Mean PPL(base)                :   9.366577 ±   0.066397
Cor(ln(PPL(Q)), ln(PPL(base))):  99.88%
Mean ln(PPL(Q)/PPL(base))     :   0.004782 ±   0.000343
Mean PPL(Q)/PPL(base)         :   1.004793 ±   0.000345
Mean PPL(Q)-PPL(base)         :   0.044894 ±   0.003261

====== KL divergence statistics ======
Mean    KLD:   0.005881 ±   0.000035
Maximum KLD:   2.356096
99.9%   KLD:   0.110341
99.0%   KLD:   0.039253
99.0%   KLD:   0.039253
Median  KLD:   0.003644
10.0%   KLD:   0.000086
 5.0%   KLD:   0.000015
 1.0%   KLD:  -0.000000
Minimum KLD:  -0.000153

====== Token probability statistics ======
Mean    Δp: -0.012 ± 0.005 %
Maximum Δp: 40.226%
99.9%   Δp: 11.947%
99.0%   Δp:  6.009%
95.0%   Δp:  2.947%
90.0%   Δp:  1.726%
75.0%   Δp:  0.356%
Median  Δp: -0.000%
25.0%   Δp: -0.356%
10.0%   Δp: -1.732%
 5.0%   Δp: -2.967%
 1.0%   Δp: -6.302%
 0.1%   Δp: -13.317%
Minimum Δp: -62.412%
RMS Δp    :  2.028 ± 0.015 %
Same top p: 95.904 ± 0.051 %