====== Perplexity statistics ======
Mean PPL(Q)                   :   9.585928 ±   0.068060
Mean PPL(base)                :   9.366577 ±   0.066397
Cor(ln(PPL(Q)), ln(PPL(base))):  99.51%
Mean ln(PPL(Q)/PPL(base))     :   0.023148 ±   0.000703
Mean PPL(Q)/PPL(base)         :   1.023418 ±   0.000719
Mean PPL(Q)-PPL(base)         :   0.219350 ±   0.006862

====== KL divergence statistics ======
Mean    KLD:   0.026627 ±   0.000108
Maximum KLD:   2.930657
99.9%   KLD:   0.451824
99.0%   KLD:   0.171826
99.0%   KLD:   0.171826
Median  KLD:   0.017210
10.0%   KLD:   0.000451
 5.0%   KLD:   0.000095
 1.0%   KLD:   0.000007
Minimum KLD:  -0.000060

====== Token probability statistics ======
Mean    Δp: -0.523 ± 0.011 %
Maximum Δp: 54.223%
99.9%   Δp: 22.680%
99.0%   Δp: 11.163%
95.0%   Δp:  5.267%
90.0%   Δp:  2.899%
75.0%   Δp:  0.419%
Median  Δp: -0.014%
25.0%   Δp: -1.188%
10.0%   Δp: -4.623%
 5.0%   Δp: -7.618%
 1.0%   Δp: -15.106%
 0.1%   Δp: -30.059%
Minimum Δp: -89.467%
RMS Δp    :  4.346 ± 0.026 %
Same top p: 91.424 ± 0.073 %