====== Perplexity statistics ======
Mean PPL(Q)                   :   9.513981 ±   0.067589
Mean PPL(base)                :   9.366577 ±   0.066397
Cor(ln(PPL(Q)), ln(PPL(base))):  99.56%
Mean ln(PPL(Q)/PPL(base))     :   0.015615 ±   0.000668
Mean PPL(Q)/PPL(base)         :   1.015737 ±   0.000679
Mean PPL(Q)-PPL(base)         :   0.147404 ±   0.006420

====== KL divergence statistics ======
Mean    KLD:   0.023792 ±   0.000107
Maximum KLD:   5.229656
99.9%   KLD:   0.422463
99.0%   KLD:   0.159748
99.0%   KLD:   0.159748
Median  KLD:   0.014752
10.0%   KLD:   0.000388
 5.0%   KLD:   0.000078
 1.0%   KLD:   0.000005
Minimum KLD:  -0.000044

====== Token probability statistics ======
Mean    Δp: -0.337 ± 0.010 %
Maximum Δp: 67.097%
99.9%   Δp: 22.363%
99.0%   Δp: 11.173%
95.0%   Δp:  5.170%
90.0%   Δp:  2.864%
75.0%   Δp:  0.466%
Median  Δp: -0.008%
25.0%   Δp: -0.987%
10.0%   Δp: -3.948%
 5.0%   Δp: -6.542%
 1.0%   Δp: -13.717%
 0.1%   Δp: -28.959%
Minimum Δp: -91.120%
RMS Δp    :  4.057 ± 0.026 %
Same top p: 92.039 ± 0.070 %