====== Perplexity statistics ======
Mean PPL(Q)                   :   9.942560 ±   0.071243
Mean PPL(base)                :   9.366577 ±   0.066397
Cor(ln(PPL(Q)), ln(PPL(base))):  98.64%
Mean ln(PPL(Q)/PPL(base))     :   0.059677 ±   0.001178
Mean PPL(Q)/PPL(base)         :   1.061493 ±   0.001251
Mean PPL(Q)-PPL(base)         :   0.575982 ±   0.012339

====== KL divergence statistics ======
Mean    KLD:   0.079935 ±   0.000289
Maximum KLD:   5.765717
99.9%   KLD:   1.150883
99.0%   KLD:   0.493128
99.0%   KLD:   0.493128
Median  KLD:   0.053589
10.0%   KLD:   0.001480
 5.0%   KLD:   0.000323
 1.0%   KLD:   0.000027
Minimum KLD:  -0.000038

====== Token probability statistics ======
Mean    Δp: -0.885 ± 0.019 %
Maximum Δp: 91.523%
99.9%   Δp: 34.667%
99.0%   Δp: 19.093%
95.0%   Δp:  9.310%
90.0%   Δp:  5.250%
75.0%   Δp:  0.738%
Median  Δp: -0.033%
25.0%   Δp: -2.046%
10.0%   Δp: -7.921%
 5.0%   Δp: -13.116%
 1.0%   Δp: -26.866%
 0.1%   Δp: -52.295%
Minimum Δp: -90.266%
RMS Δp    :  7.445 ± 0.038 %
Same top p: 85.475 ± 0.091 %