====== Perplexity statistics ======
Mean PPL(Q)                   :  10.109660 ±   0.072549
Mean PPL(base)                :   9.366577 ±   0.066397
Cor(ln(PPL(Q)), ln(PPL(base))):  98.44%
Mean ln(PPL(Q)/PPL(base))     :   0.076344 ±   0.001263
Mean PPL(Q)/PPL(base)         :   1.079333 ±   0.001363
Mean PPL(Q)-PPL(base)         :   0.743083 ±   0.013719

====== KL divergence statistics ======
Mean    KLD:   0.086444 ±   0.000342
Maximum KLD:   6.291467
99.9%   KLD:   1.404206
99.0%   KLD:   0.571756
99.0%   KLD:   0.571756
Median  KLD:   0.054763
10.0%   KLD:   0.001465
 5.0%   KLD:   0.000315
 1.0%   KLD:   0.000028
Minimum KLD:  -0.000235

====== Token probability statistics ======
Mean    Δp: -1.387 ± 0.020 %
Maximum Δp: 82.526%
99.9%   Δp: 35.574%
99.0%   Δp: 18.394%
95.0%   Δp:  8.338%
90.0%   Δp:  4.407%
75.0%   Δp:  0.508%
Median  Δp: -0.066%
25.0%   Δp: -2.517%
10.0%   Δp: -8.904%
 5.0%   Δp: -14.322%
 1.0%   Δp: -29.340%
 0.1%   Δp: -57.123%
Minimum Δp: -93.887%
RMS Δp    :  7.845 ± 0.041 %
Same top p: 85.114 ± 0.092 %