====== Perplexity statistics ======
Mean PPL(Q)                   :  31.245217 ±   0.343080
Mean PPL(base)                :   9.042786 ±   0.071503
Cor(ln(PPL(Q)), ln(PPL(base))):  80.86%
Mean ln(PPL(Q)/PPL(base))     :   1.239899 ±   0.006533
Mean PPL(Q)/PPL(base)         :   3.455265 ±   0.022573
Mean PPL(Q)-PPL(base)         :  22.202432 ±   0.288349

====== KL divergence statistics ======
Mean    KLD:   1.105266 ±   0.003926
Maximum KLD:  20.987593
99.9%   KLD:  12.310256
99.0%   KLD:   7.698290
99.0%   KLD:   7.698290
Median  KLD:   0.643550
10.0%   KLD:   0.017519
 5.0%   KLD:   0.004389
 1.0%   KLD:   0.000363
Minimum KLD:  -0.000002

====== Token probability statistics ======
Mean    Δp: -7.460 ± 0.075 %
Maximum Δp: 99.266%
99.9%   Δp: 87.347%
99.0%   Δp: 63.610%
95.0%   Δp: 33.077%
90.0%   Δp: 16.572%
75.0%   Δp:  0.938%
Median  Δp: -0.465%
25.0%   Δp: -11.152%
10.0%   Δp: -46.828%
 5.0%   Δp: -74.300%
 1.0%   Δp: -98.187%
 0.1%   Δp: -99.991%
Minimum Δp: -100.000%
RMS Δp    : 29.698 ± 0.088 %
Same top p: 65.245 ± 0.124 %