====== Perplexity statistics ======
Mean PPL(Q)                   :  30.644285 ±   0.335716
Mean PPL(base)                :   9.042786 ±   0.071503
Cor(ln(PPL(Q)), ln(PPL(base))):  81.62%
Mean ln(PPL(Q)/PPL(base))     :   1.220479 ±   0.006413
Mean PPL(Q)/PPL(base)         :   3.388810 ±   0.021733
Mean PPL(Q)-PPL(base)         :  21.601499 ±   0.280413

====== KL divergence statistics ======
Mean    KLD:   1.038541 ±   0.003836
Maximum KLD:  22.424044
99.9%   KLD:  12.381549
99.0%   KLD:   7.687484
99.0%   KLD:   7.687484
Median  KLD:   0.597444
10.0%   KLD:   0.016928
 5.0%   KLD:   0.004340
 1.0%   KLD:   0.000359
Minimum KLD:  -0.000003

====== Token probability statistics ======
Mean    Δp: -7.203 ± 0.074 %
Maximum Δp: 99.718%
99.9%   Δp: 84.842%
99.0%   Δp: 61.523%
95.0%   Δp: 32.607%
90.0%   Δp: 16.381%
75.0%   Δp:  0.982%
Median  Δp: -0.437%
25.0%   Δp: -10.550%
10.0%   Δp: -45.107%
 5.0%   Δp: -72.871%
 1.0%   Δp: -98.353%
 0.1%   Δp: -99.993%
Minimum Δp: -100.000%
RMS Δp    : 29.119 ± 0.088 %
Same top p: 66.765 ± 0.123 %