====== Perplexity statistics ======
Mean PPL(Q)                   :  36.879518 ±   0.436763
Mean PPL(base)                :   9.042786 ±   0.071503
Cor(ln(PPL(Q)), ln(PPL(base))):  80.79%
Mean ln(PPL(Q)/PPL(base))     :   1.405689 ±   0.007174
Mean PPL(Q)/PPL(base)         :   4.078336 ±   0.029260
Mean PPL(Q)-PPL(base)         :  27.836733 ±   0.381333

====== KL divergence statistics ======
Mean    KLD:   1.190922 ±   0.004215
Maximum KLD:  25.421314
99.9%   KLD:  13.739526
99.0%   KLD:   8.520005
99.0%   KLD:   8.520005
Median  KLD:   0.710480
10.0%   KLD:   0.017773
 5.0%   KLD:   0.003969
 1.0%   KLD:   0.000258
Minimum KLD:  -0.000003

====== Token probability statistics ======
Mean    Δp: -6.063 ± 0.075 %
Maximum Δp: 99.690%
99.9%   Δp: 88.494%
99.0%   Δp: 65.535%
95.0%   Δp: 36.662%
90.0%   Δp: 19.570%
75.0%   Δp:  1.644%
Median  Δp: -0.273%
25.0%   Δp: -9.153%
10.0%   Δp: -43.591%
 5.0%   Δp: -73.479%
 1.0%   Δp: -98.555%
 0.1%   Δp: -99.995%
Minimum Δp: -100.000%
RMS Δp    : 29.578 ± 0.088 %
Same top p: 66.655 ± 0.123 %