====== Perplexity statistics ======
Mean PPL(Q)                   :  31.219358 ±   0.342580
Mean PPL(base)                :   9.042786 ±   0.071503
Cor(ln(PPL(Q)), ln(PPL(base))):  80.83%
Mean ln(PPL(Q)/PPL(base))     :   1.239071 ±   0.006532
Mean PPL(Q)/PPL(base)         :   3.452405 ±   0.022552
Mean PPL(Q)-PPL(base)         :  22.176573 ±   0.287880

====== KL divergence statistics ======
Mean    KLD:   1.106608 ±   0.003932
Maximum KLD:  20.797123
99.9%   KLD:  12.310450
99.0%   KLD:   7.690277
99.0%   KLD:   7.690277
Median  KLD:   0.642402
10.0%   KLD:   0.017366
 5.0%   KLD:   0.004376
 1.0%   KLD:   0.000366
Minimum KLD:  -0.000003

====== Token probability statistics ======
Mean    Δp: -7.494 ± 0.075 %
Maximum Δp: 99.726%
99.9%   Δp: 87.733%
99.0%   Δp: 63.430%
95.0%   Δp: 33.085%
90.0%   Δp: 16.533%
75.0%   Δp:  0.946%
Median  Δp: -0.461%
25.0%   Δp: -11.162%
10.0%   Δp: -47.083%
 5.0%   Δp: -74.484%
 1.0%   Δp: -98.197%
 0.1%   Δp: -99.992%
Minimum Δp: -100.000%
RMS Δp    : 29.739 ± 0.088 %
Same top p: 65.218 ± 0.124 %