====== Perplexity statistics ======
Mean PPL(Q)                   :  33.537202 ±   0.371564
Mean PPL(base)                :   9.042786 ±   0.071503
Cor(ln(PPL(Q)), ln(PPL(base))):  79.10%
Mean ln(PPL(Q)/PPL(base))     :   1.310688 ±   0.006832
Mean PPL(Q)/PPL(base)         :   3.708725 ±   0.025338
Mean PPL(Q)-PPL(base)         :  24.494416 ±   0.318026

====== KL divergence statistics ======
Mean    KLD:   1.263077 ±   0.004253
Maximum KLD:  23.683029
99.9%   KLD:  12.829600
99.0%   KLD:   8.069357
99.0%   KLD:   8.069357
Median  KLD:   0.755642
10.0%   KLD:   0.018898
 5.0%   KLD:   0.004577
 1.0%   KLD:   0.000375
Minimum KLD:  -0.000003

====== Token probability statistics ======
Mean    Δp: -8.200 ± 0.078 %
Maximum Δp: 99.800%
99.9%   Δp: 90.394%
99.0%   Δp: 66.393%
95.0%   Δp: 34.806%
90.0%   Δp: 16.907%
75.0%   Δp:  0.806%
Median  Δp: -0.550%
25.0%   Δp: -12.684%
10.0%   Δp: -50.926%
 5.0%   Δp: -77.962%
 1.0%   Δp: -98.305%
 0.1%   Δp: -99.990%
Minimum Δp: -100.000%
RMS Δp    : 31.084 ± 0.088 %
Same top p: 62.253 ± 0.126 %