====== Perplexity statistics ======
Mean PPL(Q)                   :  36.103787 ±   0.402250
Mean PPL(base)                :   9.042786 ±   0.071503
Cor(ln(PPL(Q)), ln(PPL(base))):  77.13%
Mean ln(PPL(Q)/PPL(base))     :   1.384430 ±   0.007124
Mean PPL(Q)/PPL(base)         :   3.992551 ±   0.028445
Mean PPL(Q)-PPL(base)         :  27.061001 ±   0.350072

====== KL divergence statistics ======
Mean    KLD:   1.395578 ±   0.004559
Maximum KLD:  24.088387
99.9%   KLD:  13.768757
99.0%   KLD:   8.603606
99.0%   KLD:   8.603606
Median  KLD:   0.858334
10.0%   KLD:   0.021285
 5.0%   KLD:   0.005174
 1.0%   KLD:   0.000393
Minimum KLD:  -0.000002

====== Token probability statistics ======
Mean    Δp: -9.212 ± 0.080 %
Maximum Δp: 99.844%
99.9%   Δp: 91.248%
99.0%   Δp: 67.876%
95.0%   Δp: 34.787%
90.0%   Δp: 16.139%
75.0%   Δp:  0.593%
Median  Δp: -0.696%
25.0%   Δp: -14.997%
10.0%   Δp: -54.930%
 5.0%   Δp: -79.831%
 1.0%   Δp: -98.568%
 0.1%   Δp: -99.992%
Minimum Δp: -100.000%
RMS Δp    : 32.089 ± 0.088 %
Same top p: 59.830 ± 0.128 %