====== Perplexity statistics ======
Mean PPL(Q)                   :  35.478449 ±   0.411747
Mean PPL(base)                :   9.042786 ±   0.071503
Cor(ln(PPL(Q)), ln(PPL(base))):  80.18%
Mean ln(PPL(Q)/PPL(base))     :   1.366958 ±   0.007075
Mean PPL(Q)/PPL(base)         :   3.923398 ±   0.027759
Mean PPL(Q)-PPL(base)         :  26.435664 ±   0.356985

====== KL divergence statistics ======
Mean    KLD:   1.229937 ±   0.004277
Maximum KLD:  25.876987
99.9%   KLD:  13.510958
99.0%   KLD:   8.435304
99.0%   KLD:   8.435304
Median  KLD:   0.728065
10.0%   KLD:   0.020280
 5.0%   KLD:   0.004677
 1.0%   KLD:   0.000320
Minimum KLD:  -0.000003

====== Token probability statistics ======
Mean    Δp: -6.562 ± 0.077 %
Maximum Δp: 99.860%
99.9%   Δp: 90.203%
99.0%   Δp: 66.591%
95.0%   Δp: 36.644%
90.0%   Δp: 19.461%
75.0%   Δp:  1.507%
Median  Δp: -0.332%
25.0%   Δp: -9.977%
10.0%   Δp: -45.830%
 5.0%   Δp: -75.458%
 1.0%   Δp: -98.595%
 0.1%   Δp: -99.993%
Minimum Δp: -100.000%
RMS Δp    : 30.166 ± 0.089 %
Same top p: 65.259 ± 0.124 %