====== Perplexity statistics ======
Mean PPL(Q)                   :   7.516430 ±   0.047275
Mean PPL(base)                :   7.237090 ±   0.045539
Cor(ln(PPL(Q)), ln(PPL(base))):  99.30%
Mean ln(PPL(Q)/PPL(base))     :   0.037872 ±   0.000742
Mean PPL(Q)/PPL(base)         :   1.038599 ±   0.000771
Mean PPL(Q)-PPL(base)         :   0.279341 ±   0.005741

====== KL divergence statistics ======
Mean    KLD:   0.034545 ±   0.000172
Maximum KLD:   4.479205
99.9%   KLD:   0.809954
99.0%   KLD:   0.243338
99.0%   KLD:   0.243338
Median  KLD:   0.022288
10.0%   KLD:   0.001467
 5.0%   KLD:   0.000485
 1.0%   KLD:   0.000067
Minimum KLD:  -0.000025

====== Token probability statistics ======
Mean    Δp: -0.984 ± 0.014 %
Maximum Δp: 60.862%
99.9%   Δp: 23.910%
99.0%   Δp: 11.795%
95.0%   Δp:  5.549%
90.0%   Δp:  3.027%
75.0%   Δp:  0.404%
Median  Δp: -0.103%
25.0%   Δp: -2.015%
10.0%   Δp: -6.046%
 5.0%   Δp: -9.267%
 1.0%   Δp: -18.431%
 0.1%   Δp: -42.825%
Minimum Δp: -93.056%
RMS Δp    :  5.270 ± 0.035 %
Same top p: 90.812 ± 0.076 %