====== Perplexity statistics ======
Mean PPL(Q)                   :  30.668770 ±   0.335889
Mean PPL(base)                :   9.042786 ±   0.071503
Cor(ln(PPL(Q)), ln(PPL(base))):  81.60%
Mean ln(PPL(Q)/PPL(base))     :   1.221278 ±   0.006415
Mean PPL(Q)/PPL(base)         :   3.391518 ±   0.021755
Mean PPL(Q)-PPL(base)         :  21.625984 ±   0.280606

====== KL divergence statistics ======
Mean    KLD:   1.039101 ±   0.003848
Maximum KLD:  22.598866
99.9%   KLD:  12.543374
99.0%   KLD:   7.697062
99.0%   KLD:   7.697062
Median  KLD:   0.596171
10.0%   KLD:   0.017018
 5.0%   KLD:   0.004340
 1.0%   KLD:   0.000363
Minimum KLD:  -0.000000

====== Token probability statistics ======
Mean    Δp: -7.245 ± 0.074 %
Maximum Δp: 99.814%
99.9%   Δp: 85.186%
99.0%   Δp: 61.478%
95.0%   Δp: 32.505%
90.0%   Δp: 16.393%
75.0%   Δp:  0.971%
Median  Δp: -0.442%
25.0%   Δp: -10.578%
10.0%   Δp: -45.165%
 5.0%   Δp: -72.951%
 1.0%   Δp: -98.402%
 0.1%   Δp: -99.994%
Minimum Δp: -100.000%
RMS Δp    : 29.177 ± 0.088 %
Same top p: 66.780 ± 0.123 %