38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 9.827809 ± 0.071236
|
|
Mean PPL(base) : 9.366577 ± 0.066397
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 98.97%
|
|
Mean ln(PPL(Q)/PPL(base)) : 0.048068 ± 0.001042
|
|
Mean PPL(Q)/PPL(base) : 1.049242 ± 0.001093
|
|
Mean PPL(Q)-PPL(base) : 0.461232 ± 0.011000
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 0.059970 ± 0.000226
|
|
Maximum KLD: 5.830572
|
|
99.9% KLD: 0.899464
|
|
99.0% KLD: 0.388867
|
|
99.0% KLD: 0.388867
|
|
Median KLD: 0.039933
|
|
10.0% KLD: 0.000901
|
|
5.0% KLD: 0.000182
|
|
1.0% KLD: 0.000013
|
|
Minimum KLD: -0.000098
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -0.217 ± 0.017 %
|
|
Maximum Δp: 90.326%
|
|
99.9% Δp: 34.151%
|
|
99.0% Δp: 18.912%
|
|
95.0% Δp: 9.734%
|
|
90.0% Δp: 5.703%
|
|
75.0% Δp: 1.068%
|
|
Median Δp: -0.002%
|
|
25.0% Δp: -1.292%
|
|
10.0% Δp: -6.110%
|
|
5.0% Δp: -10.513%
|
|
1.0% Δp: -22.188%
|
|
0.1% Δp: -43.583%
|
|
Minimum Δp: -81.978%
|
|
RMS Δp : 6.574 ± 0.032 %
|
|
Same top p: 87.097 ± 0.087 %
|