38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 9.585928 ± 0.068060
|
|
Mean PPL(base) : 9.366577 ± 0.066397
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 99.51%
|
|
Mean ln(PPL(Q)/PPL(base)) : 0.023148 ± 0.000703
|
|
Mean PPL(Q)/PPL(base) : 1.023418 ± 0.000719
|
|
Mean PPL(Q)-PPL(base) : 0.219350 ± 0.006862
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 0.026627 ± 0.000108
|
|
Maximum KLD: 2.930657
|
|
99.9% KLD: 0.451824
|
|
99.0% KLD: 0.171826
|
|
99.0% KLD: 0.171826
|
|
Median KLD: 0.017210
|
|
10.0% KLD: 0.000451
|
|
5.0% KLD: 0.000095
|
|
1.0% KLD: 0.000007
|
|
Minimum KLD: -0.000060
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -0.523 ± 0.011 %
|
|
Maximum Δp: 54.223%
|
|
99.9% Δp: 22.680%
|
|
99.0% Δp: 11.163%
|
|
95.0% Δp: 5.267%
|
|
90.0% Δp: 2.899%
|
|
75.0% Δp: 0.419%
|
|
Median Δp: -0.014%
|
|
25.0% Δp: -1.188%
|
|
10.0% Δp: -4.623%
|
|
5.0% Δp: -7.618%
|
|
1.0% Δp: -15.106%
|
|
0.1% Δp: -30.059%
|
|
Minimum Δp: -89.467%
|
|
RMS Δp : 4.346 ± 0.026 %
|
|
Same top p: 91.424 ± 0.073 %
|