38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 9.410802 ± 0.066883
|
|
Mean PPL(base) : 9.366577 ± 0.066397
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 99.88%
|
|
Mean ln(PPL(Q)/PPL(base)) : 0.004710 ± 0.000355
|
|
Mean PPL(Q)/PPL(base) : 1.004722 ± 0.000357
|
|
Mean PPL(Q)-PPL(base) : 0.044224 ± 0.003363
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 0.006252 ± 0.000036
|
|
Maximum KLD: 2.202329
|
|
99.9% KLD: 0.113542
|
|
99.0% KLD: 0.041912
|
|
99.0% KLD: 0.041912
|
|
Median KLD: 0.003874
|
|
10.0% KLD: 0.000095
|
|
5.0% KLD: 0.000017
|
|
1.0% KLD: 0.000000
|
|
Minimum KLD: -0.000135
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -0.049 ± 0.005 %
|
|
Maximum Δp: 48.849%
|
|
99.9% Δp: 12.232%
|
|
99.0% Δp: 6.155%
|
|
95.0% Δp: 2.940%
|
|
90.0% Δp: 1.698%
|
|
75.0% Δp: 0.326%
|
|
Median Δp: -0.000%
|
|
25.0% Δp: -0.399%
|
|
10.0% Δp: -1.846%
|
|
5.0% Δp: -3.125%
|
|
1.0% Δp: -6.593%
|
|
0.1% Δp: -13.502%
|
|
Minimum Δp: -61.344%
|
|
RMS Δp : 2.085 ± 0.015 %
|
|
Same top p: 95.765 ± 0.052 %
|