38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 9.942560 ± 0.071243
|
|
Mean PPL(base) : 9.366577 ± 0.066397
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 98.64%
|
|
Mean ln(PPL(Q)/PPL(base)) : 0.059677 ± 0.001178
|
|
Mean PPL(Q)/PPL(base) : 1.061493 ± 0.001251
|
|
Mean PPL(Q)-PPL(base) : 0.575982 ± 0.012339
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 0.079935 ± 0.000289
|
|
Maximum KLD: 5.765717
|
|
99.9% KLD: 1.150883
|
|
99.0% KLD: 0.493128
|
|
99.0% KLD: 0.493128
|
|
Median KLD: 0.053589
|
|
10.0% KLD: 0.001480
|
|
5.0% KLD: 0.000323
|
|
1.0% KLD: 0.000027
|
|
Minimum KLD: -0.000038
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -0.885 ± 0.019 %
|
|
Maximum Δp: 91.523%
|
|
99.9% Δp: 34.667%
|
|
99.0% Δp: 19.093%
|
|
95.0% Δp: 9.310%
|
|
90.0% Δp: 5.250%
|
|
75.0% Δp: 0.738%
|
|
Median Δp: -0.033%
|
|
25.0% Δp: -2.046%
|
|
10.0% Δp: -7.921%
|
|
5.0% Δp: -13.116%
|
|
1.0% Δp: -26.866%
|
|
0.1% Δp: -52.295%
|
|
Minimum Δp: -90.266%
|
|
RMS Δp : 7.445 ± 0.038 %
|
|
Same top p: 85.475 ± 0.091 %
|