38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 9.513981 ± 0.067589
|
|
Mean PPL(base) : 9.366577 ± 0.066397
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 99.56%
|
|
Mean ln(PPL(Q)/PPL(base)) : 0.015615 ± 0.000668
|
|
Mean PPL(Q)/PPL(base) : 1.015737 ± 0.000679
|
|
Mean PPL(Q)-PPL(base) : 0.147404 ± 0.006420
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 0.023792 ± 0.000107
|
|
Maximum KLD: 5.229656
|
|
99.9% KLD: 0.422463
|
|
99.0% KLD: 0.159748
|
|
99.0% KLD: 0.159748
|
|
Median KLD: 0.014752
|
|
10.0% KLD: 0.000388
|
|
5.0% KLD: 0.000078
|
|
1.0% KLD: 0.000005
|
|
Minimum KLD: -0.000044
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -0.337 ± 0.010 %
|
|
Maximum Δp: 67.097%
|
|
99.9% Δp: 22.363%
|
|
99.0% Δp: 11.173%
|
|
95.0% Δp: 5.170%
|
|
90.0% Δp: 2.864%
|
|
75.0% Δp: 0.466%
|
|
Median Δp: -0.008%
|
|
25.0% Δp: -0.987%
|
|
10.0% Δp: -3.948%
|
|
5.0% Δp: -6.542%
|
|
1.0% Δp: -13.717%
|
|
0.1% Δp: -28.959%
|
|
Minimum Δp: -91.120%
|
|
RMS Δp : 4.057 ± 0.026 %
|
|
Same top p: 92.039 ± 0.070 %
|