38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 35.478449 ± 0.411747
|
|
Mean PPL(base) : 9.042786 ± 0.071503
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 80.18%
|
|
Mean ln(PPL(Q)/PPL(base)) : 1.366958 ± 0.007075
|
|
Mean PPL(Q)/PPL(base) : 3.923398 ± 0.027759
|
|
Mean PPL(Q)-PPL(base) : 26.435664 ± 0.356985
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 1.229937 ± 0.004277
|
|
Maximum KLD: 25.876987
|
|
99.9% KLD: 13.510958
|
|
99.0% KLD: 8.435304
|
|
99.0% KLD: 8.435304
|
|
Median KLD: 0.728065
|
|
10.0% KLD: 0.020280
|
|
5.0% KLD: 0.004677
|
|
1.0% KLD: 0.000320
|
|
Minimum KLD: -0.000003
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -6.562 ± 0.077 %
|
|
Maximum Δp: 99.860%
|
|
99.9% Δp: 90.203%
|
|
99.0% Δp: 66.591%
|
|
95.0% Δp: 36.644%
|
|
90.0% Δp: 19.461%
|
|
75.0% Δp: 1.507%
|
|
Median Δp: -0.332%
|
|
25.0% Δp: -9.977%
|
|
10.0% Δp: -45.830%
|
|
5.0% Δp: -75.458%
|
|
1.0% Δp: -98.595%
|
|
0.1% Δp: -99.993%
|
|
Minimum Δp: -100.000%
|
|
RMS Δp : 30.166 ± 0.089 %
|
|
Same top p: 65.259 ± 0.124 %
|