38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 36.103787 ± 0.402250
|
|
Mean PPL(base) : 9.042786 ± 0.071503
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 77.13%
|
|
Mean ln(PPL(Q)/PPL(base)) : 1.384430 ± 0.007124
|
|
Mean PPL(Q)/PPL(base) : 3.992551 ± 0.028445
|
|
Mean PPL(Q)-PPL(base) : 27.061001 ± 0.350072
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 1.395578 ± 0.004559
|
|
Maximum KLD: 24.088387
|
|
99.9% KLD: 13.768757
|
|
99.0% KLD: 8.603606
|
|
99.0% KLD: 8.603606
|
|
Median KLD: 0.858334
|
|
10.0% KLD: 0.021285
|
|
5.0% KLD: 0.005174
|
|
1.0% KLD: 0.000393
|
|
Minimum KLD: -0.000002
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -9.212 ± 0.080 %
|
|
Maximum Δp: 99.844%
|
|
99.9% Δp: 91.248%
|
|
99.0% Δp: 67.876%
|
|
95.0% Δp: 34.787%
|
|
90.0% Δp: 16.139%
|
|
75.0% Δp: 0.593%
|
|
Median Δp: -0.696%
|
|
25.0% Δp: -14.997%
|
|
10.0% Δp: -54.930%
|
|
5.0% Δp: -79.831%
|
|
1.0% Δp: -98.568%
|
|
0.1% Δp: -99.992%
|
|
Minimum Δp: -100.000%
|
|
RMS Δp : 32.089 ± 0.088 %
|
|
Same top p: 59.830 ± 0.128 %
|