38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 36.879518 ± 0.436763
|
|
Mean PPL(base) : 9.042786 ± 0.071503
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 80.79%
|
|
Mean ln(PPL(Q)/PPL(base)) : 1.405689 ± 0.007174
|
|
Mean PPL(Q)/PPL(base) : 4.078336 ± 0.029260
|
|
Mean PPL(Q)-PPL(base) : 27.836733 ± 0.381333
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 1.190922 ± 0.004215
|
|
Maximum KLD: 25.421314
|
|
99.9% KLD: 13.739526
|
|
99.0% KLD: 8.520005
|
|
99.0% KLD: 8.520005
|
|
Median KLD: 0.710480
|
|
10.0% KLD: 0.017773
|
|
5.0% KLD: 0.003969
|
|
1.0% KLD: 0.000258
|
|
Minimum KLD: -0.000003
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -6.063 ± 0.075 %
|
|
Maximum Δp: 99.690%
|
|
99.9% Δp: 88.494%
|
|
99.0% Δp: 65.535%
|
|
95.0% Δp: 36.662%
|
|
90.0% Δp: 19.570%
|
|
75.0% Δp: 1.644%
|
|
Median Δp: -0.273%
|
|
25.0% Δp: -9.153%
|
|
10.0% Δp: -43.591%
|
|
5.0% Δp: -73.479%
|
|
1.0% Δp: -98.555%
|
|
0.1% Δp: -99.995%
|
|
Minimum Δp: -100.000%
|
|
RMS Δp : 29.578 ± 0.088 %
|
|
Same top p: 66.655 ± 0.123 %
|