38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 34.029948 ± 0.376082
|
|
Mean PPL(base) : 9.042786 ± 0.071503
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 78.62%
|
|
Mean ln(PPL(Q)/PPL(base)) : 1.325274 ± 0.006875
|
|
Mean PPL(Q)/PPL(base) : 3.763215 ± 0.025870
|
|
Mean PPL(Q)-PPL(base) : 24.987163 ± 0.322907
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 1.300974 ± 0.004321
|
|
Maximum KLD: 23.795326
|
|
99.9% KLD: 12.854443
|
|
99.0% KLD: 8.215378
|
|
99.0% KLD: 8.215378
|
|
Median KLD: 0.782525
|
|
10.0% KLD: 0.019878
|
|
5.0% KLD: 0.004841
|
|
1.0% KLD: 0.000391
|
|
Minimum KLD: -0.000001
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -8.606 ± 0.079 %
|
|
Maximum Δp: 99.896%
|
|
99.9% Δp: 91.072%
|
|
99.0% Δp: 67.090%
|
|
95.0% Δp: 34.759%
|
|
90.0% Δp: 16.501%
|
|
75.0% Δp: 0.726%
|
|
Median Δp: -0.601%
|
|
25.0% Δp: -13.523%
|
|
10.0% Δp: -52.748%
|
|
5.0% Δp: -79.067%
|
|
1.0% Δp: -98.555%
|
|
0.1% Δp: -99.990%
|
|
Minimum Δp: -100.000%
|
|
RMS Δp : 31.537 ± 0.088 %
|
|
Same top p: 61.420 ± 0.127 %
|