38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 10.109660 ± 0.072549
|
|
Mean PPL(base) : 9.366577 ± 0.066397
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 98.44%
|
|
Mean ln(PPL(Q)/PPL(base)) : 0.076344 ± 0.001263
|
|
Mean PPL(Q)/PPL(base) : 1.079333 ± 0.001363
|
|
Mean PPL(Q)-PPL(base) : 0.743083 ± 0.013719
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 0.086444 ± 0.000342
|
|
Maximum KLD: 6.291467
|
|
99.9% KLD: 1.404206
|
|
99.0% KLD: 0.571756
|
|
99.0% KLD: 0.571756
|
|
Median KLD: 0.054763
|
|
10.0% KLD: 0.001465
|
|
5.0% KLD: 0.000315
|
|
1.0% KLD: 0.000028
|
|
Minimum KLD: -0.000235
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -1.387 ± 0.020 %
|
|
Maximum Δp: 82.526%
|
|
99.9% Δp: 35.574%
|
|
99.0% Δp: 18.394%
|
|
95.0% Δp: 8.338%
|
|
90.0% Δp: 4.407%
|
|
75.0% Δp: 0.508%
|
|
Median Δp: -0.066%
|
|
25.0% Δp: -2.517%
|
|
10.0% Δp: -8.904%
|
|
5.0% Δp: -14.322%
|
|
1.0% Δp: -29.340%
|
|
0.1% Δp: -57.123%
|
|
Minimum Δp: -93.887%
|
|
RMS Δp : 7.845 ± 0.041 %
|
|
Same top p: 85.114 ± 0.092 %
|