38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 30.644285 ± 0.335716
|
|
Mean PPL(base) : 9.042786 ± 0.071503
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 81.62%
|
|
Mean ln(PPL(Q)/PPL(base)) : 1.220479 ± 0.006413
|
|
Mean PPL(Q)/PPL(base) : 3.388810 ± 0.021733
|
|
Mean PPL(Q)-PPL(base) : 21.601499 ± 0.280413
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 1.038541 ± 0.003836
|
|
Maximum KLD: 22.424044
|
|
99.9% KLD: 12.381549
|
|
99.0% KLD: 7.687484
|
|
99.0% KLD: 7.687484
|
|
Median KLD: 0.597444
|
|
10.0% KLD: 0.016928
|
|
5.0% KLD: 0.004340
|
|
1.0% KLD: 0.000359
|
|
Minimum KLD: -0.000003
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -7.203 ± 0.074 %
|
|
Maximum Δp: 99.718%
|
|
99.9% Δp: 84.842%
|
|
99.0% Δp: 61.523%
|
|
95.0% Δp: 32.607%
|
|
90.0% Δp: 16.381%
|
|
75.0% Δp: 0.982%
|
|
Median Δp: -0.437%
|
|
25.0% Δp: -10.550%
|
|
10.0% Δp: -45.107%
|
|
5.0% Δp: -72.871%
|
|
1.0% Δp: -98.353%
|
|
0.1% Δp: -99.993%
|
|
Minimum Δp: -100.000%
|
|
RMS Δp : 29.119 ± 0.088 %
|
|
Same top p: 66.765 ± 0.123 %
|