38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
|
====== Perplexity statistics ======
|
||
|
|
Mean PPL(Q) : 32.557804 ± 0.369351
|
||
|
|
Mean PPL(base) : 9.042786 ± 0.071503
|
||
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 80.53%
|
||
|
|
Mean ln(PPL(Q)/PPL(base)) : 1.281050 ± 0.006837
|
||
|
|
Mean PPL(Q)/PPL(base) : 3.600418 ± 0.024617
|
||
|
|
Mean PPL(Q)-PPL(base) : 23.515018 ± 0.314640
|
||
|
|
|
||
|
|
====== KL divergence statistics ======
|
||
|
|
Mean KLD: 1.196823 ± 0.004146
|
||
|
|
Maximum KLD: 24.545359
|
||
|
|
99.9% KLD: 12.464450
|
||
|
|
99.0% KLD: 8.054839
|
||
|
|
99.0% KLD: 8.054839
|
||
|
|
Median KLD: 0.702317
|
||
|
|
10.0% KLD: 0.019899
|
||
|
|
5.0% KLD: 0.004923
|
||
|
|
1.0% KLD: 0.000363
|
||
|
|
Minimum KLD: -0.000003
|
||
|
|
|
||
|
|
====== Token probability statistics ======
|
||
|
|
Mean Δp: -6.314 ± 0.076 %
|
||
|
|
Maximum Δp: 99.585%
|
||
|
|
99.9% Δp: 90.128%
|
||
|
|
99.0% Δp: 66.718%
|
||
|
|
95.0% Δp: 36.821%
|
||
|
|
90.0% Δp: 19.531%
|
||
|
|
75.0% Δp: 1.614%
|
||
|
|
Median Δp: -0.338%
|
||
|
|
25.0% Δp: -9.890%
|
||
|
|
10.0% Δp: -44.374%
|
||
|
|
5.0% Δp: -73.795%
|
||
|
|
1.0% Δp: -98.369%
|
||
|
|
0.1% Δp: -99.991%
|
||
|
|
Minimum Δp: -100.000%
|
||
|
|
RMS Δp : 29.810 ± 0.088 %
|
||
|
|
Same top p: 65.550 ± 0.124 %
|