38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 10.224307 ± 0.073520
|
|
Mean PPL(base) : 9.366577 ± 0.066397
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 98.16%
|
|
Mean ln(PPL(Q)/PPL(base)) : 0.087620 ± 0.001374
|
|
Mean PPL(Q)/PPL(base) : 1.091573 ± 0.001499
|
|
Mean PPL(Q)-PPL(base) : 0.857730 ± 0.015181
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 0.101951 ± 0.000397
|
|
Maximum KLD: 6.073646
|
|
99.9% KLD: 1.662331
|
|
99.0% KLD: 0.673299
|
|
99.0% KLD: 0.673299
|
|
Median KLD: 0.064775
|
|
10.0% KLD: 0.001756
|
|
5.0% KLD: 0.000385
|
|
1.0% KLD: 0.000033
|
|
Minimum KLD: -0.000036
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -1.602 ± 0.022 %
|
|
Maximum Δp: 88.808%
|
|
99.9% Δp: 37.347%
|
|
99.0% Δp: 19.623%
|
|
95.0% Δp: 8.796%
|
|
90.0% Δp: 4.589%
|
|
75.0% Δp: 0.491%
|
|
Median Δp: -0.086%
|
|
25.0% Δp: -2.849%
|
|
10.0% Δp: -9.793%
|
|
5.0% Δp: -15.740%
|
|
1.0% Δp: -31.943%
|
|
0.1% Δp: -61.801%
|
|
Minimum Δp: -98.023%
|
|
RMS Δp : 8.487 ± 0.044 %
|
|
Same top p: 84.095 ± 0.095 %
|