38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
|
====== Perplexity statistics ======
|
||
|
|
Mean PPL(Q) : 7.516430 ± 0.047275
|
||
|
|
Mean PPL(base) : 7.237090 ± 0.045539
|
||
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 99.30%
|
||
|
|
Mean ln(PPL(Q)/PPL(base)) : 0.037872 ± 0.000742
|
||
|
|
Mean PPL(Q)/PPL(base) : 1.038599 ± 0.000771
|
||
|
|
Mean PPL(Q)-PPL(base) : 0.279341 ± 0.005741
|
||
|
|
|
||
|
|
====== KL divergence statistics ======
|
||
|
|
Mean KLD: 0.034545 ± 0.000172
|
||
|
|
Maximum KLD: 4.479205
|
||
|
|
99.9% KLD: 0.809954
|
||
|
|
99.0% KLD: 0.243338
|
||
|
|
99.0% KLD: 0.243338
|
||
|
|
Median KLD: 0.022288
|
||
|
|
10.0% KLD: 0.001467
|
||
|
|
5.0% KLD: 0.000485
|
||
|
|
1.0% KLD: 0.000067
|
||
|
|
Minimum KLD: -0.000025
|
||
|
|
|
||
|
|
====== Token probability statistics ======
|
||
|
|
Mean Δp: -0.984 ± 0.014 %
|
||
|
|
Maximum Δp: 60.862%
|
||
|
|
99.9% Δp: 23.910%
|
||
|
|
99.0% Δp: 11.795%
|
||
|
|
95.0% Δp: 5.549%
|
||
|
|
90.0% Δp: 3.027%
|
||
|
|
75.0% Δp: 0.404%
|
||
|
|
Median Δp: -0.103%
|
||
|
|
25.0% Δp: -2.015%
|
||
|
|
10.0% Δp: -6.046%
|
||
|
|
5.0% Δp: -9.267%
|
||
|
|
1.0% Δp: -18.431%
|
||
|
|
0.1% Δp: -42.825%
|
||
|
|
Minimum Δp: -93.056%
|
||
|
|
RMS Δp : 5.270 ± 0.035 %
|
||
|
|
Same top p: 90.812 ± 0.076 %
|