38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 9.529467 ± 0.067693
|
|
Mean PPL(base) : 9.366577 ± 0.066397
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 99.53%
|
|
Mean ln(PPL(Q)/PPL(base)) : 0.017241 ± 0.000692
|
|
Mean PPL(Q)/PPL(base) : 1.017391 ± 0.000704
|
|
Mean PPL(Q)-PPL(base) : 0.162890 ± 0.006661
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 0.025429 ± 0.000116
|
|
Maximum KLD: 6.250518
|
|
99.9% KLD: 0.457138
|
|
99.0% KLD: 0.169697
|
|
99.0% KLD: 0.169697
|
|
Median KLD: 0.015727
|
|
10.0% KLD: 0.000429
|
|
5.0% KLD: 0.000085
|
|
1.0% KLD: 0.000006
|
|
Minimum KLD: -0.000044
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -0.378 ± 0.011 %
|
|
Maximum Δp: 64.248%
|
|
99.9% Δp: 23.260%
|
|
99.0% Δp: 11.368%
|
|
95.0% Δp: 5.279%
|
|
90.0% Δp: 2.904%
|
|
75.0% Δp: 0.455%
|
|
Median Δp: -0.010%
|
|
25.0% Δp: -1.037%
|
|
10.0% Δp: -4.112%
|
|
5.0% Δp: -6.788%
|
|
1.0% Δp: -14.402%
|
|
0.1% Δp: -30.405%
|
|
Minimum Δp: -91.281%
|
|
RMS Δp : 4.191 ± 0.026 %
|
|
Same top p: 91.792 ± 0.071 %
|