38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
====== Perplexity statistics ======
|
|
Mean PPL(Q) : 10.010842 ± 0.071669
|
|
Mean PPL(base) : 9.366577 ± 0.066397
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 98.55%
|
|
Mean ln(PPL(Q)/PPL(base)) : 0.066521 ± 0.001216
|
|
Mean PPL(Q)/PPL(base) : 1.068783 ± 0.001299
|
|
Mean PPL(Q)-PPL(base) : 0.644264 ± 0.012880
|
|
|
|
====== KL divergence statistics ======
|
|
Mean KLD: 0.080230 ± 0.000317
|
|
Maximum KLD: 5.784035
|
|
99.9% KLD: 1.294543
|
|
99.0% KLD: 0.528458
|
|
99.0% KLD: 0.528458
|
|
Median KLD: 0.051107
|
|
10.0% KLD: 0.001336
|
|
5.0% KLD: 0.000286
|
|
1.0% KLD: 0.000024
|
|
Minimum KLD: -0.000067
|
|
|
|
====== Token probability statistics ======
|
|
Mean Δp: -1.245 ± 0.019 %
|
|
Maximum Δp: 81.317%
|
|
99.9% Δp: 34.733%
|
|
99.0% Δp: 17.968%
|
|
95.0% Δp: 8.306%
|
|
90.0% Δp: 4.460%
|
|
75.0% Δp: 0.555%
|
|
Median Δp: -0.050%
|
|
25.0% Δp: -2.346%
|
|
10.0% Δp: -8.488%
|
|
5.0% Δp: -13.739%
|
|
1.0% Δp: -28.248%
|
|
0.1% Δp: -54.584%
|
|
Minimum Δp: -91.716%
|
|
RMS Δp : 7.556 ± 0.040 %
|
|
Same top p: 85.515 ± 0.091 %
|