38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
|
====== Perplexity statistics ======
|
||
|
|
Mean PPL(Q) : 33.537202 ± 0.371564
|
||
|
|
Mean PPL(base) : 9.042786 ± 0.071503
|
||
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 79.10%
|
||
|
|
Mean ln(PPL(Q)/PPL(base)) : 1.310688 ± 0.006832
|
||
|
|
Mean PPL(Q)/PPL(base) : 3.708725 ± 0.025338
|
||
|
|
Mean PPL(Q)-PPL(base) : 24.494416 ± 0.318026
|
||
|
|
|
||
|
|
====== KL divergence statistics ======
|
||
|
|
Mean KLD: 1.263077 ± 0.004253
|
||
|
|
Maximum KLD: 23.683029
|
||
|
|
99.9% KLD: 12.829600
|
||
|
|
99.0% KLD: 8.069357
|
||
|
|
99.0% KLD: 8.069357
|
||
|
|
Median KLD: 0.755642
|
||
|
|
10.0% KLD: 0.018898
|
||
|
|
5.0% KLD: 0.004577
|
||
|
|
1.0% KLD: 0.000375
|
||
|
|
Minimum KLD: -0.000003
|
||
|
|
|
||
|
|
====== Token probability statistics ======
|
||
|
|
Mean Δp: -8.200 ± 0.078 %
|
||
|
|
Maximum Δp: 99.800%
|
||
|
|
99.9% Δp: 90.394%
|
||
|
|
99.0% Δp: 66.393%
|
||
|
|
95.0% Δp: 34.806%
|
||
|
|
90.0% Δp: 16.907%
|
||
|
|
75.0% Δp: 0.806%
|
||
|
|
Median Δp: -0.550%
|
||
|
|
25.0% Δp: -12.684%
|
||
|
|
10.0% Δp: -50.926%
|
||
|
|
5.0% Δp: -77.962%
|
||
|
|
1.0% Δp: -98.305%
|
||
|
|
0.1% Δp: -99.990%
|
||
|
|
Minimum Δp: -100.000%
|
||
|
|
RMS Δp : 31.084 ± 0.088 %
|
||
|
|
Same top p: 62.253 ± 0.126 %
|