38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
|
====== Perplexity statistics ======
|
||
|
|
Mean PPL(Q) : 31.245217 ± 0.343080
|
||
|
|
Mean PPL(base) : 9.042786 ± 0.071503
|
||
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 80.86%
|
||
|
|
Mean ln(PPL(Q)/PPL(base)) : 1.239899 ± 0.006533
|
||
|
|
Mean PPL(Q)/PPL(base) : 3.455265 ± 0.022573
|
||
|
|
Mean PPL(Q)-PPL(base) : 22.202432 ± 0.288349
|
||
|
|
|
||
|
|
====== KL divergence statistics ======
|
||
|
|
Mean KLD: 1.105266 ± 0.003926
|
||
|
|
Maximum KLD: 20.987593
|
||
|
|
99.9% KLD: 12.310256
|
||
|
|
99.0% KLD: 7.698290
|
||
|
|
99.0% KLD: 7.698290
|
||
|
|
Median KLD: 0.643550
|
||
|
|
10.0% KLD: 0.017519
|
||
|
|
5.0% KLD: 0.004389
|
||
|
|
1.0% KLD: 0.000363
|
||
|
|
Minimum KLD: -0.000002
|
||
|
|
|
||
|
|
====== Token probability statistics ======
|
||
|
|
Mean Δp: -7.460 ± 0.075 %
|
||
|
|
Maximum Δp: 99.266%
|
||
|
|
99.9% Δp: 87.347%
|
||
|
|
99.0% Δp: 63.610%
|
||
|
|
95.0% Δp: 33.077%
|
||
|
|
90.0% Δp: 16.572%
|
||
|
|
75.0% Δp: 0.938%
|
||
|
|
Median Δp: -0.465%
|
||
|
|
25.0% Δp: -11.152%
|
||
|
|
10.0% Δp: -46.828%
|
||
|
|
5.0% Δp: -74.300%
|
||
|
|
1.0% Δp: -98.187%
|
||
|
|
0.1% Δp: -99.991%
|
||
|
|
Minimum Δp: -100.000%
|
||
|
|
RMS Δp : 29.698 ± 0.088 %
|
||
|
|
Same top p: 65.245 ± 0.124 %
|