38 lines
1.0 KiB
Plaintext
38 lines
1.0 KiB
Plaintext
|
====== Perplexity statistics ======
|
||
|
|
Mean PPL(Q) : 30.668770 ± 0.335889
|
||
|
|
Mean PPL(base) : 9.042786 ± 0.071503
|
||
|
|
Cor(ln(PPL(Q)), ln(PPL(base))): 81.60%
|
||
|
|
Mean ln(PPL(Q)/PPL(base)) : 1.221278 ± 0.006415
|
||
|
|
Mean PPL(Q)/PPL(base) : 3.391518 ± 0.021755
|
||
|
|
Mean PPL(Q)-PPL(base) : 21.625984 ± 0.280606
|
||
|
|
|
||
|
|
====== KL divergence statistics ======
|
||
|
|
Mean KLD: 1.039101 ± 0.003848
|
||
|
|
Maximum KLD: 22.598866
|
||
|
|
99.9% KLD: 12.543374
|
||
|
|
99.0% KLD: 7.697062
|
||
|
|
99.0% KLD: 7.697062
|
||
|
|
Median KLD: 0.596171
|
||
|
|
10.0% KLD: 0.017018
|
||
|
|
5.0% KLD: 0.004340
|
||
|
|
1.0% KLD: 0.000363
|
||
|
|
Minimum KLD: -0.000000
|
||
|
|
|
||
|
|
====== Token probability statistics ======
|
||
|
|
Mean Δp: -7.245 ± 0.074 %
|
||
|
|
Maximum Δp: 99.814%
|
||
|
|
99.9% Δp: 85.186%
|
||
|
|
99.0% Δp: 61.478%
|
||
|
|
95.0% Δp: 32.505%
|
||
|
|
90.0% Δp: 16.393%
|
||
|
|
75.0% Δp: 0.971%
|
||
|
|
Median Δp: -0.442%
|
||
|
|
25.0% Δp: -10.578%
|
||
|
|
10.0% Δp: -45.165%
|
||
|
|
5.0% Δp: -72.951%
|
||
|
|
1.0% Δp: -98.402%
|
||
|
|
0.1% Δp: -99.994%
|
||
|
|
Minimum Δp: -100.000%
|
||
|
|
RMS Δp : 29.177 ± 0.088 %
|
||
|
|
Same top p: 66.780 ± 0.123 %
|