21 lines
1.1 KiB
Plaintext
21 lines
1.1 KiB
Plaintext
llama_model_loader: loaded meta data with 39 key-value pairs and 363 tensors from granite-4.1-8b-Q3_K.gguf (version GGUF V3 (latest))
|
|
llama_model_loader: - type f32: 81 tensors
|
|
llama_model_loader: - type q2_K: 1 tensors
|
|
llama_model_loader: - type q3_K: 1 tensors
|
|
llama_model_loader: - type q4_K: 33 tensors
|
|
llama_model_loader: - type iq2_xxs: 1 tensors
|
|
llama_model_loader: - type iq2_xs: 2 tensors
|
|
llama_model_loader: - type iq3_xxs: 31 tensors
|
|
llama_model_loader: - type iq3_s: 165 tensors
|
|
llama_model_loader: - type iq4_xs: 48 tensors
|
|
print_info: file format = GGUF V3 (latest)
|
|
print_info: file type = IQ4_XS - 4.25 bpw
|
|
print_info: file size = 3.58 GiB (3.50 BPW)
|
|
|
|
multiple_choice_score: there are 198 tasks in prompt
|
|
multiple_choice_score: reading tasks......................................................................................................................................................................................................done
|
|
multiple_choice_score : calculating GPQA-Diamond score over 198 tasks.
|
|
|
|
Final result: 21.7172 +/- 2.9377
|
|
Random chance: 24.5963 +/- 3.0683
|