llama_model_loader: loaded meta data with 39 key-value pairs and 363 tensors from granite-4.1-8b-Q1_L.gguf (version GGUF V3 (latest))
llama_model_loader: - type  f32:   81 tensors
llama_model_loader: - type q2_K:    2 tensors
llama_model_loader: - type iq2_xxs:    1 tensors
llama_model_loader: - type iq2_xs:   22 tensors
llama_model_loader: - type iq1_s:  209 tensors
llama_model_loader: - type iq2_s:   17 tensors
llama_model_loader: - type iq1_m:   31 tensors
print_info: file format = GGUF V3 (latest)
print_info: file type   = IQ1_M - 1.75 bpw
print_info: file size   = 1.79 GiB (1.75 BPW) 

multiple_choice_score: there are 198 tasks in prompt
multiple_choice_score: reading tasks......................................................................................................................................................................................................done
multiple_choice_score : calculating GPQA-Diamond score over 198 tasks.

Final result: 19.1919 +/- 2.8058
Random chance: 24.5963 +/- 3.0683