llama_model_loader: loaded meta data with 39 key-value pairs and 363 tensors from granite-4.1-8b-Q3_K.gguf (version GGUF V3 (latest))
llama_model_loader: - type  f32:   81 tensors
llama_model_loader: - type q2_K:    1 tensors
llama_model_loader: - type q3_K:    1 tensors
llama_model_loader: - type q4_K:   33 tensors
llama_model_loader: - type iq2_xxs:    1 tensors
llama_model_loader: - type iq2_xs:    2 tensors
llama_model_loader: - type iq3_xxs:   31 tensors
llama_model_loader: - type iq3_s:  165 tensors
llama_model_loader: - type iq4_xs:   48 tensors
print_info: file format = GGUF V3 (latest)
print_info: file type   = IQ4_XS - 4.25 bpw
print_info: file size   = 3.58 GiB (3.50 BPW) 

hellaswag_score : loaded 10042 tasks from prompt.
hellaswag_score : selecting 750 randomized tasks.
hellaswag_score : calculating hellaswag score over selected tasks.

750	79.33333333%	[76.2895%, 82.0782%]