llama_model_loader: loaded meta data with 39 key-value pairs and 363 tensors from granite-4.1-8b-Q8_0.gguf (version GGUF V3 (latest)) llama_model_loader: - type f32: 81 tensors llama_model_loader: - type q5_1: 2 tensors llama_model_loader: - type q8_0: 266 tensors llama_model_loader: - type q6_K: 2 tensors llama_model_loader: - type bf16: 12 tensors print_info: file format = GGUF V3 (latest) print_info: file type = Q8_0 print_info: file size = 8.70 GiB (8.50 BPW) hellaswag_score : loaded 10042 tasks from prompt. hellaswag_score : selecting 750 randomized tasks. hellaswag_score : calculating hellaswag score over selected tasks. 750 80.53333333% [77.5470%, 83.2085%]