15 lines
637 B
Plaintext
15 lines
637 B
Plaintext
llama_model_loader: loaded meta data with 39 key-value pairs and 363 tensors from granite-4.1-8b-Q6_K.gguf (version GGUF V3 (latest))
|
|
llama_model_loader: - type f32: 81 tensors
|
|
llama_model_loader: - type q8_0: 35 tensors
|
|
llama_model_loader: - type q4_K: 2 tensors
|
|
llama_model_loader: - type q5_K: 75 tensors
|
|
llama_model_loader: - type q6_K: 170 tensors
|
|
print_info: file format = GGUF V3 (latest)
|
|
print_info: file type = Q6_K
|
|
print_info: file size = 6.65 GiB (6.50 BPW)
|
|
|
|
winogrande_score : loaded 1266 tasks from prompt.
|
|
winogrande_score : selecting 750 random tasks
|
|
|
|
Final Winogrande score(750 tasks): 73.7333 +/- 1.6080
|