20 lines
890 B
Plaintext
20 lines
890 B
Plaintext
llama_model_loader: loaded meta data with 39 key-value pairs and 363 tensors from granite-4.1-8b-Q2_K.gguf (version GGUF V3 (latest))
|
|
llama_model_loader: - type f32: 81 tensors
|
|
llama_model_loader: - type q2_K: 35 tensors
|
|
llama_model_loader: - type q3_K: 1 tensors
|
|
llama_model_loader: - type iq2_xxs: 41 tensors
|
|
llama_model_loader: - type iq2_xs: 56 tensors
|
|
llama_model_loader: - type iq3_xxs: 6 tensors
|
|
llama_model_loader: - type iq1_s: 2 tensors
|
|
llama_model_loader: - type iq3_s: 38 tensors
|
|
llama_model_loader: - type iq2_s: 99 tensors
|
|
llama_model_loader: - type iq1_m: 4 tensors
|
|
print_info: file format = GGUF V3 (latest)
|
|
print_info: file type = IQ2_S - 2.5 bpw
|
|
print_info: file size = 2.56 GiB (2.50 BPW)
|
|
|
|
winogrande_score : loaded 1266 tasks from prompt.
|
|
winogrande_score : selecting 750 random tasks
|
|
|
|
Final Winogrande score(750 tasks): 65.2000 +/- 1.7405
|