18 lines
804 B
Plaintext
18 lines
804 B
Plaintext
llama_model_loader: loaded meta data with 39 key-value pairs and 363 tensors from granite-4.1-8b-Q1_L.gguf (version GGUF V3 (latest))
|
|
llama_model_loader: - type f32: 81 tensors
|
|
llama_model_loader: - type q2_K: 2 tensors
|
|
llama_model_loader: - type iq2_xxs: 1 tensors
|
|
llama_model_loader: - type iq2_xs: 22 tensors
|
|
llama_model_loader: - type iq1_s: 209 tensors
|
|
llama_model_loader: - type iq2_s: 17 tensors
|
|
llama_model_loader: - type iq1_m: 31 tensors
|
|
print_info: file format = GGUF V3 (latest)
|
|
print_info: file type = IQ1_M - 1.75 bpw
|
|
print_info: file size = 1.79 GiB (1.75 BPW)
|
|
|
|
hellaswag_score : loaded 10042 tasks from prompt.
|
|
hellaswag_score : selecting 750 randomized tasks.
|
|
hellaswag_score : calculating hellaswag score over selected tasks.
|
|
|
|
750 36.00000000% [32.6441%, 39.4986%]
|