17 lines
751 B
Plaintext
17 lines
751 B
Plaintext
llama_model_loader: loaded meta data with 39 key-value pairs and 363 tensors from granite-4.1-8b-Q8_0.gguf (version GGUF V3 (latest))
|
|
llama_model_loader: - type f32: 81 tensors
|
|
llama_model_loader: - type q5_1: 2 tensors
|
|
llama_model_loader: - type q8_0: 266 tensors
|
|
llama_model_loader: - type q6_K: 2 tensors
|
|
llama_model_loader: - type bf16: 12 tensors
|
|
print_info: file format = GGUF V3 (latest)
|
|
print_info: file type = Q8_0
|
|
print_info: file size = 8.70 GiB (8.50 BPW)
|
|
|
|
multiple_choice_score: there are 817 tasks in prompt
|
|
multiple_choice_score: selecting 750 random tasks from 817 tasks available
|
|
multiple_choice_score : calculating TruthfulQA score over 750 tasks.
|
|
|
|
Final result: 38.4000 +/- 1.7771
|
|
Random chance: 19.8992 +/- 1.4588
|