eaddario/granite-4.1-8b-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: eaddario/granite-4.1-8b-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-14 00:38:20 +08:00
commit a947aa221e
80 changed files with 12432 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

19
scores/granite-4.1-8b-q3_k.hsw Normal file
View File

@@ -0,0 +1,19 @@
llama_model_loader: loaded meta data with 39 key-value pairs and 363 tensors from granite-4.1-8b-Q3_K.gguf (version GGUF V3 (latest))
llama_model_loader: - type f32: 81 tensors
llama_model_loader: - type q2_K: 1 tensors
llama_model_loader: - type q3_K: 1 tensors
llama_model_loader: - type q4_K: 33 tensors
llama_model_loader: - type iq2_xxs: 1 tensors
llama_model_loader: - type iq2_xs: 2 tensors
llama_model_loader: - type iq3_xxs: 31 tensors
llama_model_loader: - type iq3_s: 165 tensors
llama_model_loader: - type iq4_xs: 48 tensors
print_info: file format = GGUF V3 (latest)
print_info: file type = IQ4_XS - 4.25 bpw
print_info: file size = 3.58 GiB (3.50 BPW)
hellaswag_score : loaded 10042 tasks from prompt.
hellaswag_score : selecting 750 randomized tasks.
hellaswag_score : calculating hellaswag score over selected tasks.
750 79.33333333% [76.2895%, 82.0782%]