Files
granite-4.1-8b-GGUF/scores/granite-4.1-8b-Q5_K.md
ModelHub XC a947aa221e 初始化项目,由ModelHub XC社区提供模型
Model: eaddario/granite-4.1-8b-GGUF
Source: Original Platform
2026-06-14 00:38:20 +08:00

108 KiB

granite-4.1-8b-WIP/granite-4.1-8b-Q5_K.gguf - GGUF Internal File Dump

  • Endian: LITTLE endian

Key Value Metadata Store

There are 42 key-value pairs in this file

POS TYPE Count Key Value
1 UINT32 1 GGUF.version 3
2 UINT64 1 GGUF.tensor_count 363
3 UINT64 1 GGUF.kv_count 39
4 STRING 1 general.architecture granite
5 STRING 1 general.type model
6 STRING 1 general.name Granite 4.1 8b
7 STRING 1 general.basename granite-4.1
8 STRING 1 general.size_label 8B
9 STRING 1 general.license apache-2.0
10 [STRING] 2 general.tags [ language, granite-4.1 ]
11 UINT32 1 granite.block_count 40
12 UINT32 1 granite.context_length 131072
13 UINT32 1 granite.embedding_length 4096
14 UINT32 1 granite.feed_forward_length 12800
15 UINT32 1 granite.attention.head_count 32
16 UINT32 1 granite.attention.head_count_kv 8
17 FLOAT32 1 granite.rope.freq_base 10000000.0
18 FLOAT32 1 granite.attention.layer_norm_rms_epsilon 1e-05
19 UINT32 1 granite.vocab_size 100352
20 UINT32 1 granite.rope.dimension_count 128
21 FLOAT32 1 granite.attention.scale 0.0078125
22 FLOAT32 1 granite.embedding_scale 12.0
23 FLOAT32 1 granite.residual_scale 0.22
24 FLOAT32 1 granite.logit_scale 16.0
25 STRING 1 tokenizer.ggml.model gpt2
26 STRING 1 tokenizer.ggml.pre granite-docling
27 [STRING] 100352 tokenizer.ggml.tokens [ !, ", #, $, %, ... ]
28 [INT32] 100352 tokenizer.ggml.token_type [ 1, 1, 1, 1, 1, 1, 1, ... ]
29 [STRING] 100000 tokenizer.ggml.merges [ Ġ Ġ, ĠĠ ĠĠ, i n, Ġ t, ĠĠĠĠ ĠĠĠĠ, ... ]
30 UINT32 1 tokenizer.ggml.bos_token_id 100257
31 UINT32 1 tokenizer.ggml.eos_token_id 100257
32 UINT32 1 tokenizer.ggml.unknown_token_id 100269
33 UINT32 1 tokenizer.ggml.padding_token_id 100256
34 BOOL 1 tokenizer.ggml.add_bos_token False
35 STRING 1 tokenizer.chat_template {%- set tools_system_message_p...`end_of_role
36 BOOL 1 tokenizer.ggml.add_space_prefix False
37 UINT32 1 general.quantization_version 2
38 UINT32 1 general.file_type 17
39 STRING 1 quantize.imatrix.file imatrix/imatrix-granite-4.1-8b-medium.gguf
40 STRING 1 quantize.imatrix.dataset ../../datasets/imatrix/combined_all_medium.txt
41 UINT32 1 quantize.imatrix.entries_count 280
42 UINT32 1 quantize.imatrix.chunks_count 3601

Tensors Overview ~9B Elements

Total number of elements in all tensors: 8791592960 Elements

Tensor Data Offset

This table contains the offset and data segment relative to start of file

T_ID Tensor Layer Name Data Offset (B) Data Size (B)
0 output.weight 0x367400 0x14190000
1 output_norm.weight 0x144f7400 0x4000
2 token_embd.weight 0x144fb400 0x10d80000
3 blk.0.attn_k.weight 0x2527b400 0x220000
4 blk.0.attn_norm.weight 0x2549b400 0x4000
5 blk.0.attn_output.weight 0x2549f400 0x900000
6 blk.0.attn_q.weight 0x25d9f400 0x880000
7 blk.0.attn_v.weight 0x2661f400 0x2c0000
8 blk.0.ffn_down.weight 0x268df400 0x1c20000
9 blk.0.ffn_gate.weight 0x284ff400 0x1a90000
10 blk.0.ffn_norm.weight 0x29f8f400 0x4000
11 blk.0.ffn_up.weight 0x29f93400 0x2260000
12 blk.1.attn_k.weight 0x2c1f3400 0x240000
13 blk.1.attn_norm.weight 0x2c433400 0x4000
14 blk.1.attn_output.weight 0x2c437400 0xb00000
15 blk.1.attn_q.weight 0x2cf37400 0xb00000
16 blk.1.attn_v.weight 0x2da37400 0x2c0000
17 blk.1.ffn_down.weight 0x2dcf7400 0x2260000
18 blk.1.ffn_gate.weight 0x2ff57400 0x2260000
19 blk.1.ffn_norm.weight 0x321b7400 0x4000
20 blk.1.ffn_up.weight 0x321bb400 0x2260000
21 blk.2.attn_k.weight 0x3441b400 0x240000
22 blk.2.attn_norm.weight 0x3465b400 0x4000
23 blk.2.attn_output.weight 0x3465f400 0xb00000
24 blk.2.attn_q.weight 0x3515f400 0xb00000
25 blk.2.attn_v.weight 0x35c5f400 0x2c0000
26 blk.2.ffn_down.weight 0x35f1f400 0x2260000
27 blk.2.ffn_gate.weight 0x3817f400 0x2260000
28 blk.2.ffn_norm.weight 0x3a3df400 0x4000
29 blk.2.ffn_up.weight 0x3a3e3400 0x2260000
30 blk.3.attn_k.weight 0x3c643400 0x240000
31 blk.3.attn_norm.weight 0x3c883400 0x4000
32 blk.3.attn_output.weight 0x3c887400 0xb00000
33 blk.3.attn_q.weight 0x3d387400 0x900000
34 blk.3.attn_v.weight 0x3dc87400 0x2c0000
35 blk.3.ffn_down.weight 0x3df47400 0x1c20000
36 blk.3.ffn_gate.weight 0x3fb67400 0x2260000
37 blk.3.ffn_norm.weight 0x41dc7400 0x4000
38 blk.3.ffn_up.weight 0x41dcb400 0x2260000
39 blk.4.attn_k.weight 0x4402b400 0x2c0000
40 blk.4.attn_norm.weight 0x442eb400 0x4000
41 blk.4.attn_output.weight 0x442ef400 0xb00000
42 blk.4.attn_q.weight 0x44def400 0xb00000
43 blk.4.attn_v.weight 0x458ef400 0x2c0000
44 blk.4.ffn_down.weight 0x45baf400 0x2260000
45 blk.4.ffn_gate.weight 0x47e0f400 0x2260000
46 blk.4.ffn_norm.weight 0x4a06f400 0x4000
47 blk.4.ffn_up.weight 0x4a073400 0x2260000
48 blk.5.attn_k.weight 0x4c2d3400 0x240000
49 blk.5.attn_norm.weight 0x4c513400 0x4000
50 blk.5.attn_output.weight 0x4c517400 0xb00000
51 blk.5.attn_q.weight 0x4d017400 0xb00000
52 blk.5.attn_v.weight 0x4db17400 0x2c0000
53 blk.5.ffn_down.weight 0x4ddd7400 0x1c20000
54 blk.5.ffn_gate.weight 0x4f9f7400 0x2260000
55 blk.5.ffn_norm.weight 0x51c57400 0x4000
56 blk.5.ffn_up.weight 0x51c5b400 0x2260000
57 blk.6.attn_k.weight 0x53ebb400 0x240000
58 blk.6.attn_norm.weight 0x540fb400 0x4000
59 blk.6.attn_output.weight 0x540ff400 0xb00000
60 blk.6.attn_q.weight 0x54bff400 0xb00000
61 blk.6.attn_v.weight 0x556ff400 0x300000
62 blk.6.ffn_down.weight 0x559ff400 0x2260000
63 blk.6.ffn_gate.weight 0x57c5f400 0x2260000
64 blk.6.ffn_norm.weight 0x59ebf400 0x4000
65 blk.6.ffn_up.weight 0x59ec3400 0x2260000
66 blk.7.attn_k.weight 0x5c123400 0x2c0000
67 blk.7.attn_norm.weight 0x5c3e3400 0x4000
68 blk.7.attn_output.weight 0x5c3e7400 0xb00000
69 blk.7.attn_q.weight 0x5cee7400 0xb00000
70 blk.7.attn_v.weight 0x5d9e7400 0x2c0000
71 blk.7.ffn_down.weight 0x5dca7400 0x2260000
72 blk.7.ffn_gate.weight 0x5ff07400 0x2260000
73 blk.7.ffn_norm.weight 0x62167400 0x4000
74 blk.7.ffn_up.weight 0x6216b400 0x2260000
75 blk.8.attn_k.weight 0x643cb400 0x240000
76 blk.8.attn_norm.weight 0x6460b400 0x4000
77 blk.8.attn_output.weight 0x6460f400 0xb00000
78 blk.8.attn_q.weight 0x6510f400 0xb00000
79 blk.8.attn_v.weight 0x65c0f400 0x2c0000
80 blk.8.ffn_down.weight 0x65ecf400 0x2260000
81 blk.8.ffn_gate.weight 0x6812f400 0x2260000
82 blk.8.ffn_norm.weight 0x6a38f400 0x4000
83 blk.8.ffn_up.weight 0x6a393400 0x2260000
84 blk.9.attn_k.weight 0x6c5f3400 0x240000
85 blk.9.attn_norm.weight 0x6c833400 0x4000
86 blk.9.attn_output.weight 0x6c837400 0xb00000
87 blk.9.attn_q.weight 0x6d337400 0xb00000
88 blk.9.attn_v.weight 0x6de37400 0x2c0000
89 blk.9.ffn_down.weight 0x6e0f7400 0x2260000
90 blk.9.ffn_gate.weight 0x70357400 0x2260000
91 blk.9.ffn_norm.weight 0x725b7400 0x4000
92 blk.9.ffn_up.weight 0x725bb400 0x2260000
93 blk.10.attn_k.weight 0x7481b400 0x240000
94 blk.10.attn_norm.weight 0x74a5b400 0x4000
95 blk.10.attn_output.weight 0x74a5f400 0xb00000
96 blk.10.attn_q.weight 0x7555f400 0xb00000
97 blk.10.attn_v.weight 0x7605f400 0x2c0000
98 blk.10.ffn_down.weight 0x7631f400 0x2260000
99 blk.10.ffn_gate.weight 0x7857f400 0x2260000
100 blk.10.ffn_norm.weight 0x7a7df400 0x4000
101 blk.10.ffn_up.weight 0x7a7e3400 0x2260000
102 blk.11.attn_k.weight 0x7ca43400 0x240000
103 blk.11.attn_norm.weight 0x7cc83400 0x4000
104 blk.11.attn_output.weight 0x7cc87400 0xb00000
105 blk.11.attn_q.weight 0x7d787400 0xb00000
106 blk.11.attn_v.weight 0x7e287400 0x2c0000
107 blk.11.ffn_down.weight 0x7e547400 0x2260000
108 blk.11.ffn_gate.weight 0x807a7400 0x1a90000
109 blk.11.ffn_norm.weight 0x82237400 0x4000
110 blk.11.ffn_up.weight 0x8223b400 0x2260000
111 blk.12.attn_k.weight 0x8449b400 0x240000
112 blk.12.attn_norm.weight 0x846db400 0x4000
113 blk.12.attn_output.weight 0x846df400 0xb00000
114 blk.12.attn_q.weight 0x851df400 0xb00000
115 blk.12.attn_v.weight 0x85cdf400 0x2c0000
116 blk.12.ffn_down.weight 0x85f9f400 0x2260000
117 blk.12.ffn_gate.weight 0x881ff400 0x1a90000
118 blk.12.ffn_norm.weight 0x89c8f400 0x4000
119 blk.12.ffn_up.weight 0x89c93400 0x2260000
120 blk.13.attn_k.weight 0x8bef3400 0x2c0000
121 blk.13.attn_norm.weight 0x8c1b3400 0x4000
122 blk.13.attn_output.weight 0x8c1b7400 0xb00000
123 blk.13.attn_q.weight 0x8ccb7400 0xb00000
124 blk.13.attn_v.weight 0x8d7b7400 0x2c0000
125 blk.13.ffn_down.weight 0x8da77400 0x2260000
126 blk.13.ffn_gate.weight 0x8fcd7400 0x2260000
127 blk.13.ffn_norm.weight 0x91f37400 0x4000
128 blk.13.ffn_up.weight 0x91f3b400 0x2260000
129 blk.14.attn_k.weight 0x9419b400 0x2c0000
130 blk.14.attn_norm.weight 0x9445b400 0x4000
131 blk.14.attn_output.weight 0x9445f400 0xb00000
132 blk.14.attn_q.weight 0x94f5f400 0xb00000
133 blk.14.attn_v.weight 0x95a5f400 0x2c0000
134 blk.14.ffn_down.weight 0x95d1f400 0x2260000
135 blk.14.ffn_gate.weight 0x97f7f400 0x2260000
136 blk.14.ffn_norm.weight 0x9a1df400 0x4000
137 blk.14.ffn_up.weight 0x9a1e3400 0x2260000
138 blk.15.attn_k.weight 0x9c443400 0x2c0000
139 blk.15.attn_norm.weight 0x9c703400 0x4000
140 blk.15.attn_output.weight 0x9c707400 0xb00000
141 blk.15.attn_q.weight 0x9d207400 0xb00000
142 blk.15.attn_v.weight 0x9dd07400 0x2c0000
143 blk.15.ffn_down.weight 0x9dfc7400 0x2260000
144 blk.15.ffn_gate.weight 0xa0227400 0x2260000
145 blk.15.ffn_norm.weight 0xa2487400 0x4000
146 blk.15.ffn_up.weight 0xa248b400 0x2260000
147 blk.16.attn_k.weight 0xa46eb400 0x2c0000
148 blk.16.attn_norm.weight 0xa49ab400 0x4000
149 blk.16.attn_output.weight 0xa49af400 0xb00000
150 blk.16.attn_q.weight 0xa54af400 0xb00000
151 blk.16.attn_v.weight 0xa5faf400 0x2c0000
152 blk.16.ffn_down.weight 0xa626f400 0x2260000
153 blk.16.ffn_gate.weight 0xa84cf400 0x2260000
154 blk.16.ffn_norm.weight 0xaa72f400 0x4000
155 blk.16.ffn_up.weight 0xaa733400 0x2260000
156 blk.17.attn_k.weight 0xac993400 0x2c0000
157 blk.17.attn_norm.weight 0xacc53400 0x4000
158 blk.17.attn_output.weight 0xacc57400 0xb00000
159 blk.17.attn_q.weight 0xad757400 0xb00000
160 blk.17.attn_v.weight 0xae257400 0x2c0000
161 blk.17.ffn_down.weight 0xae517400 0x2260000
162 blk.17.ffn_gate.weight 0xb0777400 0x2260000
163 blk.17.ffn_norm.weight 0xb29d7400 0x4000
164 blk.17.ffn_up.weight 0xb29db400 0x2260000
165 blk.18.attn_k.weight 0xb4c3b400 0x240000
166 blk.18.attn_norm.weight 0xb4e7b400 0x4000
167 blk.18.attn_output.weight 0xb4e7f400 0xb00000
168 blk.18.attn_q.weight 0xb597f400 0xb00000
169 blk.18.attn_v.weight 0xb647f400 0x2c0000
170 blk.18.ffn_down.weight 0xb673f400 0x2260000
171 blk.18.ffn_gate.weight 0xb899f400 0x2260000
172 blk.18.ffn_norm.weight 0xbabff400 0x4000
173 blk.18.ffn_up.weight 0xbac03400 0x2260000
174 blk.19.attn_k.weight 0xbce63400 0x240000
175 blk.19.attn_norm.weight 0xbd0a3400 0x4000
176 blk.19.attn_output.weight 0xbd0a7400 0xb00000
177 blk.19.attn_q.weight 0xbdba7400 0xb00000
178 blk.19.attn_v.weight 0xbe6a7400 0x2c0000
179 blk.19.ffn_down.weight 0xbe967400 0x2260000
180 blk.19.ffn_gate.weight 0xc0bc7400 0x2260000
181 blk.19.ffn_norm.weight 0xc2e27400 0x4000
182 blk.19.ffn_up.weight 0xc2e2b400 0x2260000
183 blk.20.attn_k.weight 0xc508b400 0x2c0000
184 blk.20.attn_norm.weight 0xc534b400 0x4000
185 blk.20.attn_output.weight 0xc534f400 0xb00000
186 blk.20.attn_q.weight 0xc5e4f400 0xb00000
187 blk.20.attn_v.weight 0xc694f400 0x2c0000
188 blk.20.ffn_down.weight 0xc6c0f400 0x2260000
189 blk.20.ffn_gate.weight 0xc8e6f400 0x2260000
190 blk.20.ffn_norm.weight 0xcb0cf400 0x4000
191 blk.20.ffn_up.weight 0xcb0d3400 0x2260000
192 blk.21.attn_k.weight 0xcd333400 0x240000
193 blk.21.attn_norm.weight 0xcd573400 0x4000
194 blk.21.attn_output.weight 0xcd577400 0xb00000
195 blk.21.attn_q.weight 0xce077400 0xb00000
196 blk.21.attn_v.weight 0xceb77400 0x2c0000
197 blk.21.ffn_down.weight 0xcee37400 0x2260000
198 blk.21.ffn_gate.weight 0xd1097400 0x2260000
199 blk.21.ffn_norm.weight 0xd32f7400 0x4000
200 blk.21.ffn_up.weight 0xd32fb400 0x2260000
201 blk.22.attn_k.weight 0xd555b400 0x2c0000
202 blk.22.attn_norm.weight 0xd581b400 0x4000
203 blk.22.attn_output.weight 0xd581f400 0xb00000
204 blk.22.attn_q.weight 0xd631f400 0xb00000
205 blk.22.attn_v.weight 0xd6e1f400 0x2c0000
206 blk.22.ffn_down.weight 0xd70df400 0x2260000
207 blk.22.ffn_gate.weight 0xd933f400 0x2260000
208 blk.22.ffn_norm.weight 0xdb59f400 0x4000
209 blk.22.ffn_up.weight 0xdb5a3400 0x2260000
210 blk.23.attn_k.weight 0xdd803400 0x240000
211 blk.23.attn_norm.weight 0xdda43400 0x4000
212 blk.23.attn_output.weight 0xdda47400 0xb00000
213 blk.23.attn_q.weight 0xde547400 0xb00000
214 blk.23.attn_v.weight 0xdf047400 0x2c0000
215 blk.23.ffn_down.weight 0xdf307400 0x2260000
216 blk.23.ffn_gate.weight 0xe1567400 0x2260000
217 blk.23.ffn_norm.weight 0xe37c7400 0x4000
218 blk.23.ffn_up.weight 0xe37cb400 0x2260000
219 blk.24.attn_k.weight 0xe5a2b400 0x240000
220 blk.24.attn_norm.weight 0xe5c6b400 0x4000
221 blk.24.attn_output.weight 0xe5c6f400 0xd20000
222 blk.24.attn_q.weight 0xe698f400 0xb00000
223 blk.24.attn_v.weight 0xe748f400 0x2c0000
224 blk.24.ffn_down.weight 0xe774f400 0x2260000
225 blk.24.ffn_gate.weight 0xe99af400 0x2260000
226 blk.24.ffn_norm.weight 0xebc0f400 0x4000
227 blk.24.ffn_up.weight 0xebc13400 0x2260000
228 blk.25.attn_k.weight 0xede73400 0x240000
229 blk.25.attn_norm.weight 0xee0b3400 0x4000
230 blk.25.attn_output.weight 0xee0b7400 0xb00000
231 blk.25.attn_q.weight 0xeebb7400 0xb00000
232 blk.25.attn_v.weight 0xef6b7400 0x2c0000
233 blk.25.ffn_down.weight 0xef977400 0x2260000
234 blk.25.ffn_gate.weight 0xf1bd7400 0x2260000
235 blk.25.ffn_norm.weight 0xf3e37400 0x4000
236 blk.25.ffn_up.weight 0xf3e3b400 0x2260000
237 blk.26.attn_k.weight 0xf609b400 0x240000
238 blk.26.attn_norm.weight 0xf62db400 0x4000
239 blk.26.attn_output.weight 0xf62df400 0xb00000
240 blk.26.attn_q.weight 0xf6ddf400 0xb00000
241 blk.26.attn_v.weight 0xf78df400 0x2c0000
242 blk.26.ffn_down.weight 0xf7b9f400 0x2260000
243 blk.26.ffn_gate.weight 0xf9dff400 0x2260000
244 blk.26.ffn_norm.weight 0xfc05f400 0x4000
245 blk.26.ffn_up.weight 0xfc063400 0x2260000
246 blk.27.attn_k.weight 0xfe2c3400 0x2c0000
247 blk.27.attn_norm.weight 0xfe583400 0x4000
248 blk.27.attn_output.weight 0xfe587400 0xb00000
249 blk.27.attn_q.weight 0xff087400 0xb00000
250 blk.27.attn_v.weight 0xffb87400 0x2c0000
251 blk.27.ffn_down.weight 0xffe47400 0x2260000
252 blk.27.ffn_gate.weight 0x1020a7400 0x2260000
253 blk.27.ffn_norm.weight 0x104307400 0x4000
254 blk.27.ffn_up.weight 0x10430b400 0x2260000
255 blk.28.attn_k.weight 0x10656b400 0x2c0000
256 blk.28.attn_norm.weight 0x10682b400 0x4000
257 blk.28.attn_output.weight 0x10682f400 0xb00000
258 blk.28.attn_q.weight 0x10732f400 0xb00000
259 blk.28.attn_v.weight 0x107e2f400 0x2c0000
260 blk.28.ffn_down.weight 0x1080ef400 0x2260000
261 blk.28.ffn_gate.weight 0x10a34f400 0x2260000
262 blk.28.ffn_norm.weight 0x10c5af400 0x4000
263 blk.28.ffn_up.weight 0x10c5b3400 0x2260000
264 blk.29.attn_k.weight 0x10e813400 0x2c0000
265 blk.29.attn_norm.weight 0x10ead3400 0x4000
266 blk.29.attn_output.weight 0x10ead7400 0xb00000
267 blk.29.attn_q.weight 0x10f5d7400 0xb00000
268 blk.29.attn_v.weight 0x1100d7400 0x2c0000
269 blk.29.ffn_down.weight 0x110397400 0x2260000
270 blk.29.ffn_gate.weight 0x1125f7400 0x2260000
271 blk.29.ffn_norm.weight 0x114857400 0x4000
272 blk.29.ffn_up.weight 0x11485b400 0x2260000
273 blk.30.attn_k.weight 0x116abb400 0x2c0000
274 blk.30.attn_norm.weight 0x116d7b400 0x4000
275 blk.30.attn_output.weight 0x116d7f400 0xb00000
276 blk.30.attn_q.weight 0x11787f400 0xb00000
277 blk.30.attn_v.weight 0x11837f400 0x2c0000
278 blk.30.ffn_down.weight 0x11863f400 0x2260000
279 blk.30.ffn_gate.weight 0x11a89f400 0x2260000
280 blk.30.ffn_norm.weight 0x11caff400 0x4000
281 blk.30.ffn_up.weight 0x11cb03400 0x2260000
282 blk.31.attn_k.weight 0x11ed63400 0x2c0000
283 blk.31.attn_norm.weight 0x11f023400 0x4000
284 blk.31.attn_output.weight 0x11f027400 0xd20000
285 blk.31.attn_q.weight 0x11fd47400 0xb00000
286 blk.31.attn_v.weight 0x120847400 0x2c0000
287 blk.31.ffn_down.weight 0x120b07400 0x2260000
288 blk.31.ffn_gate.weight 0x122d67400 0x2260000
289 blk.31.ffn_norm.weight 0x124fc7400 0x4000
290 blk.31.ffn_up.weight 0x124fcb400 0x2260000
291 blk.32.attn_k.weight 0x12722b400 0x2c0000
292 blk.32.attn_norm.weight 0x1274eb400 0x4000
293 blk.32.attn_output.weight 0x1274ef400 0xb00000
294 blk.32.attn_q.weight 0x127fef400 0xb00000
295 blk.32.attn_v.weight 0x128aef400 0x2c0000
296 blk.32.ffn_down.weight 0x128daf400 0x2260000
297 blk.32.ffn_gate.weight 0x12b00f400 0x2260000
298 blk.32.ffn_norm.weight 0x12d26f400 0x4000
299 blk.32.ffn_up.weight 0x12d273400 0x2260000
300 blk.33.attn_k.weight 0x12f4d3400 0x2c0000
301 blk.33.attn_norm.weight 0x12f793400 0x4000
302 blk.33.attn_output.weight 0x12f797400 0xd20000
303 blk.33.attn_q.weight 0x1304b7400 0xb00000
304 blk.33.attn_v.weight 0x130fb7400 0x2c0000
305 blk.33.ffn_down.weight 0x131277400 0x2260000
306 blk.33.ffn_gate.weight 0x1334d7400 0x2260000
307 blk.33.ffn_norm.weight 0x135737400 0x4000
308 blk.33.ffn_up.weight 0x13573b400 0x2260000
309 blk.34.attn_k.weight 0x13799b400 0x2c0000
310 blk.34.attn_norm.weight 0x137c5b400 0x4000
311 blk.34.attn_output.weight 0x137c5f400 0xb00000
312 blk.34.attn_q.weight 0x13875f400 0xb00000
313 blk.34.attn_v.weight 0x13925f400 0x2c0000
314 blk.34.ffn_down.weight 0x13951f400 0x2260000
315 blk.34.ffn_gate.weight 0x13b77f400 0x2260000
316 blk.34.ffn_norm.weight 0x13d9df400 0x4000
317 blk.34.ffn_up.weight 0x13d9e3400 0x2260000
318 blk.35.attn_k.weight 0x13fc43400 0x240000
319 blk.35.attn_norm.weight 0x13fe83400 0x4000
320 blk.35.attn_output.weight 0x13fe87400 0xb00000
321 blk.35.attn_q.weight 0x140987400 0xb00000
322 blk.35.attn_v.weight 0x141487400 0x2c0000
323 blk.35.ffn_down.weight 0x141747400 0x2260000
324 blk.35.ffn_gate.weight 0x1439a7400 0x2260000
325 blk.35.ffn_norm.weight 0x145c07400 0x4000
326 blk.35.ffn_up.weight 0x145c0b400 0x2260000
327 blk.36.attn_k.weight 0x147e6b400 0x240000
328 blk.36.attn_norm.weight 0x1480ab400 0x4000
329 blk.36.attn_output.weight 0x1480af400 0xb00000
330 blk.36.attn_q.weight 0x148baf400 0xb00000
331 blk.36.attn_v.weight 0x1496af400 0x2c0000
332 blk.36.ffn_down.weight 0x14996f400 0x2260000
333 blk.36.ffn_gate.weight 0x14bbcf400 0x2260000
334 blk.36.ffn_norm.weight 0x14de2f400 0x4000
335 blk.36.ffn_up.weight 0x14de33400 0x2260000
336 blk.37.attn_k.weight 0x150093400 0x240000
337 blk.37.attn_norm.weight 0x1502d3400 0x4000
338 blk.37.attn_output.weight 0x1502d7400 0xb00000
339 blk.37.attn_q.weight 0x150dd7400 0xb00000
340 blk.37.attn_v.weight 0x1518d7400 0x2c0000
341 blk.37.ffn_down.weight 0x151b97400 0x2260000
342 blk.37.ffn_gate.weight 0x153df7400 0x2260000
343 blk.37.ffn_norm.weight 0x156057400 0x4000
344 blk.37.ffn_up.weight 0x15605b400 0x2260000
345 blk.38.attn_k.weight 0x1582bb400 0x240000
346 blk.38.attn_norm.weight 0x1584fb400 0x4000
347 blk.38.attn_output.weight 0x1584ff400 0xb00000
348 blk.38.attn_q.weight 0x158fff400 0xb00000
349 blk.38.attn_v.weight 0x159aff400 0x2c0000
350 blk.38.ffn_down.weight 0x159dbf400 0x2260000
351 blk.38.ffn_gate.weight 0x15c01f400 0x2260000
352 blk.38.ffn_norm.weight 0x15e27f400 0x4000
353 blk.38.ffn_up.weight 0x15e283400 0x2260000
354 blk.39.attn_k.weight 0x1604e3400 0x2c0000
355 blk.39.attn_norm.weight 0x1607a3400 0x4000
356 blk.39.attn_output.weight 0x1607a7400 0xb00000
357 blk.39.attn_q.weight 0x1612a7400 0xb00000
358 blk.39.attn_v.weight 0x161da7400 0x2c0000
359 blk.39.ffn_down.weight 0x162067400 0x2260000
360 blk.39.ffn_gate.weight 0x1642c7400 0x2260000
361 blk.39.ffn_norm.weight 0x166527400 0x4000
362 blk.39.ffn_up.weight 0x16652b400 0x2260000

Base Tensor Group : ~822M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
0 output.weight Output (W) (~411M) 411041792 4096 x 100352 x 1 x 1 Q6_K 6.5625
1 output_norm.weight Output Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
2 token_embd.weight Token Embedding (W) (~411M) 411041792 4096 x 100352 x 1 x 1 Q5_K 5.5000
  • Total elements in base: (~822M) 822087680
  • Percentage of total elements: 9.35%
  • Bits per Weight (BPW) for base: 6.0314 bits

Block 0 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
3 blk.0.attn_k.weight Block 0 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 IQ4_XS 4.2500
4 blk.0.attn_norm.weight Block 0 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
5 blk.0.attn_output.weight Block 0 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q4_K 4.5000
6 blk.0.attn_q.weight Block 0 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 IQ4_XS 4.2500
7 blk.0.attn_v.weight Block 0 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
8 blk.0.ffn_down.weight Block 0 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q4_K 4.5000
9 blk.0.ffn_gate.weight Block 0 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 IQ4_XS 4.2500
10 blk.0.ffn_norm.weight Block 0 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
11 blk.0.ffn_up.weight Block 0 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.0: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.0: 4.6932 bits

Block 1 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
12 blk.1.attn_k.weight Block 1 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
13 blk.1.attn_norm.weight Block 1 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
14 blk.1.attn_output.weight Block 1 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
15 blk.1.attn_q.weight Block 1 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
16 blk.1.attn_v.weight Block 1 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
17 blk.1.ffn_down.weight Block 1 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
18 blk.1.ffn_gate.weight Block 1 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
19 blk.1.ffn_norm.weight Block 1 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
20 blk.1.ffn_up.weight Block 1 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.1: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.1: 5.4800 bits

Block 2 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
21 blk.2.attn_k.weight Block 2 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
22 blk.2.attn_norm.weight Block 2 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
23 blk.2.attn_output.weight Block 2 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
24 blk.2.attn_q.weight Block 2 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
25 blk.2.attn_v.weight Block 2 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
26 blk.2.ffn_down.weight Block 2 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
27 blk.2.ffn_gate.weight Block 2 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
28 blk.2.ffn_norm.weight Block 2 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
29 blk.2.ffn_up.weight Block 2 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.2: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.2: 5.4800 bits

Block 3 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
30 blk.3.attn_k.weight Block 3 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
31 blk.3.attn_norm.weight Block 3 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
32 blk.3.attn_output.weight Block 3 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
33 blk.3.attn_q.weight Block 3 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q4_K 4.5000
34 blk.3.attn_v.weight Block 3 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
35 blk.3.ffn_down.weight Block 3 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q4_K 4.5000
36 blk.3.ffn_gate.weight Block 3 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
37 blk.3.ffn_norm.weight Block 3 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
38 blk.3.ffn_up.weight Block 3 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.3: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.3: 5.1327 bits

Block 4 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
39 blk.4.attn_k.weight Block 4 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
40 blk.4.attn_norm.weight Block 4 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
41 blk.4.attn_output.weight Block 4 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
42 blk.4.attn_q.weight Block 4 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
43 blk.4.attn_v.weight Block 4 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
44 blk.4.ffn_down.weight Block 4 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
45 blk.4.ffn_gate.weight Block 4 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
46 blk.4.ffn_norm.weight Block 4 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
47 blk.4.ffn_up.weight Block 4 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.4: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.4: 5.5011 bits

Block 5 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
48 blk.5.attn_k.weight Block 5 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
49 blk.5.attn_norm.weight Block 5 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
50 blk.5.attn_output.weight Block 5 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
51 blk.5.attn_q.weight Block 5 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
52 blk.5.attn_v.weight Block 5 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
53 blk.5.ffn_down.weight Block 5 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q4_K 4.5000
54 blk.5.ffn_gate.weight Block 5 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
55 blk.5.ffn_norm.weight Block 5 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
56 blk.5.ffn_up.weight Block 5 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.5: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.5: 5.2169 bits

Block 6 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
57 blk.6.attn_k.weight Block 6 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
58 blk.6.attn_norm.weight Block 6 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
59 blk.6.attn_output.weight Block 6 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
60 blk.6.attn_q.weight Block 6 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
61 blk.6.attn_v.weight Block 6 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_1 6.0000
62 blk.6.ffn_down.weight Block 6 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
63 blk.6.ffn_gate.weight Block 6 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
64 blk.6.ffn_norm.weight Block 6 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
65 blk.6.ffn_up.weight Block 6 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.6: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.6: 5.4906 bits

Block 7 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
66 blk.7.attn_k.weight Block 7 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
67 blk.7.attn_norm.weight Block 7 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
68 blk.7.attn_output.weight Block 7 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
69 blk.7.attn_q.weight Block 7 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
70 blk.7.attn_v.weight Block 7 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
71 blk.7.ffn_down.weight Block 7 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
72 blk.7.ffn_gate.weight Block 7 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
73 blk.7.ffn_norm.weight Block 7 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
74 blk.7.ffn_up.weight Block 7 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.7: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.7: 5.5011 bits

Block 8 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
75 blk.8.attn_k.weight Block 8 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
76 blk.8.attn_norm.weight Block 8 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
77 blk.8.attn_output.weight Block 8 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
78 blk.8.attn_q.weight Block 8 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
79 blk.8.attn_v.weight Block 8 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
80 blk.8.ffn_down.weight Block 8 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
81 blk.8.ffn_gate.weight Block 8 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
82 blk.8.ffn_norm.weight Block 8 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
83 blk.8.ffn_up.weight Block 8 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.8: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.8: 5.4800 bits

Block 9 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
84 blk.9.attn_k.weight Block 9 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
85 blk.9.attn_norm.weight Block 9 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
86 blk.9.attn_output.weight Block 9 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
87 blk.9.attn_q.weight Block 9 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
88 blk.9.attn_v.weight Block 9 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
89 blk.9.ffn_down.weight Block 9 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
90 blk.9.ffn_gate.weight Block 9 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
91 blk.9.ffn_norm.weight Block 9 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
92 blk.9.ffn_up.weight Block 9 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.9: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.9: 5.4800 bits

Block 10 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
93 blk.10.attn_k.weight Block 10 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
94 blk.10.attn_norm.weight Block 10 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
95 blk.10.attn_output.weight Block 10 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
96 blk.10.attn_q.weight Block 10 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
97 blk.10.attn_v.weight Block 10 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
98 blk.10.ffn_down.weight Block 10 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
99 blk.10.ffn_gate.weight Block 10 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
100 blk.10.ffn_norm.weight Block 10 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
101 blk.10.ffn_up.weight Block 10 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.10: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.10: 5.4800 bits

Block 11 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
102 blk.11.attn_k.weight Block 11 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
103 blk.11.attn_norm.weight Block 11 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
104 blk.11.attn_output.weight Block 11 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
105 blk.11.attn_q.weight Block 11 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
106 blk.11.attn_v.weight Block 11 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
107 blk.11.ffn_down.weight Block 11 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
108 blk.11.ffn_gate.weight Block 11 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 IQ4_XS 4.2500
109 blk.11.ffn_norm.weight Block 11 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
110 blk.11.ffn_up.weight Block 11 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.11: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.11: 5.1511 bits

Block 12 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
111 blk.12.attn_k.weight Block 12 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
112 blk.12.attn_norm.weight Block 12 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
113 blk.12.attn_output.weight Block 12 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
114 blk.12.attn_q.weight Block 12 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
115 blk.12.attn_v.weight Block 12 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
116 blk.12.ffn_down.weight Block 12 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
117 blk.12.ffn_gate.weight Block 12 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 IQ4_XS 4.2500
118 blk.12.ffn_norm.weight Block 12 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
119 blk.12.ffn_up.weight Block 12 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.12: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.12: 5.1511 bits

Block 13 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
120 blk.13.attn_k.weight Block 13 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
121 blk.13.attn_norm.weight Block 13 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
122 blk.13.attn_output.weight Block 13 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
123 blk.13.attn_q.weight Block 13 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
124 blk.13.attn_v.weight Block 13 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
125 blk.13.ffn_down.weight Block 13 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
126 blk.13.ffn_gate.weight Block 13 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
127 blk.13.ffn_norm.weight Block 13 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
128 blk.13.ffn_up.weight Block 13 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.13: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.13: 5.5011 bits

Block 14 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
129 blk.14.attn_k.weight Block 14 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
130 blk.14.attn_norm.weight Block 14 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
131 blk.14.attn_output.weight Block 14 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
132 blk.14.attn_q.weight Block 14 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
133 blk.14.attn_v.weight Block 14 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
134 blk.14.ffn_down.weight Block 14 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
135 blk.14.ffn_gate.weight Block 14 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
136 blk.14.ffn_norm.weight Block 14 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
137 blk.14.ffn_up.weight Block 14 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.14: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.14: 5.5011 bits

Block 15 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
138 blk.15.attn_k.weight Block 15 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
139 blk.15.attn_norm.weight Block 15 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
140 blk.15.attn_output.weight Block 15 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
141 blk.15.attn_q.weight Block 15 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
142 blk.15.attn_v.weight Block 15 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
143 blk.15.ffn_down.weight Block 15 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
144 blk.15.ffn_gate.weight Block 15 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
145 blk.15.ffn_norm.weight Block 15 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
146 blk.15.ffn_up.weight Block 15 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.15: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.15: 5.5011 bits

Block 16 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
147 blk.16.attn_k.weight Block 16 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
148 blk.16.attn_norm.weight Block 16 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
149 blk.16.attn_output.weight Block 16 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
150 blk.16.attn_q.weight Block 16 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
151 blk.16.attn_v.weight Block 16 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
152 blk.16.ffn_down.weight Block 16 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
153 blk.16.ffn_gate.weight Block 16 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
154 blk.16.ffn_norm.weight Block 16 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
155 blk.16.ffn_up.weight Block 16 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.16: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.16: 5.5011 bits

Block 17 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
156 blk.17.attn_k.weight Block 17 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
157 blk.17.attn_norm.weight Block 17 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
158 blk.17.attn_output.weight Block 17 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
159 blk.17.attn_q.weight Block 17 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
160 blk.17.attn_v.weight Block 17 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
161 blk.17.ffn_down.weight Block 17 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
162 blk.17.ffn_gate.weight Block 17 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
163 blk.17.ffn_norm.weight Block 17 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
164 blk.17.ffn_up.weight Block 17 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.17: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.17: 5.5011 bits

Block 18 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
165 blk.18.attn_k.weight Block 18 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
166 blk.18.attn_norm.weight Block 18 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
167 blk.18.attn_output.weight Block 18 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
168 blk.18.attn_q.weight Block 18 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
169 blk.18.attn_v.weight Block 18 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
170 blk.18.ffn_down.weight Block 18 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
171 blk.18.ffn_gate.weight Block 18 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
172 blk.18.ffn_norm.weight Block 18 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
173 blk.18.ffn_up.weight Block 18 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.18: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.18: 5.4800 bits

Block 19 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
174 blk.19.attn_k.weight Block 19 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
175 blk.19.attn_norm.weight Block 19 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
176 blk.19.attn_output.weight Block 19 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
177 blk.19.attn_q.weight Block 19 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
178 blk.19.attn_v.weight Block 19 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
179 blk.19.ffn_down.weight Block 19 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
180 blk.19.ffn_gate.weight Block 19 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
181 blk.19.ffn_norm.weight Block 19 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
182 blk.19.ffn_up.weight Block 19 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.19: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.19: 5.4800 bits

Block 20 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
183 blk.20.attn_k.weight Block 20 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
184 blk.20.attn_norm.weight Block 20 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
185 blk.20.attn_output.weight Block 20 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
186 blk.20.attn_q.weight Block 20 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
187 blk.20.attn_v.weight Block 20 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
188 blk.20.ffn_down.weight Block 20 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
189 blk.20.ffn_gate.weight Block 20 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
190 blk.20.ffn_norm.weight Block 20 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
191 blk.20.ffn_up.weight Block 20 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.20: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.20: 5.5011 bits

Block 21 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
192 blk.21.attn_k.weight Block 21 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
193 blk.21.attn_norm.weight Block 21 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
194 blk.21.attn_output.weight Block 21 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
195 blk.21.attn_q.weight Block 21 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
196 blk.21.attn_v.weight Block 21 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
197 blk.21.ffn_down.weight Block 21 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
198 blk.21.ffn_gate.weight Block 21 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
199 blk.21.ffn_norm.weight Block 21 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
200 blk.21.ffn_up.weight Block 21 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.21: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.21: 5.4800 bits

Block 22 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
201 blk.22.attn_k.weight Block 22 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
202 blk.22.attn_norm.weight Block 22 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
203 blk.22.attn_output.weight Block 22 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
204 blk.22.attn_q.weight Block 22 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
205 blk.22.attn_v.weight Block 22 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
206 blk.22.ffn_down.weight Block 22 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
207 blk.22.ffn_gate.weight Block 22 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
208 blk.22.ffn_norm.weight Block 22 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
209 blk.22.ffn_up.weight Block 22 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.22: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.22: 5.5011 bits

Block 23 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
210 blk.23.attn_k.weight Block 23 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
211 blk.23.attn_norm.weight Block 23 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
212 blk.23.attn_output.weight Block 23 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
213 blk.23.attn_q.weight Block 23 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
214 blk.23.attn_v.weight Block 23 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
215 blk.23.ffn_down.weight Block 23 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
216 blk.23.ffn_gate.weight Block 23 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
217 blk.23.ffn_norm.weight Block 23 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
218 blk.23.ffn_up.weight Block 23 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.23: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.23: 5.4800 bits

Block 24 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
219 blk.24.attn_k.weight Block 24 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
220 blk.24.attn_norm.weight Block 24 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
221 blk.24.attn_output.weight Block 24 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K 6.5625
222 blk.24.attn_q.weight Block 24 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
223 blk.24.attn_v.weight Block 24 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
224 blk.24.ffn_down.weight Block 24 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
225 blk.24.ffn_gate.weight Block 24 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
226 blk.24.ffn_norm.weight Block 24 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
227 blk.24.ffn_up.weight Block 24 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.24: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.24: 5.5695 bits

Block 25 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
228 blk.25.attn_k.weight Block 25 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
229 blk.25.attn_norm.weight Block 25 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
230 blk.25.attn_output.weight Block 25 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
231 blk.25.attn_q.weight Block 25 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
232 blk.25.attn_v.weight Block 25 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
233 blk.25.ffn_down.weight Block 25 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
234 blk.25.ffn_gate.weight Block 25 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
235 blk.25.ffn_norm.weight Block 25 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
236 blk.25.ffn_up.weight Block 25 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.25: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.25: 5.4800 bits

Block 26 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
237 blk.26.attn_k.weight Block 26 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
238 blk.26.attn_norm.weight Block 26 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
239 blk.26.attn_output.weight Block 26 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
240 blk.26.attn_q.weight Block 26 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
241 blk.26.attn_v.weight Block 26 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
242 blk.26.ffn_down.weight Block 26 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
243 blk.26.ffn_gate.weight Block 26 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
244 blk.26.ffn_norm.weight Block 26 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
245 blk.26.ffn_up.weight Block 26 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.26: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.26: 5.4800 bits

Block 27 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
246 blk.27.attn_k.weight Block 27 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
247 blk.27.attn_norm.weight Block 27 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
248 blk.27.attn_output.weight Block 27 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
249 blk.27.attn_q.weight Block 27 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
250 blk.27.attn_v.weight Block 27 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
251 blk.27.ffn_down.weight Block 27 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
252 blk.27.ffn_gate.weight Block 27 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
253 blk.27.ffn_norm.weight Block 27 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
254 blk.27.ffn_up.weight Block 27 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.27: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.27: 5.5011 bits

Block 28 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
255 blk.28.attn_k.weight Block 28 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
256 blk.28.attn_norm.weight Block 28 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
257 blk.28.attn_output.weight Block 28 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
258 blk.28.attn_q.weight Block 28 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
259 blk.28.attn_v.weight Block 28 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
260 blk.28.ffn_down.weight Block 28 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
261 blk.28.ffn_gate.weight Block 28 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
262 blk.28.ffn_norm.weight Block 28 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
263 blk.28.ffn_up.weight Block 28 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.28: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.28: 5.5011 bits

Block 29 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
264 blk.29.attn_k.weight Block 29 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
265 blk.29.attn_norm.weight Block 29 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
266 blk.29.attn_output.weight Block 29 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
267 blk.29.attn_q.weight Block 29 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
268 blk.29.attn_v.weight Block 29 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
269 blk.29.ffn_down.weight Block 29 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
270 blk.29.ffn_gate.weight Block 29 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
271 blk.29.ffn_norm.weight Block 29 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
272 blk.29.ffn_up.weight Block 29 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.29: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.29: 5.5011 bits

Block 30 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
273 blk.30.attn_k.weight Block 30 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
274 blk.30.attn_norm.weight Block 30 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
275 blk.30.attn_output.weight Block 30 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
276 blk.30.attn_q.weight Block 30 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
277 blk.30.attn_v.weight Block 30 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
278 blk.30.ffn_down.weight Block 30 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
279 blk.30.ffn_gate.weight Block 30 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
280 blk.30.ffn_norm.weight Block 30 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
281 blk.30.ffn_up.weight Block 30 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.30: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.30: 5.5011 bits

Block 31 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
282 blk.31.attn_k.weight Block 31 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
283 blk.31.attn_norm.weight Block 31 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
284 blk.31.attn_output.weight Block 31 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K 6.5625
285 blk.31.attn_q.weight Block 31 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
286 blk.31.attn_v.weight Block 31 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
287 blk.31.ffn_down.weight Block 31 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
288 blk.31.ffn_gate.weight Block 31 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
289 blk.31.ffn_norm.weight Block 31 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
290 blk.31.ffn_up.weight Block 31 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.31: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.31: 5.5906 bits

Block 32 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
291 blk.32.attn_k.weight Block 32 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
292 blk.32.attn_norm.weight Block 32 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
293 blk.32.attn_output.weight Block 32 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
294 blk.32.attn_q.weight Block 32 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
295 blk.32.attn_v.weight Block 32 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
296 blk.32.ffn_down.weight Block 32 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
297 blk.32.ffn_gate.weight Block 32 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
298 blk.32.ffn_norm.weight Block 32 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
299 blk.32.ffn_up.weight Block 32 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.32: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.32: 5.5011 bits

Block 33 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
300 blk.33.attn_k.weight Block 33 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
301 blk.33.attn_norm.weight Block 33 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
302 blk.33.attn_output.weight Block 33 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K 6.5625
303 blk.33.attn_q.weight Block 33 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
304 blk.33.attn_v.weight Block 33 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
305 blk.33.ffn_down.weight Block 33 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
306 blk.33.ffn_gate.weight Block 33 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
307 blk.33.ffn_norm.weight Block 33 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
308 blk.33.ffn_up.weight Block 33 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.33: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.33: 5.5906 bits

Block 34 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
309 blk.34.attn_k.weight Block 34 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
310 blk.34.attn_norm.weight Block 34 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
311 blk.34.attn_output.weight Block 34 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
312 blk.34.attn_q.weight Block 34 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
313 blk.34.attn_v.weight Block 34 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
314 blk.34.ffn_down.weight Block 34 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
315 blk.34.ffn_gate.weight Block 34 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
316 blk.34.ffn_norm.weight Block 34 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
317 blk.34.ffn_up.weight Block 34 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.34: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.34: 5.5011 bits

Block 35 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
318 blk.35.attn_k.weight Block 35 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
319 blk.35.attn_norm.weight Block 35 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
320 blk.35.attn_output.weight Block 35 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
321 blk.35.attn_q.weight Block 35 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
322 blk.35.attn_v.weight Block 35 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
323 blk.35.ffn_down.weight Block 35 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
324 blk.35.ffn_gate.weight Block 35 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
325 blk.35.ffn_norm.weight Block 35 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
326 blk.35.ffn_up.weight Block 35 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.35: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.35: 5.4800 bits

Block 36 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
327 blk.36.attn_k.weight Block 36 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
328 blk.36.attn_norm.weight Block 36 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
329 blk.36.attn_output.weight Block 36 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
330 blk.36.attn_q.weight Block 36 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
331 blk.36.attn_v.weight Block 36 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
332 blk.36.ffn_down.weight Block 36 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
333 blk.36.ffn_gate.weight Block 36 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
334 blk.36.ffn_norm.weight Block 36 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
335 blk.36.ffn_up.weight Block 36 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.36: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.36: 5.4800 bits

Block 37 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
336 blk.37.attn_k.weight Block 37 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
337 blk.37.attn_norm.weight Block 37 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
338 blk.37.attn_output.weight Block 37 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
339 blk.37.attn_q.weight Block 37 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
340 blk.37.attn_v.weight Block 37 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
341 blk.37.ffn_down.weight Block 37 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
342 blk.37.ffn_gate.weight Block 37 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
343 blk.37.ffn_norm.weight Block 37 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
344 blk.37.ffn_up.weight Block 37 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.37: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.37: 5.4800 bits

Block 38 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
345 blk.38.attn_k.weight Block 38 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q4_K 4.5000
346 blk.38.attn_norm.weight Block 38 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
347 blk.38.attn_output.weight Block 38 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
348 blk.38.attn_q.weight Block 38 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
349 blk.38.attn_v.weight Block 38 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
350 blk.38.ffn_down.weight Block 38 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
351 blk.38.ffn_gate.weight Block 38 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
352 blk.38.ffn_norm.weight Block 38 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
353 blk.38.ffn_up.weight Block 38 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.38: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.38: 5.4800 bits

Block 39 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
354 blk.39.attn_k.weight Block 39 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
355 blk.39.attn_norm.weight Block 39 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
356 blk.39.attn_output.weight Block 39 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
357 blk.39.attn_q.weight Block 39 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q5_K 5.5000
358 blk.39.attn_v.weight Block 39 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q5_K 5.5000
359 blk.39.ffn_down.weight Block 39 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_K 5.5000
360 blk.39.ffn_gate.weight Block 39 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
361 blk.39.ffn_norm.weight Block 39 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
362 blk.39.ffn_up.weight Block 39 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q5_K 5.5000
  • Total elements in blk.39: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.39: 5.5011 bits

Total BPW for granite-4.1-8b-Q5_K.gguf: 5.4999 bits