Files
granite-4.1-8b-GGUF/scores/granite-4.1-8b-Q8_0.md
ModelHub XC a947aa221e 初始化项目,由ModelHub XC社区提供模型
Model: eaddario/granite-4.1-8b-GGUF
Source: Original Platform
2026-06-14 00:38:20 +08:00

108 KiB

granite-4.1-8b-WIP/granite-4.1-8b-Q8_0.gguf - GGUF Internal File Dump

  • Endian: LITTLE endian

Key Value Metadata Store

There are 42 key-value pairs in this file

POS TYPE Count Key Value
1 UINT32 1 GGUF.version 3
2 UINT64 1 GGUF.tensor_count 363
3 UINT64 1 GGUF.kv_count 39
4 STRING 1 general.architecture granite
5 STRING 1 general.type model
6 STRING 1 general.name Granite 4.1 8b
7 STRING 1 general.basename granite-4.1
8 STRING 1 general.size_label 8B
9 STRING 1 general.license apache-2.0
10 [STRING] 2 general.tags [ language, granite-4.1 ]
11 UINT32 1 granite.block_count 40
12 UINT32 1 granite.context_length 131072
13 UINT32 1 granite.embedding_length 4096
14 UINT32 1 granite.feed_forward_length 12800
15 UINT32 1 granite.attention.head_count 32
16 UINT32 1 granite.attention.head_count_kv 8
17 FLOAT32 1 granite.rope.freq_base 10000000.0
18 FLOAT32 1 granite.attention.layer_norm_rms_epsilon 1e-05
19 UINT32 1 granite.vocab_size 100352
20 UINT32 1 granite.rope.dimension_count 128
21 FLOAT32 1 granite.attention.scale 0.0078125
22 FLOAT32 1 granite.embedding_scale 12.0
23 FLOAT32 1 granite.residual_scale 0.22
24 FLOAT32 1 granite.logit_scale 16.0
25 STRING 1 tokenizer.ggml.model gpt2
26 STRING 1 tokenizer.ggml.pre granite-docling
27 [STRING] 100352 tokenizer.ggml.tokens [ !, ", #, $, %, ... ]
28 [INT32] 100352 tokenizer.ggml.token_type [ 1, 1, 1, 1, 1, 1, 1, ... ]
29 [STRING] 100000 tokenizer.ggml.merges [ Ġ Ġ, ĠĠ ĠĠ, i n, Ġ t, ĠĠĠĠ ĠĠĠĠ, ... ]
30 UINT32 1 tokenizer.ggml.bos_token_id 100257
31 UINT32 1 tokenizer.ggml.eos_token_id 100257
32 UINT32 1 tokenizer.ggml.unknown_token_id 100269
33 UINT32 1 tokenizer.ggml.padding_token_id 100256
34 BOOL 1 tokenizer.ggml.add_bos_token False
35 STRING 1 tokenizer.chat_template {%- set tools_system_message_p...`end_of_role
36 BOOL 1 tokenizer.ggml.add_space_prefix False
37 UINT32 1 general.quantization_version 2
38 UINT32 1 general.file_type 7
39 STRING 1 quantize.imatrix.file imatrix/imatrix-granite-4.1-8b-medium.gguf
40 STRING 1 quantize.imatrix.dataset ../../datasets/imatrix/combined_all_medium.txt
41 UINT32 1 quantize.imatrix.entries_count 280
42 UINT32 1 quantize.imatrix.chunks_count 3601

Tensors Overview ~9B Elements

Total number of elements in all tensors: 8791592960 Elements

Tensor Data Offset

This table contains the offset and data segment relative to start of file

T_ID Tensor Layer Name Data Offset (B) Data Size (B)
0 output.weight 0x367400 0x1a080000
1 output_norm.weight 0x1a3e7400 0x4000
2 token_embd.weight 0x1a3eb400 0x1a080000
3 blk.0.attn_k.weight 0x3446b400 0x440000
4 blk.0.attn_norm.weight 0x348ab400 0x4000
5 blk.0.attn_output.weight 0x348af400 0x1100000
6 blk.0.attn_q.weight 0x359af400 0xd20000
7 blk.0.attn_v.weight 0x366cf400 0x440000
8 blk.0.ffn_down.weight 0x36b0f400 0x3520000
9 blk.0.ffn_gate.weight 0x3a02f400 0x2904000
10 blk.0.ffn_norm.weight 0x3c933400 0x4000
11 blk.0.ffn_up.weight 0x3c937400 0x3520000
12 blk.1.attn_k.weight 0x3fe57400 0x440000
13 blk.1.attn_norm.weight 0x40297400 0x4000
14 blk.1.attn_output.weight 0x4029b400 0x1100000
15 blk.1.attn_q.weight 0x4139b400 0x1100000
16 blk.1.attn_v.weight 0x4249b400 0x440000
17 blk.1.ffn_down.weight 0x428db400 0x3520000
18 blk.1.ffn_gate.weight 0x45dfb400 0x3520000
19 blk.1.ffn_norm.weight 0x4931b400 0x4000
20 blk.1.ffn_up.weight 0x4931f400 0x3520000
21 blk.2.attn_k.weight 0x4c83f400 0x440000
22 blk.2.attn_norm.weight 0x4cc7f400 0x4000
23 blk.2.attn_output.weight 0x4cc83400 0x1100000
24 blk.2.attn_q.weight 0x4dd83400 0x1100000
25 blk.2.attn_v.weight 0x4ee83400 0x440000
26 blk.2.ffn_down.weight 0x4f2c3400 0x3520000
27 blk.2.ffn_gate.weight 0x527e3400 0x3520000
28 blk.2.ffn_norm.weight 0x55d03400 0x4000
29 blk.2.ffn_up.weight 0x55d07400 0x3520000
30 blk.3.attn_k.weight 0x59227400 0x440000
31 blk.3.attn_norm.weight 0x59667400 0x4000
32 blk.3.attn_output.weight 0x5966b400 0x1100000
33 blk.3.attn_q.weight 0x5a76b400 0x1100000
34 blk.3.attn_v.weight 0x5b86b400 0x800000
35 blk.3.ffn_down.weight 0x5c06b400 0x2580000
36 blk.3.ffn_gate.weight 0x5e5eb400 0x3520000
37 blk.3.ffn_norm.weight 0x61b0b400 0x4000
38 blk.3.ffn_up.weight 0x61b0f400 0x3520000
39 blk.4.attn_k.weight 0x6502f400 0x440000
40 blk.4.attn_norm.weight 0x6546f400 0x4000
41 blk.4.attn_output.weight 0x65473400 0x1100000
42 blk.4.attn_q.weight 0x66573400 0x1100000
43 blk.4.attn_v.weight 0x67673400 0x800000
44 blk.4.ffn_down.weight 0x67e73400 0x3520000
45 blk.4.ffn_gate.weight 0x6b393400 0x3520000
46 blk.4.ffn_norm.weight 0x6e8b3400 0x4000
47 blk.4.ffn_up.weight 0x6e8b7400 0x3520000
48 blk.5.attn_k.weight 0x71dd7400 0x440000
49 blk.5.attn_norm.weight 0x72217400 0x4000
50 blk.5.attn_output.weight 0x7221b400 0x1100000
51 blk.5.attn_q.weight 0x7331b400 0x1100000
52 blk.5.attn_v.weight 0x7441b400 0x800000
53 blk.5.ffn_down.weight 0x74c1b400 0x2580000
54 blk.5.ffn_gate.weight 0x7719b400 0x3520000
55 blk.5.ffn_norm.weight 0x7a6bb400 0x4000
56 blk.5.ffn_up.weight 0x7a6bf400 0x3520000
57 blk.6.attn_k.weight 0x7dbdf400 0x440000
58 blk.6.attn_norm.weight 0x7e01f400 0x4000
59 blk.6.attn_output.weight 0x7e023400 0x1100000
60 blk.6.attn_q.weight 0x7f123400 0x1100000
61 blk.6.attn_v.weight 0x80223400 0x800000
62 blk.6.ffn_down.weight 0x80a23400 0x3520000
63 blk.6.ffn_gate.weight 0x83f43400 0x3520000
64 blk.6.ffn_norm.weight 0x87463400 0x4000
65 blk.6.ffn_up.weight 0x87467400 0x3520000
66 blk.7.attn_k.weight 0x8a987400 0x440000
67 blk.7.attn_norm.weight 0x8adc7400 0x4000
68 blk.7.attn_output.weight 0x8adcb400 0x1100000
69 blk.7.attn_q.weight 0x8becb400 0x1100000
70 blk.7.attn_v.weight 0x8cfcb400 0x800000
71 blk.7.ffn_down.weight 0x8d7cb400 0x3520000
72 blk.7.ffn_gate.weight 0x90ceb400 0x3520000
73 blk.7.ffn_norm.weight 0x9420b400 0x4000
74 blk.7.ffn_up.weight 0x9420f400 0x3520000
75 blk.8.attn_k.weight 0x9772f400 0x440000
76 blk.8.attn_norm.weight 0x97b6f400 0x4000
77 blk.8.attn_output.weight 0x97b73400 0x1100000
78 blk.8.attn_q.weight 0x98c73400 0x1100000
79 blk.8.attn_v.weight 0x99d73400 0x440000
80 blk.8.ffn_down.weight 0x9a1b3400 0x3520000
81 blk.8.ffn_gate.weight 0x9d6d3400 0x3520000
82 blk.8.ffn_norm.weight 0xa0bf3400 0x4000
83 blk.8.ffn_up.weight 0xa0bf7400 0x3520000
84 blk.9.attn_k.weight 0xa4117400 0x440000
85 blk.9.attn_norm.weight 0xa4557400 0x4000
86 blk.9.attn_output.weight 0xa455b400 0x1100000
87 blk.9.attn_q.weight 0xa565b400 0x1100000
88 blk.9.attn_v.weight 0xa675b400 0x800000
89 blk.9.ffn_down.weight 0xa6f5b400 0x3520000
90 blk.9.ffn_gate.weight 0xaa47b400 0x3520000
91 blk.9.ffn_norm.weight 0xad99b400 0x4000
92 blk.9.ffn_up.weight 0xad99f400 0x3520000
93 blk.10.attn_k.weight 0xb0ebf400 0x440000
94 blk.10.attn_norm.weight 0xb12ff400 0x4000
95 blk.10.attn_output.weight 0xb1303400 0x1100000
96 blk.10.attn_q.weight 0xb2403400 0x1100000
97 blk.10.attn_v.weight 0xb3503400 0x440000
98 blk.10.ffn_down.weight 0xb3943400 0x3520000
99 blk.10.ffn_gate.weight 0xb6e63400 0x3520000
100 blk.10.ffn_norm.weight 0xba383400 0x4000
101 blk.10.ffn_up.weight 0xba387400 0x3520000
102 blk.11.attn_k.weight 0xbd8a7400 0x440000
103 blk.11.attn_norm.weight 0xbdce7400 0x4000
104 blk.11.attn_output.weight 0xbdceb400 0x1100000
105 blk.11.attn_q.weight 0xbedeb400 0x1100000
106 blk.11.attn_v.weight 0xbfeeb400 0x440000
107 blk.11.ffn_down.weight 0xc032b400 0x3520000
108 blk.11.ffn_gate.weight 0xc384b400 0x3520000
109 blk.11.ffn_norm.weight 0xc6d6b400 0x4000
110 blk.11.ffn_up.weight 0xc6d6f400 0x3520000
111 blk.12.attn_k.weight 0xca28f400 0x440000
112 blk.12.attn_norm.weight 0xca6cf400 0x4000
113 blk.12.attn_output.weight 0xca6d3400 0x1100000
114 blk.12.attn_q.weight 0xcb7d3400 0x1100000
115 blk.12.attn_v.weight 0xcc8d3400 0x440000
116 blk.12.ffn_down.weight 0xccd13400 0x3520000
117 blk.12.ffn_gate.weight 0xd0233400 0x3520000
118 blk.12.ffn_norm.weight 0xd3753400 0x4000
119 blk.12.ffn_up.weight 0xd3757400 0x3520000
120 blk.13.attn_k.weight 0xd6c77400 0x440000
121 blk.13.attn_norm.weight 0xd70b7400 0x4000
122 blk.13.attn_output.weight 0xd70bb400 0x1100000
123 blk.13.attn_q.weight 0xd81bb400 0x1100000
124 blk.13.attn_v.weight 0xd92bb400 0x440000
125 blk.13.ffn_down.weight 0xd96fb400 0x3520000
126 blk.13.ffn_gate.weight 0xdcc1b400 0x3520000
127 blk.13.ffn_norm.weight 0xe013b400 0x4000
128 blk.13.ffn_up.weight 0xe013f400 0x3520000
129 blk.14.attn_k.weight 0xe365f400 0x440000
130 blk.14.attn_norm.weight 0xe3a9f400 0x4000
131 blk.14.attn_output.weight 0xe3aa3400 0x1100000
132 blk.14.attn_q.weight 0xe4ba3400 0x1100000
133 blk.14.attn_v.weight 0xe5ca3400 0x440000
134 blk.14.ffn_down.weight 0xe60e3400 0x3520000
135 blk.14.ffn_gate.weight 0xe9603400 0x3520000
136 blk.14.ffn_norm.weight 0xecb23400 0x4000
137 blk.14.ffn_up.weight 0xecb27400 0x3520000
138 blk.15.attn_k.weight 0xf0047400 0x440000
139 blk.15.attn_norm.weight 0xf0487400 0x4000
140 blk.15.attn_output.weight 0xf048b400 0x1100000
141 blk.15.attn_q.weight 0xf158b400 0x1100000
142 blk.15.attn_v.weight 0xf268b400 0x800000
143 blk.15.ffn_down.weight 0xf2e8b400 0x3520000
144 blk.15.ffn_gate.weight 0xf63ab400 0x3520000
145 blk.15.ffn_norm.weight 0xf98cb400 0x4000
146 blk.15.ffn_up.weight 0xf98cf400 0x3520000
147 blk.16.attn_k.weight 0xfcdef400 0x440000
148 blk.16.attn_norm.weight 0xfd22f400 0x4000
149 blk.16.attn_output.weight 0xfd233400 0x1100000
150 blk.16.attn_q.weight 0xfe333400 0x1100000
151 blk.16.attn_v.weight 0xff433400 0x800000
152 blk.16.ffn_down.weight 0xffc33400 0x3520000
153 blk.16.ffn_gate.weight 0x103153400 0x3520000
154 blk.16.ffn_norm.weight 0x106673400 0x4000
155 blk.16.ffn_up.weight 0x106677400 0x3520000
156 blk.17.attn_k.weight 0x109b97400 0x440000
157 blk.17.attn_norm.weight 0x109fd7400 0x4000
158 blk.17.attn_output.weight 0x109fdb400 0x1100000
159 blk.17.attn_q.weight 0x10b0db400 0x1100000
160 blk.17.attn_v.weight 0x10c1db400 0x440000
161 blk.17.ffn_down.weight 0x10c61b400 0x3520000
162 blk.17.ffn_gate.weight 0x10fb3b400 0x3520000
163 blk.17.ffn_norm.weight 0x11305b400 0x4000
164 blk.17.ffn_up.weight 0x11305f400 0x3520000
165 blk.18.attn_k.weight 0x11657f400 0x440000
166 blk.18.attn_norm.weight 0x1169bf400 0x4000
167 blk.18.attn_output.weight 0x1169c3400 0x1100000
168 blk.18.attn_q.weight 0x117ac3400 0x1100000
169 blk.18.attn_v.weight 0x118bc3400 0x440000
170 blk.18.ffn_down.weight 0x119003400 0x3520000
171 blk.18.ffn_gate.weight 0x11c523400 0x3520000
172 blk.18.ffn_norm.weight 0x11fa43400 0x4000
173 blk.18.ffn_up.weight 0x11fa47400 0x3520000
174 blk.19.attn_k.weight 0x122f67400 0x440000
175 blk.19.attn_norm.weight 0x1233a7400 0x4000
176 blk.19.attn_output.weight 0x1233ab400 0x1100000
177 blk.19.attn_q.weight 0x1244ab400 0x1100000
178 blk.19.attn_v.weight 0x1255ab400 0x440000
179 blk.19.ffn_down.weight 0x1259eb400 0x3520000
180 blk.19.ffn_gate.weight 0x128f0b400 0x3520000
181 blk.19.ffn_norm.weight 0x12c42b400 0x4000
182 blk.19.ffn_up.weight 0x12c42f400 0x3520000
183 blk.20.attn_k.weight 0x12f94f400 0x440000
184 blk.20.attn_norm.weight 0x12fd8f400 0x4000
185 blk.20.attn_output.weight 0x12fd93400 0x1100000
186 blk.20.attn_q.weight 0x130e93400 0x1100000
187 blk.20.attn_v.weight 0x131f93400 0x800000
188 blk.20.ffn_down.weight 0x132793400 0x3520000
189 blk.20.ffn_gate.weight 0x135cb3400 0x3520000
190 blk.20.ffn_norm.weight 0x1391d3400 0x4000
191 blk.20.ffn_up.weight 0x1391d7400 0x3520000
192 blk.21.attn_k.weight 0x13c6f7400 0x440000
193 blk.21.attn_norm.weight 0x13cb37400 0x4000
194 blk.21.attn_output.weight 0x13cb3b400 0x1100000
195 blk.21.attn_q.weight 0x13dc3b400 0x1100000
196 blk.21.attn_v.weight 0x13ed3b400 0x440000
197 blk.21.ffn_down.weight 0x13f17b400 0x3520000
198 blk.21.ffn_gate.weight 0x14269b400 0x3520000
199 blk.21.ffn_norm.weight 0x145bbb400 0x4000
200 blk.21.ffn_up.weight 0x145bbf400 0x3520000
201 blk.22.attn_k.weight 0x1490df400 0x440000
202 blk.22.attn_norm.weight 0x14951f400 0x4000
203 blk.22.attn_output.weight 0x149523400 0x1100000
204 blk.22.attn_q.weight 0x14a623400 0x1100000
205 blk.22.attn_v.weight 0x14b723400 0x440000
206 blk.22.ffn_down.weight 0x14bb63400 0x3520000
207 blk.22.ffn_gate.weight 0x14f083400 0x3520000
208 blk.22.ffn_norm.weight 0x1525a3400 0x4000
209 blk.22.ffn_up.weight 0x1525a7400 0x3520000
210 blk.23.attn_k.weight 0x155ac7400 0x440000
211 blk.23.attn_norm.weight 0x155f07400 0x4000
212 blk.23.attn_output.weight 0x155f0b400 0x1100000
213 blk.23.attn_q.weight 0x15700b400 0x1100000
214 blk.23.attn_v.weight 0x15810b400 0x440000
215 blk.23.ffn_down.weight 0x15854b400 0x3520000
216 blk.23.ffn_gate.weight 0x15ba6b400 0x3520000
217 blk.23.ffn_norm.weight 0x15ef8b400 0x4000
218 blk.23.ffn_up.weight 0x15ef8f400 0x3520000
219 blk.24.attn_k.weight 0x1624af400 0x440000
220 blk.24.attn_norm.weight 0x1628ef400 0x4000
221 blk.24.attn_output.weight 0x1628f3400 0x1100000
222 blk.24.attn_q.weight 0x1639f3400 0x1100000
223 blk.24.attn_v.weight 0x164af3400 0x440000
224 blk.24.ffn_down.weight 0x164f33400 0x3520000
225 blk.24.ffn_gate.weight 0x168453400 0x3520000
226 blk.24.ffn_norm.weight 0x16b973400 0x4000
227 blk.24.ffn_up.weight 0x16b977400 0x3520000
228 blk.25.attn_k.weight 0x16ee97400 0x440000
229 blk.25.attn_norm.weight 0x16f2d7400 0x4000
230 blk.25.attn_output.weight 0x16f2db400 0x1100000
231 blk.25.attn_q.weight 0x1703db400 0x1100000
232 blk.25.attn_v.weight 0x1714db400 0x800000
233 blk.25.ffn_down.weight 0x171cdb400 0x3520000
234 blk.25.ffn_gate.weight 0x1751fb400 0x3520000
235 blk.25.ffn_norm.weight 0x17871b400 0x4000
236 blk.25.ffn_up.weight 0x17871f400 0x3520000
237 blk.26.attn_k.weight 0x17bc3f400 0x440000
238 blk.26.attn_norm.weight 0x17c07f400 0x4000
239 blk.26.attn_output.weight 0x17c083400 0x1100000
240 blk.26.attn_q.weight 0x17d183400 0x1100000
241 blk.26.attn_v.weight 0x17e283400 0x440000
242 blk.26.ffn_down.weight 0x17e6c3400 0x3520000
243 blk.26.ffn_gate.weight 0x181be3400 0x3520000
244 blk.26.ffn_norm.weight 0x185103400 0x4000
245 blk.26.ffn_up.weight 0x185107400 0x3520000
246 blk.27.attn_k.weight 0x188627400 0x440000
247 blk.27.attn_norm.weight 0x188a67400 0x4000
248 blk.27.attn_output.weight 0x188a6b400 0x1100000
249 blk.27.attn_q.weight 0x189b6b400 0x1100000
250 blk.27.attn_v.weight 0x18ac6b400 0x440000
251 blk.27.ffn_down.weight 0x18b0ab400 0x3520000
252 blk.27.ffn_gate.weight 0x18e5cb400 0x3520000
253 blk.27.ffn_norm.weight 0x191aeb400 0x4000
254 blk.27.ffn_up.weight 0x191aef400 0x3520000
255 blk.28.attn_k.weight 0x19500f400 0x440000
256 blk.28.attn_norm.weight 0x19544f400 0x4000
257 blk.28.attn_output.weight 0x195453400 0x1100000
258 blk.28.attn_q.weight 0x196553400 0x1100000
259 blk.28.attn_v.weight 0x197653400 0x800000
260 blk.28.ffn_down.weight 0x197e53400 0x3520000
261 blk.28.ffn_gate.weight 0x19b373400 0x3520000
262 blk.28.ffn_norm.weight 0x19e893400 0x4000
263 blk.28.ffn_up.weight 0x19e897400 0x3520000
264 blk.29.attn_k.weight 0x1a1db7400 0x440000
265 blk.29.attn_norm.weight 0x1a21f7400 0x4000
266 blk.29.attn_output.weight 0x1a21fb400 0x1100000
267 blk.29.attn_q.weight 0x1a32fb400 0x1100000
268 blk.29.attn_v.weight 0x1a43fb400 0x440000
269 blk.29.ffn_down.weight 0x1a483b400 0x3520000
270 blk.29.ffn_gate.weight 0x1a7d5b400 0x3520000
271 blk.29.ffn_norm.weight 0x1ab27b400 0x4000
272 blk.29.ffn_up.weight 0x1ab27f400 0x3520000
273 blk.30.attn_k.weight 0x1ae79f400 0x440000
274 blk.30.attn_norm.weight 0x1aebdf400 0x4000
275 blk.30.attn_output.weight 0x1aebe3400 0x1100000
276 blk.30.attn_q.weight 0x1afce3400 0x1100000
277 blk.30.attn_v.weight 0x1b0de3400 0x800000
278 blk.30.ffn_down.weight 0x1b15e3400 0x3520000
279 blk.30.ffn_gate.weight 0x1b4b03400 0x3520000
280 blk.30.ffn_norm.weight 0x1b8023400 0x4000
281 blk.30.ffn_up.weight 0x1b8027400 0x3520000
282 blk.31.attn_k.weight 0x1bb547400 0x440000
283 blk.31.attn_norm.weight 0x1bb987400 0x4000
284 blk.31.attn_output.weight 0x1bb98b400 0x1100000
285 blk.31.attn_q.weight 0x1bca8b400 0x1100000
286 blk.31.attn_v.weight 0x1bdb8b400 0x440000
287 blk.31.ffn_down.weight 0x1bdfcb400 0x3520000
288 blk.31.ffn_gate.weight 0x1c14eb400 0x3520000
289 blk.31.ffn_norm.weight 0x1c4a0b400 0x4000
290 blk.31.ffn_up.weight 0x1c4a0f400 0x3520000
291 blk.32.attn_k.weight 0x1c7f2f400 0x440000
292 blk.32.attn_norm.weight 0x1c836f400 0x4000
293 blk.32.attn_output.weight 0x1c8373400 0x1100000
294 blk.32.attn_q.weight 0x1c9473400 0x1100000
295 blk.32.attn_v.weight 0x1ca573400 0x440000
296 blk.32.ffn_down.weight 0x1ca9b3400 0x3520000
297 blk.32.ffn_gate.weight 0x1cded3400 0x3520000
298 blk.32.ffn_norm.weight 0x1d13f3400 0x4000
299 blk.32.ffn_up.weight 0x1d13f7400 0x3520000
300 blk.33.attn_k.weight 0x1d4917400 0x440000
301 blk.33.attn_norm.weight 0x1d4d57400 0x4000
302 blk.33.attn_output.weight 0x1d4d5b400 0x1100000
303 blk.33.attn_q.weight 0x1d5e5b400 0x1100000
304 blk.33.attn_v.weight 0x1d6f5b400 0x440000
305 blk.33.ffn_down.weight 0x1d739b400 0x3520000
306 blk.33.ffn_gate.weight 0x1da8bb400 0x3520000
307 blk.33.ffn_norm.weight 0x1ddddb400 0x4000
308 blk.33.ffn_up.weight 0x1ddddf400 0x3520000
309 blk.34.attn_k.weight 0x1e12ff400 0x440000
310 blk.34.attn_norm.weight 0x1e173f400 0x4000
311 blk.34.attn_output.weight 0x1e1743400 0x1100000
312 blk.34.attn_q.weight 0x1e2843400 0x1100000
313 blk.34.attn_v.weight 0x1e3943400 0x440000
314 blk.34.ffn_down.weight 0x1e3d83400 0x3520000
315 blk.34.ffn_gate.weight 0x1e72a3400 0x3520000
316 blk.34.ffn_norm.weight 0x1ea7c3400 0x4000
317 blk.34.ffn_up.weight 0x1ea7c7400 0x3520000
318 blk.35.attn_k.weight 0x1edce7400 0x440000
319 blk.35.attn_norm.weight 0x1ee127400 0x4000
320 blk.35.attn_output.weight 0x1ee12b400 0x1100000
321 blk.35.attn_q.weight 0x1ef22b400 0x1100000
322 blk.35.attn_v.weight 0x1f032b400 0x440000
323 blk.35.ffn_down.weight 0x1f076b400 0x3520000
324 blk.35.ffn_gate.weight 0x1f3c8b400 0x3520000
325 blk.35.ffn_norm.weight 0x1f71ab400 0x4000
326 blk.35.ffn_up.weight 0x1f71af400 0x3520000
327 blk.36.attn_k.weight 0x1fa6cf400 0x440000
328 blk.36.attn_norm.weight 0x1fab0f400 0x4000
329 blk.36.attn_output.weight 0x1fab13400 0x1100000
330 blk.36.attn_q.weight 0x1fbc13400 0x1100000
331 blk.36.attn_v.weight 0x1fcd13400 0x440000
332 blk.36.ffn_down.weight 0x1fd153400 0x3520000
333 blk.36.ffn_gate.weight 0x200673400 0x3520000
334 blk.36.ffn_norm.weight 0x203b93400 0x4000
335 blk.36.ffn_up.weight 0x203b97400 0x3520000
336 blk.37.attn_k.weight 0x2070b7400 0x440000
337 blk.37.attn_norm.weight 0x2074f7400 0x4000
338 blk.37.attn_output.weight 0x2074fb400 0x1100000
339 blk.37.attn_q.weight 0x2085fb400 0x1100000
340 blk.37.attn_v.weight 0x2096fb400 0x440000
341 blk.37.ffn_down.weight 0x209b3b400 0x3520000
342 blk.37.ffn_gate.weight 0x20d05b400 0x3520000
343 blk.37.ffn_norm.weight 0x21057b400 0x4000
344 blk.37.ffn_up.weight 0x21057f400 0x3520000
345 blk.38.attn_k.weight 0x213a9f400 0x440000
346 blk.38.attn_norm.weight 0x213edf400 0x4000
347 blk.38.attn_output.weight 0x213ee3400 0x1100000
348 blk.38.attn_q.weight 0x214fe3400 0x1100000
349 blk.38.attn_v.weight 0x2160e3400 0x440000
350 blk.38.ffn_down.weight 0x216523400 0x3520000
351 blk.38.ffn_gate.weight 0x219a43400 0x3520000
352 blk.38.ffn_norm.weight 0x21cf63400 0x4000
353 blk.38.ffn_up.weight 0x21cf67400 0x3520000
354 blk.39.attn_k.weight 0x220487400 0x440000
355 blk.39.attn_norm.weight 0x2208c7400 0x4000
356 blk.39.attn_output.weight 0x2208cb400 0x1100000
357 blk.39.attn_q.weight 0x2219cb400 0x1100000
358 blk.39.attn_v.weight 0x222acb400 0x440000
359 blk.39.ffn_down.weight 0x222f0b400 0x3520000
360 blk.39.ffn_gate.weight 0x22642b400 0x3520000
361 blk.39.ffn_norm.weight 0x22994b400 0x4000
362 blk.39.ffn_up.weight 0x22994f400 0x3520000

Base Tensor Group : ~822M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
0 output.weight Output (W) (~411M) 411041792 4096 x 100352 x 1 x 1 Q8_0 8.5000
1 output_norm.weight Output Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
2 token_embd.weight Token Embedding (W) (~411M) 411041792 4096 x 100352 x 1 x 1 Q8_0 8.5000
  • Total elements in base: (~822M) 822087680
  • Percentage of total elements: 9.35%
  • Bits per Weight (BPW) for base: 8.5001 bits

Block 0 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
3 blk.0.attn_k.weight Block 0 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
4 blk.0.attn_norm.weight Block 0 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
5 blk.0.attn_output.weight Block 0 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
6 blk.0.attn_q.weight Block 0 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q6_K 6.5625
7 blk.0.attn_v.weight Block 0 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
8 blk.0.ffn_down.weight Block 0 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
9 blk.0.ffn_gate.weight Block 0 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q6_K 6.5625
10 blk.0.ffn_norm.weight Block 0 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
11 blk.0.ffn_up.weight Block 0 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.0: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.0: 7.8280 bits

Block 1 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
12 blk.1.attn_k.weight Block 1 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
13 blk.1.attn_norm.weight Block 1 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
14 blk.1.attn_output.weight Block 1 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
15 blk.1.attn_q.weight Block 1 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
16 blk.1.attn_v.weight Block 1 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
17 blk.1.ffn_down.weight Block 1 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
18 blk.1.ffn_gate.weight Block 1 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
19 blk.1.ffn_norm.weight Block 1 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
20 blk.1.ffn_up.weight Block 1 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.1: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.1: 8.5010 bits

Block 2 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
21 blk.2.attn_k.weight Block 2 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
22 blk.2.attn_norm.weight Block 2 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
23 blk.2.attn_output.weight Block 2 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
24 blk.2.attn_q.weight Block 2 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
25 blk.2.attn_v.weight Block 2 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
26 blk.2.ffn_down.weight Block 2 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
27 blk.2.ffn_gate.weight Block 2 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
28 blk.2.ffn_norm.weight Block 2 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
29 blk.2.ffn_up.weight Block 2 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.2: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.2: 8.5010 bits

Block 3 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
30 blk.3.attn_k.weight Block 3 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
31 blk.3.attn_norm.weight Block 3 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
32 blk.3.attn_output.weight Block 3 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
33 blk.3.attn_q.weight Block 3 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
34 blk.3.attn_v.weight Block 3 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
35 blk.3.ffn_down.weight Block 3 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_1 6.0000
36 blk.3.ffn_gate.weight Block 3 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
37 blk.3.ffn_norm.weight Block 3 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
38 blk.3.ffn_up.weight Block 3 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.3: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.3: 8.0010 bits

Block 4 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
39 blk.4.attn_k.weight Block 4 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
40 blk.4.attn_norm.weight Block 4 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
41 blk.4.attn_output.weight Block 4 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
42 blk.4.attn_q.weight Block 4 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
43 blk.4.attn_v.weight Block 4 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
44 blk.4.ffn_down.weight Block 4 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
45 blk.4.ffn_gate.weight Block 4 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
46 blk.4.ffn_norm.weight Block 4 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
47 blk.4.ffn_up.weight Block 4 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.4: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.4: 8.6589 bits

Block 5 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
48 blk.5.attn_k.weight Block 5 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
49 blk.5.attn_norm.weight Block 5 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
50 blk.5.attn_output.weight Block 5 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
51 blk.5.attn_q.weight Block 5 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
52 blk.5.attn_v.weight Block 5 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
53 blk.5.ffn_down.weight Block 5 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q5_1 6.0000
54 blk.5.ffn_gate.weight Block 5 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
55 blk.5.ffn_norm.weight Block 5 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
56 blk.5.ffn_up.weight Block 5 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.5: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.5: 8.0010 bits

Block 6 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
57 blk.6.attn_k.weight Block 6 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
58 blk.6.attn_norm.weight Block 6 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
59 blk.6.attn_output.weight Block 6 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
60 blk.6.attn_q.weight Block 6 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
61 blk.6.attn_v.weight Block 6 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
62 blk.6.ffn_down.weight Block 6 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
63 blk.6.ffn_gate.weight Block 6 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
64 blk.6.ffn_norm.weight Block 6 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
65 blk.6.ffn_up.weight Block 6 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.6: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.6: 8.6589 bits

Block 7 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
66 blk.7.attn_k.weight Block 7 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
67 blk.7.attn_norm.weight Block 7 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
68 blk.7.attn_output.weight Block 7 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
69 blk.7.attn_q.weight Block 7 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
70 blk.7.attn_v.weight Block 7 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
71 blk.7.ffn_down.weight Block 7 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
72 blk.7.ffn_gate.weight Block 7 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
73 blk.7.ffn_norm.weight Block 7 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
74 blk.7.ffn_up.weight Block 7 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.7: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.7: 8.6589 bits

Block 8 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
75 blk.8.attn_k.weight Block 8 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
76 blk.8.attn_norm.weight Block 8 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
77 blk.8.attn_output.weight Block 8 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
78 blk.8.attn_q.weight Block 8 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
79 blk.8.attn_v.weight Block 8 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
80 blk.8.ffn_down.weight Block 8 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
81 blk.8.ffn_gate.weight Block 8 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
82 blk.8.ffn_norm.weight Block 8 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
83 blk.8.ffn_up.weight Block 8 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.8: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.8: 8.5010 bits

Block 9 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
84 blk.9.attn_k.weight Block 9 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
85 blk.9.attn_norm.weight Block 9 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
86 blk.9.attn_output.weight Block 9 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
87 blk.9.attn_q.weight Block 9 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
88 blk.9.attn_v.weight Block 9 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
89 blk.9.ffn_down.weight Block 9 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
90 blk.9.ffn_gate.weight Block 9 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
91 blk.9.ffn_norm.weight Block 9 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
92 blk.9.ffn_up.weight Block 9 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.9: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.9: 8.6589 bits

Block 10 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
93 blk.10.attn_k.weight Block 10 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
94 blk.10.attn_norm.weight Block 10 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
95 blk.10.attn_output.weight Block 10 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
96 blk.10.attn_q.weight Block 10 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
97 blk.10.attn_v.weight Block 10 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
98 blk.10.ffn_down.weight Block 10 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
99 blk.10.ffn_gate.weight Block 10 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
100 blk.10.ffn_norm.weight Block 10 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
101 blk.10.ffn_up.weight Block 10 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.10: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.10: 8.5010 bits

Block 11 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
102 blk.11.attn_k.weight Block 11 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
103 blk.11.attn_norm.weight Block 11 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
104 blk.11.attn_output.weight Block 11 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
105 blk.11.attn_q.weight Block 11 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
106 blk.11.attn_v.weight Block 11 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
107 blk.11.ffn_down.weight Block 11 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
108 blk.11.ffn_gate.weight Block 11 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
109 blk.11.ffn_norm.weight Block 11 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
110 blk.11.ffn_up.weight Block 11 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.11: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.11: 8.5010 bits

Block 12 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
111 blk.12.attn_k.weight Block 12 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
112 blk.12.attn_norm.weight Block 12 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
113 blk.12.attn_output.weight Block 12 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
114 blk.12.attn_q.weight Block 12 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
115 blk.12.attn_v.weight Block 12 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
116 blk.12.ffn_down.weight Block 12 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
117 blk.12.ffn_gate.weight Block 12 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
118 blk.12.ffn_norm.weight Block 12 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
119 blk.12.ffn_up.weight Block 12 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.12: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.12: 8.5010 bits

Block 13 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
120 blk.13.attn_k.weight Block 13 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
121 blk.13.attn_norm.weight Block 13 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
122 blk.13.attn_output.weight Block 13 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
123 blk.13.attn_q.weight Block 13 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
124 blk.13.attn_v.weight Block 13 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
125 blk.13.ffn_down.weight Block 13 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
126 blk.13.ffn_gate.weight Block 13 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
127 blk.13.ffn_norm.weight Block 13 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
128 blk.13.ffn_up.weight Block 13 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.13: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.13: 8.5010 bits

Block 14 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
129 blk.14.attn_k.weight Block 14 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
130 blk.14.attn_norm.weight Block 14 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
131 blk.14.attn_output.weight Block 14 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
132 blk.14.attn_q.weight Block 14 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
133 blk.14.attn_v.weight Block 14 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
134 blk.14.ffn_down.weight Block 14 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
135 blk.14.ffn_gate.weight Block 14 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
136 blk.14.ffn_norm.weight Block 14 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
137 blk.14.ffn_up.weight Block 14 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.14: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.14: 8.5010 bits

Block 15 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
138 blk.15.attn_k.weight Block 15 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
139 blk.15.attn_norm.weight Block 15 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
140 blk.15.attn_output.weight Block 15 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
141 blk.15.attn_q.weight Block 15 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
142 blk.15.attn_v.weight Block 15 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
143 blk.15.ffn_down.weight Block 15 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
144 blk.15.ffn_gate.weight Block 15 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
145 blk.15.ffn_norm.weight Block 15 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
146 blk.15.ffn_up.weight Block 15 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.15: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.15: 8.6589 bits

Block 16 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
147 blk.16.attn_k.weight Block 16 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
148 blk.16.attn_norm.weight Block 16 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
149 blk.16.attn_output.weight Block 16 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
150 blk.16.attn_q.weight Block 16 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
151 blk.16.attn_v.weight Block 16 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
152 blk.16.ffn_down.weight Block 16 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
153 blk.16.ffn_gate.weight Block 16 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
154 blk.16.ffn_norm.weight Block 16 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
155 blk.16.ffn_up.weight Block 16 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.16: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.16: 8.6589 bits

Block 17 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
156 blk.17.attn_k.weight Block 17 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
157 blk.17.attn_norm.weight Block 17 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
158 blk.17.attn_output.weight Block 17 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
159 blk.17.attn_q.weight Block 17 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
160 blk.17.attn_v.weight Block 17 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
161 blk.17.ffn_down.weight Block 17 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
162 blk.17.ffn_gate.weight Block 17 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
163 blk.17.ffn_norm.weight Block 17 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
164 blk.17.ffn_up.weight Block 17 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.17: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.17: 8.5010 bits

Block 18 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
165 blk.18.attn_k.weight Block 18 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
166 blk.18.attn_norm.weight Block 18 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
167 blk.18.attn_output.weight Block 18 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
168 blk.18.attn_q.weight Block 18 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
169 blk.18.attn_v.weight Block 18 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
170 blk.18.ffn_down.weight Block 18 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
171 blk.18.ffn_gate.weight Block 18 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
172 blk.18.ffn_norm.weight Block 18 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
173 blk.18.ffn_up.weight Block 18 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.18: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.18: 8.5010 bits

Block 19 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
174 blk.19.attn_k.weight Block 19 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
175 blk.19.attn_norm.weight Block 19 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
176 blk.19.attn_output.weight Block 19 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
177 blk.19.attn_q.weight Block 19 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
178 blk.19.attn_v.weight Block 19 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
179 blk.19.ffn_down.weight Block 19 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
180 blk.19.ffn_gate.weight Block 19 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
181 blk.19.ffn_norm.weight Block 19 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
182 blk.19.ffn_up.weight Block 19 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.19: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.19: 8.5010 bits

Block 20 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
183 blk.20.attn_k.weight Block 20 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
184 blk.20.attn_norm.weight Block 20 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
185 blk.20.attn_output.weight Block 20 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
186 blk.20.attn_q.weight Block 20 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
187 blk.20.attn_v.weight Block 20 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
188 blk.20.ffn_down.weight Block 20 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
189 blk.20.ffn_gate.weight Block 20 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
190 blk.20.ffn_norm.weight Block 20 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
191 blk.20.ffn_up.weight Block 20 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.20: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.20: 8.6589 bits

Block 21 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
192 blk.21.attn_k.weight Block 21 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
193 blk.21.attn_norm.weight Block 21 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
194 blk.21.attn_output.weight Block 21 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
195 blk.21.attn_q.weight Block 21 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
196 blk.21.attn_v.weight Block 21 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
197 blk.21.ffn_down.weight Block 21 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
198 blk.21.ffn_gate.weight Block 21 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
199 blk.21.ffn_norm.weight Block 21 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
200 blk.21.ffn_up.weight Block 21 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.21: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.21: 8.5010 bits

Block 22 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
201 blk.22.attn_k.weight Block 22 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
202 blk.22.attn_norm.weight Block 22 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
203 blk.22.attn_output.weight Block 22 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
204 blk.22.attn_q.weight Block 22 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
205 blk.22.attn_v.weight Block 22 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
206 blk.22.ffn_down.weight Block 22 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
207 blk.22.ffn_gate.weight Block 22 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
208 blk.22.ffn_norm.weight Block 22 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
209 blk.22.ffn_up.weight Block 22 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.22: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.22: 8.5010 bits

Block 23 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
210 blk.23.attn_k.weight Block 23 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
211 blk.23.attn_norm.weight Block 23 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
212 blk.23.attn_output.weight Block 23 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
213 blk.23.attn_q.weight Block 23 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
214 blk.23.attn_v.weight Block 23 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
215 blk.23.ffn_down.weight Block 23 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
216 blk.23.ffn_gate.weight Block 23 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
217 blk.23.ffn_norm.weight Block 23 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
218 blk.23.ffn_up.weight Block 23 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.23: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.23: 8.5010 bits

Block 24 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
219 blk.24.attn_k.weight Block 24 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
220 blk.24.attn_norm.weight Block 24 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
221 blk.24.attn_output.weight Block 24 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
222 blk.24.attn_q.weight Block 24 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
223 blk.24.attn_v.weight Block 24 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
224 blk.24.ffn_down.weight Block 24 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
225 blk.24.ffn_gate.weight Block 24 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
226 blk.24.ffn_norm.weight Block 24 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
227 blk.24.ffn_up.weight Block 24 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.24: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.24: 8.5010 bits

Block 25 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
228 blk.25.attn_k.weight Block 25 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
229 blk.25.attn_norm.weight Block 25 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
230 blk.25.attn_output.weight Block 25 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
231 blk.25.attn_q.weight Block 25 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
232 blk.25.attn_v.weight Block 25 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
233 blk.25.ffn_down.weight Block 25 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
234 blk.25.ffn_gate.weight Block 25 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
235 blk.25.ffn_norm.weight Block 25 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
236 blk.25.ffn_up.weight Block 25 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.25: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.25: 8.6589 bits

Block 26 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
237 blk.26.attn_k.weight Block 26 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
238 blk.26.attn_norm.weight Block 26 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
239 blk.26.attn_output.weight Block 26 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
240 blk.26.attn_q.weight Block 26 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
241 blk.26.attn_v.weight Block 26 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
242 blk.26.ffn_down.weight Block 26 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
243 blk.26.ffn_gate.weight Block 26 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
244 blk.26.ffn_norm.weight Block 26 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
245 blk.26.ffn_up.weight Block 26 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.26: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.26: 8.5010 bits

Block 27 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
246 blk.27.attn_k.weight Block 27 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
247 blk.27.attn_norm.weight Block 27 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
248 blk.27.attn_output.weight Block 27 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
249 blk.27.attn_q.weight Block 27 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
250 blk.27.attn_v.weight Block 27 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
251 blk.27.ffn_down.weight Block 27 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
252 blk.27.ffn_gate.weight Block 27 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
253 blk.27.ffn_norm.weight Block 27 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
254 blk.27.ffn_up.weight Block 27 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.27: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.27: 8.5010 bits

Block 28 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
255 blk.28.attn_k.weight Block 28 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
256 blk.28.attn_norm.weight Block 28 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
257 blk.28.attn_output.weight Block 28 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
258 blk.28.attn_q.weight Block 28 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
259 blk.28.attn_v.weight Block 28 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
260 blk.28.ffn_down.weight Block 28 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
261 blk.28.ffn_gate.weight Block 28 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
262 blk.28.ffn_norm.weight Block 28 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
263 blk.28.ffn_up.weight Block 28 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.28: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.28: 8.6589 bits

Block 29 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
264 blk.29.attn_k.weight Block 29 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
265 blk.29.attn_norm.weight Block 29 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
266 blk.29.attn_output.weight Block 29 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
267 blk.29.attn_q.weight Block 29 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
268 blk.29.attn_v.weight Block 29 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
269 blk.29.ffn_down.weight Block 29 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
270 blk.29.ffn_gate.weight Block 29 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
271 blk.29.ffn_norm.weight Block 29 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
272 blk.29.ffn_up.weight Block 29 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.29: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.29: 8.5010 bits

Block 30 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
273 blk.30.attn_k.weight Block 30 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
274 blk.30.attn_norm.weight Block 30 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
275 blk.30.attn_output.weight Block 30 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
276 blk.30.attn_q.weight Block 30 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
277 blk.30.attn_v.weight Block 30 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 BF16 16.0000
278 blk.30.ffn_down.weight Block 30 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
279 blk.30.ffn_gate.weight Block 30 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
280 blk.30.ffn_norm.weight Block 30 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
281 blk.30.ffn_up.weight Block 30 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.30: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.30: 8.6589 bits

Block 31 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
282 blk.31.attn_k.weight Block 31 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
283 blk.31.attn_norm.weight Block 31 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
284 blk.31.attn_output.weight Block 31 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
285 blk.31.attn_q.weight Block 31 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
286 blk.31.attn_v.weight Block 31 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
287 blk.31.ffn_down.weight Block 31 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
288 blk.31.ffn_gate.weight Block 31 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
289 blk.31.ffn_norm.weight Block 31 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
290 blk.31.ffn_up.weight Block 31 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.31: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.31: 8.5010 bits

Block 32 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
291 blk.32.attn_k.weight Block 32 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
292 blk.32.attn_norm.weight Block 32 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
293 blk.32.attn_output.weight Block 32 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
294 blk.32.attn_q.weight Block 32 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
295 blk.32.attn_v.weight Block 32 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
296 blk.32.ffn_down.weight Block 32 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
297 blk.32.ffn_gate.weight Block 32 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
298 blk.32.ffn_norm.weight Block 32 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
299 blk.32.ffn_up.weight Block 32 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.32: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.32: 8.5010 bits

Block 33 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
300 blk.33.attn_k.weight Block 33 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
301 blk.33.attn_norm.weight Block 33 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
302 blk.33.attn_output.weight Block 33 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
303 blk.33.attn_q.weight Block 33 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
304 blk.33.attn_v.weight Block 33 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
305 blk.33.ffn_down.weight Block 33 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
306 blk.33.ffn_gate.weight Block 33 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
307 blk.33.ffn_norm.weight Block 33 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
308 blk.33.ffn_up.weight Block 33 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.33: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.33: 8.5010 bits

Block 34 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
309 blk.34.attn_k.weight Block 34 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
310 blk.34.attn_norm.weight Block 34 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
311 blk.34.attn_output.weight Block 34 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
312 blk.34.attn_q.weight Block 34 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
313 blk.34.attn_v.weight Block 34 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
314 blk.34.ffn_down.weight Block 34 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
315 blk.34.ffn_gate.weight Block 34 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
316 blk.34.ffn_norm.weight Block 34 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
317 blk.34.ffn_up.weight Block 34 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.34: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.34: 8.5010 bits

Block 35 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
318 blk.35.attn_k.weight Block 35 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
319 blk.35.attn_norm.weight Block 35 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
320 blk.35.attn_output.weight Block 35 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
321 blk.35.attn_q.weight Block 35 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
322 blk.35.attn_v.weight Block 35 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
323 blk.35.ffn_down.weight Block 35 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
324 blk.35.ffn_gate.weight Block 35 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
325 blk.35.ffn_norm.weight Block 35 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
326 blk.35.ffn_up.weight Block 35 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.35: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.35: 8.5010 bits

Block 36 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
327 blk.36.attn_k.weight Block 36 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
328 blk.36.attn_norm.weight Block 36 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
329 blk.36.attn_output.weight Block 36 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
330 blk.36.attn_q.weight Block 36 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
331 blk.36.attn_v.weight Block 36 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
332 blk.36.ffn_down.weight Block 36 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
333 blk.36.ffn_gate.weight Block 36 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
334 blk.36.ffn_norm.weight Block 36 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
335 blk.36.ffn_up.weight Block 36 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.36: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.36: 8.5010 bits

Block 37 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
336 blk.37.attn_k.weight Block 37 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
337 blk.37.attn_norm.weight Block 37 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
338 blk.37.attn_output.weight Block 37 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
339 blk.37.attn_q.weight Block 37 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
340 blk.37.attn_v.weight Block 37 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
341 blk.37.ffn_down.weight Block 37 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
342 blk.37.ffn_gate.weight Block 37 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
343 blk.37.ffn_norm.weight Block 37 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
344 blk.37.ffn_up.weight Block 37 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.37: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.37: 8.5010 bits

Block 38 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
345 blk.38.attn_k.weight Block 38 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
346 blk.38.attn_norm.weight Block 38 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
347 blk.38.attn_output.weight Block 38 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
348 blk.38.attn_q.weight Block 38 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
349 blk.38.attn_v.weight Block 38 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
350 blk.38.ffn_down.weight Block 38 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
351 blk.38.ffn_gate.weight Block 38 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
352 blk.38.ffn_norm.weight Block 38 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
353 blk.38.ffn_up.weight Block 38 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.38: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.38: 8.5010 bits

Block 39 Tensor Group : ~199M Elements

T_ID Tensor Layer Name Human Friendly Tensor Layer Name Elements Shape Type BPW
354 blk.39.attn_k.weight Block 39 Attention Key (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
355 blk.39.attn_norm.weight Block 39 Attention Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
356 blk.39.attn_output.weight Block 39 Attention Output (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
357 blk.39.attn_q.weight Block 39 Attention Query (W) (~17M) 16777216 4096 x 4096 x 1 x 1 Q8_0 8.5000
358 blk.39.attn_v.weight Block 39 Attention Value (W) ( ~4M) 4194304 4096 x 1024 x 1 x 1 Q8_0 8.5000
359 blk.39.ffn_down.weight Block 39 Feed-Forward Network "Down" (W) (~52M) 52428800 12800 x 4096 x 1 x 1 Q8_0 8.5000
360 blk.39.ffn_gate.weight Block 39 Feed-Forward Network "Gate" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
361 blk.39.ffn_norm.weight Block 39 Feed-Forward Network Normalization (W) ( ~4K) 4096 4096 x 1 x 1 x 1 F32 32.0000
362 blk.39.ffn_up.weight Block 39 Feed-Forward Network "Up" (W) (~52M) 52428800 4096 x 12800 x 1 x 1 Q8_0 8.5000
  • Total elements in blk.39: (~199M) 199237632
  • Percentage of total elements: 2.27%
  • Bits per Weight (BPW) for blk.39: 8.5010 bits

Total BPW for granite-4.1-8b-Q8_0.gguf: 8.4988 bits