Dolphin-Mistral-24B-Venice-Edition-pruned-GGUF/scores/Dolphin-Mistral-24B-Venice-Edition-Q3_K_S.md

Dolphin-Mistral-24B-Venice-Edition-pruned-Q3_K_S.gguf - GGUF Internal File Dump

• Endian: LITTLE endian

Key Value Metadata Store

There are 46 key-value pairs in this file

POS	TYPE	Count	Key	Value
1	UINT32	1	GGUF.version	3
2	UINT64	1	GGUF.tensor_count	345
3	UINT64	1	GGUF.kv_count	43
4	STRING	1	general.architecture	llama
5	STRING	1	general.type	model
6	STRING	1	general.name	Dolphin Mistral 24B Venice Edition
7	STRING	1	general.finetune	Venice-Edition
8	STRING	1	general.basename	Dolphin-Mistral
9	STRING	1	general.size_label	24B
10	STRING	1	general.license	apache-2.0
11	UINT32	1	general.base_model.count	1
12	STRING	1	general.base_model.0.name	Mistral Small 24B Instruct 2501
13	STRING	1	general.base_model.0.version	2501
14	STRING	1	general.base_model.0.organization	Mistralai
15	STRING	1	general.base_model.0.repo_url	https://huggingface.co/mistral...istral-Small-24B-Instruct-2501
16	UINT32	1	llama.context_length	32768
17	UINT32	1	llama.embedding_length	5120
18	UINT32	1	llama.feed_forward_length	32768
19	UINT32	1	llama.attention.head_count	32
20	UINT32	1	llama.attention.head_count_kv	8
21	FLOAT32	1	llama.rope.freq_base	100000000.0
22	FLOAT32	1	llama.attention.layer_norm_rms_epsilon	1e-05
23	UINT32	1	llama.attention.key_length	128
24	UINT32	1	llama.attention.value_length	128
25	UINT32	1	llama.vocab_size	131072
26	UINT32	1	llama.rope.dimension_count	128
27	STRING	1	tokenizer.ggml.model	gpt2
28	STRING	1	tokenizer.ggml.pre	tekken
29	[STRING]	131072	tokenizer.ggml.tokens	[ <unk>, <s>, </s>, [INST], [/INST], ... ]
30	[INT32]	131072	tokenizer.ggml.token_type	[ 3, 3, 3, 3, 3, 3, 3, ... ]
31	[STRING]	269443	tokenizer.ggml.merges	[ Ġ Ġ, Ġ t, e r, i n, Ġ ĠĠĠ, ... ]
32	UINT32	1	tokenizer.ggml.bos_token_id	1
33	UINT32	1	tokenizer.ggml.eos_token_id	2
34	UINT32	1	tokenizer.ggml.unknown_token_id	0
35	UINT32	1	tokenizer.ggml.padding_token_id	11
36	BOOL	1	tokenizer.ggml.add_bos_token	True
37	BOOL	1	tokenizer.ggml.add_eos_token	False
38	STRING	1	tokenizer.chat_template	{%- set today = strftime_now("... {%- endif %}{%- endfor %}
39	BOOL	1	tokenizer.ggml.add_space_prefix	False
40	UINT32	1	general.quantization_version	2
41	UINT32	1	general.file_type	11
42	STRING	1	quantize.imatrix.file	./imatrix/imatrix-Dolphin-Mist...l-24B-Venice-Edition-small.dat
43	STRING	1	quantize.imatrix.dataset	../../datasets/imatrix/combined_eur_small.txt
44	UINT32	1	quantize.imatrix.entries_count	281
45	UINT32	1	quantize.imatrix.chunks_count	3192
46	UINT32	1	llama.block_count	38

Tensors Overview ~22B Elements

Total number of elements in all tensors: 22460892160 Elements

• Dolphin-Mistral-24B-Venice-Edition-pruned-Q3_K_S.gguf - GGUF Internal File Dump
  • Key Value Metadata Store
  • Tensors Overview ~22B Elements
    • Tensor Data Offset
    • Base Tensor Group : ~1B Elements
    • Block 0 Tensor Group : ~556M Elements
    • Block 1 Tensor Group : ~556M Elements
    • Block 2 Tensor Group : ~556M Elements
    • Block 3 Tensor Group : ~556M Elements
    • Block 4 Tensor Group : ~556M Elements
    • Block 5 Tensor Group : ~556M Elements
    • Block 6 Tensor Group : ~556M Elements
    • Block 7 Tensor Group : ~556M Elements
    • Block 8 Tensor Group : ~556M Elements
    • Block 9 Tensor Group : ~556M Elements
    • Block 10 Tensor Group : ~556M Elements
    • Block 11 Tensor Group : ~556M Elements
    • Block 12 Tensor Group : ~556M Elements
    • Block 13 Tensor Group : ~556M Elements
    • Block 14 Tensor Group : ~556M Elements
    • Block 15 Tensor Group : ~556M Elements
    • Block 16 Tensor Group : ~556M Elements
    • Block 17 Tensor Group : ~556M Elements
    • Block 18 Tensor Group : ~556M Elements
    • Block 19 Tensor Group : ~556M Elements
    • Block 20 Tensor Group : ~556M Elements
    • Block 21 Tensor Group : ~556M Elements
    • Block 22 Tensor Group : ~556M Elements
    • Block 23 Tensor Group : ~556M Elements
    • Block 24 Tensor Group : ~556M Elements
    • Block 25 Tensor Group : ~556M Elements
    • Block 26 Tensor Group : ~556M Elements
    • Block 27 Tensor Group : ~556M Elements
    • Block 28 Tensor Group : ~556M Elements
    • Block 29 Tensor Group : ~556M Elements
    • Block 30 Tensor Group : ~556M Elements
    • Block 31 Tensor Group : ~556M Elements
    • Block 32 Tensor Group : ~556M Elements
    • Block 33 Tensor Group : ~556M Elements
    • Block 34 Tensor Group : ~556M Elements
    • Block 35 Tensor Group : ~556M Elements
    • Block 36 Tensor Group : ~556M Elements
    • Block 37 Tensor Group : ~556M Elements

Tensor Data Offset

This table contains the offset and data segment relative to start of file

T_ID	Tensor Layer Name	Data Offset (B)	Data Size (B)
0	output.weight	0x784500	0x11300000
1	output_norm.weight	0x11a84500	0x5000
2	token_embd.weight	0x11a89500	0xd200000
3	blk.0.attn_k.weight	0x1ec89500	0x1a4000
4	blk.0.attn_norm.weight	0x1ee2d500	0x5000
5	blk.0.attn_output.weight	0x1ee32500	0x898000
6	blk.0.attn_q.weight	0x1f6ca500	0x690000
7	blk.0.attn_v.weight	0x1fd5a500	0x226000
8	blk.0.ffn_down.weight	0x1ff80500	0x44c0000
9	blk.0.ffn_gate.weight	0x24440500	0x3480000
10	blk.0.ffn_norm.weight	0x278c0500	0x5000
11	blk.0.ffn_up.weight	0x278c5500	0x3480000
12	blk.1.attn_k.weight	0x2ad45500	0x1a4000
13	blk.1.attn_norm.weight	0x2aee9500	0x5000
14	blk.1.attn_output.weight	0x2aeee500	0x898000
15	blk.1.attn_q.weight	0x2b786500	0x690000
16	blk.1.attn_v.weight	0x2be16500	0x226000
17	blk.1.ffn_down.weight	0x2c03c500	0x44c0000
18	blk.1.ffn_gate.weight	0x304fc500	0x3480000
19	blk.1.ffn_norm.weight	0x3397c500	0x5000
20	blk.1.ffn_up.weight	0x33981500	0x3480000
21	blk.2.attn_k.weight	0x36e01500	0x1a4000
22	blk.2.attn_norm.weight	0x36fa5500	0x5000
23	blk.2.attn_output.weight	0x36faa500	0x898000
24	blk.2.attn_q.weight	0x37842500	0x690000
25	blk.2.attn_v.weight	0x37ed2500	0x226000
26	blk.2.ffn_down.weight	0x380f8500	0x44c0000
27	blk.2.ffn_gate.weight	0x3c5b8500	0x3480000
28	blk.2.ffn_norm.weight	0x3fa38500	0x5000
29	blk.2.ffn_up.weight	0x3fa3d500	0x3480000
30	blk.3.attn_k.weight	0x42ebd500	0x1a4000
31	blk.3.attn_norm.weight	0x43061500	0x5000
32	blk.3.attn_output.weight	0x43066500	0x898000
33	blk.3.attn_q.weight	0x438fe500	0x690000
34	blk.3.attn_v.weight	0x43f8e500	0x226000
35	blk.3.ffn_down.weight	0x441b4500	0x44c0000
36	blk.3.ffn_gate.weight	0x48674500	0x3480000
37	blk.3.ffn_norm.weight	0x4baf4500	0x5000
38	blk.3.ffn_up.weight	0x4baf9500	0x3480000
39	blk.4.attn_k.weight	0x4ef79500	0x1a4000
40	blk.4.attn_norm.weight	0x4f11d500	0x5000
41	blk.4.attn_output.weight	0x4f122500	0x898000
42	blk.4.attn_q.weight	0x4f9ba500	0x690000
43	blk.4.attn_v.weight	0x5004a500	0x226000
44	blk.4.ffn_down.weight	0x50270500	0x44c0000
45	blk.4.ffn_gate.weight	0x54730500	0x3480000
46	blk.4.ffn_norm.weight	0x57bb0500	0x5000
47	blk.4.ffn_up.weight	0x57bb5500	0x3480000
48	blk.5.attn_k.weight	0x5b035500	0x1a4000
49	blk.5.attn_norm.weight	0x5b1d9500	0x5000
50	blk.5.attn_output.weight	0x5b1de500	0x898000
51	blk.5.attn_q.weight	0x5ba76500	0x690000
52	blk.5.attn_v.weight	0x5c106500	0x226000
53	blk.5.ffn_down.weight	0x5c32c500	0x44c0000
54	blk.5.ffn_gate.weight	0x607ec500	0x3480000
55	blk.5.ffn_norm.weight	0x63c6c500	0x5000
56	blk.5.ffn_up.weight	0x63c71500	0x3480000
57	blk.6.attn_k.weight	0x670f1500	0x1a4000
58	blk.6.attn_norm.weight	0x67295500	0x5000
59	blk.6.attn_output.weight	0x6729a500	0x898000
60	blk.6.attn_q.weight	0x67b32500	0x690000
61	blk.6.attn_v.weight	0x681c2500	0x226000
62	blk.6.ffn_down.weight	0x683e8500	0x44c0000
63	blk.6.ffn_gate.weight	0x6c8a8500	0x3480000
64	blk.6.ffn_norm.weight	0x6fd28500	0x5000
65	blk.6.ffn_up.weight	0x6fd2d500	0x3480000
66	blk.7.attn_k.weight	0x731ad500	0x1a4000
67	blk.7.attn_norm.weight	0x73351500	0x5000
68	blk.7.attn_output.weight	0x73356500	0x898000
69	blk.7.attn_q.weight	0x73bee500	0x690000
70	blk.7.attn_v.weight	0x7427e500	0x226000
71	blk.7.ffn_down.weight	0x744a4500	0x44c0000
72	blk.7.ffn_gate.weight	0x78964500	0x3480000
73	blk.7.ffn_norm.weight	0x7bde4500	0x5000
74	blk.7.ffn_up.weight	0x7bde9500	0x3480000
75	blk.8.attn_k.weight	0x7f269500	0x1a4000
76	blk.8.attn_norm.weight	0x7f40d500	0x5000
77	blk.8.attn_output.weight	0x7f412500	0x898000
78	blk.8.attn_q.weight	0x7fcaa500	0x690000
79	blk.8.attn_v.weight	0x8033a500	0x226000
80	blk.8.ffn_down.weight	0x80560500	0x44c0000
81	blk.8.ffn_gate.weight	0x84a20500	0x3480000
82	blk.8.ffn_norm.weight	0x87ea0500	0x5000
83	blk.8.ffn_up.weight	0x87ea5500	0x3480000
84	blk.9.attn_k.weight	0x8b325500	0x1a4000
85	blk.9.attn_norm.weight	0x8b4c9500	0x5000
86	blk.9.attn_output.weight	0x8b4ce500	0x898000
87	blk.9.attn_q.weight	0x8bd66500	0x690000
88	blk.9.attn_v.weight	0x8c3f6500	0x226000
89	blk.9.ffn_down.weight	0x8c61c500	0x44c0000
90	blk.9.ffn_gate.weight	0x90adc500	0x3480000
91	blk.9.ffn_norm.weight	0x93f5c500	0x5000
92	blk.9.ffn_up.weight	0x93f61500	0x3480000
93	blk.10.attn_k.weight	0x973e1500	0x1a4000
94	blk.10.attn_norm.weight	0x97585500	0x5000
95	blk.10.attn_output.weight	0x9758a500	0x898000
96	blk.10.attn_q.weight	0x97e22500	0x690000
97	blk.10.attn_v.weight	0x984b2500	0x226000
98	blk.10.ffn_down.weight	0x986d8500	0x44c0000
99	blk.10.ffn_gate.weight	0x9cb98500	0x3480000
100	blk.10.ffn_norm.weight	0xa0018500	0x5000
101	blk.10.ffn_up.weight	0xa001d500	0x3480000
102	blk.11.attn_k.weight	0xa349d500	0x1a4000
103	blk.11.attn_norm.weight	0xa3641500	0x5000
104	blk.11.attn_output.weight	0xa3646500	0x898000
105	blk.11.attn_q.weight	0xa3ede500	0x690000
106	blk.11.attn_v.weight	0xa456e500	0x226000
107	blk.11.ffn_down.weight	0xa4794500	0x44c0000
108	blk.11.ffn_gate.weight	0xa8c54500	0x3480000
109	blk.11.ffn_norm.weight	0xac0d4500	0x5000
110	blk.11.ffn_up.weight	0xac0d9500	0x3480000
111	blk.12.attn_k.weight	0xaf559500	0x1a4000
112	blk.12.attn_norm.weight	0xaf6fd500	0x5000
113	blk.12.attn_output.weight	0xaf702500	0x898000
114	blk.12.attn_q.weight	0xaff9a500	0x690000
115	blk.12.attn_v.weight	0xb062a500	0x226000
116	blk.12.ffn_down.weight	0xb0850500	0x44c0000
117	blk.12.ffn_gate.weight	0xb4d10500	0x3480000
118	blk.12.ffn_norm.weight	0xb8190500	0x5000
119	blk.12.ffn_up.weight	0xb8195500	0x3480000
120	blk.13.attn_k.weight	0xbb615500	0x1a4000
121	blk.13.attn_norm.weight	0xbb7b9500	0x5000
122	blk.13.attn_output.weight	0xbb7be500	0x898000
123	blk.13.attn_q.weight	0xbc056500	0x690000
124	blk.13.attn_v.weight	0xbc6e6500	0x226000
125	blk.13.ffn_down.weight	0xbc90c500	0x44c0000
126	blk.13.ffn_gate.weight	0xc0dcc500	0x3480000
127	blk.13.ffn_norm.weight	0xc424c500	0x5000
128	blk.13.ffn_up.weight	0xc4251500	0x3480000
129	blk.14.attn_k.weight	0xc76d1500	0x1a4000
130	blk.14.attn_norm.weight	0xc7875500	0x5000
131	blk.14.attn_output.weight	0xc787a500	0x898000
132	blk.14.attn_q.weight	0xc8112500	0x690000
133	blk.14.attn_v.weight	0xc87a2500	0x226000
134	blk.14.ffn_down.weight	0xc89c8500	0x44c0000
135	blk.14.ffn_gate.weight	0xcce88500	0x3480000
136	blk.14.ffn_norm.weight	0xd0308500	0x5000
137	blk.14.ffn_up.weight	0xd030d500	0x3480000
138	blk.15.attn_k.weight	0xd378d500	0x1a4000
139	blk.15.attn_norm.weight	0xd3931500	0x5000
140	blk.15.attn_output.weight	0xd3936500	0x898000
141	blk.15.attn_q.weight	0xd41ce500	0x690000
142	blk.15.attn_v.weight	0xd485e500	0x226000
143	blk.15.ffn_down.weight	0xd4a84500	0x44c0000
144	blk.15.ffn_gate.weight	0xd8f44500	0x3480000
145	blk.15.ffn_norm.weight	0xdc3c4500	0x5000
146	blk.15.ffn_up.weight	0xdc3c9500	0x3480000
147	blk.16.attn_k.weight	0xdf849500	0x1a4000
148	blk.16.attn_norm.weight	0xdf9ed500	0x5000
149	blk.16.attn_output.weight	0xdf9f2500	0x898000
150	blk.16.attn_q.weight	0xe028a500	0x690000
151	blk.16.attn_v.weight	0xe091a500	0x226000
152	blk.16.ffn_down.weight	0xe0b40500	0x44c0000
153	blk.16.ffn_gate.weight	0xe5000500	0x3480000
154	blk.16.ffn_norm.weight	0xe8480500	0x5000
155	blk.16.ffn_up.weight	0xe8485500	0x3480000
156	blk.17.attn_k.weight	0xeb905500	0x226000
157	blk.17.attn_norm.weight	0xebb2b500	0x5000
158	blk.17.attn_output.weight	0xebb30500	0x898000
159	blk.17.attn_q.weight	0xec3c8500	0x898000
160	blk.17.attn_v.weight	0xecc60500	0x226000
161	blk.17.ffn_down.weight	0xece86500	0x44c0000
162	blk.17.ffn_gate.weight	0xf1346500	0x3480000
163	blk.17.ffn_norm.weight	0xf47c6500	0x5000
164	blk.17.ffn_up.weight	0xf47cb500	0x3480000
165	blk.18.attn_k.weight	0xf7c4b500	0x226000
166	blk.18.attn_norm.weight	0xf7e71500	0x5000
167	blk.18.attn_output.weight	0xf7e76500	0x898000
168	blk.18.attn_q.weight	0xf870e500	0x898000
169	blk.18.attn_v.weight	0xf8fa6500	0x226000
170	blk.18.ffn_down.weight	0xf91cc500	0x44c0000
171	blk.18.ffn_gate.weight	0xfd68c500	0x3480000
172	blk.18.ffn_norm.weight	0x100b0c500	0x5000
173	blk.18.ffn_up.weight	0x100b11500	0x3480000
174	blk.19.attn_k.weight	0x103f91500	0x1a4000
175	blk.19.attn_norm.weight	0x104135500	0x5000
176	blk.19.attn_output.weight	0x10413a500	0x898000
177	blk.19.attn_q.weight	0x1049d2500	0x690000
178	blk.19.attn_v.weight	0x105062500	0x226000
179	blk.19.ffn_down.weight	0x105288500	0x44c0000
180	blk.19.ffn_gate.weight	0x109748500	0x3480000
181	blk.19.ffn_norm.weight	0x10cbc8500	0x5000
182	blk.19.ffn_up.weight	0x10cbcd500	0x3480000
183	blk.20.attn_k.weight	0x11004d500	0x226000
184	blk.20.attn_norm.weight	0x110273500	0x5000
185	blk.20.attn_output.weight	0x110278500	0x898000
186	blk.20.attn_q.weight	0x110b10500	0x898000
187	blk.20.attn_v.weight	0x1113a8500	0x226000
188	blk.20.ffn_down.weight	0x1115ce500	0x44c0000
189	blk.20.ffn_gate.weight	0x115a8e500	0x44c0000
190	blk.20.ffn_norm.weight	0x119f4e500	0x5000
191	blk.20.ffn_up.weight	0x119f53500	0x44c0000
192	blk.21.attn_k.weight	0x11e413500	0x1a4000
193	blk.21.attn_norm.weight	0x11e5b7500	0x5000
194	blk.21.attn_output.weight	0x11e5bc500	0x898000
195	blk.21.attn_q.weight	0x11ee54500	0x690000
196	blk.21.attn_v.weight	0x11f4e4500	0x226000
197	blk.21.ffn_down.weight	0x11f70a500	0x44c0000
198	blk.21.ffn_gate.weight	0x123bca500	0x44c0000
199	blk.21.ffn_norm.weight	0x12808a500	0x5000
200	blk.21.ffn_up.weight	0x12808f500	0x44c0000
201	blk.22.attn_k.weight	0x12c54f500	0x226000
202	blk.22.attn_norm.weight	0x12c775500	0x5000
203	blk.22.attn_output.weight	0x12c77a500	0x898000
204	blk.22.attn_q.weight	0x12d012500	0x898000
205	blk.22.attn_v.weight	0x12d8aa500	0x226000
206	blk.22.ffn_down.weight	0x12dad0500	0x44c0000
207	blk.22.ffn_gate.weight	0x131f90500	0x44c0000
208	blk.22.ffn_norm.weight	0x136450500	0x5000
209	blk.22.ffn_up.weight	0x136455500	0x44c0000
210	blk.23.attn_k.weight	0x13a915500	0x226000
211	blk.23.attn_norm.weight	0x13ab3b500	0x5000
212	blk.23.attn_output.weight	0x13ab40500	0x898000
213	blk.23.attn_q.weight	0x13b3d8500	0x898000
214	blk.23.attn_v.weight	0x13bc70500	0x226000
215	blk.23.ffn_down.weight	0x13be96500	0x44c0000
216	blk.23.ffn_gate.weight	0x140356500	0x44c0000
217	blk.23.ffn_norm.weight	0x144816500	0x5000
218	blk.23.ffn_up.weight	0x14481b500	0x44c0000
219	blk.24.attn_k.weight	0x148cdb500	0x226000
220	blk.24.attn_norm.weight	0x148f01500	0x5000
221	blk.24.attn_output.weight	0x148f06500	0x898000
222	blk.24.attn_q.weight	0x14979e500	0x898000
223	blk.24.attn_v.weight	0x14a036500	0x226000
224	blk.24.ffn_down.weight	0x14a25c500	0x44c0000
225	blk.24.ffn_gate.weight	0x14e71c500	0x44c0000
226	blk.24.ffn_norm.weight	0x152bdc500	0x5000
227	blk.24.ffn_up.weight	0x152be1500	0x44c0000
228	blk.25.attn_k.weight	0x1570a1500	0x226000
229	blk.25.attn_norm.weight	0x1572c7500	0x5000
230	blk.25.attn_output.weight	0x1572cc500	0x898000
231	blk.25.attn_q.weight	0x157b64500	0x898000
232	blk.25.attn_v.weight	0x1583fc500	0x226000
233	blk.25.ffn_down.weight	0x158622500	0x44c0000
234	blk.25.ffn_gate.weight	0x15cae2500	0x44c0000
235	blk.25.ffn_norm.weight	0x160fa2500	0x5000
236	blk.25.ffn_up.weight	0x160fa7500	0x44c0000
237	blk.26.attn_k.weight	0x165467500	0x226000
238	blk.26.attn_norm.weight	0x16568d500	0x5000
239	blk.26.attn_output.weight	0x165692500	0x898000
240	blk.26.attn_q.weight	0x165f2a500	0x898000
241	blk.26.attn_v.weight	0x1667c2500	0x226000
242	blk.26.ffn_down.weight	0x1669e8500	0x44c0000
243	blk.26.ffn_gate.weight	0x16aea8500	0x44c0000
244	blk.26.ffn_norm.weight	0x16f368500	0x5000
245	blk.26.ffn_up.weight	0x16f36d500	0x44c0000
246	blk.27.attn_k.weight	0x17382d500	0x1a4000
247	blk.27.attn_norm.weight	0x1739d1500	0x5000
248	blk.27.attn_output.weight	0x1739d6500	0x898000
249	blk.27.attn_q.weight	0x17426e500	0x690000
250	blk.27.attn_v.weight	0x1748fe500	0x226000
251	blk.27.ffn_down.weight	0x174b24500	0x44c0000
252	blk.27.ffn_gate.weight	0x178fe4500	0x44c0000
253	blk.27.ffn_norm.weight	0x17d4a4500	0x5000
254	blk.27.ffn_up.weight	0x17d4a9500	0x44c0000
255	blk.28.attn_k.weight	0x181969500	0x226000
256	blk.28.attn_norm.weight	0x181b8f500	0x5000
257	blk.28.attn_output.weight	0x181b94500	0x898000
258	blk.28.attn_q.weight	0x18242c500	0x898000
259	blk.28.attn_v.weight	0x182cc4500	0x226000
260	blk.28.ffn_down.weight	0x182eea500	0x44c0000
261	blk.28.ffn_gate.weight	0x1873aa500	0x44c0000
262	blk.28.ffn_norm.weight	0x18b86a500	0x5000
263	blk.28.ffn_up.weight	0x18b86f500	0x44c0000
264	blk.29.attn_k.weight	0x18fd2f500	0x226000
265	blk.29.attn_norm.weight	0x18ff55500	0x5000
266	blk.29.attn_output.weight	0x18ff5a500	0x898000
267	blk.29.attn_q.weight	0x1907f2500	0x898000
268	blk.29.attn_v.weight	0x19108a500	0x226000
269	blk.29.ffn_down.weight	0x1912b0500	0x44c0000
270	blk.29.ffn_gate.weight	0x195770500	0x44c0000
271	blk.29.ffn_norm.weight	0x199c30500	0x5000
272	blk.29.ffn_up.weight	0x199c35500	0x44c0000
273	blk.30.attn_k.weight	0x19e0f5500	0x226000
274	blk.30.attn_norm.weight	0x19e31b500	0x5000
275	blk.30.attn_output.weight	0x19e320500	0x898000
276	blk.30.attn_q.weight	0x19ebb8500	0x898000
277	blk.30.attn_v.weight	0x19f450500	0x226000
278	blk.30.ffn_down.weight	0x19f676500	0x44c0000
279	blk.30.ffn_gate.weight	0x1a3b36500	0x44c0000
280	blk.30.ffn_norm.weight	0x1a7ff6500	0x5000
281	blk.30.ffn_up.weight	0x1a7ffb500	0x44c0000
282	blk.31.attn_k.weight	0x1ac4bb500	0x226000
283	blk.31.attn_norm.weight	0x1ac6e1500	0x5000
284	blk.31.attn_output.weight	0x1ac6e6500	0x898000
285	blk.31.attn_q.weight	0x1acf7e500	0x898000
286	blk.31.attn_v.weight	0x1ad816500	0x226000
287	blk.31.ffn_down.weight	0x1ada3c500	0x44c0000
288	blk.31.ffn_gate.weight	0x1b1efc500	0x44c0000
289	blk.31.ffn_norm.weight	0x1b63bc500	0x5000
290	blk.31.ffn_up.weight	0x1b63c1500	0x44c0000
291	blk.32.attn_k.weight	0x1ba881500	0x226000
292	blk.32.attn_norm.weight	0x1baaa7500	0x5000
293	blk.32.attn_output.weight	0x1baaac500	0x898000
294	blk.32.attn_q.weight	0x1bb344500	0x898000
295	blk.32.attn_v.weight	0x1bbbdc500	0x226000
296	blk.32.ffn_down.weight	0x1bbe02500	0x44c0000
297	blk.32.ffn_gate.weight	0x1c02c2500	0x44c0000
298	blk.32.ffn_norm.weight	0x1c4782500	0x5000
299	blk.32.ffn_up.weight	0x1c4787500	0x44c0000
300	blk.33.attn_k.weight	0x1c8c47500	0x226000
301	blk.33.attn_norm.weight	0x1c8e6d500	0x5000
302	blk.33.attn_output.weight	0x1c8e72500	0x898000
303	blk.33.attn_q.weight	0x1c970a500	0x898000
304	blk.33.attn_v.weight	0x1c9fa2500	0x226000
305	blk.33.ffn_down.weight	0x1ca1c8500	0x44c0000
306	blk.33.ffn_gate.weight	0x1ce688500	0x44c0000
307	blk.33.ffn_norm.weight	0x1d2b48500	0x5000
308	blk.33.ffn_up.weight	0x1d2b4d500	0x44c0000
309	blk.34.attn_k.weight	0x1d700d500	0x226000
310	blk.34.attn_norm.weight	0x1d7233500	0x5000
311	blk.34.attn_output.weight	0x1d7238500	0x898000
312	blk.34.attn_q.weight	0x1d7ad0500	0x898000
313	blk.34.attn_v.weight	0x1d8368500	0x226000
314	blk.34.ffn_down.weight	0x1d858e500	0x44c0000
315	blk.34.ffn_gate.weight	0x1dca4e500	0x44c0000
316	blk.34.ffn_norm.weight	0x1e0f0e500	0x5000
317	blk.34.ffn_up.weight	0x1e0f13500	0x44c0000
318	blk.35.attn_k.weight	0x1e53d3500	0x226000
319	blk.35.attn_norm.weight	0x1e55f9500	0x5000
320	blk.35.attn_output.weight	0x1e55fe500	0x898000
321	blk.35.attn_q.weight	0x1e5e96500	0x898000
322	blk.35.attn_v.weight	0x1e672e500	0x226000
323	blk.35.ffn_down.weight	0x1e6954500	0x44c0000
324	blk.35.ffn_gate.weight	0x1eae14500	0x44c0000
325	blk.35.ffn_norm.weight	0x1ef2d4500	0x5000
326	blk.35.ffn_up.weight	0x1ef2d9500	0x44c0000
327	blk.36.attn_k.weight	0x1f3799500	0x226000
328	blk.36.attn_norm.weight	0x1f39bf500	0x5000
329	blk.36.attn_output.weight	0x1f39c4500	0x898000
330	blk.36.attn_q.weight	0x1f425c500	0x898000
331	blk.36.attn_v.weight	0x1f4af4500	0x226000
332	blk.36.ffn_down.weight	0x1f4d1a500	0x44c0000
333	blk.36.ffn_gate.weight	0x1f91da500	0x44c0000
334	blk.36.ffn_norm.weight	0x1fd69a500	0x5000
335	blk.36.ffn_up.weight	0x1fd69f500	0x44c0000
336	blk.37.attn_k.weight	0x201b5f500	0x226000
337	blk.37.attn_norm.weight	0x201d85500	0x5000
338	blk.37.attn_output.weight	0x201d8a500	0x898000
339	blk.37.attn_q.weight	0x202622500	0x898000
340	blk.37.attn_v.weight	0x202eba500	0x226000
341	blk.37.ffn_down.weight	0x2030e0500	0x44c0000
342	blk.37.ffn_gate.weight	0x2075a0500	0x44c0000
343	blk.37.ffn_norm.weight	0x20ba60500	0x5000
344	blk.37.ffn_up.weight	0x20ba65500	0x44c0000

Base Tensor Group : ~1B Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
0	output.weight	Output (W)	(~671M) 671088640	5120 x 131072 x 1 x 1	Q3_K
1	output_norm.weight	Output Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
2	token_embd.weight	Token Embedding (W)	(~671M) 671088640	5120 x 131072 x 1 x 1	Q2_K

• Total elements in base: ( ~1B) 1342182400
• Percentage of total elements: 5.98%

Block 0 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
3	blk.0.attn_k.weight	Block 0 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
4	blk.0.attn_norm.weight	Block 0 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
5	blk.0.attn_output.weight	Block 0 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
6	blk.0.attn_q.weight	Block 0 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
7	blk.0.attn_v.weight	Block 0 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
8	blk.0.ffn_down.weight	Block 0 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
9	blk.0.ffn_gate.weight	Block 0 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
10	blk.0.ffn_norm.weight	Block 0 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
11	blk.0.ffn_up.weight	Block 0 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.0: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 1 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
12	blk.1.attn_k.weight	Block 1 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
13	blk.1.attn_norm.weight	Block 1 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
14	blk.1.attn_output.weight	Block 1 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
15	blk.1.attn_q.weight	Block 1 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
16	blk.1.attn_v.weight	Block 1 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
17	blk.1.ffn_down.weight	Block 1 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
18	blk.1.ffn_gate.weight	Block 1 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
19	blk.1.ffn_norm.weight	Block 1 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
20	blk.1.ffn_up.weight	Block 1 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.1: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 2 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
21	blk.2.attn_k.weight	Block 2 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
22	blk.2.attn_norm.weight	Block 2 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
23	blk.2.attn_output.weight	Block 2 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
24	blk.2.attn_q.weight	Block 2 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
25	blk.2.attn_v.weight	Block 2 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
26	blk.2.ffn_down.weight	Block 2 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
27	blk.2.ffn_gate.weight	Block 2 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
28	blk.2.ffn_norm.weight	Block 2 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
29	blk.2.ffn_up.weight	Block 2 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.2: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 3 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
30	blk.3.attn_k.weight	Block 3 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
31	blk.3.attn_norm.weight	Block 3 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
32	blk.3.attn_output.weight	Block 3 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
33	blk.3.attn_q.weight	Block 3 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
34	blk.3.attn_v.weight	Block 3 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
35	blk.3.ffn_down.weight	Block 3 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
36	blk.3.ffn_gate.weight	Block 3 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
37	blk.3.ffn_norm.weight	Block 3 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
38	blk.3.ffn_up.weight	Block 3 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.3: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 4 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
39	blk.4.attn_k.weight	Block 4 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
40	blk.4.attn_norm.weight	Block 4 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
41	blk.4.attn_output.weight	Block 4 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
42	blk.4.attn_q.weight	Block 4 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
43	blk.4.attn_v.weight	Block 4 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
44	blk.4.ffn_down.weight	Block 4 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
45	blk.4.ffn_gate.weight	Block 4 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
46	blk.4.ffn_norm.weight	Block 4 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
47	blk.4.ffn_up.weight	Block 4 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.4: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 5 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
48	blk.5.attn_k.weight	Block 5 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
49	blk.5.attn_norm.weight	Block 5 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
50	blk.5.attn_output.weight	Block 5 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
51	blk.5.attn_q.weight	Block 5 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
52	blk.5.attn_v.weight	Block 5 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
53	blk.5.ffn_down.weight	Block 5 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
54	blk.5.ffn_gate.weight	Block 5 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
55	blk.5.ffn_norm.weight	Block 5 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
56	blk.5.ffn_up.weight	Block 5 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.5: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 6 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
57	blk.6.attn_k.weight	Block 6 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
58	blk.6.attn_norm.weight	Block 6 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
59	blk.6.attn_output.weight	Block 6 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
60	blk.6.attn_q.weight	Block 6 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
61	blk.6.attn_v.weight	Block 6 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
62	blk.6.ffn_down.weight	Block 6 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
63	blk.6.ffn_gate.weight	Block 6 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
64	blk.6.ffn_norm.weight	Block 6 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
65	blk.6.ffn_up.weight	Block 6 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.6: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 7 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
66	blk.7.attn_k.weight	Block 7 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
67	blk.7.attn_norm.weight	Block 7 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
68	blk.7.attn_output.weight	Block 7 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
69	blk.7.attn_q.weight	Block 7 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
70	blk.7.attn_v.weight	Block 7 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
71	blk.7.ffn_down.weight	Block 7 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
72	blk.7.ffn_gate.weight	Block 7 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
73	blk.7.ffn_norm.weight	Block 7 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
74	blk.7.ffn_up.weight	Block 7 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.7: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 8 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
75	blk.8.attn_k.weight	Block 8 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
76	blk.8.attn_norm.weight	Block 8 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
77	blk.8.attn_output.weight	Block 8 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
78	blk.8.attn_q.weight	Block 8 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
79	blk.8.attn_v.weight	Block 8 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
80	blk.8.ffn_down.weight	Block 8 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
81	blk.8.ffn_gate.weight	Block 8 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
82	blk.8.ffn_norm.weight	Block 8 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
83	blk.8.ffn_up.weight	Block 8 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.8: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 9 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
84	blk.9.attn_k.weight	Block 9 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
85	blk.9.attn_norm.weight	Block 9 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
86	blk.9.attn_output.weight	Block 9 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
87	blk.9.attn_q.weight	Block 9 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
88	blk.9.attn_v.weight	Block 9 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
89	blk.9.ffn_down.weight	Block 9 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
90	blk.9.ffn_gate.weight	Block 9 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
91	blk.9.ffn_norm.weight	Block 9 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
92	blk.9.ffn_up.weight	Block 9 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.9: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 10 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
93	blk.10.attn_k.weight	Block 10 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
94	blk.10.attn_norm.weight	Block 10 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
95	blk.10.attn_output.weight	Block 10 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
96	blk.10.attn_q.weight	Block 10 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
97	blk.10.attn_v.weight	Block 10 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
98	blk.10.ffn_down.weight	Block 10 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
99	blk.10.ffn_gate.weight	Block 10 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
100	blk.10.ffn_norm.weight	Block 10 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
101	blk.10.ffn_up.weight	Block 10 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.10: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 11 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
102	blk.11.attn_k.weight	Block 11 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
103	blk.11.attn_norm.weight	Block 11 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
104	blk.11.attn_output.weight	Block 11 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
105	blk.11.attn_q.weight	Block 11 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
106	blk.11.attn_v.weight	Block 11 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
107	blk.11.ffn_down.weight	Block 11 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
108	blk.11.ffn_gate.weight	Block 11 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
109	blk.11.ffn_norm.weight	Block 11 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
110	blk.11.ffn_up.weight	Block 11 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.11: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 12 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
111	blk.12.attn_k.weight	Block 12 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
112	blk.12.attn_norm.weight	Block 12 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
113	blk.12.attn_output.weight	Block 12 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
114	blk.12.attn_q.weight	Block 12 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
115	blk.12.attn_v.weight	Block 12 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
116	blk.12.ffn_down.weight	Block 12 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
117	blk.12.ffn_gate.weight	Block 12 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
118	blk.12.ffn_norm.weight	Block 12 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
119	blk.12.ffn_up.weight	Block 12 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.12: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 13 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
120	blk.13.attn_k.weight	Block 13 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
121	blk.13.attn_norm.weight	Block 13 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
122	blk.13.attn_output.weight	Block 13 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
123	blk.13.attn_q.weight	Block 13 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
124	blk.13.attn_v.weight	Block 13 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
125	blk.13.ffn_down.weight	Block 13 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
126	blk.13.ffn_gate.weight	Block 13 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
127	blk.13.ffn_norm.weight	Block 13 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
128	blk.13.ffn_up.weight	Block 13 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.13: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 14 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
129	blk.14.attn_k.weight	Block 14 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
130	blk.14.attn_norm.weight	Block 14 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
131	blk.14.attn_output.weight	Block 14 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
132	blk.14.attn_q.weight	Block 14 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
133	blk.14.attn_v.weight	Block 14 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
134	blk.14.ffn_down.weight	Block 14 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
135	blk.14.ffn_gate.weight	Block 14 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
136	blk.14.ffn_norm.weight	Block 14 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
137	blk.14.ffn_up.weight	Block 14 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.14: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 15 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
138	blk.15.attn_k.weight	Block 15 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
139	blk.15.attn_norm.weight	Block 15 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
140	blk.15.attn_output.weight	Block 15 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
141	blk.15.attn_q.weight	Block 15 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
142	blk.15.attn_v.weight	Block 15 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
143	blk.15.ffn_down.weight	Block 15 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
144	blk.15.ffn_gate.weight	Block 15 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
145	blk.15.ffn_norm.weight	Block 15 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
146	blk.15.ffn_up.weight	Block 15 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.15: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 16 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
147	blk.16.attn_k.weight	Block 16 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
148	blk.16.attn_norm.weight	Block 16 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
149	blk.16.attn_output.weight	Block 16 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
150	blk.16.attn_q.weight	Block 16 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
151	blk.16.attn_v.weight	Block 16 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
152	blk.16.ffn_down.weight	Block 16 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
153	blk.16.ffn_gate.weight	Block 16 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
154	blk.16.ffn_norm.weight	Block 16 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
155	blk.16.ffn_up.weight	Block 16 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.16: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 17 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
156	blk.17.attn_k.weight	Block 17 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
157	blk.17.attn_norm.weight	Block 17 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
158	blk.17.attn_output.weight	Block 17 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
159	blk.17.attn_q.weight	Block 17 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
160	blk.17.attn_v.weight	Block 17 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
161	blk.17.ffn_down.weight	Block 17 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
162	blk.17.ffn_gate.weight	Block 17 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
163	blk.17.ffn_norm.weight	Block 17 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
164	blk.17.ffn_up.weight	Block 17 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.17: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 18 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
165	blk.18.attn_k.weight	Block 18 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
166	blk.18.attn_norm.weight	Block 18 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
167	blk.18.attn_output.weight	Block 18 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
168	blk.18.attn_q.weight	Block 18 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
169	blk.18.attn_v.weight	Block 18 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
170	blk.18.ffn_down.weight	Block 18 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
171	blk.18.ffn_gate.weight	Block 18 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
172	blk.18.ffn_norm.weight	Block 18 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
173	blk.18.ffn_up.weight	Block 18 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.18: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 19 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
174	blk.19.attn_k.weight	Block 19 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
175	blk.19.attn_norm.weight	Block 19 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
176	blk.19.attn_output.weight	Block 19 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
177	blk.19.attn_q.weight	Block 19 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
178	blk.19.attn_v.weight	Block 19 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
179	blk.19.ffn_down.weight	Block 19 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
180	blk.19.ffn_gate.weight	Block 19 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
181	blk.19.ffn_norm.weight	Block 19 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
182	blk.19.ffn_up.weight	Block 19 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.19: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 20 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
183	blk.20.attn_k.weight	Block 20 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
184	blk.20.attn_norm.weight	Block 20 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
185	blk.20.attn_output.weight	Block 20 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
186	blk.20.attn_q.weight	Block 20 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
187	blk.20.attn_v.weight	Block 20 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
188	blk.20.ffn_down.weight	Block 20 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
189	blk.20.ffn_gate.weight	Block 20 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
190	blk.20.ffn_norm.weight	Block 20 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
191	blk.20.ffn_up.weight	Block 20 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.20: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 21 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
192	blk.21.attn_k.weight	Block 21 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
193	blk.21.attn_norm.weight	Block 21 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
194	blk.21.attn_output.weight	Block 21 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
195	blk.21.attn_q.weight	Block 21 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
196	blk.21.attn_v.weight	Block 21 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
197	blk.21.ffn_down.weight	Block 21 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
198	blk.21.ffn_gate.weight	Block 21 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
199	blk.21.ffn_norm.weight	Block 21 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
200	blk.21.ffn_up.weight	Block 21 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.21: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 22 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
201	blk.22.attn_k.weight	Block 22 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
202	blk.22.attn_norm.weight	Block 22 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
203	blk.22.attn_output.weight	Block 22 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
204	blk.22.attn_q.weight	Block 22 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
205	blk.22.attn_v.weight	Block 22 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
206	blk.22.ffn_down.weight	Block 22 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
207	blk.22.ffn_gate.weight	Block 22 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
208	blk.22.ffn_norm.weight	Block 22 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
209	blk.22.ffn_up.weight	Block 22 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.22: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 23 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
210	blk.23.attn_k.weight	Block 23 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
211	blk.23.attn_norm.weight	Block 23 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
212	blk.23.attn_output.weight	Block 23 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
213	blk.23.attn_q.weight	Block 23 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
214	blk.23.attn_v.weight	Block 23 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
215	blk.23.ffn_down.weight	Block 23 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
216	blk.23.ffn_gate.weight	Block 23 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
217	blk.23.ffn_norm.weight	Block 23 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
218	blk.23.ffn_up.weight	Block 23 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.23: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 24 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
219	blk.24.attn_k.weight	Block 24 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
220	blk.24.attn_norm.weight	Block 24 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
221	blk.24.attn_output.weight	Block 24 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
222	blk.24.attn_q.weight	Block 24 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
223	blk.24.attn_v.weight	Block 24 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
224	blk.24.ffn_down.weight	Block 24 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
225	blk.24.ffn_gate.weight	Block 24 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
226	blk.24.ffn_norm.weight	Block 24 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
227	blk.24.ffn_up.weight	Block 24 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.24: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 25 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
228	blk.25.attn_k.weight	Block 25 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
229	blk.25.attn_norm.weight	Block 25 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
230	blk.25.attn_output.weight	Block 25 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
231	blk.25.attn_q.weight	Block 25 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
232	blk.25.attn_v.weight	Block 25 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
233	blk.25.ffn_down.weight	Block 25 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
234	blk.25.ffn_gate.weight	Block 25 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
235	blk.25.ffn_norm.weight	Block 25 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
236	blk.25.ffn_up.weight	Block 25 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.25: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 26 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
237	blk.26.attn_k.weight	Block 26 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
238	blk.26.attn_norm.weight	Block 26 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
239	blk.26.attn_output.weight	Block 26 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
240	blk.26.attn_q.weight	Block 26 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
241	blk.26.attn_v.weight	Block 26 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
242	blk.26.ffn_down.weight	Block 26 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
243	blk.26.ffn_gate.weight	Block 26 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
244	blk.26.ffn_norm.weight	Block 26 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
245	blk.26.ffn_up.weight	Block 26 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.26: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 27 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
246	blk.27.attn_k.weight	Block 27 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
247	blk.27.attn_norm.weight	Block 27 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
248	blk.27.attn_output.weight	Block 27 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
249	blk.27.attn_q.weight	Block 27 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
250	blk.27.attn_v.weight	Block 27 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
251	blk.27.ffn_down.weight	Block 27 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
252	blk.27.ffn_gate.weight	Block 27 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
253	blk.27.ffn_norm.weight	Block 27 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
254	blk.27.ffn_up.weight	Block 27 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.27: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 28 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
255	blk.28.attn_k.weight	Block 28 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
256	blk.28.attn_norm.weight	Block 28 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
257	blk.28.attn_output.weight	Block 28 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
258	blk.28.attn_q.weight	Block 28 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
259	blk.28.attn_v.weight	Block 28 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
260	blk.28.ffn_down.weight	Block 28 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
261	blk.28.ffn_gate.weight	Block 28 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
262	blk.28.ffn_norm.weight	Block 28 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
263	blk.28.ffn_up.weight	Block 28 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.28: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 29 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
264	blk.29.attn_k.weight	Block 29 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
265	blk.29.attn_norm.weight	Block 29 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
266	blk.29.attn_output.weight	Block 29 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
267	blk.29.attn_q.weight	Block 29 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
268	blk.29.attn_v.weight	Block 29 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
269	blk.29.ffn_down.weight	Block 29 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
270	blk.29.ffn_gate.weight	Block 29 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
271	blk.29.ffn_norm.weight	Block 29 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
272	blk.29.ffn_up.weight	Block 29 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.29: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 30 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
273	blk.30.attn_k.weight	Block 30 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
274	blk.30.attn_norm.weight	Block 30 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
275	blk.30.attn_output.weight	Block 30 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
276	blk.30.attn_q.weight	Block 30 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
277	blk.30.attn_v.weight	Block 30 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
278	blk.30.ffn_down.weight	Block 30 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
279	blk.30.ffn_gate.weight	Block 30 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
280	blk.30.ffn_norm.weight	Block 30 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
281	blk.30.ffn_up.weight	Block 30 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.30: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 31 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
282	blk.31.attn_k.weight	Block 31 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
283	blk.31.attn_norm.weight	Block 31 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
284	blk.31.attn_output.weight	Block 31 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
285	blk.31.attn_q.weight	Block 31 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
286	blk.31.attn_v.weight	Block 31 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
287	blk.31.ffn_down.weight	Block 31 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
288	blk.31.ffn_gate.weight	Block 31 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
289	blk.31.ffn_norm.weight	Block 31 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
290	blk.31.ffn_up.weight	Block 31 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.31: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 32 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
291	blk.32.attn_k.weight	Block 32 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
292	blk.32.attn_norm.weight	Block 32 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
293	blk.32.attn_output.weight	Block 32 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
294	blk.32.attn_q.weight	Block 32 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
295	blk.32.attn_v.weight	Block 32 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
296	blk.32.ffn_down.weight	Block 32 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
297	blk.32.ffn_gate.weight	Block 32 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
298	blk.32.ffn_norm.weight	Block 32 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
299	blk.32.ffn_up.weight	Block 32 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.32: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 33 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
300	blk.33.attn_k.weight	Block 33 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
301	blk.33.attn_norm.weight	Block 33 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
302	blk.33.attn_output.weight	Block 33 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
303	blk.33.attn_q.weight	Block 33 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
304	blk.33.attn_v.weight	Block 33 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
305	blk.33.ffn_down.weight	Block 33 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
306	blk.33.ffn_gate.weight	Block 33 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
307	blk.33.ffn_norm.weight	Block 33 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
308	blk.33.ffn_up.weight	Block 33 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.33: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 34 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
309	blk.34.attn_k.weight	Block 34 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
310	blk.34.attn_norm.weight	Block 34 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
311	blk.34.attn_output.weight	Block 34 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
312	blk.34.attn_q.weight	Block 34 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
313	blk.34.attn_v.weight	Block 34 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
314	blk.34.ffn_down.weight	Block 34 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
315	blk.34.ffn_gate.weight	Block 34 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
316	blk.34.ffn_norm.weight	Block 34 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
317	blk.34.ffn_up.weight	Block 34 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.34: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 35 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
318	blk.35.attn_k.weight	Block 35 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
319	blk.35.attn_norm.weight	Block 35 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
320	blk.35.attn_output.weight	Block 35 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
321	blk.35.attn_q.weight	Block 35 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
322	blk.35.attn_v.weight	Block 35 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
323	blk.35.ffn_down.weight	Block 35 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
324	blk.35.ffn_gate.weight	Block 35 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
325	blk.35.ffn_norm.weight	Block 35 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
326	blk.35.ffn_up.weight	Block 35 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.35: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 36 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
327	blk.36.attn_k.weight	Block 36 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
328	blk.36.attn_norm.weight	Block 36 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
329	blk.36.attn_output.weight	Block 36 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
330	blk.36.attn_q.weight	Block 36 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
331	blk.36.attn_v.weight	Block 36 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
332	blk.36.ffn_down.weight	Block 36 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
333	blk.36.ffn_gate.weight	Block 36 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
334	blk.36.ffn_norm.weight	Block 36 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
335	blk.36.ffn_up.weight	Block 36 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.36: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 37 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
336	blk.37.attn_k.weight	Block 37 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
337	blk.37.attn_norm.weight	Block 37 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
338	blk.37.attn_output.weight	Block 37 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q3_K
339	blk.37.attn_q.weight	Block 37 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
340	blk.37.attn_v.weight	Block 37 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
341	blk.37.ffn_down.weight	Block 37 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q3_K
342	blk.37.ffn_gate.weight	Block 37 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
343	blk.37.ffn_norm.weight	Block 37 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
344	blk.37.ffn_up.weight	Block 37 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.37: (~556M) 555755520
• Percentage of total elements: 2.47%