Dolphin-Mistral-24B-Venice-Edition-pruned-GGUF/scores/Dolphin-Mistral-24B-Venice-Edition-Q3_K_L.md

Dolphin-Mistral-24B-Venice-Edition-pruned-Q3_K_L.gguf - GGUF Internal File Dump

• Endian: LITTLE endian

Key Value Metadata Store

There are 46 key-value pairs in this file

POS	TYPE	Count	Key	Value
1	UINT32	1	GGUF.version	3
2	UINT64	1	GGUF.tensor_count	345
3	UINT64	1	GGUF.kv_count	43
4	STRING	1	general.architecture	llama
5	STRING	1	general.type	model
6	STRING	1	general.name	Dolphin Mistral 24B Venice Edition
7	STRING	1	general.finetune	Venice-Edition
8	STRING	1	general.basename	Dolphin-Mistral
9	STRING	1	general.size_label	24B
10	STRING	1	general.license	apache-2.0
11	UINT32	1	general.base_model.count	1
12	STRING	1	general.base_model.0.name	Mistral Small 24B Instruct 2501
13	STRING	1	general.base_model.0.version	2501
14	STRING	1	general.base_model.0.organization	Mistralai
15	STRING	1	general.base_model.0.repo_url	https://huggingface.co/mistral...istral-Small-24B-Instruct-2501
16	UINT32	1	llama.context_length	32768
17	UINT32	1	llama.embedding_length	5120
18	UINT32	1	llama.feed_forward_length	32768
19	UINT32	1	llama.attention.head_count	32
20	UINT32	1	llama.attention.head_count_kv	8
21	FLOAT32	1	llama.rope.freq_base	100000000.0
22	FLOAT32	1	llama.attention.layer_norm_rms_epsilon	1e-05
23	UINT32	1	llama.attention.key_length	128
24	UINT32	1	llama.attention.value_length	128
25	UINT32	1	llama.vocab_size	131072
26	UINT32	1	llama.rope.dimension_count	128
27	STRING	1	tokenizer.ggml.model	gpt2
28	STRING	1	tokenizer.ggml.pre	tekken
29	[STRING]	131072	tokenizer.ggml.tokens	[ <unk>, <s>, </s>, [INST], [/INST], ... ]
30	[INT32]	131072	tokenizer.ggml.token_type	[ 3, 3, 3, 3, 3, 3, 3, ... ]
31	[STRING]	269443	tokenizer.ggml.merges	[ Ġ Ġ, Ġ t, e r, i n, Ġ ĠĠĠ, ... ]
32	UINT32	1	tokenizer.ggml.bos_token_id	1
33	UINT32	1	tokenizer.ggml.eos_token_id	2
34	UINT32	1	tokenizer.ggml.unknown_token_id	0
35	UINT32	1	tokenizer.ggml.padding_token_id	11
36	BOOL	1	tokenizer.ggml.add_bos_token	True
37	BOOL	1	tokenizer.ggml.add_eos_token	False
38	STRING	1	tokenizer.chat_template	{%- set today = strftime_now("... {%- endif %}{%- endfor %}
39	BOOL	1	tokenizer.ggml.add_space_prefix	False
40	UINT32	1	general.quantization_version	2
41	UINT32	1	general.file_type	13
42	STRING	1	quantize.imatrix.file	./imatrix/imatrix-Dolphin-Mist...l-24B-Venice-Edition-small.dat
43	STRING	1	quantize.imatrix.dataset	../../datasets/imatrix/combined_eur_small.txt
44	UINT32	1	quantize.imatrix.entries_count	281
45	UINT32	1	quantize.imatrix.chunks_count	3192
46	UINT32	1	llama.block_count	38

Tensors Overview ~22B Elements

Total number of elements in all tensors: 22460892160 Elements

• Dolphin-Mistral-24B-Venice-Edition-pruned-Q3_K_L.gguf - GGUF Internal File Dump
  • Key Value Metadata Store
  • Tensors Overview ~22B Elements
    • Tensor Data Offset
    • Base Tensor Group : ~1B Elements
    • Block 0 Tensor Group : ~556M Elements
    • Block 1 Tensor Group : ~556M Elements
    • Block 2 Tensor Group : ~556M Elements
    • Block 3 Tensor Group : ~556M Elements
    • Block 4 Tensor Group : ~556M Elements
    • Block 5 Tensor Group : ~556M Elements
    • Block 6 Tensor Group : ~556M Elements
    • Block 7 Tensor Group : ~556M Elements
    • Block 8 Tensor Group : ~556M Elements
    • Block 9 Tensor Group : ~556M Elements
    • Block 10 Tensor Group : ~556M Elements
    • Block 11 Tensor Group : ~556M Elements
    • Block 12 Tensor Group : ~556M Elements
    • Block 13 Tensor Group : ~556M Elements
    • Block 14 Tensor Group : ~556M Elements
    • Block 15 Tensor Group : ~556M Elements
    • Block 16 Tensor Group : ~556M Elements
    • Block 17 Tensor Group : ~556M Elements
    • Block 18 Tensor Group : ~556M Elements
    • Block 19 Tensor Group : ~556M Elements
    • Block 20 Tensor Group : ~556M Elements
    • Block 21 Tensor Group : ~556M Elements
    • Block 22 Tensor Group : ~556M Elements
    • Block 23 Tensor Group : ~556M Elements
    • Block 24 Tensor Group : ~556M Elements
    • Block 25 Tensor Group : ~556M Elements
    • Block 26 Tensor Group : ~556M Elements
    • Block 27 Tensor Group : ~556M Elements
    • Block 28 Tensor Group : ~556M Elements
    • Block 29 Tensor Group : ~556M Elements
    • Block 30 Tensor Group : ~556M Elements
    • Block 31 Tensor Group : ~556M Elements
    • Block 32 Tensor Group : ~556M Elements
    • Block 33 Tensor Group : ~556M Elements
    • Block 34 Tensor Group : ~556M Elements
    • Block 35 Tensor Group : ~556M Elements
    • Block 36 Tensor Group : ~556M Elements
    • Block 37 Tensor Group : ~556M Elements

Tensor Data Offset

This table contains the offset and data segment relative to start of file

T_ID	Tensor Layer Name	Data Offset (B)	Data Size (B)
0	output.weight	0x784500	0x11300000
1	output_norm.weight	0x11a84500	0x5000
2	token_embd.weight	0x11a89500	0x11300000
3	blk.0.attn_k.weight	0x22d89500	0x1a4000
4	blk.0.attn_norm.weight	0x22f2d500	0x5000
5	blk.0.attn_output.weight	0x22f32500	0xdc0000
6	blk.0.attn_q.weight	0x23cf2500	0x690000
7	blk.0.attn_v.weight	0x24382500	0x2d0000
8	blk.0.ffn_down.weight	0x24652500	0x6e00000
9	blk.0.ffn_gate.weight	0x2b452500	0x3480000
10	blk.0.ffn_norm.weight	0x2e8d2500	0x5000
11	blk.0.ffn_up.weight	0x2e8d7500	0x3480000
12	blk.1.attn_k.weight	0x31d57500	0x1a4000
13	blk.1.attn_norm.weight	0x31efb500	0x5000
14	blk.1.attn_output.weight	0x31f00500	0xdc0000
15	blk.1.attn_q.weight	0x32cc0500	0x690000
16	blk.1.attn_v.weight	0x33350500	0x2d0000
17	blk.1.ffn_down.weight	0x33620500	0x6e00000
18	blk.1.ffn_gate.weight	0x3a420500	0x3480000
19	blk.1.ffn_norm.weight	0x3d8a0500	0x5000
20	blk.1.ffn_up.weight	0x3d8a5500	0x3480000
21	blk.2.attn_k.weight	0x40d25500	0x1a4000
22	blk.2.attn_norm.weight	0x40ec9500	0x5000
23	blk.2.attn_output.weight	0x40ece500	0xdc0000
24	blk.2.attn_q.weight	0x41c8e500	0x690000
25	blk.2.attn_v.weight	0x4231e500	0x2d0000
26	blk.2.ffn_down.weight	0x425ee500	0x6e00000
27	blk.2.ffn_gate.weight	0x493ee500	0x3480000
28	blk.2.ffn_norm.weight	0x4c86e500	0x5000
29	blk.2.ffn_up.weight	0x4c873500	0x3480000
30	blk.3.attn_k.weight	0x4fcf3500	0x1a4000
31	blk.3.attn_norm.weight	0x4fe97500	0x5000
32	blk.3.attn_output.weight	0x4fe9c500	0xdc0000
33	blk.3.attn_q.weight	0x50c5c500	0x690000
34	blk.3.attn_v.weight	0x512ec500	0x2d0000
35	blk.3.ffn_down.weight	0x515bc500	0x6e00000
36	blk.3.ffn_gate.weight	0x583bc500	0x3480000
37	blk.3.ffn_norm.weight	0x5b83c500	0x5000
38	blk.3.ffn_up.weight	0x5b841500	0x3480000
39	blk.4.attn_k.weight	0x5ecc1500	0x1a4000
40	blk.4.attn_norm.weight	0x5ee65500	0x5000
41	blk.4.attn_output.weight	0x5ee6a500	0xdc0000
42	blk.4.attn_q.weight	0x5fc2a500	0x690000
43	blk.4.attn_v.weight	0x602ba500	0x2d0000
44	blk.4.ffn_down.weight	0x6058a500	0x6e00000
45	blk.4.ffn_gate.weight	0x6738a500	0x3480000
46	blk.4.ffn_norm.weight	0x6a80a500	0x5000
47	blk.4.ffn_up.weight	0x6a80f500	0x3480000
48	blk.5.attn_k.weight	0x6dc8f500	0x1a4000
49	blk.5.attn_norm.weight	0x6de33500	0x5000
50	blk.5.attn_output.weight	0x6de38500	0xdc0000
51	blk.5.attn_q.weight	0x6ebf8500	0x690000
52	blk.5.attn_v.weight	0x6f288500	0x2d0000
53	blk.5.ffn_down.weight	0x6f558500	0x6e00000
54	blk.5.ffn_gate.weight	0x76358500	0x3480000
55	blk.5.ffn_norm.weight	0x797d8500	0x5000
56	blk.5.ffn_up.weight	0x797dd500	0x3480000
57	blk.6.attn_k.weight	0x7cc5d500	0x1a4000
58	blk.6.attn_norm.weight	0x7ce01500	0x5000
59	blk.6.attn_output.weight	0x7ce06500	0xdc0000
60	blk.6.attn_q.weight	0x7dbc6500	0x690000
61	blk.6.attn_v.weight	0x7e256500	0x2d0000
62	blk.6.ffn_down.weight	0x7e526500	0x6e00000
63	blk.6.ffn_gate.weight	0x85326500	0x3480000
64	blk.6.ffn_norm.weight	0x887a6500	0x5000
65	blk.6.ffn_up.weight	0x887ab500	0x3480000
66	blk.7.attn_k.weight	0x8bc2b500	0x1a4000
67	blk.7.attn_norm.weight	0x8bdcf500	0x5000
68	blk.7.attn_output.weight	0x8bdd4500	0xdc0000
69	blk.7.attn_q.weight	0x8cb94500	0x690000
70	blk.7.attn_v.weight	0x8d224500	0x2d0000
71	blk.7.ffn_down.weight	0x8d4f4500	0x6e00000
72	blk.7.ffn_gate.weight	0x942f4500	0x3480000
73	blk.7.ffn_norm.weight	0x97774500	0x5000
74	blk.7.ffn_up.weight	0x97779500	0x3480000
75	blk.8.attn_k.weight	0x9abf9500	0x1a4000
76	blk.8.attn_norm.weight	0x9ad9d500	0x5000
77	blk.8.attn_output.weight	0x9ada2500	0xdc0000
78	blk.8.attn_q.weight	0x9bb62500	0x690000
79	blk.8.attn_v.weight	0x9c1f2500	0x2d0000
80	blk.8.ffn_down.weight	0x9c4c2500	0x6e00000
81	blk.8.ffn_gate.weight	0xa32c2500	0x3480000
82	blk.8.ffn_norm.weight	0xa6742500	0x5000
83	blk.8.ffn_up.weight	0xa6747500	0x3480000
84	blk.9.attn_k.weight	0xa9bc7500	0x1a4000
85	blk.9.attn_norm.weight	0xa9d6b500	0x5000
86	blk.9.attn_output.weight	0xa9d70500	0xdc0000
87	blk.9.attn_q.weight	0xaab30500	0x690000
88	blk.9.attn_v.weight	0xab1c0500	0x2d0000
89	blk.9.ffn_down.weight	0xab490500	0x6e00000
90	blk.9.ffn_gate.weight	0xb2290500	0x3480000
91	blk.9.ffn_norm.weight	0xb5710500	0x5000
92	blk.9.ffn_up.weight	0xb5715500	0x3480000
93	blk.10.attn_k.weight	0xb8b95500	0x1a4000
94	blk.10.attn_norm.weight	0xb8d39500	0x5000
95	blk.10.attn_output.weight	0xb8d3e500	0xdc0000
96	blk.10.attn_q.weight	0xb9afe500	0x690000
97	blk.10.attn_v.weight	0xba18e500	0x2d0000
98	blk.10.ffn_down.weight	0xba45e500	0x6e00000
99	blk.10.ffn_gate.weight	0xc125e500	0x3480000
100	blk.10.ffn_norm.weight	0xc46de500	0x5000
101	blk.10.ffn_up.weight	0xc46e3500	0x3480000
102	blk.11.attn_k.weight	0xc7b63500	0x1a4000
103	blk.11.attn_norm.weight	0xc7d07500	0x5000
104	blk.11.attn_output.weight	0xc7d0c500	0xdc0000
105	blk.11.attn_q.weight	0xc8acc500	0x690000
106	blk.11.attn_v.weight	0xc915c500	0x2d0000
107	blk.11.ffn_down.weight	0xc942c500	0x6e00000
108	blk.11.ffn_gate.weight	0xd022c500	0x3480000
109	blk.11.ffn_norm.weight	0xd36ac500	0x5000
110	blk.11.ffn_up.weight	0xd36b1500	0x3480000
111	blk.12.attn_k.weight	0xd6b31500	0x1a4000
112	blk.12.attn_norm.weight	0xd6cd5500	0x5000
113	blk.12.attn_output.weight	0xd6cda500	0xdc0000
114	blk.12.attn_q.weight	0xd7a9a500	0x690000
115	blk.12.attn_v.weight	0xd812a500	0x2d0000
116	blk.12.ffn_down.weight	0xd83fa500	0x6e00000
117	blk.12.ffn_gate.weight	0xdf1fa500	0x3480000
118	blk.12.ffn_norm.weight	0xe267a500	0x5000
119	blk.12.ffn_up.weight	0xe267f500	0x3480000
120	blk.13.attn_k.weight	0xe5aff500	0x1a4000
121	blk.13.attn_norm.weight	0xe5ca3500	0x5000
122	blk.13.attn_output.weight	0xe5ca8500	0xdc0000
123	blk.13.attn_q.weight	0xe6a68500	0x690000
124	blk.13.attn_v.weight	0xe70f8500	0x2d0000
125	blk.13.ffn_down.weight	0xe73c8500	0x6e00000
126	blk.13.ffn_gate.weight	0xee1c8500	0x3480000
127	blk.13.ffn_norm.weight	0xf1648500	0x5000
128	blk.13.ffn_up.weight	0xf164d500	0x3480000
129	blk.14.attn_k.weight	0xf4acd500	0x1a4000
130	blk.14.attn_norm.weight	0xf4c71500	0x5000
131	blk.14.attn_output.weight	0xf4c76500	0xdc0000
132	blk.14.attn_q.weight	0xf5a36500	0x690000
133	blk.14.attn_v.weight	0xf60c6500	0x2d0000
134	blk.14.ffn_down.weight	0xf6396500	0x6e00000
135	blk.14.ffn_gate.weight	0xfd196500	0x3480000
136	blk.14.ffn_norm.weight	0x100616500	0x5000
137	blk.14.ffn_up.weight	0x10061b500	0x3480000
138	blk.15.attn_k.weight	0x103a9b500	0x1a4000
139	blk.15.attn_norm.weight	0x103c3f500	0x5000
140	blk.15.attn_output.weight	0x103c44500	0xdc0000
141	blk.15.attn_q.weight	0x104a04500	0x690000
142	blk.15.attn_v.weight	0x105094500	0x2d0000
143	blk.15.ffn_down.weight	0x105364500	0x6e00000
144	blk.15.ffn_gate.weight	0x10c164500	0x3480000
145	blk.15.ffn_norm.weight	0x10f5e4500	0x5000
146	blk.15.ffn_up.weight	0x10f5e9500	0x3480000
147	blk.16.attn_k.weight	0x112a69500	0x1a4000
148	blk.16.attn_norm.weight	0x112c0d500	0x5000
149	blk.16.attn_output.weight	0x112c12500	0xdc0000
150	blk.16.attn_q.weight	0x1139d2500	0x690000
151	blk.16.attn_v.weight	0x114062500	0x2d0000
152	blk.16.ffn_down.weight	0x114332500	0x6e00000
153	blk.16.ffn_gate.weight	0x11b132500	0x3480000
154	blk.16.ffn_norm.weight	0x11e5b2500	0x5000
155	blk.16.ffn_up.weight	0x11e5b7500	0x3480000
156	blk.17.attn_k.weight	0x121a37500	0x226000
157	blk.17.attn_norm.weight	0x121c5d500	0x5000
158	blk.17.attn_output.weight	0x121c62500	0xdc0000
159	blk.17.attn_q.weight	0x122a22500	0x898000
160	blk.17.attn_v.weight	0x1232ba500	0x2d0000
161	blk.17.ffn_down.weight	0x12358a500	0x6e00000
162	blk.17.ffn_gate.weight	0x12a38a500	0x3480000
163	blk.17.ffn_norm.weight	0x12d80a500	0x5000
164	blk.17.ffn_up.weight	0x12d80f500	0x3480000
165	blk.18.attn_k.weight	0x130c8f500	0x226000
166	blk.18.attn_norm.weight	0x130eb5500	0x5000
167	blk.18.attn_output.weight	0x130eba500	0xdc0000
168	blk.18.attn_q.weight	0x131c7a500	0x898000
169	blk.18.attn_v.weight	0x132512500	0x2d0000
170	blk.18.ffn_down.weight	0x1327e2500	0x6e00000
171	blk.18.ffn_gate.weight	0x1395e2500	0x3480000
172	blk.18.ffn_norm.weight	0x13ca62500	0x5000
173	blk.18.ffn_up.weight	0x13ca67500	0x3480000
174	blk.19.attn_k.weight	0x13fee7500	0x1a4000
175	blk.19.attn_norm.weight	0x14008b500	0x5000
176	blk.19.attn_output.weight	0x140090500	0xdc0000
177	blk.19.attn_q.weight	0x140e50500	0x690000
178	blk.19.attn_v.weight	0x1414e0500	0x2d0000
179	blk.19.ffn_down.weight	0x1417b0500	0x6e00000
180	blk.19.ffn_gate.weight	0x1485b0500	0x3480000
181	blk.19.ffn_norm.weight	0x14ba30500	0x5000
182	blk.19.ffn_up.weight	0x14ba35500	0x3480000
183	blk.20.attn_k.weight	0x14eeb5500	0x226000
184	blk.20.attn_norm.weight	0x14f0db500	0x5000
185	blk.20.attn_output.weight	0x14f0e0500	0xdc0000
186	blk.20.attn_q.weight	0x14fea0500	0x898000
187	blk.20.attn_v.weight	0x150738500	0x2d0000
188	blk.20.ffn_down.weight	0x150a08500	0x6e00000
189	blk.20.ffn_gate.weight	0x157808500	0x44c0000
190	blk.20.ffn_norm.weight	0x15bcc8500	0x5000
191	blk.20.ffn_up.weight	0x15bccd500	0x44c0000
192	blk.21.attn_k.weight	0x16018d500	0x1a4000
193	blk.21.attn_norm.weight	0x160331500	0x5000
194	blk.21.attn_output.weight	0x160336500	0xdc0000
195	blk.21.attn_q.weight	0x1610f6500	0x690000
196	blk.21.attn_v.weight	0x161786500	0x2d0000
197	blk.21.ffn_down.weight	0x161a56500	0x6e00000
198	blk.21.ffn_gate.weight	0x168856500	0x44c0000
199	blk.21.ffn_norm.weight	0x16cd16500	0x5000
200	blk.21.ffn_up.weight	0x16cd1b500	0x44c0000
201	blk.22.attn_k.weight	0x1711db500	0x226000
202	blk.22.attn_norm.weight	0x171401500	0x5000
203	blk.22.attn_output.weight	0x171406500	0xdc0000
204	blk.22.attn_q.weight	0x1721c6500	0x898000
205	blk.22.attn_v.weight	0x172a5e500	0x2d0000
206	blk.22.ffn_down.weight	0x172d2e500	0x6e00000
207	blk.22.ffn_gate.weight	0x179b2e500	0x44c0000
208	blk.22.ffn_norm.weight	0x17dfee500	0x5000
209	blk.22.ffn_up.weight	0x17dff3500	0x44c0000
210	blk.23.attn_k.weight	0x1824b3500	0x226000
211	blk.23.attn_norm.weight	0x1826d9500	0x5000
212	blk.23.attn_output.weight	0x1826de500	0xdc0000
213	blk.23.attn_q.weight	0x18349e500	0x898000
214	blk.23.attn_v.weight	0x183d36500	0x2d0000
215	blk.23.ffn_down.weight	0x184006500	0x6e00000
216	blk.23.ffn_gate.weight	0x18ae06500	0x44c0000
217	blk.23.ffn_norm.weight	0x18f2c6500	0x5000
218	blk.23.ffn_up.weight	0x18f2cb500	0x44c0000
219	blk.24.attn_k.weight	0x19378b500	0x226000
220	blk.24.attn_norm.weight	0x1939b1500	0x5000
221	blk.24.attn_output.weight	0x1939b6500	0xdc0000
222	blk.24.attn_q.weight	0x194776500	0x898000
223	blk.24.attn_v.weight	0x19500e500	0x2d0000
224	blk.24.ffn_down.weight	0x1952de500	0x6e00000
225	blk.24.ffn_gate.weight	0x19c0de500	0x44c0000
226	blk.24.ffn_norm.weight	0x1a059e500	0x5000
227	blk.24.ffn_up.weight	0x1a05a3500	0x44c0000
228	blk.25.attn_k.weight	0x1a4a63500	0x226000
229	blk.25.attn_norm.weight	0x1a4c89500	0x5000
230	blk.25.attn_output.weight	0x1a4c8e500	0xdc0000
231	blk.25.attn_q.weight	0x1a5a4e500	0x898000
232	blk.25.attn_v.weight	0x1a62e6500	0x2d0000
233	blk.25.ffn_down.weight	0x1a65b6500	0x6e00000
234	blk.25.ffn_gate.weight	0x1ad3b6500	0x44c0000
235	blk.25.ffn_norm.weight	0x1b1876500	0x5000
236	blk.25.ffn_up.weight	0x1b187b500	0x44c0000
237	blk.26.attn_k.weight	0x1b5d3b500	0x226000
238	blk.26.attn_norm.weight	0x1b5f61500	0x5000
239	blk.26.attn_output.weight	0x1b5f66500	0xdc0000
240	blk.26.attn_q.weight	0x1b6d26500	0x898000
241	blk.26.attn_v.weight	0x1b75be500	0x2d0000
242	blk.26.ffn_down.weight	0x1b788e500	0x6e00000
243	blk.26.ffn_gate.weight	0x1be68e500	0x44c0000
244	blk.26.ffn_norm.weight	0x1c2b4e500	0x5000
245	blk.26.ffn_up.weight	0x1c2b53500	0x44c0000
246	blk.27.attn_k.weight	0x1c7013500	0x1a4000
247	blk.27.attn_norm.weight	0x1c71b7500	0x5000
248	blk.27.attn_output.weight	0x1c71bc500	0xdc0000
249	blk.27.attn_q.weight	0x1c7f7c500	0x690000
250	blk.27.attn_v.weight	0x1c860c500	0x2d0000
251	blk.27.ffn_down.weight	0x1c88dc500	0x6e00000
252	blk.27.ffn_gate.weight	0x1cf6dc500	0x44c0000
253	blk.27.ffn_norm.weight	0x1d3b9c500	0x5000
254	blk.27.ffn_up.weight	0x1d3ba1500	0x44c0000
255	blk.28.attn_k.weight	0x1d8061500	0x226000
256	blk.28.attn_norm.weight	0x1d8287500	0x5000
257	blk.28.attn_output.weight	0x1d828c500	0xdc0000
258	blk.28.attn_q.weight	0x1d904c500	0x898000
259	blk.28.attn_v.weight	0x1d98e4500	0x2d0000
260	blk.28.ffn_down.weight	0x1d9bb4500	0x6e00000
261	blk.28.ffn_gate.weight	0x1e09b4500	0x44c0000
262	blk.28.ffn_norm.weight	0x1e4e74500	0x5000
263	blk.28.ffn_up.weight	0x1e4e79500	0x44c0000
264	blk.29.attn_k.weight	0x1e9339500	0x226000
265	blk.29.attn_norm.weight	0x1e955f500	0x5000
266	blk.29.attn_output.weight	0x1e9564500	0xdc0000
267	blk.29.attn_q.weight	0x1ea324500	0x898000
268	blk.29.attn_v.weight	0x1eabbc500	0x2d0000
269	blk.29.ffn_down.weight	0x1eae8c500	0x6e00000
270	blk.29.ffn_gate.weight	0x1f1c8c500	0x44c0000
271	blk.29.ffn_norm.weight	0x1f614c500	0x5000
272	blk.29.ffn_up.weight	0x1f6151500	0x44c0000
273	blk.30.attn_k.weight	0x1fa611500	0x226000
274	blk.30.attn_norm.weight	0x1fa837500	0x5000
275	blk.30.attn_output.weight	0x1fa83c500	0xdc0000
276	blk.30.attn_q.weight	0x1fb5fc500	0x898000
277	blk.30.attn_v.weight	0x1fbe94500	0x2d0000
278	blk.30.ffn_down.weight	0x1fc164500	0x6e00000
279	blk.30.ffn_gate.weight	0x202f64500	0x44c0000
280	blk.30.ffn_norm.weight	0x207424500	0x5000
281	blk.30.ffn_up.weight	0x207429500	0x44c0000
282	blk.31.attn_k.weight	0x20b8e9500	0x226000
283	blk.31.attn_norm.weight	0x20bb0f500	0x5000
284	blk.31.attn_output.weight	0x20bb14500	0xdc0000
285	blk.31.attn_q.weight	0x20c8d4500	0x898000
286	blk.31.attn_v.weight	0x20d16c500	0x2d0000
287	blk.31.ffn_down.weight	0x20d43c500	0x6e00000
288	blk.31.ffn_gate.weight	0x21423c500	0x44c0000
289	blk.31.ffn_norm.weight	0x2186fc500	0x5000
290	blk.31.ffn_up.weight	0x218701500	0x44c0000
291	blk.32.attn_k.weight	0x21cbc1500	0x226000
292	blk.32.attn_norm.weight	0x21cde7500	0x5000
293	blk.32.attn_output.weight	0x21cdec500	0xdc0000
294	blk.32.attn_q.weight	0x21dbac500	0x898000
295	blk.32.attn_v.weight	0x21e444500	0x2d0000
296	blk.32.ffn_down.weight	0x21e714500	0x6e00000
297	blk.32.ffn_gate.weight	0x225514500	0x44c0000
298	blk.32.ffn_norm.weight	0x2299d4500	0x5000
299	blk.32.ffn_up.weight	0x2299d9500	0x44c0000
300	blk.33.attn_k.weight	0x22de99500	0x226000
301	blk.33.attn_norm.weight	0x22e0bf500	0x5000
302	blk.33.attn_output.weight	0x22e0c4500	0xdc0000
303	blk.33.attn_q.weight	0x22ee84500	0x898000
304	blk.33.attn_v.weight	0x22f71c500	0x2d0000
305	blk.33.ffn_down.weight	0x22f9ec500	0x6e00000
306	blk.33.ffn_gate.weight	0x2367ec500	0x44c0000
307	blk.33.ffn_norm.weight	0x23acac500	0x5000
308	blk.33.ffn_up.weight	0x23acb1500	0x44c0000
309	blk.34.attn_k.weight	0x23f171500	0x226000
310	blk.34.attn_norm.weight	0x23f397500	0x5000
311	blk.34.attn_output.weight	0x23f39c500	0xdc0000
312	blk.34.attn_q.weight	0x24015c500	0x898000
313	blk.34.attn_v.weight	0x2409f4500	0x2d0000
314	blk.34.ffn_down.weight	0x240cc4500	0x6e00000
315	blk.34.ffn_gate.weight	0x247ac4500	0x44c0000
316	blk.34.ffn_norm.weight	0x24bf84500	0x5000
317	blk.34.ffn_up.weight	0x24bf89500	0x44c0000
318	blk.35.attn_k.weight	0x250449500	0x226000
319	blk.35.attn_norm.weight	0x25066f500	0x5000
320	blk.35.attn_output.weight	0x250674500	0xdc0000
321	blk.35.attn_q.weight	0x251434500	0x898000
322	blk.35.attn_v.weight	0x251ccc500	0x2d0000
323	blk.35.ffn_down.weight	0x251f9c500	0x6e00000
324	blk.35.ffn_gate.weight	0x258d9c500	0x44c0000
325	blk.35.ffn_norm.weight	0x25d25c500	0x5000
326	blk.35.ffn_up.weight	0x25d261500	0x44c0000
327	blk.36.attn_k.weight	0x261721500	0x226000
328	blk.36.attn_norm.weight	0x261947500	0x5000
329	blk.36.attn_output.weight	0x26194c500	0xdc0000
330	blk.36.attn_q.weight	0x26270c500	0x898000
331	blk.36.attn_v.weight	0x262fa4500	0x2d0000
332	blk.36.ffn_down.weight	0x263274500	0x6e00000
333	blk.36.ffn_gate.weight	0x26a074500	0x44c0000
334	blk.36.ffn_norm.weight	0x26e534500	0x5000
335	blk.36.ffn_up.weight	0x26e539500	0x44c0000
336	blk.37.attn_k.weight	0x2729f9500	0x226000
337	blk.37.attn_norm.weight	0x272c1f500	0x5000
338	blk.37.attn_output.weight	0x272c24500	0xdc0000
339	blk.37.attn_q.weight	0x2739e4500	0x898000
340	blk.37.attn_v.weight	0x27427c500	0x2d0000
341	blk.37.ffn_down.weight	0x27454c500	0x6e00000
342	blk.37.ffn_gate.weight	0x27b34c500	0x44c0000
343	blk.37.ffn_norm.weight	0x27f80c500	0x5000
344	blk.37.ffn_up.weight	0x27f811500	0x44c0000

Base Tensor Group : ~1B Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
0	output.weight	Output (W)	(~671M) 671088640	5120 x 131072 x 1 x 1	Q3_K
1	output_norm.weight	Output Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
2	token_embd.weight	Token Embedding (W)	(~671M) 671088640	5120 x 131072 x 1 x 1	Q3_K

• Total elements in base: ( ~1B) 1342182400
• Percentage of total elements: 5.98%

Block 0 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
3	blk.0.attn_k.weight	Block 0 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
4	blk.0.attn_norm.weight	Block 0 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
5	blk.0.attn_output.weight	Block 0 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
6	blk.0.attn_q.weight	Block 0 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
7	blk.0.attn_v.weight	Block 0 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
8	blk.0.ffn_down.weight	Block 0 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
9	blk.0.ffn_gate.weight	Block 0 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
10	blk.0.ffn_norm.weight	Block 0 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
11	blk.0.ffn_up.weight	Block 0 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.0: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 1 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
12	blk.1.attn_k.weight	Block 1 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
13	blk.1.attn_norm.weight	Block 1 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
14	blk.1.attn_output.weight	Block 1 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
15	blk.1.attn_q.weight	Block 1 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
16	blk.1.attn_v.weight	Block 1 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
17	blk.1.ffn_down.weight	Block 1 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
18	blk.1.ffn_gate.weight	Block 1 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
19	blk.1.ffn_norm.weight	Block 1 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
20	blk.1.ffn_up.weight	Block 1 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.1: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 2 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
21	blk.2.attn_k.weight	Block 2 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
22	blk.2.attn_norm.weight	Block 2 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
23	blk.2.attn_output.weight	Block 2 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
24	blk.2.attn_q.weight	Block 2 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
25	blk.2.attn_v.weight	Block 2 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
26	blk.2.ffn_down.weight	Block 2 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
27	blk.2.ffn_gate.weight	Block 2 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
28	blk.2.ffn_norm.weight	Block 2 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
29	blk.2.ffn_up.weight	Block 2 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.2: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 3 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
30	blk.3.attn_k.weight	Block 3 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
31	blk.3.attn_norm.weight	Block 3 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
32	blk.3.attn_output.weight	Block 3 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
33	blk.3.attn_q.weight	Block 3 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
34	blk.3.attn_v.weight	Block 3 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
35	blk.3.ffn_down.weight	Block 3 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
36	blk.3.ffn_gate.weight	Block 3 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
37	blk.3.ffn_norm.weight	Block 3 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
38	blk.3.ffn_up.weight	Block 3 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.3: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 4 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
39	blk.4.attn_k.weight	Block 4 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
40	blk.4.attn_norm.weight	Block 4 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
41	blk.4.attn_output.weight	Block 4 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
42	blk.4.attn_q.weight	Block 4 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
43	blk.4.attn_v.weight	Block 4 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
44	blk.4.ffn_down.weight	Block 4 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
45	blk.4.ffn_gate.weight	Block 4 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
46	blk.4.ffn_norm.weight	Block 4 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
47	blk.4.ffn_up.weight	Block 4 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.4: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 5 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
48	blk.5.attn_k.weight	Block 5 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
49	blk.5.attn_norm.weight	Block 5 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
50	blk.5.attn_output.weight	Block 5 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
51	blk.5.attn_q.weight	Block 5 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
52	blk.5.attn_v.weight	Block 5 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
53	blk.5.ffn_down.weight	Block 5 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
54	blk.5.ffn_gate.weight	Block 5 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
55	blk.5.ffn_norm.weight	Block 5 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
56	blk.5.ffn_up.weight	Block 5 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.5: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 6 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
57	blk.6.attn_k.weight	Block 6 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
58	blk.6.attn_norm.weight	Block 6 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
59	blk.6.attn_output.weight	Block 6 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
60	blk.6.attn_q.weight	Block 6 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
61	blk.6.attn_v.weight	Block 6 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
62	blk.6.ffn_down.weight	Block 6 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
63	blk.6.ffn_gate.weight	Block 6 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
64	blk.6.ffn_norm.weight	Block 6 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
65	blk.6.ffn_up.weight	Block 6 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.6: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 7 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
66	blk.7.attn_k.weight	Block 7 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
67	blk.7.attn_norm.weight	Block 7 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
68	blk.7.attn_output.weight	Block 7 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
69	blk.7.attn_q.weight	Block 7 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
70	blk.7.attn_v.weight	Block 7 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
71	blk.7.ffn_down.weight	Block 7 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
72	blk.7.ffn_gate.weight	Block 7 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
73	blk.7.ffn_norm.weight	Block 7 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
74	blk.7.ffn_up.weight	Block 7 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.7: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 8 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
75	blk.8.attn_k.weight	Block 8 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
76	blk.8.attn_norm.weight	Block 8 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
77	blk.8.attn_output.weight	Block 8 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
78	blk.8.attn_q.weight	Block 8 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
79	blk.8.attn_v.weight	Block 8 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
80	blk.8.ffn_down.weight	Block 8 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
81	blk.8.ffn_gate.weight	Block 8 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
82	blk.8.ffn_norm.weight	Block 8 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
83	blk.8.ffn_up.weight	Block 8 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.8: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 9 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
84	blk.9.attn_k.weight	Block 9 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
85	blk.9.attn_norm.weight	Block 9 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
86	blk.9.attn_output.weight	Block 9 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
87	blk.9.attn_q.weight	Block 9 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
88	blk.9.attn_v.weight	Block 9 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
89	blk.9.ffn_down.weight	Block 9 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
90	blk.9.ffn_gate.weight	Block 9 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
91	blk.9.ffn_norm.weight	Block 9 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
92	blk.9.ffn_up.weight	Block 9 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.9: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 10 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
93	blk.10.attn_k.weight	Block 10 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
94	blk.10.attn_norm.weight	Block 10 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
95	blk.10.attn_output.weight	Block 10 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
96	blk.10.attn_q.weight	Block 10 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
97	blk.10.attn_v.weight	Block 10 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
98	blk.10.ffn_down.weight	Block 10 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
99	blk.10.ffn_gate.weight	Block 10 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
100	blk.10.ffn_norm.weight	Block 10 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
101	blk.10.ffn_up.weight	Block 10 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.10: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 11 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
102	blk.11.attn_k.weight	Block 11 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
103	blk.11.attn_norm.weight	Block 11 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
104	blk.11.attn_output.weight	Block 11 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
105	blk.11.attn_q.weight	Block 11 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
106	blk.11.attn_v.weight	Block 11 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
107	blk.11.ffn_down.weight	Block 11 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
108	blk.11.ffn_gate.weight	Block 11 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
109	blk.11.ffn_norm.weight	Block 11 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
110	blk.11.ffn_up.weight	Block 11 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.11: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 12 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
111	blk.12.attn_k.weight	Block 12 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
112	blk.12.attn_norm.weight	Block 12 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
113	blk.12.attn_output.weight	Block 12 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
114	blk.12.attn_q.weight	Block 12 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
115	blk.12.attn_v.weight	Block 12 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
116	blk.12.ffn_down.weight	Block 12 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
117	blk.12.ffn_gate.weight	Block 12 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
118	blk.12.ffn_norm.weight	Block 12 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
119	blk.12.ffn_up.weight	Block 12 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.12: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 13 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
120	blk.13.attn_k.weight	Block 13 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
121	blk.13.attn_norm.weight	Block 13 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
122	blk.13.attn_output.weight	Block 13 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
123	blk.13.attn_q.weight	Block 13 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
124	blk.13.attn_v.weight	Block 13 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
125	blk.13.ffn_down.weight	Block 13 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
126	blk.13.ffn_gate.weight	Block 13 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
127	blk.13.ffn_norm.weight	Block 13 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
128	blk.13.ffn_up.weight	Block 13 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.13: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 14 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
129	blk.14.attn_k.weight	Block 14 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
130	blk.14.attn_norm.weight	Block 14 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
131	blk.14.attn_output.weight	Block 14 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
132	blk.14.attn_q.weight	Block 14 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
133	blk.14.attn_v.weight	Block 14 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
134	blk.14.ffn_down.weight	Block 14 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
135	blk.14.ffn_gate.weight	Block 14 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
136	blk.14.ffn_norm.weight	Block 14 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
137	blk.14.ffn_up.weight	Block 14 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.14: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 15 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
138	blk.15.attn_k.weight	Block 15 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
139	blk.15.attn_norm.weight	Block 15 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
140	blk.15.attn_output.weight	Block 15 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
141	blk.15.attn_q.weight	Block 15 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
142	blk.15.attn_v.weight	Block 15 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
143	blk.15.ffn_down.weight	Block 15 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
144	blk.15.ffn_gate.weight	Block 15 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
145	blk.15.ffn_norm.weight	Block 15 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
146	blk.15.ffn_up.weight	Block 15 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.15: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 16 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
147	blk.16.attn_k.weight	Block 16 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
148	blk.16.attn_norm.weight	Block 16 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
149	blk.16.attn_output.weight	Block 16 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
150	blk.16.attn_q.weight	Block 16 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
151	blk.16.attn_v.weight	Block 16 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
152	blk.16.ffn_down.weight	Block 16 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
153	blk.16.ffn_gate.weight	Block 16 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
154	blk.16.ffn_norm.weight	Block 16 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
155	blk.16.ffn_up.weight	Block 16 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.16: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 17 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
156	blk.17.attn_k.weight	Block 17 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
157	blk.17.attn_norm.weight	Block 17 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
158	blk.17.attn_output.weight	Block 17 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
159	blk.17.attn_q.weight	Block 17 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
160	blk.17.attn_v.weight	Block 17 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
161	blk.17.ffn_down.weight	Block 17 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
162	blk.17.ffn_gate.weight	Block 17 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
163	blk.17.ffn_norm.weight	Block 17 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
164	blk.17.ffn_up.weight	Block 17 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.17: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 18 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
165	blk.18.attn_k.weight	Block 18 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
166	blk.18.attn_norm.weight	Block 18 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
167	blk.18.attn_output.weight	Block 18 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
168	blk.18.attn_q.weight	Block 18 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
169	blk.18.attn_v.weight	Block 18 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
170	blk.18.ffn_down.weight	Block 18 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
171	blk.18.ffn_gate.weight	Block 18 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
172	blk.18.ffn_norm.weight	Block 18 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
173	blk.18.ffn_up.weight	Block 18 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.18: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 19 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
174	blk.19.attn_k.weight	Block 19 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
175	blk.19.attn_norm.weight	Block 19 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
176	blk.19.attn_output.weight	Block 19 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
177	blk.19.attn_q.weight	Block 19 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
178	blk.19.attn_v.weight	Block 19 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
179	blk.19.ffn_down.weight	Block 19 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
180	blk.19.ffn_gate.weight	Block 19 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K
181	blk.19.ffn_norm.weight	Block 19 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
182	blk.19.ffn_up.weight	Block 19 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q2_K

• Total elements in blk.19: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 20 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
183	blk.20.attn_k.weight	Block 20 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
184	blk.20.attn_norm.weight	Block 20 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
185	blk.20.attn_output.weight	Block 20 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
186	blk.20.attn_q.weight	Block 20 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
187	blk.20.attn_v.weight	Block 20 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
188	blk.20.ffn_down.weight	Block 20 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
189	blk.20.ffn_gate.weight	Block 20 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
190	blk.20.ffn_norm.weight	Block 20 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
191	blk.20.ffn_up.weight	Block 20 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.20: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 21 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
192	blk.21.attn_k.weight	Block 21 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
193	blk.21.attn_norm.weight	Block 21 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
194	blk.21.attn_output.weight	Block 21 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
195	blk.21.attn_q.weight	Block 21 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
196	blk.21.attn_v.weight	Block 21 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
197	blk.21.ffn_down.weight	Block 21 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
198	blk.21.ffn_gate.weight	Block 21 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
199	blk.21.ffn_norm.weight	Block 21 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
200	blk.21.ffn_up.weight	Block 21 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.21: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 22 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
201	blk.22.attn_k.weight	Block 22 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
202	blk.22.attn_norm.weight	Block 22 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
203	blk.22.attn_output.weight	Block 22 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
204	blk.22.attn_q.weight	Block 22 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
205	blk.22.attn_v.weight	Block 22 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
206	blk.22.ffn_down.weight	Block 22 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
207	blk.22.ffn_gate.weight	Block 22 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
208	blk.22.ffn_norm.weight	Block 22 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
209	blk.22.ffn_up.weight	Block 22 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.22: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 23 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
210	blk.23.attn_k.weight	Block 23 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
211	blk.23.attn_norm.weight	Block 23 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
212	blk.23.attn_output.weight	Block 23 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
213	blk.23.attn_q.weight	Block 23 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
214	blk.23.attn_v.weight	Block 23 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
215	blk.23.ffn_down.weight	Block 23 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
216	blk.23.ffn_gate.weight	Block 23 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
217	blk.23.ffn_norm.weight	Block 23 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
218	blk.23.ffn_up.weight	Block 23 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.23: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 24 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
219	blk.24.attn_k.weight	Block 24 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
220	blk.24.attn_norm.weight	Block 24 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
221	blk.24.attn_output.weight	Block 24 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
222	blk.24.attn_q.weight	Block 24 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
223	blk.24.attn_v.weight	Block 24 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
224	blk.24.ffn_down.weight	Block 24 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
225	blk.24.ffn_gate.weight	Block 24 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
226	blk.24.ffn_norm.weight	Block 24 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
227	blk.24.ffn_up.weight	Block 24 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.24: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 25 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
228	blk.25.attn_k.weight	Block 25 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
229	blk.25.attn_norm.weight	Block 25 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
230	blk.25.attn_output.weight	Block 25 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
231	blk.25.attn_q.weight	Block 25 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
232	blk.25.attn_v.weight	Block 25 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
233	blk.25.ffn_down.weight	Block 25 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
234	blk.25.ffn_gate.weight	Block 25 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
235	blk.25.ffn_norm.weight	Block 25 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
236	blk.25.ffn_up.weight	Block 25 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.25: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 26 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
237	blk.26.attn_k.weight	Block 26 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
238	blk.26.attn_norm.weight	Block 26 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
239	blk.26.attn_output.weight	Block 26 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
240	blk.26.attn_q.weight	Block 26 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
241	blk.26.attn_v.weight	Block 26 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
242	blk.26.ffn_down.weight	Block 26 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
243	blk.26.ffn_gate.weight	Block 26 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
244	blk.26.ffn_norm.weight	Block 26 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
245	blk.26.ffn_up.weight	Block 26 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.26: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 27 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
246	blk.27.attn_k.weight	Block 27 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q2_K
247	blk.27.attn_norm.weight	Block 27 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
248	blk.27.attn_output.weight	Block 27 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
249	blk.27.attn_q.weight	Block 27 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q2_K
250	blk.27.attn_v.weight	Block 27 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
251	blk.27.ffn_down.weight	Block 27 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
252	blk.27.ffn_gate.weight	Block 27 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
253	blk.27.ffn_norm.weight	Block 27 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
254	blk.27.ffn_up.weight	Block 27 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.27: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 28 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
255	blk.28.attn_k.weight	Block 28 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
256	blk.28.attn_norm.weight	Block 28 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
257	blk.28.attn_output.weight	Block 28 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
258	blk.28.attn_q.weight	Block 28 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
259	blk.28.attn_v.weight	Block 28 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
260	blk.28.ffn_down.weight	Block 28 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
261	blk.28.ffn_gate.weight	Block 28 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
262	blk.28.ffn_norm.weight	Block 28 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
263	blk.28.ffn_up.weight	Block 28 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.28: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 29 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
264	blk.29.attn_k.weight	Block 29 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
265	blk.29.attn_norm.weight	Block 29 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
266	blk.29.attn_output.weight	Block 29 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
267	blk.29.attn_q.weight	Block 29 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
268	blk.29.attn_v.weight	Block 29 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
269	blk.29.ffn_down.weight	Block 29 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
270	blk.29.ffn_gate.weight	Block 29 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
271	blk.29.ffn_norm.weight	Block 29 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
272	blk.29.ffn_up.weight	Block 29 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.29: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 30 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
273	blk.30.attn_k.weight	Block 30 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
274	blk.30.attn_norm.weight	Block 30 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
275	blk.30.attn_output.weight	Block 30 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
276	blk.30.attn_q.weight	Block 30 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
277	blk.30.attn_v.weight	Block 30 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
278	blk.30.ffn_down.weight	Block 30 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
279	blk.30.ffn_gate.weight	Block 30 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
280	blk.30.ffn_norm.weight	Block 30 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
281	blk.30.ffn_up.weight	Block 30 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.30: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 31 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
282	blk.31.attn_k.weight	Block 31 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
283	blk.31.attn_norm.weight	Block 31 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
284	blk.31.attn_output.weight	Block 31 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
285	blk.31.attn_q.weight	Block 31 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
286	blk.31.attn_v.weight	Block 31 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
287	blk.31.ffn_down.weight	Block 31 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
288	blk.31.ffn_gate.weight	Block 31 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
289	blk.31.ffn_norm.weight	Block 31 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
290	blk.31.ffn_up.weight	Block 31 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.31: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 32 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
291	blk.32.attn_k.weight	Block 32 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
292	blk.32.attn_norm.weight	Block 32 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
293	blk.32.attn_output.weight	Block 32 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
294	blk.32.attn_q.weight	Block 32 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
295	blk.32.attn_v.weight	Block 32 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
296	blk.32.ffn_down.weight	Block 32 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
297	blk.32.ffn_gate.weight	Block 32 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
298	blk.32.ffn_norm.weight	Block 32 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
299	blk.32.ffn_up.weight	Block 32 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.32: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 33 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
300	blk.33.attn_k.weight	Block 33 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
301	blk.33.attn_norm.weight	Block 33 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
302	blk.33.attn_output.weight	Block 33 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
303	blk.33.attn_q.weight	Block 33 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
304	blk.33.attn_v.weight	Block 33 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
305	blk.33.ffn_down.weight	Block 33 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
306	blk.33.ffn_gate.weight	Block 33 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
307	blk.33.ffn_norm.weight	Block 33 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
308	blk.33.ffn_up.weight	Block 33 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.33: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 34 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
309	blk.34.attn_k.weight	Block 34 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
310	blk.34.attn_norm.weight	Block 34 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
311	blk.34.attn_output.weight	Block 34 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
312	blk.34.attn_q.weight	Block 34 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
313	blk.34.attn_v.weight	Block 34 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
314	blk.34.ffn_down.weight	Block 34 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
315	blk.34.ffn_gate.weight	Block 34 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
316	blk.34.ffn_norm.weight	Block 34 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
317	blk.34.ffn_up.weight	Block 34 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.34: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 35 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
318	blk.35.attn_k.weight	Block 35 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
319	blk.35.attn_norm.weight	Block 35 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
320	blk.35.attn_output.weight	Block 35 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
321	blk.35.attn_q.weight	Block 35 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
322	blk.35.attn_v.weight	Block 35 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
323	blk.35.ffn_down.weight	Block 35 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
324	blk.35.ffn_gate.weight	Block 35 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
325	blk.35.ffn_norm.weight	Block 35 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
326	blk.35.ffn_up.weight	Block 35 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.35: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 36 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
327	blk.36.attn_k.weight	Block 36 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
328	blk.36.attn_norm.weight	Block 36 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
329	blk.36.attn_output.weight	Block 36 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
330	blk.36.attn_q.weight	Block 36 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
331	blk.36.attn_v.weight	Block 36 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
332	blk.36.ffn_down.weight	Block 36 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
333	blk.36.ffn_gate.weight	Block 36 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
334	blk.36.ffn_norm.weight	Block 36 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
335	blk.36.ffn_up.weight	Block 36 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.36: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 37 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
336	blk.37.attn_k.weight	Block 37 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q3_K
337	blk.37.attn_norm.weight	Block 37 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
338	blk.37.attn_output.weight	Block 37 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
339	blk.37.attn_q.weight	Block 37 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q3_K
340	blk.37.attn_v.weight	Block 37 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
341	blk.37.ffn_down.weight	Block 37 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
342	blk.37.ffn_gate.weight	Block 37 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K
343	blk.37.ffn_norm.weight	Block 37 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
344	blk.37.ffn_up.weight	Block 37 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q3_K

• Total elements in blk.37: (~556M) 555755520
• Percentage of total elements: 2.47%