Dolphin-Mistral-24B-Venice-Edition-pruned-GGUF/scores/Dolphin-Mistral-24B-Venice-Edition-Q5_K_M.md

Dolphin-Mistral-24B-Venice-Edition-pruned-Q5_K_M.gguf - GGUF Internal File Dump

• Endian: LITTLE endian

Key Value Metadata Store

There are 46 key-value pairs in this file

POS	TYPE	Count	Key	Value
1	UINT32	1	GGUF.version	3
2	UINT64	1	GGUF.tensor_count	345
3	UINT64	1	GGUF.kv_count	43
4	STRING	1	general.architecture	llama
5	STRING	1	general.type	model
6	STRING	1	general.name	Dolphin Mistral 24B Venice Edition
7	STRING	1	general.finetune	Venice-Edition
8	STRING	1	general.basename	Dolphin-Mistral
9	STRING	1	general.size_label	24B
10	STRING	1	general.license	apache-2.0
11	UINT32	1	general.base_model.count	1
12	STRING	1	general.base_model.0.name	Mistral Small 24B Instruct 2501
13	STRING	1	general.base_model.0.version	2501
14	STRING	1	general.base_model.0.organization	Mistralai
15	STRING	1	general.base_model.0.repo_url	https://huggingface.co/mistral...istral-Small-24B-Instruct-2501
16	UINT32	1	llama.context_length	32768
17	UINT32	1	llama.embedding_length	5120
18	UINT32	1	llama.feed_forward_length	32768
19	UINT32	1	llama.attention.head_count	32
20	UINT32	1	llama.attention.head_count_kv	8
21	FLOAT32	1	llama.rope.freq_base	100000000.0
22	FLOAT32	1	llama.attention.layer_norm_rms_epsilon	1e-05
23	UINT32	1	llama.attention.key_length	128
24	UINT32	1	llama.attention.value_length	128
25	UINT32	1	llama.vocab_size	131072
26	UINT32	1	llama.rope.dimension_count	128
27	STRING	1	tokenizer.ggml.model	gpt2
28	STRING	1	tokenizer.ggml.pre	tekken
29	[STRING]	131072	tokenizer.ggml.tokens	[ <unk>, <s>, </s>, [INST], [/INST], ... ]
30	[INT32]	131072	tokenizer.ggml.token_type	[ 3, 3, 3, 3, 3, 3, 3, ... ]
31	[STRING]	269443	tokenizer.ggml.merges	[ Ġ Ġ, Ġ t, e r, i n, Ġ ĠĠĠ, ... ]
32	UINT32	1	tokenizer.ggml.bos_token_id	1
33	UINT32	1	tokenizer.ggml.eos_token_id	2
34	UINT32	1	tokenizer.ggml.unknown_token_id	0
35	UINT32	1	tokenizer.ggml.padding_token_id	11
36	BOOL	1	tokenizer.ggml.add_bos_token	True
37	BOOL	1	tokenizer.ggml.add_eos_token	False
38	STRING	1	tokenizer.chat_template	{%- set today = strftime_now("... {%- endif %}{%- endfor %}
39	BOOL	1	tokenizer.ggml.add_space_prefix	False
40	UINT32	1	general.quantization_version	2
41	UINT32	1	general.file_type	17
42	STRING	1	quantize.imatrix.file	./imatrix/imatrix-Dolphin-Mist...l-24B-Venice-Edition-small.dat
43	STRING	1	quantize.imatrix.dataset	../../datasets/imatrix/combined_eur_small.txt
44	UINT32	1	quantize.imatrix.entries_count	281
45	UINT32	1	quantize.imatrix.chunks_count	3192
46	UINT32	1	llama.block_count	38

Tensors Overview ~22B Elements

Total number of elements in all tensors: 22460892160 Elements

• Dolphin-Mistral-24B-Venice-Edition-pruned-Q5_K_M.gguf - GGUF Internal File Dump
  • Key Value Metadata Store
  • Tensors Overview ~22B Elements
    • Tensor Data Offset
    • Base Tensor Group : ~1B Elements
    • Block 0 Tensor Group : ~556M Elements
    • Block 1 Tensor Group : ~556M Elements
    • Block 2 Tensor Group : ~556M Elements
    • Block 3 Tensor Group : ~556M Elements
    • Block 4 Tensor Group : ~556M Elements
    • Block 5 Tensor Group : ~556M Elements
    • Block 6 Tensor Group : ~556M Elements
    • Block 7 Tensor Group : ~556M Elements
    • Block 8 Tensor Group : ~556M Elements
    • Block 9 Tensor Group : ~556M Elements
    • Block 10 Tensor Group : ~556M Elements
    • Block 11 Tensor Group : ~556M Elements
    • Block 12 Tensor Group : ~556M Elements
    • Block 13 Tensor Group : ~556M Elements
    • Block 14 Tensor Group : ~556M Elements
    • Block 15 Tensor Group : ~556M Elements
    • Block 16 Tensor Group : ~556M Elements
    • Block 17 Tensor Group : ~556M Elements
    • Block 18 Tensor Group : ~556M Elements
    • Block 19 Tensor Group : ~556M Elements
    • Block 20 Tensor Group : ~556M Elements
    • Block 21 Tensor Group : ~556M Elements
    • Block 22 Tensor Group : ~556M Elements
    • Block 23 Tensor Group : ~556M Elements
    • Block 24 Tensor Group : ~556M Elements
    • Block 25 Tensor Group : ~556M Elements
    • Block 26 Tensor Group : ~556M Elements
    • Block 27 Tensor Group : ~556M Elements
    • Block 28 Tensor Group : ~556M Elements
    • Block 29 Tensor Group : ~556M Elements
    • Block 30 Tensor Group : ~556M Elements
    • Block 31 Tensor Group : ~556M Elements
    • Block 32 Tensor Group : ~556M Elements
    • Block 33 Tensor Group : ~556M Elements
    • Block 34 Tensor Group : ~556M Elements
    • Block 35 Tensor Group : ~556M Elements
    • Block 36 Tensor Group : ~556M Elements
    • Block 37 Tensor Group : ~556M Elements

Tensor Data Offset

This table contains the offset and data segment relative to start of file

T_ID	Tensor Layer Name	Data Offset (B)	Data Size (B)
0	output.weight	0x784500	0x1b800000
1	output_norm.weight	0x1bf84500	0x5000
2	token_embd.weight	0x1bf89500	0x11300000
3	blk.0.attn_k.weight	0x2d289500	0x2d0000
4	blk.0.attn_norm.weight	0x2d559500	0x5000
5	blk.0.attn_output.weight	0x2d55e500	0xdc0000
6	blk.0.attn_q.weight	0x2e31e500	0xb40000
7	blk.0.attn_v.weight	0x2ee5e500	0x370000
8	blk.0.ffn_down.weight	0x2f1ce500	0x8340000
9	blk.0.ffn_gate.weight	0x3750e500	0x5a00000
10	blk.0.ffn_norm.weight	0x3cf0e500	0x5000
11	blk.0.ffn_up.weight	0x3cf13500	0x5a00000
12	blk.1.attn_k.weight	0x42913500	0x2d0000
13	blk.1.attn_norm.weight	0x42be3500	0x5000
14	blk.1.attn_output.weight	0x42be8500	0xdc0000
15	blk.1.attn_q.weight	0x439a8500	0xb40000
16	blk.1.attn_v.weight	0x444e8500	0x370000
17	blk.1.ffn_down.weight	0x44858500	0x8340000
18	blk.1.ffn_gate.weight	0x4cb98500	0x5a00000
19	blk.1.ffn_norm.weight	0x52598500	0x5000
20	blk.1.ffn_up.weight	0x5259d500	0x5a00000
21	blk.2.attn_k.weight	0x57f9d500	0x2d0000
22	blk.2.attn_norm.weight	0x5826d500	0x5000
23	blk.2.attn_output.weight	0x58272500	0xdc0000
24	blk.2.attn_q.weight	0x59032500	0xb40000
25	blk.2.attn_v.weight	0x59b72500	0x370000
26	blk.2.ffn_down.weight	0x59ee2500	0x8340000
27	blk.2.ffn_gate.weight	0x62222500	0x5a00000
28	blk.2.ffn_norm.weight	0x67c22500	0x5000
29	blk.2.ffn_up.weight	0x67c27500	0x5a00000
30	blk.3.attn_k.weight	0x6d627500	0x2d0000
31	blk.3.attn_norm.weight	0x6d8f7500	0x5000
32	blk.3.attn_output.weight	0x6d8fc500	0xdc0000
33	blk.3.attn_q.weight	0x6e6bc500	0xb40000
34	blk.3.attn_v.weight	0x6f1fc500	0x370000
35	blk.3.ffn_down.weight	0x6f56c500	0x8340000
36	blk.3.ffn_gate.weight	0x778ac500	0x5a00000
37	blk.3.ffn_norm.weight	0x7d2ac500	0x5000
38	blk.3.ffn_up.weight	0x7d2b1500	0x5a00000
39	blk.4.attn_k.weight	0x82cb1500	0x2d0000
40	blk.4.attn_norm.weight	0x82f81500	0x5000
41	blk.4.attn_output.weight	0x82f86500	0xdc0000
42	blk.4.attn_q.weight	0x83d46500	0xb40000
43	blk.4.attn_v.weight	0x84886500	0x41a000
44	blk.4.ffn_down.weight	0x84ca0500	0x8340000
45	blk.4.ffn_gate.weight	0x8cfe0500	0x5a00000
46	blk.4.ffn_norm.weight	0x929e0500	0x5000
47	blk.4.ffn_up.weight	0x929e5500	0x5a00000
48	blk.5.attn_k.weight	0x983e5500	0x2d0000
49	blk.5.attn_norm.weight	0x986b5500	0x5000
50	blk.5.attn_output.weight	0x986ba500	0xdc0000
51	blk.5.attn_q.weight	0x9947a500	0xb40000
52	blk.5.attn_v.weight	0x99fba500	0x41a000
53	blk.5.ffn_down.weight	0x9a3d4500	0x6e00000
54	blk.5.ffn_gate.weight	0xa11d4500	0x5a00000
55	blk.5.ffn_norm.weight	0xa6bd4500	0x5000
56	blk.5.ffn_up.weight	0xa6bd9500	0x5a00000
57	blk.6.attn_k.weight	0xac5d9500	0x2d0000
58	blk.6.attn_norm.weight	0xac8a9500	0x5000
59	blk.6.attn_output.weight	0xac8ae500	0xdc0000
60	blk.6.attn_q.weight	0xad66e500	0xb40000
61	blk.6.attn_v.weight	0xae1ae500	0x370000
62	blk.6.ffn_down.weight	0xae51e500	0x6e00000
63	blk.6.ffn_gate.weight	0xb531e500	0x5a00000
64	blk.6.ffn_norm.weight	0xbad1e500	0x5000
65	blk.6.ffn_up.weight	0xbad23500	0x5a00000
66	blk.7.attn_k.weight	0xc0723500	0x2d0000
67	blk.7.attn_norm.weight	0xc09f3500	0x5000
68	blk.7.attn_output.weight	0xc09f8500	0xdc0000
69	blk.7.attn_q.weight	0xc17b8500	0xb40000
70	blk.7.attn_v.weight	0xc22f8500	0x41a000
71	blk.7.ffn_down.weight	0xc2712500	0x8340000
72	blk.7.ffn_gate.weight	0xcaa52500	0x5a00000
73	blk.7.ffn_norm.weight	0xd0452500	0x5000
74	blk.7.ffn_up.weight	0xd0457500	0x5a00000
75	blk.8.attn_k.weight	0xd5e57500	0x2d0000
76	blk.8.attn_norm.weight	0xd6127500	0x5000
77	blk.8.attn_output.weight	0xd612c500	0xdc0000
78	blk.8.attn_q.weight	0xd6eec500	0xb40000
79	blk.8.attn_v.weight	0xd7a2c500	0x41a000
80	blk.8.ffn_down.weight	0xd7e46500	0x6e00000
81	blk.8.ffn_gate.weight	0xdec46500	0x5a00000
82	blk.8.ffn_norm.weight	0xe4646500	0x5000
83	blk.8.ffn_up.weight	0xe464b500	0x5a00000
84	blk.9.attn_k.weight	0xea04b500	0x2d0000
85	blk.9.attn_norm.weight	0xea31b500	0x5000
86	blk.9.attn_output.weight	0xea320500	0xdc0000
87	blk.9.attn_q.weight	0xeb0e0500	0xb40000
88	blk.9.attn_v.weight	0xebc20500	0x370000
89	blk.9.ffn_down.weight	0xebf90500	0x6e00000
90	blk.9.ffn_gate.weight	0xf2d90500	0x5a00000
91	blk.9.ffn_norm.weight	0xf8790500	0x5000
92	blk.9.ffn_up.weight	0xf8795500	0x5a00000
93	blk.10.attn_k.weight	0xfe195500	0x2d0000
94	blk.10.attn_norm.weight	0xfe465500	0x5000
95	blk.10.attn_output.weight	0xfe46a500	0xdc0000
96	blk.10.attn_q.weight	0xff22a500	0xb40000
97	blk.10.attn_v.weight	0xffd6a500	0x41a000
98	blk.10.ffn_down.weight	0x100184500	0x8340000
99	blk.10.ffn_gate.weight	0x1084c4500	0x5a00000
100	blk.10.ffn_norm.weight	0x10dec4500	0x5000
101	blk.10.ffn_up.weight	0x10dec9500	0x5a00000
102	blk.11.attn_k.weight	0x1138c9500	0x2d0000
103	blk.11.attn_norm.weight	0x113b99500	0x5000
104	blk.11.attn_output.weight	0x113b9e500	0xdc0000
105	blk.11.attn_q.weight	0x11495e500	0xb40000
106	blk.11.attn_v.weight	0x11549e500	0x41a000
107	blk.11.ffn_down.weight	0x1158b8500	0x6e00000
108	blk.11.ffn_gate.weight	0x11c6b8500	0x5a00000
109	blk.11.ffn_norm.weight	0x1220b8500	0x5000
110	blk.11.ffn_up.weight	0x1220bd500	0x5a00000
111	blk.12.attn_k.weight	0x127abd500	0x2d0000
112	blk.12.attn_norm.weight	0x127d8d500	0x5000
113	blk.12.attn_output.weight	0x127d92500	0xdc0000
114	blk.12.attn_q.weight	0x128b52500	0xb40000
115	blk.12.attn_v.weight	0x129692500	0x370000
116	blk.12.ffn_down.weight	0x129a02500	0x6e00000
117	blk.12.ffn_gate.weight	0x130802500	0x5a00000
118	blk.12.ffn_norm.weight	0x136202500	0x5000
119	blk.12.ffn_up.weight	0x136207500	0x5a00000
120	blk.13.attn_k.weight	0x13bc07500	0x2d0000
121	blk.13.attn_norm.weight	0x13bed7500	0x5000
122	blk.13.attn_output.weight	0x13bedc500	0xdc0000
123	blk.13.attn_q.weight	0x13cc9c500	0xb40000
124	blk.13.attn_v.weight	0x13d7dc500	0x41a000
125	blk.13.ffn_down.weight	0x13dbf6500	0x8340000
126	blk.13.ffn_gate.weight	0x145f36500	0x5a00000
127	blk.13.ffn_norm.weight	0x14b936500	0x5000
128	blk.13.ffn_up.weight	0x14b93b500	0x5a00000
129	blk.14.attn_k.weight	0x15133b500	0x2d0000
130	blk.14.attn_norm.weight	0x15160b500	0x5000
131	blk.14.attn_output.weight	0x151610500	0xdc0000
132	blk.14.attn_q.weight	0x1523d0500	0xb40000
133	blk.14.attn_v.weight	0x152f10500	0x41a000
134	blk.14.ffn_down.weight	0x15332a500	0x6e00000
135	blk.14.ffn_gate.weight	0x15a12a500	0x5a00000
136	blk.14.ffn_norm.weight	0x15fb2a500	0x5000
137	blk.14.ffn_up.weight	0x15fb2f500	0x5a00000
138	blk.15.attn_k.weight	0x16552f500	0x2d0000
139	blk.15.attn_norm.weight	0x1657ff500	0x5000
140	blk.15.attn_output.weight	0x165804500	0xdc0000
141	blk.15.attn_q.weight	0x1665c4500	0xb40000
142	blk.15.attn_v.weight	0x167104500	0x370000
143	blk.15.ffn_down.weight	0x167474500	0x6e00000
144	blk.15.ffn_gate.weight	0x16e274500	0x5a00000
145	blk.15.ffn_norm.weight	0x173c74500	0x5000
146	blk.15.ffn_up.weight	0x173c79500	0x5a00000
147	blk.16.attn_k.weight	0x179679500	0x2d0000
148	blk.16.attn_norm.weight	0x179949500	0x5000
149	blk.16.attn_output.weight	0x17994e500	0xdc0000
150	blk.16.attn_q.weight	0x17a70e500	0xb40000
151	blk.16.attn_v.weight	0x17b24e500	0x41a000
152	blk.16.ffn_down.weight	0x17b668500	0x8340000
153	blk.16.ffn_gate.weight	0x1839a8500	0x5a00000
154	blk.16.ffn_norm.weight	0x1893a8500	0x5000
155	blk.16.ffn_up.weight	0x1893ad500	0x5a00000
156	blk.17.attn_k.weight	0x18edad500	0x2d0000
157	blk.17.attn_norm.weight	0x18f07d500	0x5000
158	blk.17.attn_output.weight	0x18f082500	0xdc0000
159	blk.17.attn_q.weight	0x18fe42500	0xb40000
160	blk.17.attn_v.weight	0x190982500	0x41a000
161	blk.17.ffn_down.weight	0x190d9c500	0x6e00000
162	blk.17.ffn_gate.weight	0x197b9c500	0x5a00000
163	blk.17.ffn_norm.weight	0x19d59c500	0x5000
164	blk.17.ffn_up.weight	0x19d5a1500	0x5a00000
165	blk.18.attn_k.weight	0x1a2fa1500	0x2d0000
166	blk.18.attn_norm.weight	0x1a3271500	0x5000
167	blk.18.attn_output.weight	0x1a3276500	0xdc0000
168	blk.18.attn_q.weight	0x1a4036500	0xb40000
169	blk.18.attn_v.weight	0x1a4b76500	0x370000
170	blk.18.ffn_down.weight	0x1a4ee6500	0x6e00000
171	blk.18.ffn_gate.weight	0x1abce6500	0x5a00000
172	blk.18.ffn_norm.weight	0x1b16e6500	0x5000
173	blk.18.ffn_up.weight	0x1b16eb500	0x5a00000
174	blk.19.attn_k.weight	0x1b70eb500	0x2d0000
175	blk.19.attn_norm.weight	0x1b73bb500	0x5000
176	blk.19.attn_output.weight	0x1b73c0500	0xdc0000
177	blk.19.attn_q.weight	0x1b8180500	0xb40000
178	blk.19.attn_v.weight	0x1b8cc0500	0x41a000
179	blk.19.ffn_down.weight	0x1b90da500	0x8340000
180	blk.19.ffn_gate.weight	0x1c141a500	0x5a00000
181	blk.19.ffn_norm.weight	0x1c6e1a500	0x5000
182	blk.19.ffn_up.weight	0x1c6e1f500	0x5a00000
183	blk.20.attn_k.weight	0x1cc81f500	0x2d0000
184	blk.20.attn_norm.weight	0x1ccaef500	0x5000
185	blk.20.attn_output.weight	0x1ccaf4500	0xdc0000
186	blk.20.attn_q.weight	0x1cd8b4500	0xb40000
187	blk.20.attn_v.weight	0x1ce3f4500	0x41a000
188	blk.20.ffn_down.weight	0x1ce80e500	0x6e00000
189	blk.20.ffn_gate.weight	0x1d560e500	0x5a00000
190	blk.20.ffn_norm.weight	0x1db00e500	0x5000
191	blk.20.ffn_up.weight	0x1db013500	0x5a00000
192	blk.21.attn_k.weight	0x1e0a13500	0x2d0000
193	blk.21.attn_norm.weight	0x1e0ce3500	0x5000
194	blk.21.attn_output.weight	0x1e0ce8500	0xdc0000
195	blk.21.attn_q.weight	0x1e1aa8500	0xb40000
196	blk.21.attn_v.weight	0x1e25e8500	0x370000
197	blk.21.ffn_down.weight	0x1e2958500	0x6e00000
198	blk.21.ffn_gate.weight	0x1e9758500	0x5a00000
199	blk.21.ffn_norm.weight	0x1ef158500	0x5000
200	blk.21.ffn_up.weight	0x1ef15d500	0x5a00000
201	blk.22.attn_k.weight	0x1f4b5d500	0x2d0000
202	blk.22.attn_norm.weight	0x1f4e2d500	0x5000
203	blk.22.attn_output.weight	0x1f4e32500	0xdc0000
204	blk.22.attn_q.weight	0x1f5bf2500	0xb40000
205	blk.22.attn_v.weight	0x1f6732500	0x41a000
206	blk.22.ffn_down.weight	0x1f6b4c500	0x8340000
207	blk.22.ffn_gate.weight	0x1fee8c500	0x5a00000
208	blk.22.ffn_norm.weight	0x20488c500	0x5000
209	blk.22.ffn_up.weight	0x204891500	0x5a00000
210	blk.23.attn_k.weight	0x20a291500	0x2d0000
211	blk.23.attn_norm.weight	0x20a561500	0x5000
212	blk.23.attn_output.weight	0x20a566500	0xdc0000
213	blk.23.attn_q.weight	0x20b326500	0xb40000
214	blk.23.attn_v.weight	0x20be66500	0x41a000
215	blk.23.ffn_down.weight	0x20c280500	0x6e00000
216	blk.23.ffn_gate.weight	0x213080500	0x5a00000
217	blk.23.ffn_norm.weight	0x218a80500	0x5000
218	blk.23.ffn_up.weight	0x218a85500	0x5a00000
219	blk.24.attn_k.weight	0x21e485500	0x2d0000
220	blk.24.attn_norm.weight	0x21e755500	0x5000
221	blk.24.attn_output.weight	0x21e75a500	0xdc0000
222	blk.24.attn_q.weight	0x21f51a500	0xb40000
223	blk.24.attn_v.weight	0x22005a500	0x370000
224	blk.24.ffn_down.weight	0x2203ca500	0x6e00000
225	blk.24.ffn_gate.weight	0x2271ca500	0x5a00000
226	blk.24.ffn_norm.weight	0x22cbca500	0x5000
227	blk.24.ffn_up.weight	0x22cbcf500	0x5a00000
228	blk.25.attn_k.weight	0x2325cf500	0x370000
229	blk.25.attn_norm.weight	0x23293f500	0x5000
230	blk.25.attn_output.weight	0x232944500	0xdc0000
231	blk.25.attn_q.weight	0x233704500	0xdc0000
232	blk.25.attn_v.weight	0x2344c4500	0x41a000
233	blk.25.ffn_down.weight	0x2348de500	0x8340000
234	blk.25.ffn_gate.weight	0x23cc1e500	0x5a00000
235	blk.25.ffn_norm.weight	0x24261e500	0x5000
236	blk.25.ffn_up.weight	0x242623500	0x5a00000
237	blk.26.attn_k.weight	0x248023500	0x2d0000
238	blk.26.attn_norm.weight	0x2482f3500	0x5000
239	blk.26.attn_output.weight	0x2482f8500	0xdc0000
240	blk.26.attn_q.weight	0x2490b8500	0xb40000
241	blk.26.attn_v.weight	0x249bf8500	0x41a000
242	blk.26.ffn_down.weight	0x24a012500	0x6e00000
243	blk.26.ffn_gate.weight	0x250e12500	0x5a00000
244	blk.26.ffn_norm.weight	0x256812500	0x5000
245	blk.26.ffn_up.weight	0x256817500	0x5a00000
246	blk.27.attn_k.weight	0x25c217500	0x2d0000
247	blk.27.attn_norm.weight	0x25c4e7500	0x5000
248	blk.27.attn_output.weight	0x25c4ec500	0xdc0000
249	blk.27.attn_q.weight	0x25d2ac500	0xb40000
250	blk.27.attn_v.weight	0x25ddec500	0x370000
251	blk.27.ffn_down.weight	0x25e15c500	0x6e00000
252	blk.27.ffn_gate.weight	0x264f5c500	0x5a00000
253	blk.27.ffn_norm.weight	0x26a95c500	0x5000
254	blk.27.ffn_up.weight	0x26a961500	0x5a00000
255	blk.28.attn_k.weight	0x270361500	0x370000
256	blk.28.attn_norm.weight	0x2706d1500	0x5000
257	blk.28.attn_output.weight	0x2706d6500	0xdc0000
258	blk.28.attn_q.weight	0x271496500	0xdc0000
259	blk.28.attn_v.weight	0x272256500	0x41a000
260	blk.28.ffn_down.weight	0x272670500	0x8340000
261	blk.28.ffn_gate.weight	0x27a9b0500	0x5a00000
262	blk.28.ffn_norm.weight	0x2803b0500	0x5000
263	blk.28.ffn_up.weight	0x2803b5500	0x5a00000
264	blk.29.attn_k.weight	0x285db5500	0x2d0000
265	blk.29.attn_norm.weight	0x286085500	0x5000
266	blk.29.attn_output.weight	0x28608a500	0xdc0000
267	blk.29.attn_q.weight	0x286e4a500	0xb40000
268	blk.29.attn_v.weight	0x28798a500	0x41a000
269	blk.29.ffn_down.weight	0x287da4500	0x6e00000
270	blk.29.ffn_gate.weight	0x28eba4500	0x5a00000
271	blk.29.ffn_norm.weight	0x2945a4500	0x5000
272	blk.29.ffn_up.weight	0x2945a9500	0x5a00000
273	blk.30.attn_k.weight	0x299fa9500	0x370000
274	blk.30.attn_norm.weight	0x29a319500	0x5000
275	blk.30.attn_output.weight	0x29a31e500	0xdc0000
276	blk.30.attn_q.weight	0x29b0de500	0xdc0000
277	blk.30.attn_v.weight	0x29be9e500	0x41a000
278	blk.30.ffn_down.weight	0x29c2b8500	0x6e00000
279	blk.30.ffn_gate.weight	0x2a30b8500	0x6e00000
280	blk.30.ffn_norm.weight	0x2a9eb8500	0x5000
281	blk.30.ffn_up.weight	0x2a9ebd500	0x6e00000
282	blk.31.attn_k.weight	0x2b0cbd500	0x2d0000
283	blk.31.attn_norm.weight	0x2b0f8d500	0x5000
284	blk.31.attn_output.weight	0x2b0f92500	0xdc0000
285	blk.31.attn_q.weight	0x2b1d52500	0xb40000
286	blk.31.attn_v.weight	0x2b2892500	0x41a000
287	blk.31.ffn_down.weight	0x2b2cac500	0x8340000
288	blk.31.ffn_gate.weight	0x2bafec500	0x6e00000
289	blk.31.ffn_norm.weight	0x2c1dec500	0x5000
290	blk.31.ffn_up.weight	0x2c1df1500	0x6e00000
291	blk.32.attn_k.weight	0x2c8bf1500	0x370000
292	blk.32.attn_norm.weight	0x2c8f61500	0x5000
293	blk.32.attn_output.weight	0x2c8f66500	0xdc0000
294	blk.32.attn_q.weight	0x2c9d26500	0xdc0000
295	blk.32.attn_v.weight	0x2caae6500	0x41a000
296	blk.32.ffn_down.weight	0x2caf00500	0x6e00000
297	blk.32.ffn_gate.weight	0x2d1d00500	0x6e00000
298	blk.32.ffn_norm.weight	0x2d8b00500	0x5000
299	blk.32.ffn_up.weight	0x2d8b05500	0x6e00000
300	blk.33.attn_k.weight	0x2df905500	0x370000
301	blk.33.attn_norm.weight	0x2dfc75500	0x5000
302	blk.33.attn_output.weight	0x2dfc7a500	0xdc0000
303	blk.33.attn_q.weight	0x2e0a3a500	0xdc0000
304	blk.33.attn_v.weight	0x2e17fa500	0x41a000
305	blk.33.ffn_down.weight	0x2e1c14500	0x6e00000
306	blk.33.ffn_gate.weight	0x2e8a14500	0x6e00000
307	blk.33.ffn_norm.weight	0x2ef814500	0x5000
308	blk.33.ffn_up.weight	0x2ef819500	0x6e00000
309	blk.34.attn_k.weight	0x2f6619500	0x370000
310	blk.34.attn_norm.weight	0x2f6989500	0x5000
311	blk.34.attn_output.weight	0x2f698e500	0xdc0000
312	blk.34.attn_q.weight	0x2f774e500	0xdc0000
313	blk.34.attn_v.weight	0x2f850e500	0x41a000
314	blk.34.ffn_down.weight	0x2f8928500	0x8340000
315	blk.34.ffn_gate.weight	0x300c68500	0x6e00000
316	blk.34.ffn_norm.weight	0x307a68500	0x5000
317	blk.34.ffn_up.weight	0x307a6d500	0x6e00000
318	blk.35.attn_k.weight	0x30e86d500	0x370000
319	blk.35.attn_norm.weight	0x30ebdd500	0x5000
320	blk.35.attn_output.weight	0x30ebe2500	0xdc0000
321	blk.35.attn_q.weight	0x30f9a2500	0xdc0000
322	blk.35.attn_v.weight	0x310762500	0x41a000
323	blk.35.ffn_down.weight	0x310b7c500	0x8340000
324	blk.35.ffn_gate.weight	0x318ebc500	0x6e00000
325	blk.35.ffn_norm.weight	0x31fcbc500	0x5000
326	blk.35.ffn_up.weight	0x31fcc1500	0x6e00000
327	blk.36.attn_k.weight	0x326ac1500	0x370000
328	blk.36.attn_norm.weight	0x326e31500	0x5000
329	blk.36.attn_output.weight	0x326e36500	0xdc0000
330	blk.36.attn_q.weight	0x327bf6500	0xdc0000
331	blk.36.attn_v.weight	0x3289b6500	0x41a000
332	blk.36.ffn_down.weight	0x328dd0500	0x8340000
333	blk.36.ffn_gate.weight	0x331110500	0x6e00000
334	blk.36.ffn_norm.weight	0x337f10500	0x5000
335	blk.36.ffn_up.weight	0x337f15500	0x6e00000
336	blk.37.attn_k.weight	0x33ed15500	0x370000
337	blk.37.attn_norm.weight	0x33f085500	0x5000
338	blk.37.attn_output.weight	0x33f08a500	0xdc0000
339	blk.37.attn_q.weight	0x33fe4a500	0xdc0000
340	blk.37.attn_v.weight	0x340c0a500	0x41a000
341	blk.37.ffn_down.weight	0x341024500	0x8340000
342	blk.37.ffn_gate.weight	0x349364500	0x6e00000
343	blk.37.ffn_norm.weight	0x350164500	0x5000
344	blk.37.ffn_up.weight	0x350169500	0x6e00000

Base Tensor Group : ~1B Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
0	output.weight	Output (W)	(~671M) 671088640	5120 x 131072 x 1 x 1	Q5_K
1	output_norm.weight	Output Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
2	token_embd.weight	Token Embedding (W)	(~671M) 671088640	5120 x 131072 x 1 x 1	Q3_K

• Total elements in base: ( ~1B) 1342182400
• Percentage of total elements: 5.98%

Block 0 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
3	blk.0.attn_k.weight	Block 0 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
4	blk.0.attn_norm.weight	Block 0 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
5	blk.0.attn_output.weight	Block 0 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
6	blk.0.attn_q.weight	Block 0 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
7	blk.0.attn_v.weight	Block 0 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
8	blk.0.ffn_down.weight	Block 0 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
9	blk.0.ffn_gate.weight	Block 0 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
10	blk.0.ffn_norm.weight	Block 0 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
11	blk.0.ffn_up.weight	Block 0 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.0: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 1 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
12	blk.1.attn_k.weight	Block 1 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
13	blk.1.attn_norm.weight	Block 1 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
14	blk.1.attn_output.weight	Block 1 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
15	blk.1.attn_q.weight	Block 1 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
16	blk.1.attn_v.weight	Block 1 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
17	blk.1.ffn_down.weight	Block 1 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
18	blk.1.ffn_gate.weight	Block 1 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
19	blk.1.ffn_norm.weight	Block 1 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
20	blk.1.ffn_up.weight	Block 1 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.1: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 2 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
21	blk.2.attn_k.weight	Block 2 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
22	blk.2.attn_norm.weight	Block 2 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
23	blk.2.attn_output.weight	Block 2 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
24	blk.2.attn_q.weight	Block 2 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
25	blk.2.attn_v.weight	Block 2 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
26	blk.2.ffn_down.weight	Block 2 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
27	blk.2.ffn_gate.weight	Block 2 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
28	blk.2.ffn_norm.weight	Block 2 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
29	blk.2.ffn_up.weight	Block 2 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.2: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 3 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
30	blk.3.attn_k.weight	Block 3 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
31	blk.3.attn_norm.weight	Block 3 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
32	blk.3.attn_output.weight	Block 3 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
33	blk.3.attn_q.weight	Block 3 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
34	blk.3.attn_v.weight	Block 3 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
35	blk.3.ffn_down.weight	Block 3 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
36	blk.3.ffn_gate.weight	Block 3 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
37	blk.3.ffn_norm.weight	Block 3 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
38	blk.3.ffn_up.weight	Block 3 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.3: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 4 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
39	blk.4.attn_k.weight	Block 4 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
40	blk.4.attn_norm.weight	Block 4 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
41	blk.4.attn_output.weight	Block 4 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
42	blk.4.attn_q.weight	Block 4 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
43	blk.4.attn_v.weight	Block 4 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
44	blk.4.ffn_down.weight	Block 4 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
45	blk.4.ffn_gate.weight	Block 4 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
46	blk.4.ffn_norm.weight	Block 4 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
47	blk.4.ffn_up.weight	Block 4 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.4: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 5 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
48	blk.5.attn_k.weight	Block 5 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
49	blk.5.attn_norm.weight	Block 5 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
50	blk.5.attn_output.weight	Block 5 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
51	blk.5.attn_q.weight	Block 5 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
52	blk.5.attn_v.weight	Block 5 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
53	blk.5.ffn_down.weight	Block 5 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
54	blk.5.ffn_gate.weight	Block 5 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
55	blk.5.ffn_norm.weight	Block 5 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
56	blk.5.ffn_up.weight	Block 5 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.5: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 6 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
57	blk.6.attn_k.weight	Block 6 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
58	blk.6.attn_norm.weight	Block 6 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
59	blk.6.attn_output.weight	Block 6 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
60	blk.6.attn_q.weight	Block 6 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
61	blk.6.attn_v.weight	Block 6 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
62	blk.6.ffn_down.weight	Block 6 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
63	blk.6.ffn_gate.weight	Block 6 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
64	blk.6.ffn_norm.weight	Block 6 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
65	blk.6.ffn_up.weight	Block 6 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.6: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 7 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
66	blk.7.attn_k.weight	Block 7 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
67	blk.7.attn_norm.weight	Block 7 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
68	blk.7.attn_output.weight	Block 7 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
69	blk.7.attn_q.weight	Block 7 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
70	blk.7.attn_v.weight	Block 7 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
71	blk.7.ffn_down.weight	Block 7 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
72	blk.7.ffn_gate.weight	Block 7 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
73	blk.7.ffn_norm.weight	Block 7 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
74	blk.7.ffn_up.weight	Block 7 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.7: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 8 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
75	blk.8.attn_k.weight	Block 8 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
76	blk.8.attn_norm.weight	Block 8 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
77	blk.8.attn_output.weight	Block 8 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
78	blk.8.attn_q.weight	Block 8 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
79	blk.8.attn_v.weight	Block 8 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
80	blk.8.ffn_down.weight	Block 8 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
81	blk.8.ffn_gate.weight	Block 8 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
82	blk.8.ffn_norm.weight	Block 8 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
83	blk.8.ffn_up.weight	Block 8 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.8: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 9 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
84	blk.9.attn_k.weight	Block 9 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
85	blk.9.attn_norm.weight	Block 9 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
86	blk.9.attn_output.weight	Block 9 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
87	blk.9.attn_q.weight	Block 9 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
88	blk.9.attn_v.weight	Block 9 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
89	blk.9.ffn_down.weight	Block 9 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
90	blk.9.ffn_gate.weight	Block 9 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
91	blk.9.ffn_norm.weight	Block 9 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
92	blk.9.ffn_up.weight	Block 9 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.9: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 10 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
93	blk.10.attn_k.weight	Block 10 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
94	blk.10.attn_norm.weight	Block 10 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
95	blk.10.attn_output.weight	Block 10 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
96	blk.10.attn_q.weight	Block 10 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
97	blk.10.attn_v.weight	Block 10 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
98	blk.10.ffn_down.weight	Block 10 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
99	blk.10.ffn_gate.weight	Block 10 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
100	blk.10.ffn_norm.weight	Block 10 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
101	blk.10.ffn_up.weight	Block 10 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.10: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 11 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
102	blk.11.attn_k.weight	Block 11 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
103	blk.11.attn_norm.weight	Block 11 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
104	blk.11.attn_output.weight	Block 11 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
105	blk.11.attn_q.weight	Block 11 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
106	blk.11.attn_v.weight	Block 11 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
107	blk.11.ffn_down.weight	Block 11 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
108	blk.11.ffn_gate.weight	Block 11 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
109	blk.11.ffn_norm.weight	Block 11 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
110	blk.11.ffn_up.weight	Block 11 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.11: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 12 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
111	blk.12.attn_k.weight	Block 12 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
112	blk.12.attn_norm.weight	Block 12 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
113	blk.12.attn_output.weight	Block 12 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
114	blk.12.attn_q.weight	Block 12 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
115	blk.12.attn_v.weight	Block 12 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
116	blk.12.ffn_down.weight	Block 12 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
117	blk.12.ffn_gate.weight	Block 12 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
118	blk.12.ffn_norm.weight	Block 12 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
119	blk.12.ffn_up.weight	Block 12 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.12: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 13 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
120	blk.13.attn_k.weight	Block 13 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
121	blk.13.attn_norm.weight	Block 13 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
122	blk.13.attn_output.weight	Block 13 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
123	blk.13.attn_q.weight	Block 13 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
124	blk.13.attn_v.weight	Block 13 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
125	blk.13.ffn_down.weight	Block 13 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
126	blk.13.ffn_gate.weight	Block 13 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
127	blk.13.ffn_norm.weight	Block 13 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
128	blk.13.ffn_up.weight	Block 13 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.13: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 14 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
129	blk.14.attn_k.weight	Block 14 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
130	blk.14.attn_norm.weight	Block 14 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
131	blk.14.attn_output.weight	Block 14 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
132	blk.14.attn_q.weight	Block 14 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
133	blk.14.attn_v.weight	Block 14 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
134	blk.14.ffn_down.weight	Block 14 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
135	blk.14.ffn_gate.weight	Block 14 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
136	blk.14.ffn_norm.weight	Block 14 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
137	blk.14.ffn_up.weight	Block 14 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.14: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 15 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
138	blk.15.attn_k.weight	Block 15 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
139	blk.15.attn_norm.weight	Block 15 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
140	blk.15.attn_output.weight	Block 15 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
141	blk.15.attn_q.weight	Block 15 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
142	blk.15.attn_v.weight	Block 15 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
143	blk.15.ffn_down.weight	Block 15 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
144	blk.15.ffn_gate.weight	Block 15 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
145	blk.15.ffn_norm.weight	Block 15 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
146	blk.15.ffn_up.weight	Block 15 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.15: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 16 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
147	blk.16.attn_k.weight	Block 16 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
148	blk.16.attn_norm.weight	Block 16 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
149	blk.16.attn_output.weight	Block 16 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
150	blk.16.attn_q.weight	Block 16 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
151	blk.16.attn_v.weight	Block 16 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
152	blk.16.ffn_down.weight	Block 16 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
153	blk.16.ffn_gate.weight	Block 16 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
154	blk.16.ffn_norm.weight	Block 16 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
155	blk.16.ffn_up.weight	Block 16 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.16: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 17 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
156	blk.17.attn_k.weight	Block 17 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
157	blk.17.attn_norm.weight	Block 17 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
158	blk.17.attn_output.weight	Block 17 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
159	blk.17.attn_q.weight	Block 17 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
160	blk.17.attn_v.weight	Block 17 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
161	blk.17.ffn_down.weight	Block 17 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
162	blk.17.ffn_gate.weight	Block 17 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
163	blk.17.ffn_norm.weight	Block 17 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
164	blk.17.ffn_up.weight	Block 17 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.17: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 18 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
165	blk.18.attn_k.weight	Block 18 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
166	blk.18.attn_norm.weight	Block 18 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
167	blk.18.attn_output.weight	Block 18 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
168	blk.18.attn_q.weight	Block 18 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
169	blk.18.attn_v.weight	Block 18 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
170	blk.18.ffn_down.weight	Block 18 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
171	blk.18.ffn_gate.weight	Block 18 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
172	blk.18.ffn_norm.weight	Block 18 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
173	blk.18.ffn_up.weight	Block 18 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.18: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 19 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
174	blk.19.attn_k.weight	Block 19 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
175	blk.19.attn_norm.weight	Block 19 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
176	blk.19.attn_output.weight	Block 19 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
177	blk.19.attn_q.weight	Block 19 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
178	blk.19.attn_v.weight	Block 19 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
179	blk.19.ffn_down.weight	Block 19 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
180	blk.19.ffn_gate.weight	Block 19 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
181	blk.19.ffn_norm.weight	Block 19 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
182	blk.19.ffn_up.weight	Block 19 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.19: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 20 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
183	blk.20.attn_k.weight	Block 20 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
184	blk.20.attn_norm.weight	Block 20 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
185	blk.20.attn_output.weight	Block 20 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
186	blk.20.attn_q.weight	Block 20 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
187	blk.20.attn_v.weight	Block 20 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
188	blk.20.ffn_down.weight	Block 20 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
189	blk.20.ffn_gate.weight	Block 20 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
190	blk.20.ffn_norm.weight	Block 20 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
191	blk.20.ffn_up.weight	Block 20 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.20: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 21 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
192	blk.21.attn_k.weight	Block 21 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
193	blk.21.attn_norm.weight	Block 21 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
194	blk.21.attn_output.weight	Block 21 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
195	blk.21.attn_q.weight	Block 21 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
196	blk.21.attn_v.weight	Block 21 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
197	blk.21.ffn_down.weight	Block 21 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
198	blk.21.ffn_gate.weight	Block 21 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
199	blk.21.ffn_norm.weight	Block 21 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
200	blk.21.ffn_up.weight	Block 21 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.21: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 22 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
201	blk.22.attn_k.weight	Block 22 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
202	blk.22.attn_norm.weight	Block 22 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
203	blk.22.attn_output.weight	Block 22 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
204	blk.22.attn_q.weight	Block 22 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
205	blk.22.attn_v.weight	Block 22 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
206	blk.22.ffn_down.weight	Block 22 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
207	blk.22.ffn_gate.weight	Block 22 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
208	blk.22.ffn_norm.weight	Block 22 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
209	blk.22.ffn_up.weight	Block 22 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.22: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 23 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
210	blk.23.attn_k.weight	Block 23 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
211	blk.23.attn_norm.weight	Block 23 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
212	blk.23.attn_output.weight	Block 23 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
213	blk.23.attn_q.weight	Block 23 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
214	blk.23.attn_v.weight	Block 23 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
215	blk.23.ffn_down.weight	Block 23 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
216	blk.23.ffn_gate.weight	Block 23 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
217	blk.23.ffn_norm.weight	Block 23 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
218	blk.23.ffn_up.weight	Block 23 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.23: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 24 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
219	blk.24.attn_k.weight	Block 24 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
220	blk.24.attn_norm.weight	Block 24 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
221	blk.24.attn_output.weight	Block 24 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
222	blk.24.attn_q.weight	Block 24 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
223	blk.24.attn_v.weight	Block 24 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
224	blk.24.ffn_down.weight	Block 24 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
225	blk.24.ffn_gate.weight	Block 24 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
226	blk.24.ffn_norm.weight	Block 24 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
227	blk.24.ffn_up.weight	Block 24 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.24: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 25 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
228	blk.25.attn_k.weight	Block 25 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
229	blk.25.attn_norm.weight	Block 25 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
230	blk.25.attn_output.weight	Block 25 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
231	blk.25.attn_q.weight	Block 25 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q5_K
232	blk.25.attn_v.weight	Block 25 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
233	blk.25.ffn_down.weight	Block 25 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
234	blk.25.ffn_gate.weight	Block 25 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
235	blk.25.ffn_norm.weight	Block 25 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
236	blk.25.ffn_up.weight	Block 25 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.25: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 26 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
237	blk.26.attn_k.weight	Block 26 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
238	blk.26.attn_norm.weight	Block 26 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
239	blk.26.attn_output.weight	Block 26 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
240	blk.26.attn_q.weight	Block 26 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
241	blk.26.attn_v.weight	Block 26 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
242	blk.26.ffn_down.weight	Block 26 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
243	blk.26.ffn_gate.weight	Block 26 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
244	blk.26.ffn_norm.weight	Block 26 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
245	blk.26.ffn_up.weight	Block 26 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.26: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 27 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
246	blk.27.attn_k.weight	Block 27 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
247	blk.27.attn_norm.weight	Block 27 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
248	blk.27.attn_output.weight	Block 27 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
249	blk.27.attn_q.weight	Block 27 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
250	blk.27.attn_v.weight	Block 27 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
251	blk.27.ffn_down.weight	Block 27 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
252	blk.27.ffn_gate.weight	Block 27 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
253	blk.27.ffn_norm.weight	Block 27 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
254	blk.27.ffn_up.weight	Block 27 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.27: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 28 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
255	blk.28.attn_k.weight	Block 28 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
256	blk.28.attn_norm.weight	Block 28 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
257	blk.28.attn_output.weight	Block 28 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
258	blk.28.attn_q.weight	Block 28 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q5_K
259	blk.28.attn_v.weight	Block 28 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
260	blk.28.ffn_down.weight	Block 28 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
261	blk.28.ffn_gate.weight	Block 28 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
262	blk.28.ffn_norm.weight	Block 28 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
263	blk.28.ffn_up.weight	Block 28 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.28: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 29 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
264	blk.29.attn_k.weight	Block 29 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
265	blk.29.attn_norm.weight	Block 29 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
266	blk.29.attn_output.weight	Block 29 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
267	blk.29.attn_q.weight	Block 29 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
268	blk.29.attn_v.weight	Block 29 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
269	blk.29.ffn_down.weight	Block 29 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
270	blk.29.ffn_gate.weight	Block 29 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K
271	blk.29.ffn_norm.weight	Block 29 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
272	blk.29.ffn_up.weight	Block 29 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q4_K

• Total elements in blk.29: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 30 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
273	blk.30.attn_k.weight	Block 30 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
274	blk.30.attn_norm.weight	Block 30 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
275	blk.30.attn_output.weight	Block 30 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
276	blk.30.attn_q.weight	Block 30 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q5_K
277	blk.30.attn_v.weight	Block 30 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
278	blk.30.ffn_down.weight	Block 30 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
279	blk.30.ffn_gate.weight	Block 30 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K
280	blk.30.ffn_norm.weight	Block 30 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
281	blk.30.ffn_up.weight	Block 30 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K

• Total elements in blk.30: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 31 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
282	blk.31.attn_k.weight	Block 31 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q4_K
283	blk.31.attn_norm.weight	Block 31 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
284	blk.31.attn_output.weight	Block 31 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
285	blk.31.attn_q.weight	Block 31 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q4_K
286	blk.31.attn_v.weight	Block 31 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
287	blk.31.ffn_down.weight	Block 31 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
288	blk.31.ffn_gate.weight	Block 31 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K
289	blk.31.ffn_norm.weight	Block 31 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
290	blk.31.ffn_up.weight	Block 31 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K

• Total elements in blk.31: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 32 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
291	blk.32.attn_k.weight	Block 32 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
292	blk.32.attn_norm.weight	Block 32 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
293	blk.32.attn_output.weight	Block 32 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
294	blk.32.attn_q.weight	Block 32 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q5_K
295	blk.32.attn_v.weight	Block 32 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
296	blk.32.ffn_down.weight	Block 32 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
297	blk.32.ffn_gate.weight	Block 32 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K
298	blk.32.ffn_norm.weight	Block 32 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
299	blk.32.ffn_up.weight	Block 32 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K

• Total elements in blk.32: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 33 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
300	blk.33.attn_k.weight	Block 33 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
301	blk.33.attn_norm.weight	Block 33 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
302	blk.33.attn_output.weight	Block 33 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
303	blk.33.attn_q.weight	Block 33 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q5_K
304	blk.33.attn_v.weight	Block 33 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
305	blk.33.ffn_down.weight	Block 33 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q5_K
306	blk.33.ffn_gate.weight	Block 33 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K
307	blk.33.ffn_norm.weight	Block 33 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
308	blk.33.ffn_up.weight	Block 33 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K

• Total elements in blk.33: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 34 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
309	blk.34.attn_k.weight	Block 34 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
310	blk.34.attn_norm.weight	Block 34 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
311	blk.34.attn_output.weight	Block 34 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
312	blk.34.attn_q.weight	Block 34 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q5_K
313	blk.34.attn_v.weight	Block 34 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
314	blk.34.ffn_down.weight	Block 34 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
315	blk.34.ffn_gate.weight	Block 34 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K
316	blk.34.ffn_norm.weight	Block 34 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
317	blk.34.ffn_up.weight	Block 34 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K

• Total elements in blk.34: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 35 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
318	blk.35.attn_k.weight	Block 35 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
319	blk.35.attn_norm.weight	Block 35 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
320	blk.35.attn_output.weight	Block 35 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
321	blk.35.attn_q.weight	Block 35 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q5_K
322	blk.35.attn_v.weight	Block 35 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
323	blk.35.ffn_down.weight	Block 35 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
324	blk.35.ffn_gate.weight	Block 35 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K
325	blk.35.ffn_norm.weight	Block 35 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
326	blk.35.ffn_up.weight	Block 35 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K

• Total elements in blk.35: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 36 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
327	blk.36.attn_k.weight	Block 36 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
328	blk.36.attn_norm.weight	Block 36 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
329	blk.36.attn_output.weight	Block 36 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
330	blk.36.attn_q.weight	Block 36 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q5_K
331	blk.36.attn_v.weight	Block 36 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
332	blk.36.ffn_down.weight	Block 36 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
333	blk.36.ffn_gate.weight	Block 36 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K
334	blk.36.ffn_norm.weight	Block 36 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
335	blk.36.ffn_up.weight	Block 36 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K

• Total elements in blk.36: (~556M) 555755520
• Percentage of total elements: 2.47%

Block 37 Tensor Group : ~556M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
336	blk.37.attn_k.weight	Block 37 Attention Key (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q5_K
337	blk.37.attn_norm.weight	Block 37 Attention Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
338	blk.37.attn_output.weight	Block 37 Attention Output (W)	( ~21M) 20971520	4096 x 5120 x 1 x 1	Q5_K
339	blk.37.attn_q.weight	Block 37 Attention Query (W)	( ~21M) 20971520	5120 x 4096 x 1 x 1	Q5_K
340	blk.37.attn_v.weight	Block 37 Attention Value (W)	( ~5M) 5242880	5120 x 1024 x 1 x 1	Q6_K
341	blk.37.ffn_down.weight	Block 37 Feed-Forward Network "Down" (W)	(~168M) 167772160	32768 x 5120 x 1 x 1	Q6_K
342	blk.37.ffn_gate.weight	Block 37 Feed-Forward Network "Gate" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K
343	blk.37.ffn_norm.weight	Block 37 Feed-Forward Network Normalization (W)	( ~5K) 5120	5120 x 1 x 1 x 1	F32
344	blk.37.ffn_up.weight	Block 37 Feed-Forward Network "Up" (W)	(~168M) 167772160	5120 x 32768 x 1 x 1	Q5_K

• Total elements in blk.37: (~556M) 555755520
• Percentage of total elements: 2.47%