gemma-3-12b-it-pruned-GGUF/scores/gemma-3-12b-it-Q8_0.md

gemma-3-12b-it-Q8_0.gguf - GGUF Internal File Dump

• Endian: LITTLE endian

Key Value Metadata Store

There are 48 key-value pairs in this file

POS	TYPE	Count	Key	Value
1	UINT32	1	GGUF.version	3
2	UINT64	1	GGUF.tensor_count	600
3	UINT64	1	GGUF.kv_count	45
4	STRING	1	general.architecture	gemma3
5	STRING	1	general.type	model
6	STRING	1	general.name	Gemma 3 12b It
7	STRING	1	general.finetune	it
8	STRING	1	general.basename	gemma-3
9	STRING	1	general.size_label	12B
10	STRING	1	general.license	gemma
11	UINT32	1	general.base_model.count	1
12	STRING	1	general.base_model.0.name	Gemma 3 12b Pt
13	STRING	1	general.base_model.0.organization	Google
14	STRING	1	general.base_model.0.repo_url	https://huggingface.co/google/gemma-3-12b-pt
15	[STRING]	1	general.tags	[ image-text-to-text ]
16	UINT32	1	gemma3.context_length	131072
17	UINT32	1	gemma3.embedding_length	3840
18	UINT32	1	gemma3.feed_forward_length	15360
19	UINT32	1	gemma3.attention.head_count	16
20	FLOAT32	1	gemma3.attention.layer_norm_rms_epsilon	1e-06
21	UINT32	1	gemma3.attention.key_length	256
22	UINT32	1	gemma3.attention.value_length	256
23	FLOAT32	1	gemma3.rope.freq_base	1000000.0
24	UINT32	1	gemma3.attention.sliding_window	1024
25	UINT32	1	gemma3.attention.head_count_kv	8
26	STRING	1	gemma3.rope.scaling.type	linear
27	FLOAT32	1	gemma3.rope.scaling.factor	8.0
28	STRING	1	tokenizer.ggml.model	llama
29	STRING	1	tokenizer.ggml.pre	default
30	[STRING]	262144	tokenizer.ggml.tokens	[ <pad>, <eos>, <bos>, <unk>, <mask>, ... ]
31	[FLOAT32]	262144	tokenizer.ggml.scores	[ -1000.0, -1000.0, -1000.0, -1000.0, -1000.0, -1000.0, -1000.0, ... ]
32	[INT32]	262144	tokenizer.ggml.token_type	[ 3, 3, 3, 3, 3, 4, 3, ... ]
33	UINT32	1	tokenizer.ggml.bos_token_id	2
34	UINT32	1	tokenizer.ggml.eos_token_id	1
35	UINT32	1	tokenizer.ggml.unknown_token_id	3
36	UINT32	1	tokenizer.ggml.padding_token_id	0
37	BOOL	1	tokenizer.ggml.add_bos_token	True
38	BOOL	1	tokenizer.ggml.add_eos_token	False
39	STRING	1	tokenizer.chat_template	{{ bos_token }}{%- if message..._turn>model'}}{%- endif -%}
40	BOOL	1	tokenizer.ggml.add_space_prefix	False
41	UINT32	1	general.quantization_version	2
42	UINT32	1	general.file_type	7
43	BOOL	1	general.pruned	True
44	UINT32	1	gemma3.block_count	46
45	STRING	1	quantize.imatrix.file	./imatrix/imatrix-gemma-3-12b-it-small.dat
46	STRING	1	quantize.imatrix.dataset	../../datasets/imatrix/combined_eur_small.txt
47	INT32	1	quantize.imatrix.entries_count	336
48	INT32	1	quantize.imatrix.chunks_count	3226

Tensors Overview ~11B Elements

Total number of elements in all tensors: 11317490432 Elements

• gemma-3-12b-it-Q8_0.gguf - GGUF Internal File Dump
  • Key Value Metadata Store
  • Tensors Overview ~11B Elements
    • Tensor Data Offset
    • Base Tensor Group : ~1B Elements
    • Block 0 Tensor Group : ~224M Elements
    • Block 1 Tensor Group : ~224M Elements
    • Block 2 Tensor Group : ~224M Elements
    • Block 3 Tensor Group : ~224M Elements
    • Block 4 Tensor Group : ~224M Elements
    • Block 5 Tensor Group : ~224M Elements
    • Block 6 Tensor Group : ~224M Elements
    • Block 7 Tensor Group : ~224M Elements
    • Block 8 Tensor Group : ~224M Elements
    • Block 9 Tensor Group : ~224M Elements
    • Block 10 Tensor Group : ~224M Elements
    • Block 11 Tensor Group : ~224M Elements
    • Block 12 Tensor Group : ~224M Elements
    • Block 13 Tensor Group : ~224M Elements
    • Block 14 Tensor Group : ~224M Elements
    • Block 15 Tensor Group : ~224M Elements
    • Block 16 Tensor Group : ~224M Elements
    • Block 17 Tensor Group : ~224M Elements
    • Block 18 Tensor Group : ~224M Elements
    • Block 19 Tensor Group : ~224M Elements
    • Block 20 Tensor Group : ~224M Elements
    • Block 21 Tensor Group : ~224M Elements
    • Block 22 Tensor Group : ~224M Elements
    • Block 23 Tensor Group : ~224M Elements
    • Block 24 Tensor Group : ~224M Elements
    • Block 25 Tensor Group : ~224M Elements
    • Block 26 Tensor Group : ~224M Elements
    • Block 27 Tensor Group : ~224M Elements
    • Block 28 Tensor Group : ~224M Elements
    • Block 29 Tensor Group : ~224M Elements
    • Block 30 Tensor Group : ~224M Elements
    • Block 31 Tensor Group : ~224M Elements
    • Block 32 Tensor Group : ~224M Elements
    • Block 33 Tensor Group : ~224M Elements
    • Block 34 Tensor Group : ~224M Elements
    • Block 35 Tensor Group : ~224M Elements
    • Block 36 Tensor Group : ~224M Elements
    • Block 37 Tensor Group : ~224M Elements
    • Block 38 Tensor Group : ~224M Elements
    • Block 39 Tensor Group : ~224M Elements
    • Block 40 Tensor Group : ~224M Elements
    • Block 41 Tensor Group : ~224M Elements
    • Block 42 Tensor Group : ~224M Elements
    • Block 43 Tensor Group : ~224M Elements
    • Block 44 Tensor Group : ~224M Elements
    • Block 45 Tensor Group : ~224M Elements

Tensor Data Offset

This table contains the offset and data segment relative to start of file

T_ID	Tensor Layer Name	Data Offset (B)	Data Size (B)
0	output_norm.weight	0x63ee20	0x3c00
1	token_embd.weight	0x642a20	0x19c80000
2	blk.0.attn_k.weight	0x1a2c2a20	0x7f8000
3	blk.0.attn_k_norm.weight	0x1aabaa20	0x400
4	blk.0.attn_norm.weight	0x1aabae20	0x3c00
5	blk.0.attn_output.weight	0x1aabea20	0xff0000
6	blk.0.attn_q.weight	0x1baaea20	0xff0000
7	blk.0.attn_q_norm.weight	0x1ca9ea20	0x400
8	blk.0.attn_v.weight	0x1ca9ee20	0xf00000
9	blk.0.ffn_down.weight	0x1d99ee20	0x3bc4000
10	blk.0.ffn_gate.weight	0x21562e20	0x3bc4000
11	blk.0.ffn_norm.weight	0x25126e20	0x3c00
12	blk.0.ffn_up.weight	0x2512aa20	0x3bc4000
13	blk.0.post_attention_norm.weight	0x28ceea20	0x3c00
14	blk.0.post_ffw_norm.weight	0x28cf2620	0x3c00
15	blk.1.attn_k.weight	0x28cf6220	0x7f8000
16	blk.1.attn_k_norm.weight	0x294ee220	0x400
17	blk.1.attn_norm.weight	0x294ee620	0x3c00
18	blk.1.attn_output.weight	0x294f2220	0xff0000
19	blk.1.attn_q.weight	0x2a4e2220	0xff0000
20	blk.1.attn_q_norm.weight	0x2b4d2220	0x400
21	blk.1.attn_v.weight	0x2b4d2620	0xf00000
22	blk.1.ffn_down.weight	0x2c3d2620	0x3bc4000
23	blk.1.ffn_gate.weight	0x2ff96620	0x3bc4000
24	blk.1.ffn_norm.weight	0x33b5a620	0x3c00
25	blk.1.ffn_up.weight	0x33b5e220	0x3bc4000
26	blk.1.post_attention_norm.weight	0x37722220	0x3c00
27	blk.1.post_ffw_norm.weight	0x37725e20	0x3c00
28	blk.2.attn_k.weight	0x37729a20	0x7f8000
29	blk.2.attn_k_norm.weight	0x37f21a20	0x400
30	blk.2.attn_norm.weight	0x37f21e20	0x3c00
31	blk.2.attn_output.weight	0x37f25a20	0xff0000
32	blk.2.attn_q.weight	0x38f15a20	0xff0000
33	blk.2.attn_q_norm.weight	0x39f05a20	0x400
34	blk.2.attn_v.weight	0x39f05e20	0xf00000
35	blk.2.ffn_down.weight	0x3ae05e20	0x3bc4000
36	blk.2.ffn_gate.weight	0x3e9c9e20	0x3bc4000
37	blk.2.ffn_norm.weight	0x4258de20	0x3c00
38	blk.2.ffn_up.weight	0x42591a20	0x3bc4000
39	blk.2.post_attention_norm.weight	0x46155a20	0x3c00
40	blk.2.post_ffw_norm.weight	0x46159620	0x3c00
41	blk.3.attn_k.weight	0x4615d220	0x7f8000
42	blk.3.attn_k_norm.weight	0x46955220	0x400
43	blk.3.attn_norm.weight	0x46955620	0x3c00
44	blk.3.attn_output.weight	0x46959220	0xff0000
45	blk.3.attn_q.weight	0x47949220	0xff0000
46	blk.3.attn_q_norm.weight	0x48939220	0x400
47	blk.3.attn_v.weight	0x48939620	0xf00000
48	blk.3.ffn_down.weight	0x49839620	0x3bc4000
49	blk.3.ffn_gate.weight	0x4d3fd620	0x3bc4000
50	blk.3.ffn_norm.weight	0x50fc1620	0x3c00
51	blk.3.ffn_up.weight	0x50fc5220	0x3bc4000
52	blk.3.post_attention_norm.weight	0x54b89220	0x3c00
53	blk.3.post_ffw_norm.weight	0x54b8ce20	0x3c00
54	blk.4.attn_k.weight	0x54b90a20	0x7f8000
55	blk.4.attn_k_norm.weight	0x55388a20	0x400
56	blk.4.attn_norm.weight	0x55388e20	0x3c00
57	blk.4.attn_output.weight	0x5538ca20	0xff0000
58	blk.4.attn_q.weight	0x5637ca20	0xff0000
59	blk.4.attn_q_norm.weight	0x5736ca20	0x400
60	blk.4.attn_v.weight	0x5736ce20	0xf00000
61	blk.4.ffn_down.weight	0x5826ce20	0x3bc4000
62	blk.4.ffn_gate.weight	0x5be30e20	0x3bc4000
63	blk.4.ffn_norm.weight	0x5f9f4e20	0x3c00
64	blk.4.ffn_up.weight	0x5f9f8a20	0x3bc4000
65	blk.4.post_attention_norm.weight	0x635bca20	0x3c00
66	blk.4.post_ffw_norm.weight	0x635c0620	0x3c00
67	blk.5.attn_k.weight	0x635c4220	0x7f8000
68	blk.5.attn_k_norm.weight	0x63dbc220	0x400
69	blk.5.attn_norm.weight	0x63dbc620	0x3c00
70	blk.5.attn_output.weight	0x63dc0220	0xff0000
71	blk.5.attn_q.weight	0x64db0220	0xff0000
72	blk.5.attn_q_norm.weight	0x65da0220	0x400
73	blk.5.attn_v.weight	0x65da0620	0xf00000
74	blk.5.ffn_down.weight	0x66ca0620	0x3bc4000
75	blk.5.ffn_gate.weight	0x6a864620	0x3bc4000
76	blk.5.ffn_norm.weight	0x6e428620	0x3c00
77	blk.5.ffn_up.weight	0x6e42c220	0x3bc4000
78	blk.5.post_attention_norm.weight	0x71ff0220	0x3c00
79	blk.5.post_ffw_norm.weight	0x71ff3e20	0x3c00
80	blk.6.attn_k.weight	0x71ff7a20	0x7f8000
81	blk.6.attn_k_norm.weight	0x727efa20	0x400
82	blk.6.attn_norm.weight	0x727efe20	0x3c00
83	blk.6.attn_output.weight	0x727f3a20	0xff0000
84	blk.6.attn_q.weight	0x737e3a20	0xff0000
85	blk.6.attn_q_norm.weight	0x747d3a20	0x400
86	blk.6.attn_v.weight	0x747d3e20	0xf00000
87	blk.6.ffn_down.weight	0x756d3e20	0x3bc4000
88	blk.6.ffn_gate.weight	0x79297e20	0x3bc4000
89	blk.6.ffn_norm.weight	0x7ce5be20	0x3c00
90	blk.6.ffn_up.weight	0x7ce5fa20	0x3bc4000
91	blk.6.post_attention_norm.weight	0x80a23a20	0x3c00
92	blk.6.post_ffw_norm.weight	0x80a27620	0x3c00
93	blk.7.attn_k.weight	0x80a2b220	0x7f8000
94	blk.7.attn_k_norm.weight	0x81223220	0x400
95	blk.7.attn_norm.weight	0x81223620	0x3c00
96	blk.7.attn_output.weight	0x81227220	0xff0000
97	blk.7.attn_q.weight	0x82217220	0xff0000
98	blk.7.attn_q_norm.weight	0x83207220	0x400
99	blk.7.attn_v.weight	0x83207620	0xf00000
100	blk.7.ffn_down.weight	0x84107620	0x3bc4000
101	blk.7.ffn_gate.weight	0x87ccb620	0x3bc4000
102	blk.7.ffn_norm.weight	0x8b88f620	0x3c00
103	blk.7.ffn_up.weight	0x8b893220	0x3bc4000
104	blk.7.post_attention_norm.weight	0x8f457220	0x3c00
105	blk.7.post_ffw_norm.weight	0x8f45ae20	0x3c00
106	blk.8.attn_k.weight	0x8f45ea20	0x7f8000
107	blk.8.attn_k_norm.weight	0x8fc56a20	0x400
108	blk.8.attn_norm.weight	0x8fc56e20	0x3c00
109	blk.8.attn_output.weight	0x8fc5aa20	0xff0000
110	blk.8.attn_q.weight	0x90c4aa20	0xff0000
111	blk.8.attn_q_norm.weight	0x91c3aa20	0x400
112	blk.8.attn_v.weight	0x91c3ae20	0xf00000
113	blk.8.ffn_down.weight	0x92b3ae20	0x3bc4000
114	blk.8.ffn_gate.weight	0x966fee20	0x3bc4000
115	blk.8.ffn_norm.weight	0x9a2c2e20	0x3c00
116	blk.8.ffn_up.weight	0x9a2c6a20	0x3bc4000
117	blk.8.post_attention_norm.weight	0x9de8aa20	0x3c00
118	blk.8.post_ffw_norm.weight	0x9de8e620	0x3c00
119	blk.9.attn_k.weight	0x9de92220	0x7f8000
120	blk.9.attn_k_norm.weight	0x9e68a220	0x400
121	blk.9.attn_norm.weight	0x9e68a620	0x3c00
122	blk.9.attn_output.weight	0x9e68e220	0xff0000
123	blk.9.attn_q.weight	0x9f67e220	0xff0000
124	blk.9.attn_q_norm.weight	0xa066e220	0x400
125	blk.9.attn_v.weight	0xa066e620	0xf00000
126	blk.9.ffn_down.weight	0xa156e620	0x3bc4000
127	blk.9.ffn_gate.weight	0xa5132620	0x3bc4000
128	blk.9.ffn_norm.weight	0xa8cf6620	0x3c00
129	blk.9.ffn_up.weight	0xa8cfa220	0x3bc4000
130	blk.9.post_attention_norm.weight	0xac8be220	0x3c00
131	blk.9.post_ffw_norm.weight	0xac8c1e20	0x3c00
132	blk.10.attn_k.weight	0xac8c5a20	0x7f8000
133	blk.10.attn_k_norm.weight	0xad0bda20	0x400
134	blk.10.attn_norm.weight	0xad0bde20	0x3c00
135	blk.10.attn_output.weight	0xad0c1a20	0xff0000
136	blk.10.attn_q.weight	0xae0b1a20	0xff0000
137	blk.10.attn_q_norm.weight	0xaf0a1a20	0x400
138	blk.10.attn_v.weight	0xaf0a1e20	0xf00000
139	blk.10.ffn_down.weight	0xaffa1e20	0x3bc4000
140	blk.10.ffn_gate.weight	0xb3b65e20	0x3bc4000
141	blk.10.ffn_norm.weight	0xb7729e20	0x3c00
142	blk.10.ffn_up.weight	0xb772da20	0x3bc4000
143	blk.10.post_attention_norm.weight	0xbb2f1a20	0x3c00
144	blk.10.post_ffw_norm.weight	0xbb2f5620	0x3c00
145	blk.11.attn_k.weight	0xbb2f9220	0x627000
146	blk.11.attn_k_norm.weight	0xbb920220	0x400
147	blk.11.attn_norm.weight	0xbb920620	0x3c00
148	blk.11.attn_output.weight	0xbb924220	0xff0000
149	blk.11.attn_q.weight	0xbc914220	0xc4e000
150	blk.11.attn_q_norm.weight	0xbd562220	0x400
151	blk.11.attn_v.weight	0xbd562620	0xf00000
152	blk.11.ffn_down.weight	0xbe462620	0x3bc4000
153	blk.11.ffn_gate.weight	0xc2026620	0x2e24800
154	blk.11.ffn_norm.weight	0xc4e4ae20	0x3c00
155	blk.11.ffn_up.weight	0xc4e4ea20	0x2e24800
156	blk.11.post_attention_norm.weight	0xc7c73220	0x3c00
157	blk.11.post_ffw_norm.weight	0xc7c76e20	0x3c00
158	blk.12.attn_k.weight	0xc7c7aa20	0x627000
159	blk.12.attn_k_norm.weight	0xc82a1a20	0x400
160	blk.12.attn_norm.weight	0xc82a1e20	0x3c00
161	blk.12.attn_output.weight	0xc82a5a20	0xff0000
162	blk.12.attn_q.weight	0xc9295a20	0xc4e000
163	blk.12.attn_q_norm.weight	0xc9ee3a20	0x400
164	blk.12.attn_v.weight	0xc9ee3e20	0xf00000
165	blk.12.ffn_down.weight	0xcade3e20	0x3bc4000
166	blk.12.ffn_gate.weight	0xce9a7e20	0x2e24800
167	blk.12.ffn_norm.weight	0xd17cc620	0x3c00
168	blk.12.ffn_up.weight	0xd17d0220	0x2e24800
169	blk.12.post_attention_norm.weight	0xd45f4a20	0x3c00
170	blk.12.post_ffw_norm.weight	0xd45f8620	0x3c00
171	blk.13.attn_k.weight	0xd45fc220	0x627000
172	blk.13.attn_k_norm.weight	0xd4c23220	0x400
173	blk.13.attn_norm.weight	0xd4c23620	0x3c00
174	blk.13.attn_output.weight	0xd4c27220	0xff0000
175	blk.13.attn_q.weight	0xd5c17220	0xc4e000
176	blk.13.attn_q_norm.weight	0xd6865220	0x400
177	blk.13.attn_v.weight	0xd6865620	0xf00000
178	blk.13.ffn_down.weight	0xd7765620	0x3bc4000
179	blk.13.ffn_gate.weight	0xdb329620	0x2e24800
180	blk.13.ffn_norm.weight	0xde14de20	0x3c00
181	blk.13.ffn_up.weight	0xde151a20	0x2e24800
182	blk.13.post_attention_norm.weight	0xe0f76220	0x3c00
183	blk.13.post_ffw_norm.weight	0xe0f79e20	0x3c00
184	blk.14.attn_k.weight	0xe0f7da20	0x627000
185	blk.14.attn_k_norm.weight	0xe15a4a20	0x400
186	blk.14.attn_norm.weight	0xe15a4e20	0x3c00
187	blk.14.attn_output.weight	0xe15a8a20	0xff0000
188	blk.14.attn_q.weight	0xe2598a20	0xc4e000
189	blk.14.attn_q_norm.weight	0xe31e6a20	0x400
190	blk.14.attn_v.weight	0xe31e6e20	0xf00000
191	blk.14.ffn_down.weight	0xe40e6e20	0x3bc4000
192	blk.14.ffn_gate.weight	0xe7caae20	0x2e24800
193	blk.14.ffn_norm.weight	0xeaacf620	0x3c00
194	blk.14.ffn_up.weight	0xeaad3220	0x2e24800
195	blk.14.post_attention_norm.weight	0xed8f7a20	0x3c00
196	blk.14.post_ffw_norm.weight	0xed8fb620	0x3c00
197	blk.15.attn_k.weight	0xed8ff220	0x627000
198	blk.15.attn_k_norm.weight	0xedf26220	0x400
199	blk.15.attn_norm.weight	0xedf26620	0x3c00
200	blk.15.attn_output.weight	0xedf2a220	0xff0000
201	blk.15.attn_q.weight	0xeef1a220	0xc4e000
202	blk.15.attn_q_norm.weight	0xefb68220	0x400
203	blk.15.attn_v.weight	0xefb68620	0xf00000
204	blk.15.ffn_down.weight	0xf0a68620	0x3bc4000
205	blk.15.ffn_gate.weight	0xf462c620	0x2e24800
206	blk.15.ffn_norm.weight	0xf7450e20	0x3c00
207	blk.15.ffn_up.weight	0xf7454a20	0x2e24800
208	blk.15.post_attention_norm.weight	0xfa279220	0x3c00
209	blk.15.post_ffw_norm.weight	0xfa27ce20	0x3c00
210	blk.16.attn_k.weight	0xfa280a20	0x627000
211	blk.16.attn_k_norm.weight	0xfa8a7a20	0x400
212	blk.16.attn_norm.weight	0xfa8a7e20	0x3c00
213	blk.16.attn_output.weight	0xfa8aba20	0xff0000
214	blk.16.attn_q.weight	0xfb89ba20	0xc4e000
215	blk.16.attn_q_norm.weight	0xfc4e9a20	0x400
216	blk.16.attn_v.weight	0xfc4e9e20	0xf00000
217	blk.16.ffn_down.weight	0xfd3e9e20	0x3bc4000
218	blk.16.ffn_gate.weight	0x100fade20	0x2e24800
219	blk.16.ffn_norm.weight	0x103dd2620	0x3c00
220	blk.16.ffn_up.weight	0x103dd6220	0x2e24800
221	blk.16.post_attention_norm.weight	0x106bfaa20	0x3c00
222	blk.16.post_ffw_norm.weight	0x106bfe620	0x3c00
223	blk.17.attn_k.weight	0x106c02220	0x627000
224	blk.17.attn_k_norm.weight	0x107229220	0x400
225	blk.17.attn_norm.weight	0x107229620	0x3c00
226	blk.17.attn_output.weight	0x10722d220	0xff0000
227	blk.17.attn_q.weight	0x10821d220	0xc4e000
228	blk.17.attn_q_norm.weight	0x108e6b220	0x400
229	blk.17.attn_v.weight	0x108e6b620	0xf00000
230	blk.17.ffn_down.weight	0x109d6b620	0x3bc4000
231	blk.17.ffn_gate.weight	0x10d92f620	0x2e24800
232	blk.17.ffn_norm.weight	0x110753e20	0x3c00
233	blk.17.ffn_up.weight	0x110757a20	0x2e24800
234	blk.17.post_attention_norm.weight	0x11357c220	0x3c00
235	blk.17.post_ffw_norm.weight	0x11357fe20	0x3c00
236	blk.18.attn_k.weight	0x113583a20	0x627000
237	blk.18.attn_k_norm.weight	0x113baaa20	0x400
238	blk.18.attn_norm.weight	0x113baae20	0x3c00
239	blk.18.attn_output.weight	0x113baea20	0xff0000
240	blk.18.attn_q.weight	0x114b9ea20	0xc4e000
241	blk.18.attn_q_norm.weight	0x1157eca20	0x400
242	blk.18.attn_v.weight	0x1157ece20	0xf00000
243	blk.18.ffn_down.weight	0x1166ece20	0x3bc4000
244	blk.18.ffn_gate.weight	0x11a2b0e20	0x2e24800
245	blk.18.ffn_norm.weight	0x11d0d5620	0x3c00
246	blk.18.ffn_up.weight	0x11d0d9220	0x2e24800
247	blk.18.post_attention_norm.weight	0x11fefda20	0x3c00
248	blk.18.post_ffw_norm.weight	0x11ff01620	0x3c00
249	blk.19.attn_k.weight	0x11ff05220	0x627000
250	blk.19.attn_k_norm.weight	0x12052c220	0x400
251	blk.19.attn_norm.weight	0x12052c620	0x3c00
252	blk.19.attn_output.weight	0x120530220	0xff0000
253	blk.19.attn_q.weight	0x121520220	0xc4e000
254	blk.19.attn_q_norm.weight	0x12216e220	0x400
255	blk.19.attn_v.weight	0x12216e620	0xf00000
256	blk.19.ffn_down.weight	0x12306e620	0x3bc4000
257	blk.19.ffn_gate.weight	0x126c32620	0x2e24800
258	blk.19.ffn_norm.weight	0x129a56e20	0x3c00
259	blk.19.ffn_up.weight	0x129a5aa20	0x2e24800
260	blk.19.post_attention_norm.weight	0x12c87f220	0x3c00
261	blk.19.post_ffw_norm.weight	0x12c882e20	0x3c00
262	blk.20.attn_k.weight	0x12c886a20	0x627000
263	blk.20.attn_k_norm.weight	0x12ceada20	0x400
264	blk.20.attn_norm.weight	0x12ceade20	0x3c00
265	blk.20.attn_output.weight	0x12ceb1a20	0xff0000
266	blk.20.attn_q.weight	0x12dea1a20	0xc4e000
267	blk.20.attn_q_norm.weight	0x12eaefa20	0x400
268	blk.20.attn_v.weight	0x12eaefe20	0xf00000
269	blk.20.ffn_down.weight	0x12f9efe20	0x3bc4000
270	blk.20.ffn_gate.weight	0x1335b3e20	0x2e24800
271	blk.20.ffn_norm.weight	0x1363d8620	0x3c00
272	blk.20.ffn_up.weight	0x1363dc220	0x2e24800
273	blk.20.post_attention_norm.weight	0x139200a20	0x3c00
274	blk.20.post_ffw_norm.weight	0x139204620	0x3c00
275	blk.21.attn_k.weight	0x139208220	0x627000
276	blk.21.attn_k_norm.weight	0x13982f220	0x400
277	blk.21.attn_norm.weight	0x13982f620	0x3c00
278	blk.21.attn_output.weight	0x139833220	0xff0000
279	blk.21.attn_q.weight	0x13a823220	0xc4e000
280	blk.21.attn_q_norm.weight	0x13b471220	0x400
281	blk.21.attn_v.weight	0x13b471620	0xf00000
282	blk.21.ffn_down.weight	0x13c371620	0x3bc4000
283	blk.21.ffn_gate.weight	0x13ff35620	0x2e24800
284	blk.21.ffn_norm.weight	0x142d59e20	0x3c00
285	blk.21.ffn_up.weight	0x142d5da20	0x2e24800
286	blk.21.post_attention_norm.weight	0x145b82220	0x3c00
287	blk.21.post_ffw_norm.weight	0x145b85e20	0x3c00
288	blk.22.attn_k.weight	0x145b89a20	0x627000
289	blk.22.attn_k_norm.weight	0x1461b0a20	0x400
290	blk.22.attn_norm.weight	0x1461b0e20	0x3c00
291	blk.22.attn_output.weight	0x1461b4a20	0xff0000
292	blk.22.attn_q.weight	0x1471a4a20	0xc4e000
293	blk.22.attn_q_norm.weight	0x147df2a20	0x400
294	blk.22.attn_v.weight	0x147df2e20	0xf00000
295	blk.22.ffn_down.weight	0x148cf2e20	0x3bc4000
296	blk.22.ffn_gate.weight	0x14c8b6e20	0x2e24800
297	blk.22.ffn_norm.weight	0x14f6db620	0x3c00
298	blk.22.ffn_up.weight	0x14f6df220	0x2e24800
299	blk.22.post_attention_norm.weight	0x152503a20	0x3c00
300	blk.22.post_ffw_norm.weight	0x152507620	0x3c00
301	blk.23.attn_k.weight	0x15250b220	0x627000
302	blk.23.attn_k_norm.weight	0x152b32220	0x400
303	blk.23.attn_norm.weight	0x152b32620	0x3c00
304	blk.23.attn_output.weight	0x152b36220	0xff0000
305	blk.23.attn_q.weight	0x153b26220	0xc4e000
306	blk.23.attn_q_norm.weight	0x154774220	0x400
307	blk.23.attn_v.weight	0x154774620	0xf00000
308	blk.23.ffn_down.weight	0x155674620	0x3bc4000
309	blk.23.ffn_gate.weight	0x159238620	0x2e24800
310	blk.23.ffn_norm.weight	0x15c05ce20	0x3c00
311	blk.23.ffn_up.weight	0x15c060a20	0x2e24800
312	blk.23.post_attention_norm.weight	0x15ee85220	0x3c00
313	blk.23.post_ffw_norm.weight	0x15ee88e20	0x3c00
314	blk.24.attn_k.weight	0x15ee8ca20	0x7f8000
315	blk.24.attn_k_norm.weight	0x15f684a20	0x400
316	blk.24.attn_norm.weight	0x15f684e20	0x3c00
317	blk.24.attn_output.weight	0x15f688a20	0xff0000
318	blk.24.attn_q.weight	0x160678a20	0xff0000
319	blk.24.attn_q_norm.weight	0x161668a20	0x400
320	blk.24.attn_v.weight	0x161668e20	0xf00000
321	blk.24.ffn_down.weight	0x162568e20	0x3bc4000
322	blk.24.ffn_gate.weight	0x16612ce20	0x3bc4000
323	blk.24.ffn_norm.weight	0x169cf0e20	0x3c00
324	blk.24.ffn_up.weight	0x169cf4a20	0x3bc4000
325	blk.24.post_attention_norm.weight	0x16d8b8a20	0x3c00
326	blk.24.post_ffw_norm.weight	0x16d8bc620	0x3c00
327	blk.25.attn_k.weight	0x16d8c0220	0x627000
328	blk.25.attn_k_norm.weight	0x16dee7220	0x400
329	blk.25.attn_norm.weight	0x16dee7620	0x3c00
330	blk.25.attn_output.weight	0x16deeb220	0xff0000
331	blk.25.attn_q.weight	0x16eedb220	0xc4e000
332	blk.25.attn_q_norm.weight	0x16fb29220	0x400
333	blk.25.attn_v.weight	0x16fb29620	0xf00000
334	blk.25.ffn_down.weight	0x170a29620	0x3bc4000
335	blk.25.ffn_gate.weight	0x1745ed620	0x2e24800
336	blk.25.ffn_norm.weight	0x177411e20	0x3c00
337	blk.25.ffn_up.weight	0x177415a20	0x2e24800
338	blk.25.post_attention_norm.weight	0x17a23a220	0x3c00
339	blk.25.post_ffw_norm.weight	0x17a23de20	0x3c00
340	blk.26.attn_k.weight	0x17a241a20	0x627000
341	blk.26.attn_k_norm.weight	0x17a868a20	0x400
342	blk.26.attn_norm.weight	0x17a868e20	0x3c00
343	blk.26.attn_output.weight	0x17a86ca20	0xff0000
344	blk.26.attn_q.weight	0x17b85ca20	0xc4e000
345	blk.26.attn_q_norm.weight	0x17c4aaa20	0x400
346	blk.26.attn_v.weight	0x17c4aae20	0xf00000
347	blk.26.ffn_down.weight	0x17d3aae20	0x3bc4000
348	blk.26.ffn_gate.weight	0x180f6ee20	0x2e24800
349	blk.26.ffn_norm.weight	0x183d93620	0x3c00
350	blk.26.ffn_up.weight	0x183d97220	0x2e24800
351	blk.26.post_attention_norm.weight	0x186bbba20	0x3c00
352	blk.26.post_ffw_norm.weight	0x186bbf620	0x3c00
353	blk.27.attn_k.weight	0x186bc3220	0x627000
354	blk.27.attn_k_norm.weight	0x1871ea220	0x400
355	blk.27.attn_norm.weight	0x1871ea620	0x3c00
356	blk.27.attn_output.weight	0x1871ee220	0xff0000
357	blk.27.attn_q.weight	0x1881de220	0xc4e000
358	blk.27.attn_q_norm.weight	0x188e2c220	0x400
359	blk.27.attn_v.weight	0x188e2c620	0xf00000
360	blk.27.ffn_down.weight	0x189d2c620	0x3bc4000
361	blk.27.ffn_gate.weight	0x18d8f0620	0x2e24800
362	blk.27.ffn_norm.weight	0x190714e20	0x3c00
363	blk.27.ffn_up.weight	0x190718a20	0x2e24800
364	blk.27.post_attention_norm.weight	0x19353d220	0x3c00
365	blk.27.post_ffw_norm.weight	0x193540e20	0x3c00
366	blk.28.attn_k.weight	0x193544a20	0x7f8000
367	blk.28.attn_k_norm.weight	0x193d3ca20	0x400
368	blk.28.attn_norm.weight	0x193d3ce20	0x3c00
369	blk.28.attn_output.weight	0x193d40a20	0xff0000
370	blk.28.attn_q.weight	0x194d30a20	0xff0000
371	blk.28.attn_q_norm.weight	0x195d20a20	0x400
372	blk.28.attn_v.weight	0x195d20e20	0xf00000
373	blk.28.ffn_down.weight	0x196c20e20	0x3bc4000
374	blk.28.ffn_gate.weight	0x19a7e4e20	0x3bc4000
375	blk.28.ffn_norm.weight	0x19e3a8e20	0x3c00
376	blk.28.ffn_up.weight	0x19e3aca20	0x3bc4000
377	blk.28.post_attention_norm.weight	0x1a1f70a20	0x3c00
378	blk.28.post_ffw_norm.weight	0x1a1f74620	0x3c00
379	blk.29.attn_k.weight	0x1a1f78220	0x627000
380	blk.29.attn_k_norm.weight	0x1a259f220	0x400
381	blk.29.attn_norm.weight	0x1a259f620	0x3c00
382	blk.29.attn_output.weight	0x1a25a3220	0xff0000
383	blk.29.attn_q.weight	0x1a3593220	0xc4e000
384	blk.29.attn_q_norm.weight	0x1a41e1220	0x400
385	blk.29.attn_v.weight	0x1a41e1620	0xf00000
386	blk.29.ffn_down.weight	0x1a50e1620	0x3bc4000
387	blk.29.ffn_gate.weight	0x1a8ca5620	0x2e24800
388	blk.29.ffn_norm.weight	0x1abac9e20	0x3c00
389	blk.29.ffn_up.weight	0x1abacda20	0x2e24800
390	blk.29.post_attention_norm.weight	0x1ae8f2220	0x3c00
391	blk.29.post_ffw_norm.weight	0x1ae8f5e20	0x3c00
392	blk.30.attn_k.weight	0x1ae8f9a20	0x627000
393	blk.30.attn_k_norm.weight	0x1aef20a20	0x400
394	blk.30.attn_norm.weight	0x1aef20e20	0x3c00
395	blk.30.attn_output.weight	0x1aef24a20	0xff0000
396	blk.30.attn_q.weight	0x1aff14a20	0xc4e000
397	blk.30.attn_q_norm.weight	0x1b0b62a20	0x400
398	blk.30.attn_v.weight	0x1b0b62e20	0xf00000
399	blk.30.ffn_down.weight	0x1b1a62e20	0x3bc4000
400	blk.30.ffn_gate.weight	0x1b5626e20	0x2e24800
401	blk.30.ffn_norm.weight	0x1b844b620	0x3c00
402	blk.30.ffn_up.weight	0x1b844f220	0x2e24800
403	blk.30.post_attention_norm.weight	0x1bb273a20	0x3c00
404	blk.30.post_ffw_norm.weight	0x1bb277620	0x3c00
405	blk.31.attn_k.weight	0x1bb27b220	0x7f8000
406	blk.31.attn_k_norm.weight	0x1bba73220	0x400
407	blk.31.attn_norm.weight	0x1bba73620	0x3c00
408	blk.31.attn_output.weight	0x1bba77220	0xff0000
409	blk.31.attn_q.weight	0x1bca67220	0xff0000
410	blk.31.attn_q_norm.weight	0x1bda57220	0x400
411	blk.31.attn_v.weight	0x1bda57620	0xf00000
412	blk.31.ffn_down.weight	0x1be957620	0x3bc4000
413	blk.31.ffn_gate.weight	0x1c251b620	0x3bc4000
414	blk.31.ffn_norm.weight	0x1c60df620	0x3c00
415	blk.31.ffn_up.weight	0x1c60e3220	0x3bc4000
416	blk.31.post_attention_norm.weight	0x1c9ca7220	0x3c00
417	blk.31.post_ffw_norm.weight	0x1c9caae20	0x3c00
418	blk.32.attn_k.weight	0x1c9caea20	0x7f8000
419	blk.32.attn_k_norm.weight	0x1ca4a6a20	0x400
420	blk.32.attn_norm.weight	0x1ca4a6e20	0x3c00
421	blk.32.attn_output.weight	0x1ca4aaa20	0xff0000
422	blk.32.attn_q.weight	0x1cb49aa20	0xff0000
423	blk.32.attn_q_norm.weight	0x1cc48aa20	0x400
424	blk.32.attn_v.weight	0x1cc48ae20	0xf00000
425	blk.32.ffn_down.weight	0x1cd38ae20	0x3bc4000
426	blk.32.ffn_gate.weight	0x1d0f4ee20	0x3bc4000
427	blk.32.ffn_norm.weight	0x1d4b12e20	0x3c00
428	blk.32.ffn_up.weight	0x1d4b16a20	0x3bc4000
429	blk.32.post_attention_norm.weight	0x1d86daa20	0x3c00
430	blk.32.post_ffw_norm.weight	0x1d86de620	0x3c00
431	blk.33.attn_k.weight	0x1d86e2220	0x7f8000
432	blk.33.attn_k_norm.weight	0x1d8eda220	0x400
433	blk.33.attn_norm.weight	0x1d8eda620	0x3c00
434	blk.33.attn_output.weight	0x1d8ede220	0xff0000
435	blk.33.attn_q.weight	0x1d9ece220	0xff0000
436	blk.33.attn_q_norm.weight	0x1daebe220	0x400
437	blk.33.attn_v.weight	0x1daebe620	0xf00000
438	blk.33.ffn_down.weight	0x1dbdbe620	0x3bc4000
439	blk.33.ffn_gate.weight	0x1df982620	0x3bc4000
440	blk.33.ffn_norm.weight	0x1e3546620	0x3c00
441	blk.33.ffn_up.weight	0x1e354a220	0x3bc4000
442	blk.33.post_attention_norm.weight	0x1e710e220	0x3c00
443	blk.33.post_ffw_norm.weight	0x1e7111e20	0x3c00
444	blk.34.attn_k.weight	0x1e7115a20	0x7f8000
445	blk.34.attn_k_norm.weight	0x1e790da20	0x400
446	blk.34.attn_norm.weight	0x1e790de20	0x3c00
447	blk.34.attn_output.weight	0x1e7911a20	0xff0000
448	blk.34.attn_q.weight	0x1e8901a20	0xff0000
449	blk.34.attn_q_norm.weight	0x1e98f1a20	0x400
450	blk.34.attn_v.weight	0x1e98f1e20	0xf00000
451	blk.34.ffn_down.weight	0x1ea7f1e20	0x3bc4000
452	blk.34.ffn_gate.weight	0x1ee3b5e20	0x3bc4000
453	blk.34.ffn_norm.weight	0x1f1f79e20	0x3c00
454	blk.34.ffn_up.weight	0x1f1f7da20	0x3bc4000
455	blk.34.post_attention_norm.weight	0x1f5b41a20	0x3c00
456	blk.34.post_ffw_norm.weight	0x1f5b45620	0x3c00
457	blk.35.attn_k.weight	0x1f5b49220	0x627000
458	blk.35.attn_k_norm.weight	0x1f6170220	0x400
459	blk.35.attn_norm.weight	0x1f6170620	0x3c00
460	blk.35.attn_output.weight	0x1f6174220	0xff0000
461	blk.35.attn_q.weight	0x1f7164220	0xc4e000
462	blk.35.attn_q_norm.weight	0x1f7db2220	0x400
463	blk.35.attn_v.weight	0x1f7db2620	0xf00000
464	blk.35.ffn_down.weight	0x1f8cb2620	0x3bc4000
465	blk.35.ffn_gate.weight	0x1fc876620	0x2e24800
466	blk.35.ffn_norm.weight	0x1ff69ae20	0x3c00
467	blk.35.ffn_up.weight	0x1ff69ea20	0x2e24800
468	blk.35.post_attention_norm.weight	0x2024c3220	0x3c00
469	blk.35.post_ffw_norm.weight	0x2024c6e20	0x3c00
470	blk.36.attn_k.weight	0x2024caa20	0x7f8000
471	blk.36.attn_k_norm.weight	0x202cc2a20	0x400
472	blk.36.attn_norm.weight	0x202cc2e20	0x3c00
473	blk.36.attn_output.weight	0x202cc6a20	0xff0000
474	blk.36.attn_q.weight	0x203cb6a20	0xff0000
475	blk.36.attn_q_norm.weight	0x204ca6a20	0x400
476	blk.36.attn_v.weight	0x204ca6e20	0xf00000
477	blk.36.ffn_down.weight	0x205ba6e20	0x3bc4000
478	blk.36.ffn_gate.weight	0x20976ae20	0x3bc4000
479	blk.36.ffn_norm.weight	0x20d32ee20	0x3c00
480	blk.36.ffn_up.weight	0x20d332a20	0x3bc4000
481	blk.36.post_attention_norm.weight	0x210ef6a20	0x3c00
482	blk.36.post_ffw_norm.weight	0x210efa620	0x3c00
483	blk.37.attn_k.weight	0x210efe220	0x7f8000
484	blk.37.attn_k_norm.weight	0x2116f6220	0x400
485	blk.37.attn_norm.weight	0x2116f6620	0x3c00
486	blk.37.attn_output.weight	0x2116fa220	0xff0000
487	blk.37.attn_q.weight	0x2126ea220	0xff0000
488	blk.37.attn_q_norm.weight	0x2136da220	0x400
489	blk.37.attn_v.weight	0x2136da620	0xf00000
490	blk.37.ffn_down.weight	0x2145da620	0x3bc4000
491	blk.37.ffn_gate.weight	0x21819e620	0x3bc4000
492	blk.37.ffn_norm.weight	0x21bd62620	0x3c00
493	blk.37.ffn_up.weight	0x21bd66220	0x3bc4000
494	blk.37.post_attention_norm.weight	0x21f92a220	0x3c00
495	blk.37.post_ffw_norm.weight	0x21f92de20	0x3c00
496	blk.38.attn_k.weight	0x21f931a20	0x7f8000
497	blk.38.attn_k_norm.weight	0x220129a20	0x400
498	blk.38.attn_norm.weight	0x220129e20	0x3c00
499	blk.38.attn_output.weight	0x22012da20	0xff0000
500	blk.38.attn_q.weight	0x22111da20	0xff0000
501	blk.38.attn_q_norm.weight	0x22210da20	0x400
502	blk.38.attn_v.weight	0x22210de20	0xf00000
503	blk.38.ffn_down.weight	0x22300de20	0x3bc4000
504	blk.38.ffn_gate.weight	0x226bd1e20	0x3bc4000
505	blk.38.ffn_norm.weight	0x22a795e20	0x3c00
506	blk.38.ffn_up.weight	0x22a799a20	0x3bc4000
507	blk.38.post_attention_norm.weight	0x22e35da20	0x3c00
508	blk.38.post_ffw_norm.weight	0x22e361620	0x3c00
509	blk.39.attn_k.weight	0x22e365220	0x7f8000
510	blk.39.attn_k_norm.weight	0x22eb5d220	0x400
511	blk.39.attn_norm.weight	0x22eb5d620	0x3c00
512	blk.39.attn_output.weight	0x22eb61220	0xff0000
513	blk.39.attn_q.weight	0x22fb51220	0xff0000
514	blk.39.attn_q_norm.weight	0x230b41220	0x400
515	blk.39.attn_v.weight	0x230b41620	0xf00000
516	blk.39.ffn_down.weight	0x231a41620	0x3bc4000
517	blk.39.ffn_gate.weight	0x235605620	0x3bc4000
518	blk.39.ffn_norm.weight	0x2391c9620	0x3c00
519	blk.39.ffn_up.weight	0x2391cd220	0x3bc4000
520	blk.39.post_attention_norm.weight	0x23cd91220	0x3c00
521	blk.39.post_ffw_norm.weight	0x23cd94e20	0x3c00
522	blk.40.attn_k.weight	0x23cd98a20	0x7f8000
523	blk.40.attn_k_norm.weight	0x23d590a20	0x400
524	blk.40.attn_norm.weight	0x23d590e20	0x3c00
525	blk.40.attn_output.weight	0x23d594a20	0xff0000
526	blk.40.attn_q.weight	0x23e584a20	0xff0000
527	blk.40.attn_q_norm.weight	0x23f574a20	0x400
528	blk.40.attn_v.weight	0x23f574e20	0xf00000
529	blk.40.ffn_down.weight	0x240474e20	0x3bc4000
530	blk.40.ffn_gate.weight	0x244038e20	0x3bc4000
531	blk.40.ffn_norm.weight	0x247bfce20	0x3c00
532	blk.40.ffn_up.weight	0x247c00a20	0x3bc4000
533	blk.40.post_attention_norm.weight	0x24b7c4a20	0x3c00
534	blk.40.post_ffw_norm.weight	0x24b7c8620	0x3c00
535	blk.41.attn_k.weight	0x24b7cc220	0x627000
536	blk.41.attn_k_norm.weight	0x24bdf3220	0x400
537	blk.41.attn_norm.weight	0x24bdf3620	0x3c00
538	blk.41.attn_output.weight	0x24bdf7220	0xff0000
539	blk.41.attn_q.weight	0x24cde7220	0xc4e000
540	blk.41.attn_q_norm.weight	0x24da35220	0x400
541	blk.41.attn_v.weight	0x24da35620	0xf00000
542	blk.41.ffn_down.weight	0x24e935620	0x3bc4000
543	blk.41.ffn_gate.weight	0x2524f9620	0x2e24800
544	blk.41.ffn_norm.weight	0x25531de20	0x3c00
545	blk.41.ffn_up.weight	0x255321a20	0x2e24800
546	blk.41.post_attention_norm.weight	0x258146220	0x3c00
547	blk.41.post_ffw_norm.weight	0x258149e20	0x3c00
548	blk.42.attn_k.weight	0x25814da20	0x627000
549	blk.42.attn_k_norm.weight	0x258774a20	0x400
550	blk.42.attn_norm.weight	0x258774e20	0x3c00
551	blk.42.attn_output.weight	0x258778a20	0xff0000
552	blk.42.attn_q.weight	0x259768a20	0xc4e000
553	blk.42.attn_q_norm.weight	0x25a3b6a20	0x400
554	blk.42.attn_v.weight	0x25a3b6e20	0xf00000
555	blk.42.ffn_down.weight	0x25b2b6e20	0x3bc4000
556	blk.42.ffn_gate.weight	0x25ee7ae20	0x2e24800
557	blk.42.ffn_norm.weight	0x261c9f620	0x3c00
558	blk.42.ffn_up.weight	0x261ca3220	0x2e24800
559	blk.42.post_attention_norm.weight	0x264ac7a20	0x3c00
560	blk.42.post_ffw_norm.weight	0x264acb620	0x3c00
561	blk.43.attn_k.weight	0x264acf220	0x627000
562	blk.43.attn_k_norm.weight	0x2650f6220	0x400
563	blk.43.attn_norm.weight	0x2650f6620	0x3c00
564	blk.43.attn_output.weight	0x2650fa220	0xff0000
565	blk.43.attn_q.weight	0x2660ea220	0xc4e000
566	blk.43.attn_q_norm.weight	0x266d38220	0x400
567	blk.43.attn_v.weight	0x266d38620	0xf00000
568	blk.43.ffn_down.weight	0x267c38620	0x3bc4000
569	blk.43.ffn_gate.weight	0x26b7fc620	0x2e24800
570	blk.43.ffn_norm.weight	0x26e620e20	0x3c00
571	blk.43.ffn_up.weight	0x26e624a20	0x2e24800
572	blk.43.post_attention_norm.weight	0x271449220	0x3c00
573	blk.43.post_ffw_norm.weight	0x27144ce20	0x3c00
574	blk.44.attn_k.weight	0x271450a20	0x7f8000
575	blk.44.attn_k_norm.weight	0x271c48a20	0x400
576	blk.44.attn_norm.weight	0x271c48e20	0x3c00
577	blk.44.attn_output.weight	0x271c4ca20	0xff0000
578	blk.44.attn_q.weight	0x272c3ca20	0xff0000
579	blk.44.attn_q_norm.weight	0x273c2ca20	0x400
580	blk.44.attn_v.weight	0x273c2ce20	0xf00000
581	blk.44.ffn_down.weight	0x274b2ce20	0x3bc4000
582	blk.44.ffn_gate.weight	0x2786f0e20	0x3bc4000
583	blk.44.ffn_norm.weight	0x27c2b4e20	0x3c00
584	blk.44.ffn_up.weight	0x27c2b8a20	0x3bc4000
585	blk.44.post_attention_norm.weight	0x27fe7ca20	0x3c00
586	blk.44.post_ffw_norm.weight	0x27fe80620	0x3c00
587	blk.45.attn_k.weight	0x27fe84220	0x7f8000
588	blk.45.attn_k_norm.weight	0x28067c220	0x400
589	blk.45.attn_norm.weight	0x28067c620	0x3c00
590	blk.45.attn_output.weight	0x280680220	0xff0000
591	blk.45.attn_q.weight	0x281670220	0xff0000
592	blk.45.attn_q_norm.weight	0x282660220	0x400
593	blk.45.attn_v.weight	0x282660620	0xf00000
594	blk.45.ffn_down.weight	0x283560620	0x3bc4000
595	blk.45.ffn_gate.weight	0x287124620	0x3bc4000
596	blk.45.ffn_norm.weight	0x28ace8620	0x3c00
597	blk.45.ffn_up.weight	0x28acec220	0x3bc4000
598	blk.45.post_attention_norm.weight	0x28e8b0220	0x3c00
599	blk.45.post_ffw_norm.weight	0x28e8b3e20	0x3c00

Base Tensor Group : ~1B Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
0	output_norm.weight	Output Normalization (W)	(~4K) 3840	3840 x 1 x 1 x 1	F32
1	token_embd.weight	Token Embedding (W)	(~1B) 1006632960	3840 x 262144 x 1 x 1	Q3_K

• Total elements in base: ( ~1B) 1006636800
• Percentage of total elements: 8.89%

Block 0 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
2	blk.0.attn_k.weight	Block 0 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
3	blk.0.attn_k_norm.weight	Block 0 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
4	blk.0.attn_norm.weight	Block 0 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
5	blk.0.attn_output.weight	Block 0 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
6	blk.0.attn_q.weight	Block 0 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
7	blk.0.attn_q_norm.weight	Block 0 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
8	blk.0.attn_v.weight	Block 0 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
9	blk.0.ffn_down.weight	Block 0 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
10	blk.0.ffn_gate.weight	Block 0 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
11	blk.0.ffn_norm.weight	Block 0 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
12	blk.0.ffn_up.weight	Block 0 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
13	blk.0.post_attention_norm.weight	Block 0 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
14	blk.0.post_ffw_norm.weight	Block 0 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.0: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 1 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
15	blk.1.attn_k.weight	Block 1 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
16	blk.1.attn_k_norm.weight	Block 1 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
17	blk.1.attn_norm.weight	Block 1 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
18	blk.1.attn_output.weight	Block 1 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
19	blk.1.attn_q.weight	Block 1 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
20	blk.1.attn_q_norm.weight	Block 1 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
21	blk.1.attn_v.weight	Block 1 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
22	blk.1.ffn_down.weight	Block 1 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
23	blk.1.ffn_gate.weight	Block 1 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
24	blk.1.ffn_norm.weight	Block 1 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
25	blk.1.ffn_up.weight	Block 1 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
26	blk.1.post_attention_norm.weight	Block 1 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
27	blk.1.post_ffw_norm.weight	Block 1 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.1: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 2 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
28	blk.2.attn_k.weight	Block 2 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
29	blk.2.attn_k_norm.weight	Block 2 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
30	blk.2.attn_norm.weight	Block 2 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
31	blk.2.attn_output.weight	Block 2 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
32	blk.2.attn_q.weight	Block 2 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
33	blk.2.attn_q_norm.weight	Block 2 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
34	blk.2.attn_v.weight	Block 2 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
35	blk.2.ffn_down.weight	Block 2 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
36	blk.2.ffn_gate.weight	Block 2 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
37	blk.2.ffn_norm.weight	Block 2 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
38	blk.2.ffn_up.weight	Block 2 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
39	blk.2.post_attention_norm.weight	Block 2 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
40	blk.2.post_ffw_norm.weight	Block 2 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.2: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 3 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
41	blk.3.attn_k.weight	Block 3 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
42	blk.3.attn_k_norm.weight	Block 3 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
43	blk.3.attn_norm.weight	Block 3 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
44	blk.3.attn_output.weight	Block 3 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
45	blk.3.attn_q.weight	Block 3 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
46	blk.3.attn_q_norm.weight	Block 3 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
47	blk.3.attn_v.weight	Block 3 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
48	blk.3.ffn_down.weight	Block 3 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
49	blk.3.ffn_gate.weight	Block 3 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
50	blk.3.ffn_norm.weight	Block 3 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
51	blk.3.ffn_up.weight	Block 3 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
52	blk.3.post_attention_norm.weight	Block 3 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
53	blk.3.post_ffw_norm.weight	Block 3 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.3: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 4 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
54	blk.4.attn_k.weight	Block 4 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
55	blk.4.attn_k_norm.weight	Block 4 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
56	blk.4.attn_norm.weight	Block 4 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
57	blk.4.attn_output.weight	Block 4 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
58	blk.4.attn_q.weight	Block 4 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
59	blk.4.attn_q_norm.weight	Block 4 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
60	blk.4.attn_v.weight	Block 4 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
61	blk.4.ffn_down.weight	Block 4 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
62	blk.4.ffn_gate.weight	Block 4 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
63	blk.4.ffn_norm.weight	Block 4 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
64	blk.4.ffn_up.weight	Block 4 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
65	blk.4.post_attention_norm.weight	Block 4 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
66	blk.4.post_ffw_norm.weight	Block 4 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.4: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 5 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
67	blk.5.attn_k.weight	Block 5 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
68	blk.5.attn_k_norm.weight	Block 5 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
69	blk.5.attn_norm.weight	Block 5 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
70	blk.5.attn_output.weight	Block 5 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
71	blk.5.attn_q.weight	Block 5 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
72	blk.5.attn_q_norm.weight	Block 5 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
73	blk.5.attn_v.weight	Block 5 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
74	blk.5.ffn_down.weight	Block 5 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
75	blk.5.ffn_gate.weight	Block 5 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
76	blk.5.ffn_norm.weight	Block 5 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
77	blk.5.ffn_up.weight	Block 5 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
78	blk.5.post_attention_norm.weight	Block 5 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
79	blk.5.post_ffw_norm.weight	Block 5 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.5: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 6 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
80	blk.6.attn_k.weight	Block 6 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
81	blk.6.attn_k_norm.weight	Block 6 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
82	blk.6.attn_norm.weight	Block 6 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
83	blk.6.attn_output.weight	Block 6 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
84	blk.6.attn_q.weight	Block 6 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
85	blk.6.attn_q_norm.weight	Block 6 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
86	blk.6.attn_v.weight	Block 6 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
87	blk.6.ffn_down.weight	Block 6 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
88	blk.6.ffn_gate.weight	Block 6 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
89	blk.6.ffn_norm.weight	Block 6 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
90	blk.6.ffn_up.weight	Block 6 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
91	blk.6.post_attention_norm.weight	Block 6 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
92	blk.6.post_ffw_norm.weight	Block 6 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.6: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 7 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
93	blk.7.attn_k.weight	Block 7 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
94	blk.7.attn_k_norm.weight	Block 7 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
95	blk.7.attn_norm.weight	Block 7 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
96	blk.7.attn_output.weight	Block 7 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
97	blk.7.attn_q.weight	Block 7 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
98	blk.7.attn_q_norm.weight	Block 7 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
99	blk.7.attn_v.weight	Block 7 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
100	blk.7.ffn_down.weight	Block 7 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
101	blk.7.ffn_gate.weight	Block 7 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
102	blk.7.ffn_norm.weight	Block 7 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
103	blk.7.ffn_up.weight	Block 7 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
104	blk.7.post_attention_norm.weight	Block 7 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
105	blk.7.post_ffw_norm.weight	Block 7 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.7: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 8 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
106	blk.8.attn_k.weight	Block 8 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
107	blk.8.attn_k_norm.weight	Block 8 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
108	blk.8.attn_norm.weight	Block 8 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
109	blk.8.attn_output.weight	Block 8 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
110	blk.8.attn_q.weight	Block 8 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
111	blk.8.attn_q_norm.weight	Block 8 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
112	blk.8.attn_v.weight	Block 8 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
113	blk.8.ffn_down.weight	Block 8 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
114	blk.8.ffn_gate.weight	Block 8 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
115	blk.8.ffn_norm.weight	Block 8 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
116	blk.8.ffn_up.weight	Block 8 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
117	blk.8.post_attention_norm.weight	Block 8 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
118	blk.8.post_ffw_norm.weight	Block 8 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.8: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 9 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
119	blk.9.attn_k.weight	Block 9 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
120	blk.9.attn_k_norm.weight	Block 9 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
121	blk.9.attn_norm.weight	Block 9 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
122	blk.9.attn_output.weight	Block 9 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
123	blk.9.attn_q.weight	Block 9 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
124	blk.9.attn_q_norm.weight	Block 9 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
125	blk.9.attn_v.weight	Block 9 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
126	blk.9.ffn_down.weight	Block 9 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
127	blk.9.ffn_gate.weight	Block 9 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
128	blk.9.ffn_norm.weight	Block 9 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
129	blk.9.ffn_up.weight	Block 9 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
130	blk.9.post_attention_norm.weight	Block 9 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
131	blk.9.post_ffw_norm.weight	Block 9 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.9: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 10 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
132	blk.10.attn_k.weight	Block 10 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
133	blk.10.attn_k_norm.weight	Block 10 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
134	blk.10.attn_norm.weight	Block 10 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
135	blk.10.attn_output.weight	Block 10 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
136	blk.10.attn_q.weight	Block 10 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
137	blk.10.attn_q_norm.weight	Block 10 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
138	blk.10.attn_v.weight	Block 10 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
139	blk.10.ffn_down.weight	Block 10 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
140	blk.10.ffn_gate.weight	Block 10 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
141	blk.10.ffn_norm.weight	Block 10 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
142	blk.10.ffn_up.weight	Block 10 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
143	blk.10.post_attention_norm.weight	Block 10 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
144	blk.10.post_ffw_norm.weight	Block 10 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.10: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 11 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
145	blk.11.attn_k.weight	Block 11 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
146	blk.11.attn_k_norm.weight	Block 11 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
147	blk.11.attn_norm.weight	Block 11 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
148	blk.11.attn_output.weight	Block 11 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
149	blk.11.attn_q.weight	Block 11 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
150	blk.11.attn_q_norm.weight	Block 11 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
151	blk.11.attn_v.weight	Block 11 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
152	blk.11.ffn_down.weight	Block 11 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
153	blk.11.ffn_gate.weight	Block 11 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
154	blk.11.ffn_norm.weight	Block 11 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
155	blk.11.ffn_up.weight	Block 11 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
156	blk.11.post_attention_norm.weight	Block 11 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
157	blk.11.post_ffw_norm.weight	Block 11 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.11: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 12 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
158	blk.12.attn_k.weight	Block 12 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
159	blk.12.attn_k_norm.weight	Block 12 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
160	blk.12.attn_norm.weight	Block 12 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
161	blk.12.attn_output.weight	Block 12 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
162	blk.12.attn_q.weight	Block 12 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
163	blk.12.attn_q_norm.weight	Block 12 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
164	blk.12.attn_v.weight	Block 12 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
165	blk.12.ffn_down.weight	Block 12 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
166	blk.12.ffn_gate.weight	Block 12 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
167	blk.12.ffn_norm.weight	Block 12 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
168	blk.12.ffn_up.weight	Block 12 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
169	blk.12.post_attention_norm.weight	Block 12 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
170	blk.12.post_ffw_norm.weight	Block 12 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.12: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 13 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
171	blk.13.attn_k.weight	Block 13 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
172	blk.13.attn_k_norm.weight	Block 13 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
173	blk.13.attn_norm.weight	Block 13 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
174	blk.13.attn_output.weight	Block 13 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
175	blk.13.attn_q.weight	Block 13 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
176	blk.13.attn_q_norm.weight	Block 13 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
177	blk.13.attn_v.weight	Block 13 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
178	blk.13.ffn_down.weight	Block 13 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
179	blk.13.ffn_gate.weight	Block 13 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
180	blk.13.ffn_norm.weight	Block 13 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
181	blk.13.ffn_up.weight	Block 13 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
182	blk.13.post_attention_norm.weight	Block 13 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
183	blk.13.post_ffw_norm.weight	Block 13 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.13: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 14 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
184	blk.14.attn_k.weight	Block 14 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
185	blk.14.attn_k_norm.weight	Block 14 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
186	blk.14.attn_norm.weight	Block 14 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
187	blk.14.attn_output.weight	Block 14 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
188	blk.14.attn_q.weight	Block 14 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
189	blk.14.attn_q_norm.weight	Block 14 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
190	blk.14.attn_v.weight	Block 14 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
191	blk.14.ffn_down.weight	Block 14 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
192	blk.14.ffn_gate.weight	Block 14 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
193	blk.14.ffn_norm.weight	Block 14 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
194	blk.14.ffn_up.weight	Block 14 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
195	blk.14.post_attention_norm.weight	Block 14 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
196	blk.14.post_ffw_norm.weight	Block 14 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.14: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 15 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
197	blk.15.attn_k.weight	Block 15 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
198	blk.15.attn_k_norm.weight	Block 15 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
199	blk.15.attn_norm.weight	Block 15 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
200	blk.15.attn_output.weight	Block 15 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
201	blk.15.attn_q.weight	Block 15 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
202	blk.15.attn_q_norm.weight	Block 15 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
203	blk.15.attn_v.weight	Block 15 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
204	blk.15.ffn_down.weight	Block 15 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
205	blk.15.ffn_gate.weight	Block 15 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
206	blk.15.ffn_norm.weight	Block 15 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
207	blk.15.ffn_up.weight	Block 15 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
208	blk.15.post_attention_norm.weight	Block 15 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
209	blk.15.post_ffw_norm.weight	Block 15 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.15: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 16 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
210	blk.16.attn_k.weight	Block 16 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
211	blk.16.attn_k_norm.weight	Block 16 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
212	blk.16.attn_norm.weight	Block 16 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
213	blk.16.attn_output.weight	Block 16 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
214	blk.16.attn_q.weight	Block 16 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
215	blk.16.attn_q_norm.weight	Block 16 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
216	blk.16.attn_v.weight	Block 16 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
217	blk.16.ffn_down.weight	Block 16 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
218	blk.16.ffn_gate.weight	Block 16 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
219	blk.16.ffn_norm.weight	Block 16 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
220	blk.16.ffn_up.weight	Block 16 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
221	blk.16.post_attention_norm.weight	Block 16 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
222	blk.16.post_ffw_norm.weight	Block 16 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.16: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 17 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
223	blk.17.attn_k.weight	Block 17 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
224	blk.17.attn_k_norm.weight	Block 17 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
225	blk.17.attn_norm.weight	Block 17 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
226	blk.17.attn_output.weight	Block 17 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
227	blk.17.attn_q.weight	Block 17 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
228	blk.17.attn_q_norm.weight	Block 17 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
229	blk.17.attn_v.weight	Block 17 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
230	blk.17.ffn_down.weight	Block 17 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
231	blk.17.ffn_gate.weight	Block 17 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
232	blk.17.ffn_norm.weight	Block 17 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
233	blk.17.ffn_up.weight	Block 17 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
234	blk.17.post_attention_norm.weight	Block 17 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
235	blk.17.post_ffw_norm.weight	Block 17 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.17: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 18 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
236	blk.18.attn_k.weight	Block 18 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
237	blk.18.attn_k_norm.weight	Block 18 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
238	blk.18.attn_norm.weight	Block 18 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
239	blk.18.attn_output.weight	Block 18 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
240	blk.18.attn_q.weight	Block 18 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
241	blk.18.attn_q_norm.weight	Block 18 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
242	blk.18.attn_v.weight	Block 18 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
243	blk.18.ffn_down.weight	Block 18 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
244	blk.18.ffn_gate.weight	Block 18 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
245	blk.18.ffn_norm.weight	Block 18 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
246	blk.18.ffn_up.weight	Block 18 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
247	blk.18.post_attention_norm.weight	Block 18 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
248	blk.18.post_ffw_norm.weight	Block 18 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.18: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 19 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
249	blk.19.attn_k.weight	Block 19 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
250	blk.19.attn_k_norm.weight	Block 19 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
251	blk.19.attn_norm.weight	Block 19 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
252	blk.19.attn_output.weight	Block 19 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
253	blk.19.attn_q.weight	Block 19 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
254	blk.19.attn_q_norm.weight	Block 19 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
255	blk.19.attn_v.weight	Block 19 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
256	blk.19.ffn_down.weight	Block 19 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
257	blk.19.ffn_gate.weight	Block 19 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
258	blk.19.ffn_norm.weight	Block 19 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
259	blk.19.ffn_up.weight	Block 19 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
260	blk.19.post_attention_norm.weight	Block 19 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
261	blk.19.post_ffw_norm.weight	Block 19 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.19: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 20 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
262	blk.20.attn_k.weight	Block 20 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
263	blk.20.attn_k_norm.weight	Block 20 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
264	blk.20.attn_norm.weight	Block 20 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
265	blk.20.attn_output.weight	Block 20 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
266	blk.20.attn_q.weight	Block 20 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
267	blk.20.attn_q_norm.weight	Block 20 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
268	blk.20.attn_v.weight	Block 20 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
269	blk.20.ffn_down.weight	Block 20 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
270	blk.20.ffn_gate.weight	Block 20 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
271	blk.20.ffn_norm.weight	Block 20 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
272	blk.20.ffn_up.weight	Block 20 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
273	blk.20.post_attention_norm.weight	Block 20 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
274	blk.20.post_ffw_norm.weight	Block 20 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.20: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 21 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
275	blk.21.attn_k.weight	Block 21 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
276	blk.21.attn_k_norm.weight	Block 21 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
277	blk.21.attn_norm.weight	Block 21 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
278	blk.21.attn_output.weight	Block 21 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
279	blk.21.attn_q.weight	Block 21 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
280	blk.21.attn_q_norm.weight	Block 21 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
281	blk.21.attn_v.weight	Block 21 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
282	blk.21.ffn_down.weight	Block 21 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
283	blk.21.ffn_gate.weight	Block 21 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
284	blk.21.ffn_norm.weight	Block 21 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
285	blk.21.ffn_up.weight	Block 21 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
286	blk.21.post_attention_norm.weight	Block 21 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
287	blk.21.post_ffw_norm.weight	Block 21 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.21: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 22 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
288	blk.22.attn_k.weight	Block 22 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
289	blk.22.attn_k_norm.weight	Block 22 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
290	blk.22.attn_norm.weight	Block 22 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
291	blk.22.attn_output.weight	Block 22 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
292	blk.22.attn_q.weight	Block 22 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
293	blk.22.attn_q_norm.weight	Block 22 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
294	blk.22.attn_v.weight	Block 22 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
295	blk.22.ffn_down.weight	Block 22 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
296	blk.22.ffn_gate.weight	Block 22 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
297	blk.22.ffn_norm.weight	Block 22 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
298	blk.22.ffn_up.weight	Block 22 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
299	blk.22.post_attention_norm.weight	Block 22 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
300	blk.22.post_ffw_norm.weight	Block 22 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.22: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 23 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
301	blk.23.attn_k.weight	Block 23 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
302	blk.23.attn_k_norm.weight	Block 23 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
303	blk.23.attn_norm.weight	Block 23 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
304	blk.23.attn_output.weight	Block 23 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
305	blk.23.attn_q.weight	Block 23 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
306	blk.23.attn_q_norm.weight	Block 23 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
307	blk.23.attn_v.weight	Block 23 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
308	blk.23.ffn_down.weight	Block 23 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
309	blk.23.ffn_gate.weight	Block 23 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
310	blk.23.ffn_norm.weight	Block 23 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
311	blk.23.ffn_up.weight	Block 23 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
312	blk.23.post_attention_norm.weight	Block 23 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
313	blk.23.post_ffw_norm.weight	Block 23 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.23: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 24 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
314	blk.24.attn_k.weight	Block 24 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
315	blk.24.attn_k_norm.weight	Block 24 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
316	blk.24.attn_norm.weight	Block 24 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
317	blk.24.attn_output.weight	Block 24 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
318	blk.24.attn_q.weight	Block 24 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
319	blk.24.attn_q_norm.weight	Block 24 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
320	blk.24.attn_v.weight	Block 24 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
321	blk.24.ffn_down.weight	Block 24 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
322	blk.24.ffn_gate.weight	Block 24 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
323	blk.24.ffn_norm.weight	Block 24 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
324	blk.24.ffn_up.weight	Block 24 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
325	blk.24.post_attention_norm.weight	Block 24 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
326	blk.24.post_ffw_norm.weight	Block 24 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.24: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 25 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
327	blk.25.attn_k.weight	Block 25 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
328	blk.25.attn_k_norm.weight	Block 25 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
329	blk.25.attn_norm.weight	Block 25 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
330	blk.25.attn_output.weight	Block 25 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
331	blk.25.attn_q.weight	Block 25 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
332	blk.25.attn_q_norm.weight	Block 25 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
333	blk.25.attn_v.weight	Block 25 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
334	blk.25.ffn_down.weight	Block 25 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
335	blk.25.ffn_gate.weight	Block 25 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
336	blk.25.ffn_norm.weight	Block 25 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
337	blk.25.ffn_up.weight	Block 25 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
338	blk.25.post_attention_norm.weight	Block 25 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
339	blk.25.post_ffw_norm.weight	Block 25 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.25: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 26 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
340	blk.26.attn_k.weight	Block 26 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
341	blk.26.attn_k_norm.weight	Block 26 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
342	blk.26.attn_norm.weight	Block 26 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
343	blk.26.attn_output.weight	Block 26 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
344	blk.26.attn_q.weight	Block 26 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
345	blk.26.attn_q_norm.weight	Block 26 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
346	blk.26.attn_v.weight	Block 26 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
347	blk.26.ffn_down.weight	Block 26 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
348	blk.26.ffn_gate.weight	Block 26 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
349	blk.26.ffn_norm.weight	Block 26 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
350	blk.26.ffn_up.weight	Block 26 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
351	blk.26.post_attention_norm.weight	Block 26 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
352	blk.26.post_ffw_norm.weight	Block 26 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.26: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 27 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
353	blk.27.attn_k.weight	Block 27 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
354	blk.27.attn_k_norm.weight	Block 27 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
355	blk.27.attn_norm.weight	Block 27 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
356	blk.27.attn_output.weight	Block 27 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
357	blk.27.attn_q.weight	Block 27 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
358	blk.27.attn_q_norm.weight	Block 27 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
359	blk.27.attn_v.weight	Block 27 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
360	blk.27.ffn_down.weight	Block 27 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
361	blk.27.ffn_gate.weight	Block 27 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
362	blk.27.ffn_norm.weight	Block 27 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
363	blk.27.ffn_up.weight	Block 27 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
364	blk.27.post_attention_norm.weight	Block 27 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
365	blk.27.post_ffw_norm.weight	Block 27 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.27: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 28 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
366	blk.28.attn_k.weight	Block 28 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
367	blk.28.attn_k_norm.weight	Block 28 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
368	blk.28.attn_norm.weight	Block 28 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
369	blk.28.attn_output.weight	Block 28 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
370	blk.28.attn_q.weight	Block 28 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
371	blk.28.attn_q_norm.weight	Block 28 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
372	blk.28.attn_v.weight	Block 28 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
373	blk.28.ffn_down.weight	Block 28 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
374	blk.28.ffn_gate.weight	Block 28 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
375	blk.28.ffn_norm.weight	Block 28 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
376	blk.28.ffn_up.weight	Block 28 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
377	blk.28.post_attention_norm.weight	Block 28 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
378	blk.28.post_ffw_norm.weight	Block 28 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.28: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 29 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
379	blk.29.attn_k.weight	Block 29 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
380	blk.29.attn_k_norm.weight	Block 29 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
381	blk.29.attn_norm.weight	Block 29 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
382	blk.29.attn_output.weight	Block 29 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
383	blk.29.attn_q.weight	Block 29 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
384	blk.29.attn_q_norm.weight	Block 29 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
385	blk.29.attn_v.weight	Block 29 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
386	blk.29.ffn_down.weight	Block 29 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
387	blk.29.ffn_gate.weight	Block 29 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
388	blk.29.ffn_norm.weight	Block 29 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
389	blk.29.ffn_up.weight	Block 29 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
390	blk.29.post_attention_norm.weight	Block 29 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
391	blk.29.post_ffw_norm.weight	Block 29 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.29: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 30 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
392	blk.30.attn_k.weight	Block 30 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
393	blk.30.attn_k_norm.weight	Block 30 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
394	blk.30.attn_norm.weight	Block 30 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
395	blk.30.attn_output.weight	Block 30 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
396	blk.30.attn_q.weight	Block 30 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
397	blk.30.attn_q_norm.weight	Block 30 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
398	blk.30.attn_v.weight	Block 30 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
399	blk.30.ffn_down.weight	Block 30 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
400	blk.30.ffn_gate.weight	Block 30 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
401	blk.30.ffn_norm.weight	Block 30 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
402	blk.30.ffn_up.weight	Block 30 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
403	blk.30.post_attention_norm.weight	Block 30 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
404	blk.30.post_ffw_norm.weight	Block 30 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.30: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 31 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
405	blk.31.attn_k.weight	Block 31 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
406	blk.31.attn_k_norm.weight	Block 31 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
407	blk.31.attn_norm.weight	Block 31 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
408	blk.31.attn_output.weight	Block 31 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
409	blk.31.attn_q.weight	Block 31 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
410	blk.31.attn_q_norm.weight	Block 31 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
411	blk.31.attn_v.weight	Block 31 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
412	blk.31.ffn_down.weight	Block 31 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
413	blk.31.ffn_gate.weight	Block 31 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
414	blk.31.ffn_norm.weight	Block 31 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
415	blk.31.ffn_up.weight	Block 31 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
416	blk.31.post_attention_norm.weight	Block 31 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
417	blk.31.post_ffw_norm.weight	Block 31 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.31: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 32 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
418	blk.32.attn_k.weight	Block 32 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
419	blk.32.attn_k_norm.weight	Block 32 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
420	blk.32.attn_norm.weight	Block 32 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
421	blk.32.attn_output.weight	Block 32 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
422	blk.32.attn_q.weight	Block 32 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
423	blk.32.attn_q_norm.weight	Block 32 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
424	blk.32.attn_v.weight	Block 32 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
425	blk.32.ffn_down.weight	Block 32 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
426	blk.32.ffn_gate.weight	Block 32 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
427	blk.32.ffn_norm.weight	Block 32 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
428	blk.32.ffn_up.weight	Block 32 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
429	blk.32.post_attention_norm.weight	Block 32 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
430	blk.32.post_ffw_norm.weight	Block 32 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.32: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 33 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
431	blk.33.attn_k.weight	Block 33 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
432	blk.33.attn_k_norm.weight	Block 33 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
433	blk.33.attn_norm.weight	Block 33 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
434	blk.33.attn_output.weight	Block 33 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
435	blk.33.attn_q.weight	Block 33 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
436	blk.33.attn_q_norm.weight	Block 33 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
437	blk.33.attn_v.weight	Block 33 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
438	blk.33.ffn_down.weight	Block 33 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
439	blk.33.ffn_gate.weight	Block 33 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
440	blk.33.ffn_norm.weight	Block 33 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
441	blk.33.ffn_up.weight	Block 33 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
442	blk.33.post_attention_norm.weight	Block 33 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
443	blk.33.post_ffw_norm.weight	Block 33 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.33: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 34 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
444	blk.34.attn_k.weight	Block 34 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
445	blk.34.attn_k_norm.weight	Block 34 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
446	blk.34.attn_norm.weight	Block 34 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
447	blk.34.attn_output.weight	Block 34 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
448	blk.34.attn_q.weight	Block 34 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
449	blk.34.attn_q_norm.weight	Block 34 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
450	blk.34.attn_v.weight	Block 34 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
451	blk.34.ffn_down.weight	Block 34 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
452	blk.34.ffn_gate.weight	Block 34 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
453	blk.34.ffn_norm.weight	Block 34 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
454	blk.34.ffn_up.weight	Block 34 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
455	blk.34.post_attention_norm.weight	Block 34 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
456	blk.34.post_ffw_norm.weight	Block 34 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.34: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 35 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
457	blk.35.attn_k.weight	Block 35 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
458	blk.35.attn_k_norm.weight	Block 35 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
459	blk.35.attn_norm.weight	Block 35 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
460	blk.35.attn_output.weight	Block 35 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
461	blk.35.attn_q.weight	Block 35 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
462	blk.35.attn_q_norm.weight	Block 35 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
463	blk.35.attn_v.weight	Block 35 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
464	blk.35.ffn_down.weight	Block 35 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
465	blk.35.ffn_gate.weight	Block 35 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
466	blk.35.ffn_norm.weight	Block 35 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
467	blk.35.ffn_up.weight	Block 35 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
468	blk.35.post_attention_norm.weight	Block 35 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
469	blk.35.post_ffw_norm.weight	Block 35 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.35: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 36 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
470	blk.36.attn_k.weight	Block 36 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
471	blk.36.attn_k_norm.weight	Block 36 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
472	blk.36.attn_norm.weight	Block 36 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
473	blk.36.attn_output.weight	Block 36 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
474	blk.36.attn_q.weight	Block 36 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
475	blk.36.attn_q_norm.weight	Block 36 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
476	blk.36.attn_v.weight	Block 36 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
477	blk.36.ffn_down.weight	Block 36 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
478	blk.36.ffn_gate.weight	Block 36 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
479	blk.36.ffn_norm.weight	Block 36 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
480	blk.36.ffn_up.weight	Block 36 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
481	blk.36.post_attention_norm.weight	Block 36 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
482	blk.36.post_ffw_norm.weight	Block 36 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.36: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 37 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
483	blk.37.attn_k.weight	Block 37 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
484	blk.37.attn_k_norm.weight	Block 37 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
485	blk.37.attn_norm.weight	Block 37 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
486	blk.37.attn_output.weight	Block 37 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
487	blk.37.attn_q.weight	Block 37 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
488	blk.37.attn_q_norm.weight	Block 37 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
489	blk.37.attn_v.weight	Block 37 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
490	blk.37.ffn_down.weight	Block 37 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
491	blk.37.ffn_gate.weight	Block 37 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
492	blk.37.ffn_norm.weight	Block 37 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
493	blk.37.ffn_up.weight	Block 37 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
494	blk.37.post_attention_norm.weight	Block 37 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
495	blk.37.post_ffw_norm.weight	Block 37 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.37: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 38 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
496	blk.38.attn_k.weight	Block 38 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
497	blk.38.attn_k_norm.weight	Block 38 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
498	blk.38.attn_norm.weight	Block 38 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
499	blk.38.attn_output.weight	Block 38 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
500	blk.38.attn_q.weight	Block 38 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
501	blk.38.attn_q_norm.weight	Block 38 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
502	blk.38.attn_v.weight	Block 38 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
503	blk.38.ffn_down.weight	Block 38 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
504	blk.38.ffn_gate.weight	Block 38 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
505	blk.38.ffn_norm.weight	Block 38 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
506	blk.38.ffn_up.weight	Block 38 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
507	blk.38.post_attention_norm.weight	Block 38 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
508	blk.38.post_ffw_norm.weight	Block 38 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.38: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 39 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
509	blk.39.attn_k.weight	Block 39 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
510	blk.39.attn_k_norm.weight	Block 39 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
511	blk.39.attn_norm.weight	Block 39 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
512	blk.39.attn_output.weight	Block 39 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
513	blk.39.attn_q.weight	Block 39 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
514	blk.39.attn_q_norm.weight	Block 39 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
515	blk.39.attn_v.weight	Block 39 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
516	blk.39.ffn_down.weight	Block 39 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
517	blk.39.ffn_gate.weight	Block 39 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
518	blk.39.ffn_norm.weight	Block 39 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
519	blk.39.ffn_up.weight	Block 39 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
520	blk.39.post_attention_norm.weight	Block 39 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
521	blk.39.post_ffw_norm.weight	Block 39 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.39: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 40 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
522	blk.40.attn_k.weight	Block 40 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
523	blk.40.attn_k_norm.weight	Block 40 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
524	blk.40.attn_norm.weight	Block 40 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
525	blk.40.attn_output.weight	Block 40 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
526	blk.40.attn_q.weight	Block 40 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
527	blk.40.attn_q_norm.weight	Block 40 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
528	blk.40.attn_v.weight	Block 40 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
529	blk.40.ffn_down.weight	Block 40 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
530	blk.40.ffn_gate.weight	Block 40 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
531	blk.40.ffn_norm.weight	Block 40 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
532	blk.40.ffn_up.weight	Block 40 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
533	blk.40.post_attention_norm.weight	Block 40 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
534	blk.40.post_ffw_norm.weight	Block 40 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.40: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 41 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
535	blk.41.attn_k.weight	Block 41 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
536	blk.41.attn_k_norm.weight	Block 41 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
537	blk.41.attn_norm.weight	Block 41 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
538	blk.41.attn_output.weight	Block 41 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
539	blk.41.attn_q.weight	Block 41 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
540	blk.41.attn_q_norm.weight	Block 41 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
541	blk.41.attn_v.weight	Block 41 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
542	blk.41.ffn_down.weight	Block 41 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
543	blk.41.ffn_gate.weight	Block 41 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
544	blk.41.ffn_norm.weight	Block 41 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
545	blk.41.ffn_up.weight	Block 41 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
546	blk.41.post_attention_norm.weight	Block 41 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
547	blk.41.post_ffw_norm.weight	Block 41 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.41: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 42 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
548	blk.42.attn_k.weight	Block 42 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
549	blk.42.attn_k_norm.weight	Block 42 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
550	blk.42.attn_norm.weight	Block 42 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
551	blk.42.attn_output.weight	Block 42 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
552	blk.42.attn_q.weight	Block 42 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
553	blk.42.attn_q_norm.weight	Block 42 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
554	blk.42.attn_v.weight	Block 42 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
555	blk.42.ffn_down.weight	Block 42 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
556	blk.42.ffn_gate.weight	Block 42 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
557	blk.42.ffn_norm.weight	Block 42 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
558	blk.42.ffn_up.weight	Block 42 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
559	blk.42.post_attention_norm.weight	Block 42 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
560	blk.42.post_ffw_norm.weight	Block 42 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.42: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 43 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
561	blk.43.attn_k.weight	Block 43 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q6_K
562	blk.43.attn_k_norm.weight	Block 43 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
563	blk.43.attn_norm.weight	Block 43 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
564	blk.43.attn_output.weight	Block 43 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
565	blk.43.attn_q.weight	Block 43 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q6_K
566	blk.43.attn_q_norm.weight	Block 43 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
567	blk.43.attn_v.weight	Block 43 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
568	blk.43.ffn_down.weight	Block 43 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
569	blk.43.ffn_gate.weight	Block 43 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
570	blk.43.ffn_norm.weight	Block 43 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
571	blk.43.ffn_up.weight	Block 43 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q6_K
572	blk.43.post_attention_norm.weight	Block 43 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
573	blk.43.post_ffw_norm.weight	Block 43 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.43: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 44 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
574	blk.44.attn_k.weight	Block 44 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
575	blk.44.attn_k_norm.weight	Block 44 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
576	blk.44.attn_norm.weight	Block 44 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
577	blk.44.attn_output.weight	Block 44 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
578	blk.44.attn_q.weight	Block 44 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
579	blk.44.attn_q_norm.weight	Block 44 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
580	blk.44.attn_v.weight	Block 44 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
581	blk.44.ffn_down.weight	Block 44 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
582	blk.44.ffn_gate.weight	Block 44 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
583	blk.44.ffn_norm.weight	Block 44 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
584	blk.44.ffn_up.weight	Block 44 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
585	blk.44.post_attention_norm.weight	Block 44 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
586	blk.44.post_ffw_norm.weight	Block 44 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.44: (~224M) 224148992
• Percentage of total elements: 1.98%

Block 45 Tensor Group : ~224M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
587	blk.45.attn_k.weight	Block 45 Attention Key (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	Q8_0
588	blk.45.attn_k_norm.weight	Block 45 Attn_K_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
589	blk.45.attn_norm.weight	Block 45 Attention Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
590	blk.45.attn_output.weight	Block 45 Attention Output (W)	(~16M) 15728640	4096 x 3840 x 1 x 1	Q8_0
591	blk.45.attn_q.weight	Block 45 Attention Query (W)	(~16M) 15728640	3840 x 4096 x 1 x 1	Q8_0
592	blk.45.attn_q_norm.weight	Block 45 Attn_Q_Norm (W)	( 256) 256	256 x 1 x 1 x 1	F32
593	blk.45.attn_v.weight	Block 45 Attention Value (W)	( ~8M) 7864320	3840 x 2048 x 1 x 1	F16
594	blk.45.ffn_down.weight	Block 45 Feed-Forward Network "Down" (W)	(~59M) 58982400	15360 x 3840 x 1 x 1	Q8_0
595	blk.45.ffn_gate.weight	Block 45 Feed-Forward Network "Gate" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
596	blk.45.ffn_norm.weight	Block 45 Feed-Forward Network Normalization (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
597	blk.45.ffn_up.weight	Block 45 Feed-Forward Network "Up" (W)	(~59M) 58982400	3840 x 15360 x 1 x 1	Q8_0
598	blk.45.post_attention_norm.weight	Block 45 Post_Attention_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32
599	blk.45.post_ffw_norm.weight	Block 45 Post_Ffw_Norm (W)	( ~4K) 3840	3840 x 1 x 1 x 1	F32

• Total elements in blk.45: (~224M) 224148992
• Percentage of total elements: 1.98%