Instructions to use eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M

Use Docker

docker model run hf.co/eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M

LM Studio
Jan

vLLM

How to use eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M

Ollama
How to use eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF with Ollama:
```
ollama run hf.co/eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M
```
Unsloth Desktop
Docker Model Runner
How to use eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF with Docker Model Runner:
```
docker model run hf.co/eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M
```

Lemonade

How to use eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull eaddario/DeepSeek-R1-Distill-Llama-8B-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.DeepSeek-R1-Distill-Llama-8B-GGUF-Q4_K_M

List all available models

lemonade list

Atomic Chat

DeepSeek-R1-Distill-Llama-8B-GGUF / scores /DeepSeek-R1-Distill-Llama-8B-Q4_K_M.md

eaddario

Add GGUF internal file structure

66279ab verified over 1 year ago

preview code

Raw

History Blame

83.1 kB

DeepSeek-R1-Distill-Llama-8B-Q4_K_M.gguf - GGUF Internal File Dump

Endian: LITTLE endian

Key Value Metadata Store

There are 36 key-value pairs in this file

POS	TYPE	Count	Key	Value
1	UINT32	1	GGUF.version	3
2	UINT64	1	GGUF.tensor_count	292
3	UINT64	1	GGUF.kv_count	33
4	STRING	1	general.architecture	`llama`
5	STRING	1	general.type	`model`
6	STRING	1	general.name	`DeepSeek R1 Distill Llama 8B`
7	STRING	1	general.basename	`DeepSeek-R1-Distill-Llama`
8	STRING	1	general.size_label	`8B`
9	STRING	1	general.license	`mit`
10	UINT32	1	llama.block_count	32
11	UINT32	1	llama.context_length	131072
12	UINT32	1	llama.embedding_length	4096
13	UINT32	1	llama.feed_forward_length	14336
14	UINT32	1	llama.attention.head_count	32
15	UINT32	1	llama.attention.head_count_kv	8
16	FLOAT32	1	llama.rope.freq_base	500000.0
17	FLOAT32	1	llama.attention.layer_norm_rms_epsilon	1e-05
18	UINT32	1	llama.vocab_size	128256
19	UINT32	1	llama.rope.dimension_count	128
20	STRING	1	tokenizer.ggml.model	`gpt2`
21	STRING	1	tokenizer.ggml.pre	`llama-bpe`
22	[STRING]	128256	tokenizer.ggml.tokens	[ `!`, `"`, `#`, `$`, `%`, ... ]
23	[INT32]	128256	tokenizer.ggml.token_type	[ 1, 1, 1, 1, 1, 1, 1, ... ]
24	[STRING]	280147	tokenizer.ggml.merges	[ `Ġ Ġ`, `Ġ ĠĠĠ`, `ĠĠ ĠĠ`, `ĠĠĠ Ġ`, `i n`, ... ]
25	UINT32	1	tokenizer.ggml.bos_token_id	128000
26	UINT32	1	tokenizer.ggml.eos_token_id	128001
27	UINT32	1	tokenizer.ggml.padding_token_id	128001
28	BOOL	1	tokenizer.ggml.add_bos_token	True
29	BOOL	1	tokenizer.ggml.add_eos_token	False
30	STRING	1	tokenizer.chat_template	`{% if not add_generation_promp`...`{{'<｜Assistant｜>'}}{% endif %}`
31	UINT32	1	general.quantization_version	2
32	UINT32	1	general.file_type	15
33	STRING	1	quantize.imatrix.file	`./imatrix/imatrix-DeepSeek-R1-Distill-Llama-8B-small.dat`
34	STRING	1	quantize.imatrix.dataset	`../../datasets/imatrix/calibration_all_small.txt`
35	INT32	1	quantize.imatrix.entries_count	225
36	INT32	1	quantize.imatrix.chunks_count	1130

Tensors Overview ~8B Elements

Total number of elements in all tensors: 8030261312 Elements

DeepSeek-R1-Distill-Llama-8B-Q4_K_M.gguf - GGUF Internal File Dump
- Key Value Metadata Store
- Tensors Overview ~8B Elements

Tensor Data Offset

This table contains the offset and data segment relative to start of file

T_ID	Tensor Layer Name	Data Offset (B)	Data Size (B)
0	output.weight	0x779a80	0x119d0000
1	output_norm.weight	0x12149a80	0x4000
2	rope_freqs.weight	0x1214da80	0x100
3	token_embd.weight	0x1214db80	0xd746000
4	blk.0.attn_k.weight	0x1f893b80	0x240000
5	blk.0.attn_norm.weight	0x1fad3b80	0x4000
6	blk.0.attn_output.weight	0x1fad7b80	0x900000
7	blk.0.attn_q.weight	0x203d7b80	0x900000
8	blk.0.attn_v.weight	0x20cd7b80	0x2c0000
9	blk.0.ffn_down.weight	0x20f97b80	0x2680000
10	blk.0.ffn_gate.weight	0x23617b80	0x1f80000
11	blk.0.ffn_norm.weight	0x25597b80	0x4000
12	blk.0.ffn_up.weight	0x2559bb80	0x1f80000
13	blk.1.attn_k.weight	0x2751bb80	0x240000
14	blk.1.attn_norm.weight	0x2775bb80	0x4000
15	blk.1.attn_output.weight	0x2775fb80	0x900000
16	blk.1.attn_q.weight	0x2805fb80	0x900000
17	blk.1.attn_v.weight	0x2895fb80	0x2c0000
18	blk.1.ffn_down.weight	0x28c1fb80	0x2680000
19	blk.1.ffn_gate.weight	0x2b29fb80	0x1f80000
20	blk.1.ffn_norm.weight	0x2d21fb80	0x4000
21	blk.1.ffn_up.weight	0x2d223b80	0x1f80000
22	blk.2.attn_k.weight	0x2f1a3b80	0x240000
23	blk.2.attn_norm.weight	0x2f3e3b80	0x4000
24	blk.2.attn_output.weight	0x2f3e7b80	0x900000
25	blk.2.attn_q.weight	0x2fce7b80	0x900000
26	blk.2.attn_v.weight	0x305e7b80	0x2c0000
27	blk.2.ffn_down.weight	0x308a7b80	0x2680000
28	blk.2.ffn_gate.weight	0x32f27b80	0x1f80000
29	blk.2.ffn_norm.weight	0x34ea7b80	0x4000
30	blk.2.ffn_up.weight	0x34eabb80	0x1f80000
31	blk.3.attn_k.weight	0x36e2bb80	0x240000
32	blk.3.attn_norm.weight	0x3706bb80	0x4000
33	blk.3.attn_output.weight	0x3706fb80	0x900000
34	blk.3.attn_q.weight	0x3796fb80	0x900000
35	blk.3.attn_v.weight	0x3826fb80	0x2c0000
36	blk.3.ffn_down.weight	0x3852fb80	0x2680000
37	blk.3.ffn_gate.weight	0x3abafb80	0x1f80000
38	blk.3.ffn_norm.weight	0x3cb2fb80	0x4000
39	blk.3.ffn_up.weight	0x3cb33b80	0x1f80000
40	blk.4.attn_k.weight	0x3eab3b80	0x240000
41	blk.4.attn_norm.weight	0x3ecf3b80	0x4000
42	blk.4.attn_output.weight	0x3ecf7b80	0x900000
43	blk.4.attn_q.weight	0x3f5f7b80	0x900000
44	blk.4.attn_v.weight	0x3fef7b80	0x2c0000
45	blk.4.ffn_down.weight	0x401b7b80	0x2680000
46	blk.4.ffn_gate.weight	0x42837b80	0x1f80000
47	blk.4.ffn_norm.weight	0x447b7b80	0x4000
48	blk.4.ffn_up.weight	0x447bbb80	0x1f80000
49	blk.5.attn_k.weight	0x4673bb80	0x240000
50	blk.5.attn_norm.weight	0x4697bb80	0x4000
51	blk.5.attn_output.weight	0x4697fb80	0x900000
52	blk.5.attn_q.weight	0x4727fb80	0x900000
53	blk.5.attn_v.weight	0x47b7fb80	0x2c0000
54	blk.5.ffn_down.weight	0x47e3fb80	0x2680000
55	blk.5.ffn_gate.weight	0x4a4bfb80	0x1f80000
56	blk.5.ffn_norm.weight	0x4c43fb80	0x4000
57	blk.5.ffn_up.weight	0x4c443b80	0x1f80000
58	blk.6.attn_k.weight	0x4e3c3b80	0x240000
59	blk.6.attn_norm.weight	0x4e603b80	0x4000
60	blk.6.attn_output.weight	0x4e607b80	0x900000
61	blk.6.attn_q.weight	0x4ef07b80	0x900000
62	blk.6.attn_v.weight	0x4f807b80	0x2c0000
63	blk.6.ffn_down.weight	0x4fac7b80	0x2680000
64	blk.6.ffn_gate.weight	0x52147b80	0x1f80000
65	blk.6.ffn_norm.weight	0x540c7b80	0x4000
66	blk.6.ffn_up.weight	0x540cbb80	0x1f80000
67	blk.7.attn_k.weight	0x5604bb80	0x240000
68	blk.7.attn_norm.weight	0x5628bb80	0x4000
69	blk.7.attn_output.weight	0x5628fb80	0x900000
70	blk.7.attn_q.weight	0x56b8fb80	0x900000
71	blk.7.attn_v.weight	0x5748fb80	0x2c0000
72	blk.7.ffn_down.weight	0x5774fb80	0x2680000
73	blk.7.ffn_gate.weight	0x59dcfb80	0x1f80000
74	blk.7.ffn_norm.weight	0x5bd4fb80	0x4000
75	blk.7.ffn_up.weight	0x5bd53b80	0x1f80000
76	blk.8.attn_k.weight	0x5dcd3b80	0x240000
77	blk.8.attn_norm.weight	0x5df13b80	0x4000
78	blk.8.attn_output.weight	0x5df17b80	0x900000
79	blk.8.attn_q.weight	0x5e817b80	0x900000
80	blk.8.attn_v.weight	0x5f117b80	0x2c0000
81	blk.8.ffn_down.weight	0x5f3d7b80	0x2680000
82	blk.8.ffn_gate.weight	0x61a57b80	0x1f80000
83	blk.8.ffn_norm.weight	0x639d7b80	0x4000
84	blk.8.ffn_up.weight	0x639dbb80	0x1f80000
85	blk.9.attn_k.weight	0x6595bb80	0x240000
86	blk.9.attn_norm.weight	0x65b9bb80	0x4000
87	blk.9.attn_output.weight	0x65b9fb80	0x900000
88	blk.9.attn_q.weight	0x6649fb80	0x900000
89	blk.9.attn_v.weight	0x66d9fb80	0x2c0000
90	blk.9.ffn_down.weight	0x6705fb80	0x2680000
91	blk.9.ffn_gate.weight	0x696dfb80	0x1f80000
92	blk.9.ffn_norm.weight	0x6b65fb80	0x4000
93	blk.9.ffn_up.weight	0x6b663b80	0x1f80000
94	blk.10.attn_k.weight	0x6d5e3b80	0x240000
95	blk.10.attn_norm.weight	0x6d823b80	0x4000
96	blk.10.attn_output.weight	0x6d827b80	0x900000
97	blk.10.attn_q.weight	0x6e127b80	0x900000
98	blk.10.attn_v.weight	0x6ea27b80	0x2c0000
99	blk.10.ffn_down.weight	0x6ece7b80	0x2680000
100	blk.10.ffn_gate.weight	0x71367b80	0x1f80000
101	blk.10.ffn_norm.weight	0x732e7b80	0x4000
102	blk.10.ffn_up.weight	0x732ebb80	0x1f80000
103	blk.11.attn_k.weight	0x7526bb80	0x240000
104	blk.11.attn_norm.weight	0x754abb80	0x4000
105	blk.11.attn_output.weight	0x754afb80	0x900000
106	blk.11.attn_q.weight	0x75dafb80	0x900000
107	blk.11.attn_v.weight	0x766afb80	0x2c0000
108	blk.11.ffn_down.weight	0x7696fb80	0x2680000
109	blk.11.ffn_gate.weight	0x78fefb80	0x1f80000
110	blk.11.ffn_norm.weight	0x7af6fb80	0x4000
111	blk.11.ffn_up.weight	0x7af73b80	0x1f80000
112	blk.12.attn_k.weight	0x7cef3b80	0x240000
113	blk.12.attn_norm.weight	0x7d133b80	0x4000
114	blk.12.attn_output.weight	0x7d137b80	0x900000
115	blk.12.attn_q.weight	0x7da37b80	0x900000
116	blk.12.attn_v.weight	0x7e337b80	0x2c0000
117	blk.12.ffn_down.weight	0x7e5f7b80	0x2680000
118	blk.12.ffn_gate.weight	0x80c77b80	0x1f80000
119	blk.12.ffn_norm.weight	0x82bf7b80	0x4000
120	blk.12.ffn_up.weight	0x82bfbb80	0x1f80000
121	blk.13.attn_k.weight	0x84b7bb80	0x240000
122	blk.13.attn_norm.weight	0x84dbbb80	0x4000
123	blk.13.attn_output.weight	0x84dbfb80	0x900000
124	blk.13.attn_q.weight	0x856bfb80	0x900000
125	blk.13.attn_v.weight	0x85fbfb80	0x2c0000
126	blk.13.ffn_down.weight	0x8627fb80	0x2680000
127	blk.13.ffn_gate.weight	0x888ffb80	0x1f80000
128	blk.13.ffn_norm.weight	0x8a87fb80	0x4000
129	blk.13.ffn_up.weight	0x8a883b80	0x1f80000
130	blk.14.attn_k.weight	0x8c803b80	0x240000
131	blk.14.attn_norm.weight	0x8ca43b80	0x4000
132	blk.14.attn_output.weight	0x8ca47b80	0x900000
133	blk.14.attn_q.weight	0x8d347b80	0x900000
134	blk.14.attn_v.weight	0x8dc47b80	0x2c0000
135	blk.14.ffn_down.weight	0x8df07b80	0x2680000
136	blk.14.ffn_gate.weight	0x90587b80	0x1f80000
137	blk.14.ffn_norm.weight	0x92507b80	0x4000
138	blk.14.ffn_up.weight	0x9250bb80	0x1f80000
139	blk.15.attn_k.weight	0x9448bb80	0x240000
140	blk.15.attn_norm.weight	0x946cbb80	0x4000
141	blk.15.attn_output.weight	0x946cfb80	0x900000
142	blk.15.attn_q.weight	0x94fcfb80	0x900000
143	blk.15.attn_v.weight	0x958cfb80	0x2c0000
144	blk.15.ffn_down.weight	0x95b8fb80	0x2680000
145	blk.15.ffn_gate.weight	0x9820fb80	0x1f80000
146	blk.15.ffn_norm.weight	0x9a18fb80	0x4000
147	blk.15.ffn_up.weight	0x9a193b80	0x1f80000
148	blk.16.attn_k.weight	0x9c113b80	0x1b8000
149	blk.16.attn_norm.weight	0x9c2cbb80	0x4000
150	blk.16.attn_output.weight	0x9c2cfb80	0x900000
151	blk.16.attn_q.weight	0x9cbcfb80	0x6e0000
152	blk.16.attn_v.weight	0x9d2afb80	0x240000
153	blk.16.ffn_down.weight	0x9d4efb80	0x2680000
154	blk.16.ffn_gate.weight	0x9fb6fb80	0x1810000
155	blk.16.ffn_norm.weight	0xa137fb80	0x4000
156	blk.16.ffn_up.weight	0xa1383b80	0x1810000
157	blk.17.attn_k.weight	0xa2b93b80	0x1b8000
158	blk.17.attn_norm.weight	0xa2d4bb80	0x4000
159	blk.17.attn_output.weight	0xa2d4fb80	0x900000
160	blk.17.attn_q.weight	0xa364fb80	0x6e0000
161	blk.17.attn_v.weight	0xa3d2fb80	0x240000
162	blk.17.ffn_down.weight	0xa3f6fb80	0x2680000
163	blk.17.ffn_gate.weight	0xa65efb80	0x1810000
164	blk.17.ffn_norm.weight	0xa7dffb80	0x4000
165	blk.17.ffn_up.weight	0xa7e03b80	0x1810000
166	blk.18.attn_k.weight	0xa9613b80	0x1b8000
167	blk.18.attn_norm.weight	0xa97cbb80	0x4000
168	blk.18.attn_output.weight	0xa97cfb80	0x900000
169	blk.18.attn_q.weight	0xaa0cfb80	0x6e0000
170	blk.18.attn_v.weight	0xaa7afb80	0x240000
171	blk.18.ffn_down.weight	0xaa9efb80	0x2680000
172	blk.18.ffn_gate.weight	0xad06fb80	0x1810000
173	blk.18.ffn_norm.weight	0xae87fb80	0x4000
174	blk.18.ffn_up.weight	0xae883b80	0x1810000
175	blk.19.attn_k.weight	0xb0093b80	0x1b8000
176	blk.19.attn_norm.weight	0xb024bb80	0x4000
177	blk.19.attn_output.weight	0xb024fb80	0x900000
178	blk.19.attn_q.weight	0xb0b4fb80	0x6e0000
179	blk.19.attn_v.weight	0xb122fb80	0x240000
180	blk.19.ffn_down.weight	0xb146fb80	0x2680000
181	blk.19.ffn_gate.weight	0xb3aefb80	0x1810000
182	blk.19.ffn_norm.weight	0xb52ffb80	0x4000
183	blk.19.ffn_up.weight	0xb5303b80	0x1810000
184	blk.20.attn_k.weight	0xb6b13b80	0x1b8000
185	blk.20.attn_norm.weight	0xb6ccbb80	0x4000
186	blk.20.attn_output.weight	0xb6ccfb80	0x900000
187	blk.20.attn_q.weight	0xb75cfb80	0x6e0000
188	blk.20.attn_v.weight	0xb7cafb80	0x240000
189	blk.20.ffn_down.weight	0xb7eefb80	0x2680000
190	blk.20.ffn_gate.weight	0xba56fb80	0x1810000
191	blk.20.ffn_norm.weight	0xbbd7fb80	0x4000
192	blk.20.ffn_up.weight	0xbbd83b80	0x1810000
193	blk.21.attn_k.weight	0xbd593b80	0x1b8000
194	blk.21.attn_norm.weight	0xbd74bb80	0x4000
195	blk.21.attn_output.weight	0xbd74fb80	0x900000
196	blk.21.attn_q.weight	0xbe04fb80	0x6e0000
197	blk.21.attn_v.weight	0xbe72fb80	0x240000
198	blk.21.ffn_down.weight	0xbe96fb80	0x2680000
199	blk.21.ffn_gate.weight	0xc0fefb80	0x1810000
200	blk.21.ffn_norm.weight	0xc27ffb80	0x4000
201	blk.21.ffn_up.weight	0xc2803b80	0x1810000
202	blk.22.attn_k.weight	0xc4013b80	0x1b8000
203	blk.22.attn_norm.weight	0xc41cbb80	0x4000
204	blk.22.attn_output.weight	0xc41cfb80	0x900000
205	blk.22.attn_q.weight	0xc4acfb80	0x6e0000
206	blk.22.attn_v.weight	0xc51afb80	0x240000
207	blk.22.ffn_down.weight	0xc53efb80	0x2680000
208	blk.22.ffn_gate.weight	0xc7a6fb80	0x1810000
209	blk.22.ffn_norm.weight	0xc927fb80	0x4000
210	blk.22.ffn_up.weight	0xc9283b80	0x1810000
211	blk.23.attn_k.weight	0xcaa93b80	0x1b8000
212	blk.23.attn_norm.weight	0xcac4bb80	0x4000
213	blk.23.attn_output.weight	0xcac4fb80	0x900000
214	blk.23.attn_q.weight	0xcb54fb80	0x6e0000
215	blk.23.attn_v.weight	0xcbc2fb80	0x240000
216	blk.23.ffn_down.weight	0xcbe6fb80	0x2680000
217	blk.23.ffn_gate.weight	0xce4efb80	0x1810000
218	blk.23.ffn_norm.weight	0xcfcffb80	0x4000
219	blk.23.ffn_up.weight	0xcfd03b80	0x1810000
220	blk.24.attn_k.weight	0xd1513b80	0x1b8000
221	blk.24.attn_norm.weight	0xd16cbb80	0x4000
222	blk.24.attn_output.weight	0xd16cfb80	0x900000
223	blk.24.attn_q.weight	0xd1fcfb80	0x6e0000
224	blk.24.attn_v.weight	0xd26afb80	0x240000
225	blk.24.ffn_down.weight	0xd28efb80	0x2680000
226	blk.24.ffn_gate.weight	0xd4f6fb80	0x1810000
227	blk.24.ffn_norm.weight	0xd677fb80	0x4000
228	blk.24.ffn_up.weight	0xd6783b80	0x1810000
229	blk.25.attn_k.weight	0xd7f93b80	0x1b8000
230	blk.25.attn_norm.weight	0xd814bb80	0x4000
231	blk.25.attn_output.weight	0xd814fb80	0x900000
232	blk.25.attn_q.weight	0xd8a4fb80	0x6e0000
233	blk.25.attn_v.weight	0xd912fb80	0x240000
234	blk.25.ffn_down.weight	0xd936fb80	0x2680000
235	blk.25.ffn_gate.weight	0xdb9efb80	0x1810000
236	blk.25.ffn_norm.weight	0xdd1ffb80	0x4000
237	blk.25.ffn_up.weight	0xdd203b80	0x1810000
238	blk.26.attn_k.weight	0xdea13b80	0x1b8000
239	blk.26.attn_norm.weight	0xdebcbb80	0x4000
240	blk.26.attn_output.weight	0xdebcfb80	0x900000
241	blk.26.attn_q.weight	0xdf4cfb80	0x6e0000
242	blk.26.attn_v.weight	0xdfbafb80	0x240000
243	blk.26.ffn_down.weight	0xdfdefb80	0x2680000
244	blk.26.ffn_gate.weight	0xe246fb80	0x1810000
245	blk.26.ffn_norm.weight	0xe3c7fb80	0x4000
246	blk.26.ffn_up.weight	0xe3c83b80	0x1810000
247	blk.27.attn_k.weight	0xe5493b80	0x1b8000
248	blk.27.attn_norm.weight	0xe564bb80	0x4000
249	blk.27.attn_output.weight	0xe564fb80	0x900000
250	blk.27.attn_q.weight	0xe5f4fb80	0x6e0000
251	blk.27.attn_v.weight	0xe662fb80	0x240000
252	blk.27.ffn_down.weight	0xe686fb80	0x2680000
253	blk.27.ffn_gate.weight	0xe8eefb80	0x1810000
254	blk.27.ffn_norm.weight	0xea6ffb80	0x4000
255	blk.27.ffn_up.weight	0xea703b80	0x1810000
256	blk.28.attn_k.weight	0xebf13b80	0x1b8000
257	blk.28.attn_norm.weight	0xec0cbb80	0x4000
258	blk.28.attn_output.weight	0xec0cfb80	0x900000
259	blk.28.attn_q.weight	0xec9cfb80	0x6e0000
260	blk.28.attn_v.weight	0xed0afb80	0x240000
261	blk.28.ffn_down.weight	0xed2efb80	0x2680000
262	blk.28.ffn_gate.weight	0xef96fb80	0x1810000
263	blk.28.ffn_norm.weight	0xf117fb80	0x4000
264	blk.28.ffn_up.weight	0xf1183b80	0x1810000
265	blk.29.attn_k.weight	0xf2993b80	0x1b8000
266	blk.29.attn_norm.weight	0xf2b4bb80	0x4000
267	blk.29.attn_output.weight	0xf2b4fb80	0x900000
268	blk.29.attn_q.weight	0xf344fb80	0x6e0000
269	blk.29.attn_v.weight	0xf3b2fb80	0x240000
270	blk.29.ffn_down.weight	0xf3d6fb80	0x2680000
271	blk.29.ffn_gate.weight	0xf63efb80	0x1810000
272	blk.29.ffn_norm.weight	0xf7bffb80	0x4000
273	blk.29.ffn_up.weight	0xf7c03b80	0x1810000
274	blk.30.attn_k.weight	0xf9413b80	0x1b8000
275	blk.30.attn_norm.weight	0xf95cbb80	0x4000
276	blk.30.attn_output.weight	0xf95cfb80	0x900000
277	blk.30.attn_q.weight	0xf9ecfb80	0x6e0000
278	blk.30.attn_v.weight	0xfa5afb80	0x240000
279	blk.30.ffn_down.weight	0xfa7efb80	0x2680000
280	blk.30.ffn_gate.weight	0xfce6fb80	0x1810000
281	blk.30.ffn_norm.weight	0xfe67fb80	0x4000
282	blk.30.ffn_up.weight	0xfe683b80	0x1810000
283	blk.31.attn_k.weight	0xffe93b80	0x1b8000
284	blk.31.attn_norm.weight	0x10004bb80	0x4000
285	blk.31.attn_output.weight	0x10004fb80	0x900000
286	blk.31.attn_q.weight	0x10094fb80	0x6e0000
287	blk.31.attn_v.weight	0x10102fb80	0x240000
288	blk.31.ffn_down.weight	0x10126fb80	0x2680000
289	blk.31.ffn_gate.weight	0x1038efb80	0x1810000
290	blk.31.ffn_norm.weight	0x1050ffb80	0x4000
291	blk.31.ffn_up.weight	0x105103b80	0x1810000

Base Tensor Group : ~1B Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
0	output.weight	Output (W)	(~525M) 525336576	4096 x 128256 x 1 x 1	Q4_K
1	output_norm.weight	Output Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
2	rope_freqs.weight	Rope_Freqs (W)	( 64) 64	64 x 1 x 1 x 1	F32
3	token_embd.weight	Token Embedding (W)	(~525M) 525336576	4096 x 128256 x 1 x 1	Q3_K

Total elements in base: ( ~1B) 1050677312
Percentage of total elements: 13.08%

Block 0 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
4	blk.0.attn_k.weight	Block 0 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
5	blk.0.attn_norm.weight	Block 0 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
6	blk.0.attn_output.weight	Block 0 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
7	blk.0.attn_q.weight	Block 0 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
8	blk.0.attn_v.weight	Block 0 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
9	blk.0.ffn_down.weight	Block 0 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
10	blk.0.ffn_gate.weight	Block 0 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
11	blk.0.ffn_norm.weight	Block 0 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
12	blk.0.ffn_up.weight	Block 0 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.0: (~218M) 218112000
Percentage of total elements: 2.72%

Block 1 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
13	blk.1.attn_k.weight	Block 1 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
14	blk.1.attn_norm.weight	Block 1 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
15	blk.1.attn_output.weight	Block 1 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
16	blk.1.attn_q.weight	Block 1 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
17	blk.1.attn_v.weight	Block 1 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
18	blk.1.ffn_down.weight	Block 1 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
19	blk.1.ffn_gate.weight	Block 1 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
20	blk.1.ffn_norm.weight	Block 1 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
21	blk.1.ffn_up.weight	Block 1 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.1: (~218M) 218112000
Percentage of total elements: 2.72%

Block 2 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
22	blk.2.attn_k.weight	Block 2 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
23	blk.2.attn_norm.weight	Block 2 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
24	blk.2.attn_output.weight	Block 2 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
25	blk.2.attn_q.weight	Block 2 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
26	blk.2.attn_v.weight	Block 2 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
27	blk.2.ffn_down.weight	Block 2 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
28	blk.2.ffn_gate.weight	Block 2 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
29	blk.2.ffn_norm.weight	Block 2 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
30	blk.2.ffn_up.weight	Block 2 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.2: (~218M) 218112000
Percentage of total elements: 2.72%

Block 3 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
31	blk.3.attn_k.weight	Block 3 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
32	blk.3.attn_norm.weight	Block 3 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
33	blk.3.attn_output.weight	Block 3 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
34	blk.3.attn_q.weight	Block 3 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
35	blk.3.attn_v.weight	Block 3 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
36	blk.3.ffn_down.weight	Block 3 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
37	blk.3.ffn_gate.weight	Block 3 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
38	blk.3.ffn_norm.weight	Block 3 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
39	blk.3.ffn_up.weight	Block 3 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.3: (~218M) 218112000
Percentage of total elements: 2.72%

Block 4 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
40	blk.4.attn_k.weight	Block 4 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
41	blk.4.attn_norm.weight	Block 4 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
42	blk.4.attn_output.weight	Block 4 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
43	blk.4.attn_q.weight	Block 4 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
44	blk.4.attn_v.weight	Block 4 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
45	blk.4.ffn_down.weight	Block 4 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
46	blk.4.ffn_gate.weight	Block 4 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
47	blk.4.ffn_norm.weight	Block 4 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
48	blk.4.ffn_up.weight	Block 4 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.4: (~218M) 218112000
Percentage of total elements: 2.72%

Block 5 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
49	blk.5.attn_k.weight	Block 5 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
50	blk.5.attn_norm.weight	Block 5 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
51	blk.5.attn_output.weight	Block 5 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
52	blk.5.attn_q.weight	Block 5 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
53	blk.5.attn_v.weight	Block 5 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
54	blk.5.ffn_down.weight	Block 5 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
55	blk.5.ffn_gate.weight	Block 5 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
56	blk.5.ffn_norm.weight	Block 5 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
57	blk.5.ffn_up.weight	Block 5 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.5: (~218M) 218112000
Percentage of total elements: 2.72%

Block 6 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
58	blk.6.attn_k.weight	Block 6 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
59	blk.6.attn_norm.weight	Block 6 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
60	blk.6.attn_output.weight	Block 6 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
61	blk.6.attn_q.weight	Block 6 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
62	blk.6.attn_v.weight	Block 6 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
63	blk.6.ffn_down.weight	Block 6 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
64	blk.6.ffn_gate.weight	Block 6 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
65	blk.6.ffn_norm.weight	Block 6 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
66	blk.6.ffn_up.weight	Block 6 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.6: (~218M) 218112000
Percentage of total elements: 2.72%

Block 7 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
67	blk.7.attn_k.weight	Block 7 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
68	blk.7.attn_norm.weight	Block 7 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
69	blk.7.attn_output.weight	Block 7 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
70	blk.7.attn_q.weight	Block 7 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
71	blk.7.attn_v.weight	Block 7 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
72	blk.7.ffn_down.weight	Block 7 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
73	blk.7.ffn_gate.weight	Block 7 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
74	blk.7.ffn_norm.weight	Block 7 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
75	blk.7.ffn_up.weight	Block 7 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.7: (~218M) 218112000
Percentage of total elements: 2.72%

Block 8 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
76	blk.8.attn_k.weight	Block 8 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
77	blk.8.attn_norm.weight	Block 8 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
78	blk.8.attn_output.weight	Block 8 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
79	blk.8.attn_q.weight	Block 8 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
80	blk.8.attn_v.weight	Block 8 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
81	blk.8.ffn_down.weight	Block 8 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
82	blk.8.ffn_gate.weight	Block 8 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
83	blk.8.ffn_norm.weight	Block 8 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
84	blk.8.ffn_up.weight	Block 8 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.8: (~218M) 218112000
Percentage of total elements: 2.72%

Block 9 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
85	blk.9.attn_k.weight	Block 9 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
86	blk.9.attn_norm.weight	Block 9 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
87	blk.9.attn_output.weight	Block 9 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
88	blk.9.attn_q.weight	Block 9 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
89	blk.9.attn_v.weight	Block 9 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
90	blk.9.ffn_down.weight	Block 9 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
91	blk.9.ffn_gate.weight	Block 9 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
92	blk.9.ffn_norm.weight	Block 9 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
93	blk.9.ffn_up.weight	Block 9 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.9: (~218M) 218112000
Percentage of total elements: 2.72%

Block 10 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
94	blk.10.attn_k.weight	Block 10 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
95	blk.10.attn_norm.weight	Block 10 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
96	blk.10.attn_output.weight	Block 10 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
97	blk.10.attn_q.weight	Block 10 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
98	blk.10.attn_v.weight	Block 10 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
99	blk.10.ffn_down.weight	Block 10 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
100	blk.10.ffn_gate.weight	Block 10 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
101	blk.10.ffn_norm.weight	Block 10 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
102	blk.10.ffn_up.weight	Block 10 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.10: (~218M) 218112000
Percentage of total elements: 2.72%

Block 11 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
103	blk.11.attn_k.weight	Block 11 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
104	blk.11.attn_norm.weight	Block 11 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
105	blk.11.attn_output.weight	Block 11 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
106	blk.11.attn_q.weight	Block 11 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
107	blk.11.attn_v.weight	Block 11 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
108	blk.11.ffn_down.weight	Block 11 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
109	blk.11.ffn_gate.weight	Block 11 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
110	blk.11.ffn_norm.weight	Block 11 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
111	blk.11.ffn_up.weight	Block 11 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.11: (~218M) 218112000
Percentage of total elements: 2.72%

Block 12 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
112	blk.12.attn_k.weight	Block 12 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
113	blk.12.attn_norm.weight	Block 12 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
114	blk.12.attn_output.weight	Block 12 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
115	blk.12.attn_q.weight	Block 12 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
116	blk.12.attn_v.weight	Block 12 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
117	blk.12.ffn_down.weight	Block 12 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
118	blk.12.ffn_gate.weight	Block 12 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
119	blk.12.ffn_norm.weight	Block 12 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
120	blk.12.ffn_up.weight	Block 12 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.12: (~218M) 218112000
Percentage of total elements: 2.72%

Block 13 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
121	blk.13.attn_k.weight	Block 13 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
122	blk.13.attn_norm.weight	Block 13 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
123	blk.13.attn_output.weight	Block 13 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
124	blk.13.attn_q.weight	Block 13 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
125	blk.13.attn_v.weight	Block 13 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
126	blk.13.ffn_down.weight	Block 13 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
127	blk.13.ffn_gate.weight	Block 13 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
128	blk.13.ffn_norm.weight	Block 13 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
129	blk.13.ffn_up.weight	Block 13 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.13: (~218M) 218112000
Percentage of total elements: 2.72%

Block 14 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
130	blk.14.attn_k.weight	Block 14 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
131	blk.14.attn_norm.weight	Block 14 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
132	blk.14.attn_output.weight	Block 14 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
133	blk.14.attn_q.weight	Block 14 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
134	blk.14.attn_v.weight	Block 14 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
135	blk.14.ffn_down.weight	Block 14 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
136	blk.14.ffn_gate.weight	Block 14 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
137	blk.14.ffn_norm.weight	Block 14 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
138	blk.14.ffn_up.weight	Block 14 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.14: (~218M) 218112000
Percentage of total elements: 2.72%

Block 15 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
139	blk.15.attn_k.weight	Block 15 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
140	blk.15.attn_norm.weight	Block 15 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
141	blk.15.attn_output.weight	Block 15 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
142	blk.15.attn_q.weight	Block 15 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
143	blk.15.attn_v.weight	Block 15 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q5_K
144	blk.15.ffn_down.weight	Block 15 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
145	blk.15.ffn_gate.weight	Block 15 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K
146	blk.15.ffn_norm.weight	Block 15 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
147	blk.15.ffn_up.weight	Block 15 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q4_K

Total elements in blk.15: (~218M) 218112000
Percentage of total elements: 2.72%

Block 16 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
148	blk.16.attn_k.weight	Block 16 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
149	blk.16.attn_norm.weight	Block 16 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
150	blk.16.attn_output.weight	Block 16 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
151	blk.16.attn_q.weight	Block 16 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
152	blk.16.attn_v.weight	Block 16 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
153	blk.16.ffn_down.weight	Block 16 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
154	blk.16.ffn_gate.weight	Block 16 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
155	blk.16.ffn_norm.weight	Block 16 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
156	blk.16.ffn_up.weight	Block 16 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.16: (~218M) 218112000
Percentage of total elements: 2.72%

Block 17 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
157	blk.17.attn_k.weight	Block 17 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
158	blk.17.attn_norm.weight	Block 17 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
159	blk.17.attn_output.weight	Block 17 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
160	blk.17.attn_q.weight	Block 17 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
161	blk.17.attn_v.weight	Block 17 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
162	blk.17.ffn_down.weight	Block 17 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
163	blk.17.ffn_gate.weight	Block 17 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
164	blk.17.ffn_norm.weight	Block 17 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
165	blk.17.ffn_up.weight	Block 17 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.17: (~218M) 218112000
Percentage of total elements: 2.72%

Block 18 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
166	blk.18.attn_k.weight	Block 18 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
167	blk.18.attn_norm.weight	Block 18 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
168	blk.18.attn_output.weight	Block 18 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
169	blk.18.attn_q.weight	Block 18 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
170	blk.18.attn_v.weight	Block 18 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
171	blk.18.ffn_down.weight	Block 18 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
172	blk.18.ffn_gate.weight	Block 18 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
173	blk.18.ffn_norm.weight	Block 18 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
174	blk.18.ffn_up.weight	Block 18 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.18: (~218M) 218112000
Percentage of total elements: 2.72%

Block 19 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
175	blk.19.attn_k.weight	Block 19 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
176	blk.19.attn_norm.weight	Block 19 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
177	blk.19.attn_output.weight	Block 19 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
178	blk.19.attn_q.weight	Block 19 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
179	blk.19.attn_v.weight	Block 19 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
180	blk.19.ffn_down.weight	Block 19 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
181	blk.19.ffn_gate.weight	Block 19 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
182	blk.19.ffn_norm.weight	Block 19 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
183	blk.19.ffn_up.weight	Block 19 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.19: (~218M) 218112000
Percentage of total elements: 2.72%

Block 20 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
184	blk.20.attn_k.weight	Block 20 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
185	blk.20.attn_norm.weight	Block 20 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
186	blk.20.attn_output.weight	Block 20 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
187	blk.20.attn_q.weight	Block 20 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
188	blk.20.attn_v.weight	Block 20 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
189	blk.20.ffn_down.weight	Block 20 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
190	blk.20.ffn_gate.weight	Block 20 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
191	blk.20.ffn_norm.weight	Block 20 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
192	blk.20.ffn_up.weight	Block 20 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.20: (~218M) 218112000
Percentage of total elements: 2.72%

Block 21 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
193	blk.21.attn_k.weight	Block 21 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
194	blk.21.attn_norm.weight	Block 21 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
195	blk.21.attn_output.weight	Block 21 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
196	blk.21.attn_q.weight	Block 21 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
197	blk.21.attn_v.weight	Block 21 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
198	blk.21.ffn_down.weight	Block 21 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
199	blk.21.ffn_gate.weight	Block 21 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
200	blk.21.ffn_norm.weight	Block 21 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
201	blk.21.ffn_up.weight	Block 21 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.21: (~218M) 218112000
Percentage of total elements: 2.72%

Block 22 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
202	blk.22.attn_k.weight	Block 22 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
203	blk.22.attn_norm.weight	Block 22 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
204	blk.22.attn_output.weight	Block 22 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
205	blk.22.attn_q.weight	Block 22 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
206	blk.22.attn_v.weight	Block 22 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
207	blk.22.ffn_down.weight	Block 22 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
208	blk.22.ffn_gate.weight	Block 22 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
209	blk.22.ffn_norm.weight	Block 22 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
210	blk.22.ffn_up.weight	Block 22 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.22: (~218M) 218112000
Percentage of total elements: 2.72%

Block 23 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
211	blk.23.attn_k.weight	Block 23 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
212	blk.23.attn_norm.weight	Block 23 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
213	blk.23.attn_output.weight	Block 23 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
214	blk.23.attn_q.weight	Block 23 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
215	blk.23.attn_v.weight	Block 23 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
216	blk.23.ffn_down.weight	Block 23 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
217	blk.23.ffn_gate.weight	Block 23 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
218	blk.23.ffn_norm.weight	Block 23 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
219	blk.23.ffn_up.weight	Block 23 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.23: (~218M) 218112000
Percentage of total elements: 2.72%

Block 24 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
220	blk.24.attn_k.weight	Block 24 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
221	blk.24.attn_norm.weight	Block 24 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
222	blk.24.attn_output.weight	Block 24 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
223	blk.24.attn_q.weight	Block 24 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
224	blk.24.attn_v.weight	Block 24 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
225	blk.24.ffn_down.weight	Block 24 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
226	blk.24.ffn_gate.weight	Block 24 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
227	blk.24.ffn_norm.weight	Block 24 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
228	blk.24.ffn_up.weight	Block 24 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.24: (~218M) 218112000
Percentage of total elements: 2.72%

Block 25 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
229	blk.25.attn_k.weight	Block 25 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
230	blk.25.attn_norm.weight	Block 25 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
231	blk.25.attn_output.weight	Block 25 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
232	blk.25.attn_q.weight	Block 25 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
233	blk.25.attn_v.weight	Block 25 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
234	blk.25.ffn_down.weight	Block 25 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
235	blk.25.ffn_gate.weight	Block 25 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
236	blk.25.ffn_norm.weight	Block 25 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
237	blk.25.ffn_up.weight	Block 25 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.25: (~218M) 218112000
Percentage of total elements: 2.72%

Block 26 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
238	blk.26.attn_k.weight	Block 26 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
239	blk.26.attn_norm.weight	Block 26 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
240	blk.26.attn_output.weight	Block 26 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
241	blk.26.attn_q.weight	Block 26 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
242	blk.26.attn_v.weight	Block 26 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
243	blk.26.ffn_down.weight	Block 26 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
244	blk.26.ffn_gate.weight	Block 26 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
245	blk.26.ffn_norm.weight	Block 26 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
246	blk.26.ffn_up.weight	Block 26 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.26: (~218M) 218112000
Percentage of total elements: 2.72%

Block 27 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
247	blk.27.attn_k.weight	Block 27 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
248	blk.27.attn_norm.weight	Block 27 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
249	blk.27.attn_output.weight	Block 27 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
250	blk.27.attn_q.weight	Block 27 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
251	blk.27.attn_v.weight	Block 27 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
252	blk.27.ffn_down.weight	Block 27 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
253	blk.27.ffn_gate.weight	Block 27 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
254	blk.27.ffn_norm.weight	Block 27 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
255	blk.27.ffn_up.weight	Block 27 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.27: (~218M) 218112000
Percentage of total elements: 2.72%

Block 28 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
256	blk.28.attn_k.weight	Block 28 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
257	blk.28.attn_norm.weight	Block 28 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
258	blk.28.attn_output.weight	Block 28 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
259	blk.28.attn_q.weight	Block 28 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
260	blk.28.attn_v.weight	Block 28 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
261	blk.28.ffn_down.weight	Block 28 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
262	blk.28.ffn_gate.weight	Block 28 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
263	blk.28.ffn_norm.weight	Block 28 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
264	blk.28.ffn_up.weight	Block 28 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.28: (~218M) 218112000
Percentage of total elements: 2.72%

Block 29 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
265	blk.29.attn_k.weight	Block 29 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
266	blk.29.attn_norm.weight	Block 29 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
267	blk.29.attn_output.weight	Block 29 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
268	blk.29.attn_q.weight	Block 29 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
269	blk.29.attn_v.weight	Block 29 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
270	blk.29.ffn_down.weight	Block 29 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
271	blk.29.ffn_gate.weight	Block 29 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
272	blk.29.ffn_norm.weight	Block 29 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
273	blk.29.ffn_up.weight	Block 29 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.29: (~218M) 218112000
Percentage of total elements: 2.72%

Block 30 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
274	blk.30.attn_k.weight	Block 30 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
275	blk.30.attn_norm.weight	Block 30 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
276	blk.30.attn_output.weight	Block 30 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
277	blk.30.attn_q.weight	Block 30 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
278	blk.30.attn_v.weight	Block 30 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
279	blk.30.ffn_down.weight	Block 30 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
280	blk.30.ffn_gate.weight	Block 30 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
281	blk.30.ffn_norm.weight	Block 30 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
282	blk.30.ffn_up.weight	Block 30 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.30: (~218M) 218112000
Percentage of total elements: 2.72%

Block 31 Tensor Group : ~218M Elements

T_ID	Tensor Layer Name	Human Friendly Tensor Layer Name	Elements	Shape	Type
283	blk.31.attn_k.weight	Block 31 Attention Key (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q3_K
284	blk.31.attn_norm.weight	Block 31 Attention Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
285	blk.31.attn_output.weight	Block 31 Attention Output (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q4_K
286	blk.31.attn_q.weight	Block 31 Attention Query (W)	(~17M) 16777216	4096 x 4096 x 1 x 1	Q3_K
287	blk.31.attn_v.weight	Block 31 Attention Value (W)	( ~4M) 4194304	4096 x 1024 x 1 x 1	Q4_K
288	blk.31.ffn_down.weight	Block 31 Feed-Forward Network "Down" (W)	(~59M) 58720256	14336 x 4096 x 1 x 1	Q5_K
289	blk.31.ffn_gate.weight	Block 31 Feed-Forward Network "Gate" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K
290	blk.31.ffn_norm.weight	Block 31 Feed-Forward Network Normalization (W)	( ~4K) 4096	4096 x 1 x 1 x 1	F32
291	blk.31.ffn_up.weight	Block 31 Feed-Forward Network "Up" (W)	(~59M) 58720256	4096 x 14336 x 1 x 1	Q3_K

Total elements in blk.31: (~218M) 218112000
Percentage of total elements: 2.72%