0xSero commited on
Commit
381eb63
·
verified ·
1 Parent(s): b80c337

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
+ model.safetensors.index.json filter=lfs diff=lfs merge=lfs -text
LICENSE ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MIT License
2
+
3
+ Copyright (c) 2026 Zhipu AI
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
README.md ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: zai-org/GLM-5.2
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - moe
7
+ - reap
8
+ - pruning
9
+ - router-kd
10
+ - knowledge
11
+ - nvfp4
12
+ - glm
13
+ - glm-5.2
14
+ ---
15
+
16
+ # GLM-5.2-504B-K — knowledge-augmented REAP keep-168 (full-data Router-KD, NVFP4)
17
+
18
+ The **"K-cut"** sibling of [`0xSero/GLM-5.2-504B`](https://huggingface.co/0xSero/GLM-5.2-504B): the
19
+ same ~504B / keep-168 budget, but the expert selection is **biased toward knowledge & reasoning** —
20
+ the winning top-160 core (kept bit-for-bit) **plus the 8 highest-priority knowledge-exclusive experts
21
+ per layer** that coding-saliency pruning drops. Recovered with gate-only **Router-KD trained on the
22
+ FULL calibration set (~18.6k real traces)** — 6x the data of the first-pass cuts.
23
+
24
+ ## Sponsor
25
+ 8x NVIDIA B200 sponsored by [Lambda](https://lambda.ai). Thank you.
26
+
27
+ ## Why this variant exists
28
+ REAP saliency computed from coding traces under-weights experts that fire mainly on
29
+ reasoning/knowledge. The K-cut deliberately re-includes them — trading a sliver of coding-saliency
30
+ coverage for broader knowledge coverage. Reach for this on knowledge/reasoning-heavy workloads; use
31
+ the plain [`GLM-5.2-504B`](https://huggingface.co/0xSero/GLM-5.2-504B) otherwise.
32
+
33
+ ## Eval (n=2000 held-out real prompts, raw, no max_tokens / no timeout)
34
+ | metric | GLM-5.2-504B-K (this) | GLM-5.2-504B (plain floor) |
35
+ |---|---|---|
36
+ | attractor / loop rate | **0.078** | 0.072 |
37
+ | natural-EOS rate | 0.923 | 0.928 |
38
+ | distinct-4 | 0.881 | 0.880 |
39
+ | median tokens | 1232 | 1267 |
40
+
41
+ On the loop metric this is **at parity with (or better than) the plain-cut floor**. The residual loops are inherent to GLM-5.2 itself (the unpruned teacher
42
+ loops on the same prompts), so neither cut "fixes" them — this one buys knowledge-expert coverage.
43
+
44
+ ## Serving (vLLM)
45
+ ```bash
46
+ vllm serve 0xSero/GLM-5.2-504B-K --tensor-parallel-size 8 \
47
+ --quantization modelopt_fp4 --kv-cache-dtype fp8 --trust-remote-code --max-model-len 262144
48
+ ```
49
+
50
+ ---
51
+ *REAP knowledge-augmented cut + full-data Router-KD. Compute sponsored by [Lambda](https://lambda.ai).*
chat_template.jinja ADDED
@@ -0,0 +1,119 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [gMASK]<sop>
2
+ {%- set effective_reasoning_effort = 'high' if reasoning_effort is defined and reasoning_effort == 'high' else 'max' -%}
3
+ {%- if (enable_thinking is not defined or enable_thinking) and effective_reasoning_effort is not none -%}<|system|>Reasoning Effort: {{ effective_reasoning_effort | capitalize }}{%- endif -%}
4
+ {%- if tools -%}
5
+ {%- macro tool_to_json(tool) -%}
6
+ {%- set ns_tool = namespace(first=true) -%}
7
+ {{ '{' -}}
8
+ {%- for k, v in tool.items() -%}
9
+ {%- if k != 'defer_loading' and k != 'strict' -%}
10
+ {%- if not ns_tool.first -%}{{- ', ' -}}{%- endif -%}
11
+ {%- set ns_tool.first = false -%}
12
+ "{{ k }}": {{ v | tojson(ensure_ascii=False) }}
13
+ {%- endif -%}
14
+ {%- endfor -%}
15
+ {{- '}' -}}
16
+ {%- endmacro -%}
17
+ <|system|>
18
+ # Tools
19
+
20
+ You may call one or more functions to assist with the user query.
21
+
22
+ You are provided with function signatures within <tools></tools> XML tags:
23
+ <tools>
24
+ {% for tool in tools %}
25
+ {%- if 'function' in tool -%}
26
+ {%- set tool = tool['function'] -%}
27
+ {%- endif -%}
28
+ {% if tool.defer_loading is not defined or not tool.defer_loading %}
29
+ {{ tool_to_json(tool) }}
30
+ {% endif %}
31
+ {% endfor %}
32
+ </tools>
33
+
34
+ For each function call, output the function name and arguments within the following XML format:
35
+ <tool_call>{function-name}<arg_key>{arg-key-1}</arg_key><arg_value>{arg-value-1}</arg_value><arg_key>{arg-key-2}</arg_key><arg_value>{arg-value-2}</arg_value>...</tool_call>{%- endif -%}
36
+ {%- macro visible_text(content) -%}
37
+ {%- if content is string -%}
38
+ {{- content }}
39
+ {%- elif content is iterable and content is not mapping -%}
40
+ {%- for item in content -%}
41
+ {%- if item is mapping and item.type == 'text' -%}
42
+ {{- item.text }}
43
+ {%- elif item is string -%}
44
+ {{- item }}
45
+ {%- elif item is mapping and item.type in ['image', 'image_url', 'video', 'video_url', 'audio', 'audio_url', 'input_audio'] -%}
46
+ {%- set media_type = item.type | replace('_url', '') | replace('input_', '') -%}
47
+ {{- "<reminder>You are unable to process this " ~ media_type ~ " because you don't have multi-modal input ability. Try different methods.</reminder>" }}
48
+ {%- endif -%}
49
+ {%- endfor -%}
50
+ {%- else -%}
51
+ {{- content }}
52
+ {%- endif -%}
53
+ {%- endmacro -%}
54
+ {%- set ns = namespace(last_user_index=-1) -%}
55
+ {%- for m in messages %}
56
+ {%- if m.role == 'user' %}
57
+ {%- set ns.last_user_index = loop.index0 -%}
58
+ {%- endif %}
59
+ {%- endfor %}
60
+ {%- for m in messages -%}
61
+ {%- if m.role == 'user' -%}<|user|>{{ visible_text(m.content) }}
62
+ {%- elif m.role == 'assistant' -%}
63
+ <|assistant|>
64
+ {%- set content = visible_text(m.content) %}
65
+ {%- if m.reasoning_content is string %}
66
+ {%- set reasoning_content = m.reasoning_content %}
67
+ {%- elif '</think>' in content %}
68
+ {%- set reasoning_content = content.split('</think>')[0].split('<think>')[-1] %}
69
+ {%- set content = content.split('</think>')[-1] %}
70
+ {%- endif %}
71
+ {%- if ((clear_thinking is defined and not clear_thinking) or loop.index0 > ns.last_user_index) and reasoning_content is defined -%}
72
+ {{ '<think>' + reasoning_content + '</think>'}}
73
+ {%- else -%}
74
+ {{ '<think></think>' }}
75
+ {%- endif -%}
76
+ {%- if content.strip() -%}
77
+ {{ content.strip() }}
78
+ {%- endif -%}
79
+ {% if m.tool_calls %}
80
+ {% for tc in m.tool_calls %}
81
+ {%- if tc.function %}
82
+ {%- set tc = tc.function %}
83
+ {%- endif %}
84
+ {{- '<tool_call>' + tc.name -}}
85
+ {% set _args = tc.arguments %}{% for k, v in _args.items() %}<arg_key>{{ k }}</arg_key><arg_value>{{ v | tojson(ensure_ascii=False) if v is not string else v }}</arg_value>{% endfor %}</tool_call>{% endfor %}
86
+ {% endif %}
87
+ {%- elif m.role == 'tool' -%}
88
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
89
+ {{- '<|observation|>' -}}
90
+ {%- endif %}
91
+ {%- if m.content is string -%}
92
+ {{- '<tool_response>' + m.content + '</tool_response>' -}}
93
+ {%- elif m.content is iterable and m.content is not mapping and m.content and m.content.0.type == "tool_reference" -%}
94
+ {{- '<tool_response><tools>\n' -}}
95
+ {% for tr in m.content %}
96
+ {%- for tool in tools -%}
97
+ {%- if 'function' in tool -%}
98
+ {%- set tool = tool['function'] -%}
99
+ {%- endif -%}
100
+ {%- if tool.name == tr.name -%}
101
+ {{- tool_to_json(tool) + '\n' -}}
102
+ {%- endif -%}
103
+ {%- endfor -%}
104
+ {%- endfor -%}
105
+ {{- '</tools></tool_response>' -}}
106
+ {%- elif m.content is iterable and m.content is not mapping and m.content and m.content.0 is mapping and m.content.0.output is defined -%}
107
+ {%- for tr in m.content -%}
108
+ {{- '<tool_response>' + tr.output + '</tool_response>' -}}
109
+ {%- endfor -%}
110
+ {%- else -%}
111
+ {{- '<tool_response>' + visible_text(m.content) + '</tool_response>' -}}
112
+ {% endif -%}
113
+ {%- elif m.role == 'system' -%}
114
+ <|system|>{{ visible_text(m.content) }}
115
+ {%- endif -%}
116
+ {%- endfor -%}
117
+ {%- if add_generation_prompt -%}
118
+ <|assistant|>{{- '<think></think>' if (enable_thinking is defined and not enable_thinking) else '<think>' -}}
119
+ {%- endif -%}
config.json ADDED
@@ -0,0 +1,418 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "GlmMoeDsaForCausalLM"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "dtype": "bfloat16",
8
+ "eos_token_id": [
9
+ 154820,
10
+ 154827,
11
+ 154829
12
+ ],
13
+ "ep_size": 1,
14
+ "first_k_dense_replace": 3,
15
+ "head_dim": 192,
16
+ "hidden_act": "silu",
17
+ "hidden_size": 6144,
18
+ "index_head_dim": 128,
19
+ "index_n_heads": 32,
20
+ "index_share_for_mtp_iteration": true,
21
+ "index_skip_topk_offset": 3,
22
+ "index_topk": 2048,
23
+ "index_topk_freq": 4,
24
+ "index_topk_pattern": null,
25
+ "indexer_rope_interleave": true,
26
+ "indexer_types": [
27
+ "full",
28
+ "full",
29
+ "full",
30
+ "shared",
31
+ "shared",
32
+ "shared",
33
+ "full",
34
+ "shared",
35
+ "shared",
36
+ "shared",
37
+ "full",
38
+ "shared",
39
+ "shared",
40
+ "shared",
41
+ "full",
42
+ "shared",
43
+ "shared",
44
+ "shared",
45
+ "full",
46
+ "shared",
47
+ "shared",
48
+ "shared",
49
+ "full",
50
+ "shared",
51
+ "shared",
52
+ "shared",
53
+ "full",
54
+ "shared",
55
+ "shared",
56
+ "shared",
57
+ "full",
58
+ "shared",
59
+ "shared",
60
+ "shared",
61
+ "full",
62
+ "shared",
63
+ "shared",
64
+ "shared",
65
+ "full",
66
+ "shared",
67
+ "shared",
68
+ "shared",
69
+ "full",
70
+ "shared",
71
+ "shared",
72
+ "shared",
73
+ "full",
74
+ "shared",
75
+ "shared",
76
+ "shared",
77
+ "full",
78
+ "shared",
79
+ "shared",
80
+ "shared",
81
+ "full",
82
+ "shared",
83
+ "shared",
84
+ "shared",
85
+ "full",
86
+ "shared",
87
+ "shared",
88
+ "shared",
89
+ "full",
90
+ "shared",
91
+ "shared",
92
+ "shared",
93
+ "full",
94
+ "shared",
95
+ "shared",
96
+ "shared",
97
+ "full",
98
+ "shared",
99
+ "shared",
100
+ "shared",
101
+ "full",
102
+ "shared",
103
+ "shared",
104
+ "shared"
105
+ ],
106
+ "initializer_range": 0.02,
107
+ "intermediate_size": 12288,
108
+ "kv_lora_rank": 512,
109
+ "max_position_embeddings": 1048576,
110
+ "mlp_layer_types": [
111
+ "dense",
112
+ "dense",
113
+ "dense",
114
+ "sparse",
115
+ "sparse",
116
+ "sparse",
117
+ "sparse",
118
+ "sparse",
119
+ "sparse",
120
+ "sparse",
121
+ "sparse",
122
+ "sparse",
123
+ "sparse",
124
+ "sparse",
125
+ "sparse",
126
+ "sparse",
127
+ "sparse",
128
+ "sparse",
129
+ "sparse",
130
+ "sparse",
131
+ "sparse",
132
+ "sparse",
133
+ "sparse",
134
+ "sparse",
135
+ "sparse",
136
+ "sparse",
137
+ "sparse",
138
+ "sparse",
139
+ "sparse",
140
+ "sparse",
141
+ "sparse",
142
+ "sparse",
143
+ "sparse",
144
+ "sparse",
145
+ "sparse",
146
+ "sparse",
147
+ "sparse",
148
+ "sparse",
149
+ "sparse",
150
+ "sparse",
151
+ "sparse",
152
+ "sparse",
153
+ "sparse",
154
+ "sparse",
155
+ "sparse",
156
+ "sparse",
157
+ "sparse",
158
+ "sparse",
159
+ "sparse",
160
+ "sparse",
161
+ "sparse",
162
+ "sparse",
163
+ "sparse",
164
+ "sparse",
165
+ "sparse",
166
+ "sparse",
167
+ "sparse",
168
+ "sparse",
169
+ "sparse",
170
+ "sparse",
171
+ "sparse",
172
+ "sparse",
173
+ "sparse",
174
+ "sparse",
175
+ "sparse",
176
+ "sparse",
177
+ "sparse",
178
+ "sparse",
179
+ "sparse",
180
+ "sparse",
181
+ "sparse",
182
+ "sparse",
183
+ "sparse",
184
+ "sparse",
185
+ "sparse",
186
+ "sparse",
187
+ "sparse",
188
+ "sparse"
189
+ ],
190
+ "model_type": "glm_moe_dsa",
191
+ "moe_intermediate_size": 2048,
192
+ "moe_layer_freq": 1,
193
+ "n_group": 1,
194
+ "n_routed_experts": 168,
195
+ "n_shared_experts": 1,
196
+ "norm_topk_prob": true,
197
+ "num_attention_heads": 64,
198
+ "num_experts_per_tok": 8,
199
+ "num_hidden_layers": 78,
200
+ "num_key_value_heads": 64,
201
+ "num_nextn_predict_layers": 1,
202
+ "pad_token_id": 154820,
203
+ "pretraining_tp": 1,
204
+ "q_lora_rank": 2048,
205
+ "qk_head_dim": 256,
206
+ "qk_nope_head_dim": 192,
207
+ "qk_rope_head_dim": 64,
208
+ "rms_norm_eps": 1e-05,
209
+ "rope_interleave": true,
210
+ "rope_parameters": {
211
+ "rope_theta": 8000000,
212
+ "rope_type": "default"
213
+ },
214
+ "routed_scaling_factor": 2.5,
215
+ "scoring_func": "sigmoid",
216
+ "tie_word_embeddings": false,
217
+ "topk_group": 1,
218
+ "topk_method": "noaux_tc",
219
+ "transformers_version": "5.12.0",
220
+ "use_cache": true,
221
+ "v_head_dim": 256,
222
+ "vocab_size": 154880,
223
+ "quantization_config": {
224
+ "config_groups": {
225
+ "group_0": {
226
+ "input_activations": {
227
+ "dynamic": false,
228
+ "num_bits": 4,
229
+ "type": "float",
230
+ "group_size": 16
231
+ },
232
+ "weights": {
233
+ "dynamic": false,
234
+ "num_bits": 4,
235
+ "type": "float",
236
+ "group_size": 16
237
+ },
238
+ "targets": [
239
+ "Linear"
240
+ ]
241
+ }
242
+ },
243
+ "ignore": [
244
+ "lm_head",
245
+ "model.layers.0.mlp*",
246
+ "model.layers.0.self_attn*",
247
+ "model.layers.0.self_attn.indexer*",
248
+ "model.layers.1.mlp*",
249
+ "model.layers.1.self_attn*",
250
+ "model.layers.1.self_attn.indexer*",
251
+ "*shared_experts*",
252
+ "model.layers.10.self_attn*",
253
+ "model.layers.10.self_attn.indexer*",
254
+ "model.layers.11.self_attn*",
255
+ "model.layers.11.self_attn.indexer*",
256
+ "model.layers.12.self_attn*",
257
+ "model.layers.12.self_attn.indexer*",
258
+ "model.layers.13.self_attn*",
259
+ "model.layers.13.self_attn.indexer*",
260
+ "model.layers.14.self_attn*",
261
+ "model.layers.14.self_attn.indexer*",
262
+ "model.layers.15.self_attn*",
263
+ "model.layers.15.self_attn.indexer*",
264
+ "model.layers.16.self_attn*",
265
+ "model.layers.16.self_attn.indexer*",
266
+ "model.layers.17.self_attn*",
267
+ "model.layers.17.self_attn.indexer*",
268
+ "model.layers.18.self_attn*",
269
+ "model.layers.18.self_attn.indexer*",
270
+ "model.layers.19.self_attn*",
271
+ "model.layers.19.self_attn.indexer*",
272
+ "model.layers.2.mlp*",
273
+ "model.layers.2.self_attn*",
274
+ "model.layers.2.self_attn.indexer*",
275
+ "model.layers.20.self_attn*",
276
+ "model.layers.20.self_attn.indexer*",
277
+ "model.layers.21.self_attn*",
278
+ "model.layers.21.self_attn.indexer*",
279
+ "model.layers.22.self_attn*",
280
+ "model.layers.22.self_attn.indexer*",
281
+ "model.layers.23.self_attn*",
282
+ "model.layers.23.self_attn.indexer*",
283
+ "model.layers.24.self_attn*",
284
+ "model.layers.24.self_attn.indexer*",
285
+ "model.layers.25.self_attn*",
286
+ "model.layers.25.self_attn.indexer*",
287
+ "model.layers.26.self_attn*",
288
+ "model.layers.26.self_attn.indexer*",
289
+ "model.layers.27.self_attn*",
290
+ "model.layers.27.self_attn.indexer*",
291
+ "model.layers.28.self_attn*",
292
+ "model.layers.28.self_attn.indexer*",
293
+ "model.layers.29.self_attn*",
294
+ "model.layers.29.self_attn.indexer*",
295
+ "model.layers.3.self_attn*",
296
+ "model.layers.3.self_attn.indexer*",
297
+ "model.layers.30.self_attn*",
298
+ "model.layers.30.self_attn.indexer*",
299
+ "model.layers.31.self_attn*",
300
+ "model.layers.31.self_attn.indexer*",
301
+ "model.layers.32.self_attn*",
302
+ "model.layers.32.self_attn.indexer*",
303
+ "model.layers.33.self_attn*",
304
+ "model.layers.33.self_attn.indexer*",
305
+ "model.layers.34.self_attn*",
306
+ "model.layers.34.self_attn.indexer*",
307
+ "model.layers.35.self_attn*",
308
+ "model.layers.35.self_attn.indexer*",
309
+ "model.layers.36.self_attn*",
310
+ "model.layers.36.self_attn.indexer*",
311
+ "model.layers.37.self_attn*",
312
+ "model.layers.37.self_attn.indexer*",
313
+ "model.layers.38.self_attn*",
314
+ "model.layers.38.self_attn.indexer*",
315
+ "model.layers.39.self_attn*",
316
+ "model.layers.39.self_attn.indexer*",
317
+ "model.layers.4.self_attn*",
318
+ "model.layers.4.self_attn.indexer*",
319
+ "model.layers.40.self_attn*",
320
+ "model.layers.40.self_attn.indexer*",
321
+ "model.layers.41.self_attn*",
322
+ "model.layers.41.self_attn.indexer*",
323
+ "model.layers.42.self_attn*",
324
+ "model.layers.42.self_attn.indexer*",
325
+ "model.layers.43.self_attn*",
326
+ "model.layers.43.self_attn.indexer*",
327
+ "model.layers.44.self_attn*",
328
+ "model.layers.44.self_attn.indexer*",
329
+ "model.layers.45.self_attn*",
330
+ "model.layers.45.self_attn.indexer*",
331
+ "model.layers.46.self_attn*",
332
+ "model.layers.46.self_attn.indexer*",
333
+ "model.layers.47.self_attn*",
334
+ "model.layers.47.self_attn.indexer*",
335
+ "model.layers.48.self_attn*",
336
+ "model.layers.48.self_attn.indexer*",
337
+ "model.layers.49.self_attn*",
338
+ "model.layers.49.self_attn.indexer*",
339
+ "model.layers.5.self_attn*",
340
+ "model.layers.5.self_attn.indexer*",
341
+ "model.layers.50.self_attn*",
342
+ "model.layers.50.self_attn.indexer*",
343
+ "model.layers.51.self_attn*",
344
+ "model.layers.51.self_attn.indexer*",
345
+ "model.layers.52.self_attn*",
346
+ "model.layers.52.self_attn.indexer*",
347
+ "model.layers.53.self_attn*",
348
+ "model.layers.53.self_attn.indexer*",
349
+ "model.layers.54.self_attn*",
350
+ "model.layers.54.self_attn.indexer*",
351
+ "model.layers.55.self_attn*",
352
+ "model.layers.55.self_attn.indexer*",
353
+ "model.layers.56.self_attn*",
354
+ "model.layers.56.self_attn.indexer*",
355
+ "model.layers.57.self_attn*",
356
+ "model.layers.57.self_attn.indexer*",
357
+ "model.layers.58.self_attn*",
358
+ "model.layers.58.self_attn.indexer*",
359
+ "model.layers.59.self_attn*",
360
+ "model.layers.59.self_attn.indexer*",
361
+ "model.layers.6.self_attn*",
362
+ "model.layers.6.self_attn.indexer*",
363
+ "model.layers.60.self_attn*",
364
+ "model.layers.60.self_attn.indexer*",
365
+ "model.layers.61.self_attn*",
366
+ "model.layers.61.self_attn.indexer*",
367
+ "model.layers.62.self_attn*",
368
+ "model.layers.62.self_attn.indexer*",
369
+ "model.layers.63.self_attn*",
370
+ "model.layers.63.self_attn.indexer*",
371
+ "model.layers.64.self_attn*",
372
+ "model.layers.64.self_attn.indexer*",
373
+ "model.layers.65.self_attn*",
374
+ "model.layers.65.self_attn.indexer*",
375
+ "model.layers.66.self_attn*",
376
+ "model.layers.66.self_attn.indexer*",
377
+ "model.layers.67.self_attn*",
378
+ "model.layers.67.self_attn.indexer*",
379
+ "model.layers.68.self_attn*",
380
+ "model.layers.68.self_attn.indexer*",
381
+ "model.layers.69.self_attn*",
382
+ "model.layers.69.self_attn.indexer*",
383
+ "model.layers.7.self_attn*",
384
+ "model.layers.7.self_attn.indexer*",
385
+ "model.layers.70.self_attn*",
386
+ "model.layers.70.self_attn.indexer*",
387
+ "model.layers.71.self_attn*",
388
+ "model.layers.71.self_attn.indexer*",
389
+ "model.layers.72.self_attn*",
390
+ "model.layers.72.self_attn.indexer*",
391
+ "model.layers.73.self_attn*",
392
+ "model.layers.73.self_attn.indexer*",
393
+ "model.layers.74.self_attn*",
394
+ "model.layers.74.self_attn.indexer*",
395
+ "model.layers.75.self_attn*",
396
+ "model.layers.75.self_attn.indexer*",
397
+ "model.layers.76.self_attn*",
398
+ "model.layers.76.self_attn.indexer*",
399
+ "model.layers.77.self_attn*",
400
+ "model.layers.77.self_attn.indexer*",
401
+ "model.layers.8.self_attn*",
402
+ "model.layers.8.self_attn.indexer*",
403
+ "model.layers.9.self_attn*",
404
+ "model.layers.9.self_attn.indexer*",
405
+ "model.layers.78.eh_proj*",
406
+ "model.layers.78.self_attn*",
407
+ "model.layers.78.self_attn.indexer*",
408
+ "model.layers.78.mlp.gate*",
409
+ "model.layers.78.mlp.shared_experts*"
410
+ ],
411
+ "quant_algo": "NVFP4",
412
+ "producer": {
413
+ "name": "modelopt",
414
+ "version": "0.39.0.dev290+gf9d9a71de.d20260214"
415
+ },
416
+ "quant_method": "modelopt"
417
+ }
418
+ }
generation_config.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "eos_token_id": [
4
+ 154820,
5
+ 154827,
6
+ 154829
7
+ ],
8
+ "pad_token_id": 154820,
9
+ "temperature": 1.0,
10
+ "top_p": 0.95,
11
+ "transformers_version": "5.12.0"
12
+ }
model-00001.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e32eb17744ce168464db1e52af4fb3466a0b2f0d25e930f64bf097ed064e5562
3
+ size 5000912520
model-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:926df1b551c1d19fe56730b5d705298cf859e18ce718fdf41e04ffdd3ebba3ec
3
+ size 5000636364
model-00004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1367004c73763aaf5309bd7e24e387e59f254a593857c07973875a03f625452
3
+ size 5166417984
model-00005.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc4a23a2ef1259e4b8f72cdaf98308d56d88f4b0c041ea795678ec2fda02b246
3
+ size 5000910116
model-00009.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3236d6d8f76afef822f4d5c7e04add890a92503f5a87b4c682e980d4f865d6d0
3
+ size 5000241880
model-00011.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84aeb90f97ed617c77f2cf1d24ecddef737717db14b043988cbc341f4ac40e17
3
+ size 5006010796
model-00012.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f1c499a02258f7a02cdb9c74957dd5c147b408a2a56990a6dc2cc6e793bf149
3
+ size 5001422756
model-00013.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eaad58ef5b6d8201a3226c483a0ffc517a8abc6ec18fe098719126fc57de777c
3
+ size 5005596112
model-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:522f8001146b46ff930a805ba9c29be328cbb229efc0ab945be3b260fdf4dce8
3
+ size 5006010788
model-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:519be3732637e34abde9b962b80c14debee206eb90918734b9057ab02beedc20
3
+ size 5001422748
model-00020.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:350ed3d8ee410f0cd9822950b8e3080565eb5cbd8131449b588fc356d44f37a4
3
+ size 5002972344
model-00021.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72f51dc0ad2322b37b1b11c726219b444841a3d7464a5bf63da31e3ec99cb0e9
3
+ size 5001555720
model-00022.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3d4d4cfadd955335d7079060a795defd2e367831849f50ef1435897ac748866
3
+ size 5001422892
model-00025.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8eee33e55fc294ed188c11c53d06e4a15f3811112c53c3932df1d2b666c7a6cb
3
+ size 5000909684
model-00027.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2379e2df9b56ca8f296204b78c653291b92867a453aa8a88e659a66a51756d2f
3
+ size 5001422804
model-00028.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62a9ea869d167e5f9343140203d50a042d25c4704e037ca41c5297e340c0a8f9
3
+ size 5003105772
model-00030.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:826e8eb1951b0fd4790218484fb22dd676eb8a880a3e6c53f659064c0ed26ea1
3
+ size 5001422948
model-00031.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95bc65aa72d7c3cdaa61d2e1453030cedcbf4a288434db02176841c16a79b76c
3
+ size 5001422788
model-00032.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:910f4c775e05c9d12104670b5d95b8b004212c10992ffebaa572d84b1a902e2c
3
+ size 5003105764
model-00033.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0e3a5af36aafe686ef4395e282f9a346e71ae86d77ec702907674a546126f31
3
+ size 5001422684
model-00034.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d076e85b7bd7f30318fd54dffa0e9611c50a45df7c048d98f7c17c6239d2814
3
+ size 5001422052
model-00035.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90d598c9c665a1bb56fe7aa7777a78be550ec88123783c3771f138b2c0f975c7
3
+ size 5001422148
model-00036.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0499790d617a3f20ca82fdea339e63bf380d68c9c6e8313594d250b6c8066f9
3
+ size 5003105788
model-00037.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b83490bc9bd65e903e97cd6d08bc85e5c6349ce68e65bb60eb31f6bc7cedf8c0
3
+ size 5001422740
model-00038.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44a51b916cc7308e9a8f3f5d84369e5a0555c994953dee587f137f2a17de5ccd
3
+ size 5001422964
model-00039.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6e5665442cb7786318bc751a80b0f8207abeb0acec84a6c983511481b87dc04
3
+ size 5006010644
model-00042.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c74d7e0a6fb088f94c94a403402de2a953b41c230953966f7747eefb59326a4
3
+ size 5006010764
model-00043.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3bd55fd96ba81cd04212f471de12931167f51368b0131b7521c55d5ef8e54f3
3
+ size 5001421292
model-00044.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0833692890268a635153700d3ce669aa847c09f4ac09a26971cf5d322f9cec3b
3
+ size 5003105716
model-00046.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6f5a3286732329777d8e6851545a64d1caf9d12bb918c87d61b638617862f5b
3
+ size 5006010812
model-00047.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4d4270ec45e070d7fd7151c4e78d746d2e772727749f8f8b966ca8d9f58360e
3
+ size 5001422764
model-00049.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6164122cb7e3e90faf09e0457b2aa92717d195c1fe295cc1ef97e3aa25aa576
3
+ size 5006010708
model-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:406f00ee2be46b9a50ba023e9cf35d66ce50890081f276719d0a477f825473d5
3
+ size 5001422948
model-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d59986622f67249c501100c5df41f36c047b042d93ba7342cd8483f1ca30146c
3
+ size 5005091788
model-00054.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d491b893b39b7e133228e8fb7f6efc7d401f3d92c008545c1bf2721fca79daa3
3
+ size 5001422940
model-00055.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03d910b6456af7f9b1520f1d05b3af90cd7715db3f666d8ae634453f5392a78e
3
+ size 5112282228
model-00056.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1137a7c2f03d8692df34c197a8fdeb1a674b8d3ba999261b432c6410d897367c
3
+ size 5005498036
model-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab5b10eccbb5de97322f8895636d0c6892d5c0ec8fa07089c612423d437bbaed
3
+ size 5001422988
model-00058.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc4d1b6ae4c738eb485ce2c6e3e8a8c9e764361a93d443e870bc1117e657efa1
3
+ size 5001422780
model-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04d4321b5dd0ab4124e08b71813467cfa085ecd2d1bd1e9ab73045d190feab58
3
+ size 5004367132
model-00062.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1335ab687f82bc394a095c591449547daee1fddd6447dac0215b36e7ed74a03b
3
+ size 5008224104
model-00063.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d07c8d923bbba0bb61e2afb8bf23a0ad0917a01dd574e9347c98c4d8425572d8
3
+ size 2515249728
model.safetensors.index.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fe40b894556e2aa4b0580ddd0d9fc1fd638f64aa04ecc43989c9030b056e8a3
3
+ size 12706968
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19e773648cb4e65de8660ea6365e10acca112d42a854923df93db4a6f333a82d
3
+ size 20217442