picocreator commited on
Commit
1c8e963
·
verified ·
1 Parent(s): 6491227

Add files using upload-large-folder tool

Browse files
Files changed (50) hide show
  1. README.md +209 -3
  2. config.json +229 -0
  3. fp8_quantization_report.json +620 -0
  4. model-00004-of-00057.safetensors +3 -0
  5. model-00006-of-00057.safetensors +3 -0
  6. model-00007-of-00057.safetensors +3 -0
  7. model-00009-of-00057.safetensors +3 -0
  8. model-00010-of-00057.safetensors +3 -0
  9. model-00011-of-00057.safetensors +3 -0
  10. model-00013-of-00057.safetensors +3 -0
  11. model-00014-of-00057.safetensors +3 -0
  12. model-00017-of-00057.safetensors +3 -0
  13. model-00018-of-00057.safetensors +3 -0
  14. model-00019-of-00057.safetensors +3 -0
  15. model-00020-of-00057.safetensors +3 -0
  16. model-00023-of-00057.safetensors +3 -0
  17. model-00025-of-00057.safetensors +3 -0
  18. model-00026-of-00057.safetensors +3 -0
  19. model-00029-of-00057.safetensors +3 -0
  20. model-00031-of-00057.safetensors +3 -0
  21. model-00032-of-00057.safetensors +3 -0
  22. model-00033-of-00057.safetensors +3 -0
  23. model-00035-of-00057.safetensors +3 -0
  24. model-00037-of-00057.safetensors +3 -0
  25. model-00038-of-00057.safetensors +3 -0
  26. model-00039-of-00057.safetensors +3 -0
  27. model-00040-of-00057.safetensors +3 -0
  28. model-00041-of-00057.safetensors +3 -0
  29. model-00042-of-00057.safetensors +3 -0
  30. model-00044-of-00057.safetensors +3 -0
  31. model-00045-of-00057.safetensors +3 -0
  32. model-00046-of-00057.safetensors +3 -0
  33. model-00050-of-00057.safetensors +3 -0
  34. model-00051-of-00057.safetensors +3 -0
  35. model-00053-of-00057.safetensors +3 -0
  36. model-00055-of-00057.safetensors +3 -0
  37. model-00056-of-00057.safetensors +3 -0
  38. model-00057-of-00057.safetensors +3 -0
  39. model-00058-of-00070.safetensors +3 -0
  40. model-00060-of-00070.safetensors +3 -0
  41. model-00061-of-00070.safetensors +3 -0
  42. model-00062-of-00070.safetensors +3 -0
  43. model-00063-of-00070.safetensors +3 -0
  44. model-00064-of-00070.safetensors +3 -0
  45. model-00065-of-00070.safetensors +3 -0
  46. model-00066-of-00070.safetensors +3 -0
  47. model-00068-of-00070.safetensors +3 -0
  48. model-00069-of-00070.safetensors +3 -0
  49. model-00070-of-00070.safetensors +3 -0
  50. model.safetensors.index.json +0 -0
README.md CHANGED
@@ -1,3 +1,209 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Mini GLM 5.2 Active-MTP Debug Checkpoint, FP8
2
+
3
+ This is a small GLM-5.2-style checkpoint built for inference plumbing and kernel
4
+ debugging, not for model quality. This directory is the FP8 weight-quantized
5
+ variant of the active-MTP full-dimension checkpoint.
6
+
7
+ The base model is a 14-layer mini GLM-MoE-DSA model trained for readable English.
8
+ It has been upscaled to GLM-5.2-compatible tensor dimensions and includes one
9
+ appended MTP/EAGLE next-token layer for SGLang speculative decoding.
10
+
11
+ The FP8 export follows the public GLM-5.2-FP8 checkpoint convention:
12
+
13
+ - eligible 2D linear weights are stored as `torch.float8_e4m3fn`
14
+ - each quantized weight has a sibling `*_scale_inv` tensor
15
+ - scale tensors are FP32 with 128x128 block granularity
16
+ - embeddings, norms, router gates, DSA `weights_proj`, and MTP glue
17
+ projections/norms remain unquantized
18
+
19
+ ## Intended Use
20
+
21
+ - Debug SGLang GLM-MoE-DSA inference without loading the full GLM 5.2 model.
22
+ - Exercise DSA, MoE, attention, TP sharding, FP8 KV cache, and EAGLE/MTP paths.
23
+ - Validate kernel changes against a checkpoint that is small in layer count but
24
+ keeps GLM-5.2-like shapes.
25
+
26
+ This model is expected to produce readable but repetitive English. It is not a
27
+ general-purpose language model.
28
+
29
+ ## MTP Details
30
+
31
+ The appended MTP layer is active and nonzero. Its attention and MoE tensors were
32
+ trained, rather than zeroed out, so this checkpoint can exercise the MTP decoder
33
+ attention/MoE path during serving.
34
+
35
+ The MTP trainer uses SGLang EAGLE nextn alignment:
36
+
37
+ ```text
38
+ hidden[t] + token[t+1] -> token[t+2]
39
+ ```
40
+
41
+ For rollout step `k`:
42
+
43
+ ```text
44
+ input token = token[t+k+1]
45
+ target = token[t+k+2]
46
+ ```
47
+
48
+ This is intentionally not the standard LM shift
49
+ `hidden[t] + token[t] -> token[t+1]`.
50
+
51
+ ## Compatibility
52
+
53
+ ### SGLang
54
+
55
+ This directory is intended for SGLang serving with GLM-MoE-DSA, TileLang DSA,
56
+ FP8 KV cache, and EAGLE speculative decoding.
57
+
58
+ Example shape of the serving command:
59
+
60
+ ```bash
61
+ source ./ENV_RUN.sh
62
+ CUDA_VISIBLE_DEVICES=6,7 HIP_VISIBLE_DEVICES=6,7 sglang serve \
63
+ --model-path /root/inference-v2/mini-glm-5.2/v1c-upscale/checkpoints/v1b-mtp-active-decoder-serveddata-align-1k-full-original-dims-tiled-sglang-fp8 \
64
+ --tp 2 \
65
+ --trust-remote-code \
66
+ --dsa-prefill-backend tilelang \
67
+ --dsa-decode-backend tilelang \
68
+ --kv-cache-dtype fp8_e4m3 \
69
+ --chunked-prefill-size 4096 \
70
+ --max-total-tokens 4096 \
71
+ --speculative-algorithm EAGLE \
72
+ --speculative-num-steps 3 \
73
+ --speculative-eagle-topk 1 \
74
+ --speculative-num-draft-tokens 4 \
75
+ --disable-custom-all-reduce \
76
+ --disable-shared-experts-fusion \
77
+ --cuda-graph-backend-decode disabled \
78
+ --cuda-graph-backend-prefill disabled
79
+ ```
80
+
81
+ ### Hugging Face Transformers
82
+
83
+ Use the BF16/full-dimension checkpoint for Hugging Face Transformers CPU/GPU
84
+ reference inference. This FP8 directory is intended for SGLang's GLM FP8 loader.
85
+ The FP8 tensors match the GLM-5.2-FP8 safetensors layout, but generic HF
86
+ Transformers inference may not dequantize this custom GLM-MoE-DSA FP8 format.
87
+
88
+ ```python
89
+ from transformers import AutoModelForCausalLM, AutoTokenizer
90
+
91
+ path = "/root/inference-v2/mini-glm-5.2/v1c-upscale/checkpoints/v1b-mtp-active-decoder-serveddata-align-1k-full-original-dims-tiled-sglang"
92
+ tokenizer = AutoTokenizer.from_pretrained(path, trust_remote_code=True)
93
+ model = AutoModelForCausalLM.from_pretrained(path, trust_remote_code=True)
94
+ ```
95
+
96
+ HF inference uses only the base 14-layer causal LM. The appended MTP tensors are
97
+ reported as unexpected keys because HF Transformers' `glm_moe_dsa` model does
98
+ not implement the MTP/EAGLE nextn path.
99
+
100
+ ## Training Summary
101
+
102
+ The MTP layer was trained from copied active decoder weights with the corrected
103
+ SGLang EAGLE alignment on a small SGLang-served token dataset.
104
+
105
+ Final offline served-data metrics for the source MTP checkpoint:
106
+
107
+ | Metric | Value |
108
+ |---|---:|
109
+ | accept@0 | 0.9295 |
110
+ | accept@1 | 0.8760 |
111
+ | accept@2 | 0.8292 |
112
+ | average accepted draft tokens | 2.6346 |
113
+ | data loss | 0.7798 |
114
+
115
+ These are offline metrics on the small served-token dataset and should be treated
116
+ as a debugging signal, not a model-quality benchmark.
117
+
118
+ ## Example Outputs
119
+
120
+ The model is only expected to produce barely passable English. Repetition,
121
+ generic phrasing, weak reasoning, and topic drift are normal.
122
+
123
+ Observed SGLang FP8 raw-completion sample:
124
+
125
+ Prompt:
126
+
127
+ ```text
128
+ A small language model is useful for testing inference code because
129
+ ```
130
+
131
+ Response:
132
+
133
+ ```text
134
+ it is an independent scientific method. However, the application of the
135
+ language is considered as a social, practical approach. It has a wide range of
136
+ specific characteristics and may be used for clinical practice.
137
+ ```
138
+
139
+ The text is readable but semantically loose; that is the expected quality bar
140
+ for this plumbing checkpoint.
141
+
142
+ These examples show the intended quality bar: readable text for plumbing tests,
143
+ not useful answers.
144
+
145
+ ### Example 1
146
+
147
+ Prompt:
148
+
149
+ ```text
150
+ The quick brown fox
151
+ ```
152
+
153
+ Observed HF base-model response:
154
+
155
+ ```text
156
+ The quick brown fox is a very good thing to do. It is a good thing to do.
157
+ ```
158
+
159
+ ### Example 2
160
+
161
+ Prompt:
162
+
163
+ ```text
164
+ Write one short paragraph about a library in a small town.
165
+ ```
166
+
167
+ Expected style of response:
168
+
169
+ ```text
170
+ The library is a quiet place in the center of the town. People come there to
171
+ read books, ask questions, and sit at the tables in the afternoon. It is not a
172
+ large building, but it is useful for the people who live nearby.
173
+ ```
174
+
175
+ ### Example 3
176
+
177
+ Prompt:
178
+
179
+ ```text
180
+ Explain why rain falls from clouds.
181
+ ```
182
+
183
+ Expected style of response:
184
+
185
+ ```text
186
+ Rain falls from clouds when water in the air becomes heavy enough to fall down.
187
+ The cloud is made of small drops, and those drops can join together. When they
188
+ become too heavy, they fall as rain.
189
+ ```
190
+
191
+ ### Example 4
192
+
193
+ Prompt:
194
+
195
+ ```text
196
+ Continue this sentence: The old machine started slowly because
197
+ ```
198
+
199
+ Expected style of response:
200
+
201
+ ```text
202
+ The old machine started slowly because the parts were worn and the motor needed
203
+ time to move. It made a small sound, then a louder sound, and finally began to
204
+ work again.
205
+ ```
206
+
207
+ The responses above are coherent enough to inspect inference behavior, token
208
+ flow, speculative decoding, and kernel changes. They should not be used to judge
209
+ instruction following or factual accuracy.
config.json ADDED
@@ -0,0 +1,229 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "GlmMoeDsaForCausalLM"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "dtype": "bfloat16",
8
+ "eos_token_id": [
9
+ 154820,
10
+ 154827,
11
+ 154829
12
+ ],
13
+ "ep_size": 1,
14
+ "first_k_dense_replace": 2,
15
+ "head_dim": 64,
16
+ "hidden_act": "silu",
17
+ "hidden_size": 6144,
18
+ "index_head_dim": 128,
19
+ "index_n_heads": 32,
20
+ "index_share_for_mtp_iteration": true,
21
+ "index_skip_topk_offset": 3,
22
+ "index_topk": 2048,
23
+ "index_topk_freq": 4,
24
+ "index_topk_pattern": null,
25
+ "indexer_rope_interleave": true,
26
+ "indexer_types": [
27
+ "full",
28
+ "full",
29
+ "shared",
30
+ "shared",
31
+ "shared",
32
+ "full",
33
+ "shared",
34
+ "shared",
35
+ "shared",
36
+ "full",
37
+ "shared",
38
+ "shared",
39
+ "shared",
40
+ "full"
41
+ ],
42
+ "initializer_range": 0.02,
43
+ "intermediate_size": 12288,
44
+ "kv_lora_rank": 512,
45
+ "max_position_embeddings": 16384,
46
+ "mlp_layer_types": [
47
+ "dense",
48
+ "dense",
49
+ "sparse",
50
+ "sparse",
51
+ "sparse",
52
+ "sparse",
53
+ "sparse",
54
+ "sparse",
55
+ "sparse",
56
+ "sparse",
57
+ "sparse",
58
+ "sparse",
59
+ "sparse",
60
+ "sparse"
61
+ ],
62
+ "model_type": "glm_moe_dsa",
63
+ "moe_intermediate_size": 2048,
64
+ "moe_layer_freq": 1,
65
+ "n_group": 1,
66
+ "n_routed_experts": 256,
67
+ "n_shared_experts": 1,
68
+ "norm_topk_prob": true,
69
+ "num_attention_heads": 64,
70
+ "num_experts_per_tok": 8,
71
+ "num_hidden_layers": 14,
72
+ "num_key_value_heads": 64,
73
+ "num_nextn_predict_layers": 1,
74
+ "pad_token_id": 154820,
75
+ "pretraining_tp": 1,
76
+ "q_lora_rank": 2048,
77
+ "qk_head_dim": 256,
78
+ "qk_nope_head_dim": 192,
79
+ "qk_rope_head_dim": 64,
80
+ "quantization_config": {
81
+ "activation_scheme": "dynamic",
82
+ "fmt": "e4m3",
83
+ "modules_to_not_convert": [
84
+ "lm_head",
85
+ "model.embed_tokens",
86
+ "model.layers.0.input_layernorm",
87
+ "model.layers.0.post_attention_layernorm",
88
+ "model.layers.0.self_attn.indexer.k_norm",
89
+ "model.layers.0.self_attn.indexer.weights_proj",
90
+ "model.layers.0.self_attn.kv_a_layernorm",
91
+ "model.layers.0.self_attn.q_a_layernorm",
92
+ "model.layers.1.input_layernorm",
93
+ "model.layers.1.post_attention_layernorm",
94
+ "model.layers.1.self_attn.indexer.k_norm",
95
+ "model.layers.1.self_attn.indexer.weights_proj",
96
+ "model.layers.1.self_attn.kv_a_layernorm",
97
+ "model.layers.1.self_attn.q_a_layernorm",
98
+ "model.layers.10.input_layernorm",
99
+ "model.layers.10.mlp.gate",
100
+ "model.layers.10.post_attention_layernorm",
101
+ "model.layers.10.self_attn.indexer.k_norm",
102
+ "model.layers.10.self_attn.indexer.weights_proj",
103
+ "model.layers.10.self_attn.kv_a_layernorm",
104
+ "model.layers.10.self_attn.q_a_layernorm",
105
+ "model.layers.11.input_layernorm",
106
+ "model.layers.11.mlp.gate",
107
+ "model.layers.11.post_attention_layernorm",
108
+ "model.layers.11.self_attn.indexer.k_norm",
109
+ "model.layers.11.self_attn.indexer.weights_proj",
110
+ "model.layers.11.self_attn.kv_a_layernorm",
111
+ "model.layers.11.self_attn.q_a_layernorm",
112
+ "model.layers.12.input_layernorm",
113
+ "model.layers.12.mlp.gate",
114
+ "model.layers.12.post_attention_layernorm",
115
+ "model.layers.12.self_attn.indexer.k_norm",
116
+ "model.layers.12.self_attn.indexer.weights_proj",
117
+ "model.layers.12.self_attn.kv_a_layernorm",
118
+ "model.layers.12.self_attn.q_a_layernorm",
119
+ "model.layers.13.input_layernorm",
120
+ "model.layers.13.mlp.gate",
121
+ "model.layers.13.post_attention_layernorm",
122
+ "model.layers.13.self_attn.indexer.k_norm",
123
+ "model.layers.13.self_attn.indexer.weights_proj",
124
+ "model.layers.13.self_attn.kv_a_layernorm",
125
+ "model.layers.13.self_attn.q_a_layernorm",
126
+ "model.layers.14.eh_proj",
127
+ "model.layers.14.enorm",
128
+ "model.layers.14.hnorm",
129
+ "model.layers.14.input_layernorm",
130
+ "model.layers.14.mlp.gate",
131
+ "model.layers.14.post_attention_layernorm",
132
+ "model.layers.14.self_attn.indexer.k_norm",
133
+ "model.layers.14.self_attn.indexer.weights_proj",
134
+ "model.layers.14.self_attn.kv_a_layernorm",
135
+ "model.layers.14.self_attn.q_a_layernorm",
136
+ "model.layers.14.shared_head.norm",
137
+ "model.layers.2.input_layernorm",
138
+ "model.layers.2.mlp.gate",
139
+ "model.layers.2.post_attention_layernorm",
140
+ "model.layers.2.self_attn.indexer.k_norm",
141
+ "model.layers.2.self_attn.indexer.weights_proj",
142
+ "model.layers.2.self_attn.kv_a_layernorm",
143
+ "model.layers.2.self_attn.q_a_layernorm",
144
+ "model.layers.3.input_layernorm",
145
+ "model.layers.3.mlp.gate",
146
+ "model.layers.3.post_attention_layernorm",
147
+ "model.layers.3.self_attn.indexer.k_norm",
148
+ "model.layers.3.self_attn.indexer.weights_proj",
149
+ "model.layers.3.self_attn.kv_a_layernorm",
150
+ "model.layers.3.self_attn.q_a_layernorm",
151
+ "model.layers.4.input_layernorm",
152
+ "model.layers.4.mlp.gate",
153
+ "model.layers.4.post_attention_layernorm",
154
+ "model.layers.4.self_attn.indexer.k_norm",
155
+ "model.layers.4.self_attn.indexer.weights_proj",
156
+ "model.layers.4.self_attn.kv_a_layernorm",
157
+ "model.layers.4.self_attn.q_a_layernorm",
158
+ "model.layers.5.input_layernorm",
159
+ "model.layers.5.mlp.gate",
160
+ "model.layers.5.post_attention_layernorm",
161
+ "model.layers.5.self_attn.indexer.k_norm",
162
+ "model.layers.5.self_attn.indexer.weights_proj",
163
+ "model.layers.5.self_attn.kv_a_layernorm",
164
+ "model.layers.5.self_attn.q_a_layernorm",
165
+ "model.layers.6.input_layernorm",
166
+ "model.layers.6.mlp.gate",
167
+ "model.layers.6.post_attention_layernorm",
168
+ "model.layers.6.self_attn.indexer.k_norm",
169
+ "model.layers.6.self_attn.indexer.weights_proj",
170
+ "model.layers.6.self_attn.kv_a_layernorm",
171
+ "model.layers.6.self_attn.q_a_layernorm",
172
+ "model.layers.7.input_layernorm",
173
+ "model.layers.7.mlp.gate",
174
+ "model.layers.7.post_attention_layernorm",
175
+ "model.layers.7.self_attn.indexer.k_norm",
176
+ "model.layers.7.self_attn.indexer.weights_proj",
177
+ "model.layers.7.self_attn.kv_a_layernorm",
178
+ "model.layers.7.self_attn.q_a_layernorm",
179
+ "model.layers.8.input_layernorm",
180
+ "model.layers.8.mlp.gate",
181
+ "model.layers.8.post_attention_layernorm",
182
+ "model.layers.8.self_attn.indexer.k_norm",
183
+ "model.layers.8.self_attn.indexer.weights_proj",
184
+ "model.layers.8.self_attn.kv_a_layernorm",
185
+ "model.layers.8.self_attn.q_a_layernorm",
186
+ "model.layers.9.input_layernorm",
187
+ "model.layers.9.mlp.gate",
188
+ "model.layers.9.post_attention_layernorm",
189
+ "model.layers.9.self_attn.indexer.k_norm",
190
+ "model.layers.9.self_attn.indexer.weights_proj",
191
+ "model.layers.9.self_attn.kv_a_layernorm",
192
+ "model.layers.9.self_attn.q_a_layernorm",
193
+ "model.norm"
194
+ ],
195
+ "quant_method": "fp8",
196
+ "weight_block_size": [
197
+ 128,
198
+ 128
199
+ ]
200
+ },
201
+ "rms_norm_eps": 1e-05,
202
+ "rope_interleave": true,
203
+ "rope_parameters": {
204
+ "rope_theta": 8000000,
205
+ "rope_type": "default"
206
+ },
207
+ "routed_scaling_factor": 2.5,
208
+ "scoring_func": "sigmoid",
209
+ "tie_word_embeddings": false,
210
+ "topk_group": 1,
211
+ "topk_method": "noaux_tc",
212
+ "torch_dtype": "bfloat16",
213
+ "transformers_version": "5.12.0",
214
+ "use_cache": true,
215
+ "v1c_full_upscale": {
216
+ "active_attention_heads": 16,
217
+ "active_hidden_size": 1024,
218
+ "active_routed_experts": 16,
219
+ "expansion_strategy": "tiled active subspace with averaged input repeats",
220
+ "inactive_expert_bias": -1000000000.0,
221
+ "mtp_source_checkpoint": "/root/inference-v2/mini-glm-5.2/v1b-mtp/checkpoints/mtp-active-decoder-serveddata-align-1k/final",
222
+ "num_nextn_predict_layers": 1,
223
+ "source_checkpoint": "/root/inference-v2/mini-glm-5.2/v1a-mini-model/checkpoints/stage-b2-finewebedu16k-cont100m-2gpu/final",
224
+ "strict_equivalence_caveat": "RoPE 32->64 maps source frequencies into every-other target pair; unused target RoPE pairs are zero.",
225
+ "target_config": "/root/inference-v2/mini-glm-5.2/v1a-mini-model/config/glm-5.2-original-config.json"
226
+ },
227
+ "v_head_dim": 256,
228
+ "vocab_size": 154880
229
+ }
fp8_quantization_report.json ADDED
@@ -0,0 +1,620 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "block_size": [
3
+ 128,
4
+ 128
5
+ ],
6
+ "fp8_dtype": "torch.float8_e4m3fn",
7
+ "fp8_max": 448.0,
8
+ "modules_to_not_convert": [
9
+ "lm_head",
10
+ "model.embed_tokens",
11
+ "model.layers.0.input_layernorm",
12
+ "model.layers.0.post_attention_layernorm",
13
+ "model.layers.0.self_attn.indexer.k_norm",
14
+ "model.layers.0.self_attn.indexer.weights_proj",
15
+ "model.layers.0.self_attn.kv_a_layernorm",
16
+ "model.layers.0.self_attn.q_a_layernorm",
17
+ "model.layers.1.input_layernorm",
18
+ "model.layers.1.post_attention_layernorm",
19
+ "model.layers.1.self_attn.indexer.k_norm",
20
+ "model.layers.1.self_attn.indexer.weights_proj",
21
+ "model.layers.1.self_attn.kv_a_layernorm",
22
+ "model.layers.1.self_attn.q_a_layernorm",
23
+ "model.layers.10.input_layernorm",
24
+ "model.layers.10.mlp.gate",
25
+ "model.layers.10.post_attention_layernorm",
26
+ "model.layers.10.self_attn.indexer.k_norm",
27
+ "model.layers.10.self_attn.indexer.weights_proj",
28
+ "model.layers.10.self_attn.kv_a_layernorm",
29
+ "model.layers.10.self_attn.q_a_layernorm",
30
+ "model.layers.11.input_layernorm",
31
+ "model.layers.11.mlp.gate",
32
+ "model.layers.11.post_attention_layernorm",
33
+ "model.layers.11.self_attn.indexer.k_norm",
34
+ "model.layers.11.self_attn.indexer.weights_proj",
35
+ "model.layers.11.self_attn.kv_a_layernorm",
36
+ "model.layers.11.self_attn.q_a_layernorm",
37
+ "model.layers.12.input_layernorm",
38
+ "model.layers.12.mlp.gate",
39
+ "model.layers.12.post_attention_layernorm",
40
+ "model.layers.12.self_attn.indexer.k_norm",
41
+ "model.layers.12.self_attn.indexer.weights_proj",
42
+ "model.layers.12.self_attn.kv_a_layernorm",
43
+ "model.layers.12.self_attn.q_a_layernorm",
44
+ "model.layers.13.input_layernorm",
45
+ "model.layers.13.mlp.gate",
46
+ "model.layers.13.post_attention_layernorm",
47
+ "model.layers.13.self_attn.indexer.k_norm",
48
+ "model.layers.13.self_attn.indexer.weights_proj",
49
+ "model.layers.13.self_attn.kv_a_layernorm",
50
+ "model.layers.13.self_attn.q_a_layernorm",
51
+ "model.layers.14.eh_proj",
52
+ "model.layers.14.enorm",
53
+ "model.layers.14.hnorm",
54
+ "model.layers.14.input_layernorm",
55
+ "model.layers.14.mlp.gate",
56
+ "model.layers.14.post_attention_layernorm",
57
+ "model.layers.14.self_attn.indexer.k_norm",
58
+ "model.layers.14.self_attn.indexer.weights_proj",
59
+ "model.layers.14.self_attn.kv_a_layernorm",
60
+ "model.layers.14.self_attn.q_a_layernorm",
61
+ "model.layers.14.shared_head.norm",
62
+ "model.layers.2.input_layernorm",
63
+ "model.layers.2.mlp.gate",
64
+ "model.layers.2.post_attention_layernorm",
65
+ "model.layers.2.self_attn.indexer.k_norm",
66
+ "model.layers.2.self_attn.indexer.weights_proj",
67
+ "model.layers.2.self_attn.kv_a_layernorm",
68
+ "model.layers.2.self_attn.q_a_layernorm",
69
+ "model.layers.3.input_layernorm",
70
+ "model.layers.3.mlp.gate",
71
+ "model.layers.3.post_attention_layernorm",
72
+ "model.layers.3.self_attn.indexer.k_norm",
73
+ "model.layers.3.self_attn.indexer.weights_proj",
74
+ "model.layers.3.self_attn.kv_a_layernorm",
75
+ "model.layers.3.self_attn.q_a_layernorm",
76
+ "model.layers.4.input_layernorm",
77
+ "model.layers.4.mlp.gate",
78
+ "model.layers.4.post_attention_layernorm",
79
+ "model.layers.4.self_attn.indexer.k_norm",
80
+ "model.layers.4.self_attn.indexer.weights_proj",
81
+ "model.layers.4.self_attn.kv_a_layernorm",
82
+ "model.layers.4.self_attn.q_a_layernorm",
83
+ "model.layers.5.input_layernorm",
84
+ "model.layers.5.mlp.gate",
85
+ "model.layers.5.post_attention_layernorm",
86
+ "model.layers.5.self_attn.indexer.k_norm",
87
+ "model.layers.5.self_attn.indexer.weights_proj",
88
+ "model.layers.5.self_attn.kv_a_layernorm",
89
+ "model.layers.5.self_attn.q_a_layernorm",
90
+ "model.layers.6.input_layernorm",
91
+ "model.layers.6.mlp.gate",
92
+ "model.layers.6.post_attention_layernorm",
93
+ "model.layers.6.self_attn.indexer.k_norm",
94
+ "model.layers.6.self_attn.indexer.weights_proj",
95
+ "model.layers.6.self_attn.kv_a_layernorm",
96
+ "model.layers.6.self_attn.q_a_layernorm",
97
+ "model.layers.7.input_layernorm",
98
+ "model.layers.7.mlp.gate",
99
+ "model.layers.7.post_attention_layernorm",
100
+ "model.layers.7.self_attn.indexer.k_norm",
101
+ "model.layers.7.self_attn.indexer.weights_proj",
102
+ "model.layers.7.self_attn.kv_a_layernorm",
103
+ "model.layers.7.self_attn.q_a_layernorm",
104
+ "model.layers.8.input_layernorm",
105
+ "model.layers.8.mlp.gate",
106
+ "model.layers.8.post_attention_layernorm",
107
+ "model.layers.8.self_attn.indexer.k_norm",
108
+ "model.layers.8.self_attn.indexer.weights_proj",
109
+ "model.layers.8.self_attn.kv_a_layernorm",
110
+ "model.layers.8.self_attn.q_a_layernorm",
111
+ "model.layers.9.input_layernorm",
112
+ "model.layers.9.mlp.gate",
113
+ "model.layers.9.post_attention_layernorm",
114
+ "model.layers.9.self_attn.indexer.k_norm",
115
+ "model.layers.9.self_attn.indexer.weights_proj",
116
+ "model.layers.9.self_attn.kv_a_layernorm",
117
+ "model.layers.9.self_attn.q_a_layernorm",
118
+ "model.norm"
119
+ ],
120
+ "modules_to_not_convert_count": 110,
121
+ "output": "/root/inference-v2/mini-glm-5.2/v1c-upscale/checkpoints/v1b-mtp-active-decoder-serveddata-align-1k-full-original-dims-tiled-sglang-fp8",
122
+ "output_tensor_bytes": 133220606848,
123
+ "preserved_tensors": 138,
124
+ "quantized_tensors": 10134,
125
+ "scale_tensors": 10134,
126
+ "shards": [
127
+ {
128
+ "preserved": 8,
129
+ "quantized": 6,
130
+ "scale_tensors": 6,
131
+ "shard": "model-00001-of-00057.safetensors",
132
+ "tensor_bytes": 4046015104
133
+ },
134
+ {
135
+ "preserved": 20,
136
+ "quantized": 125,
137
+ "scale_tensors": 125,
138
+ "shard": "model-00002-of-00057.safetensors",
139
+ "tensor_bytes": 2149413376
140
+ },
141
+ {
142
+ "preserved": 16,
143
+ "quantized": 153,
144
+ "scale_tensors": 153,
145
+ "shard": "model-00003-of-00057.safetensors",
146
+ "tensor_bytes": 2141656640
147
+ },
148
+ {
149
+ "preserved": 18,
150
+ "quantized": 145,
151
+ "scale_tensors": 145,
152
+ "shard": "model-00004-of-00057.safetensors",
153
+ "tensor_bytes": 2140887360
154
+ },
155
+ {
156
+ "preserved": 19,
157
+ "quantized": 152,
158
+ "scale_tensors": 152,
159
+ "shard": "model-00005-of-00057.safetensors",
160
+ "tensor_bytes": 2104293376
161
+ },
162
+ {
163
+ "preserved": 44,
164
+ "quantized": 158,
165
+ "scale_tensors": 158,
166
+ "shard": "model-00006-of-00057.safetensors",
167
+ "tensor_bytes": 2152283904
168
+ },
169
+ {
170
+ "preserved": 0,
171
+ "quantized": 170,
172
+ "scale_tensors": 170,
173
+ "shard": "model-00007-of-00057.safetensors",
174
+ "tensor_bytes": 2139617280
175
+ },
176
+ {
177
+ "preserved": 0,
178
+ "quantized": 170,
179
+ "scale_tensors": 170,
180
+ "shard": "model-00008-of-00057.safetensors",
181
+ "tensor_bytes": 2139617280
182
+ },
183
+ {
184
+ "preserved": 0,
185
+ "quantized": 170,
186
+ "scale_tensors": 170,
187
+ "shard": "model-00009-of-00057.safetensors",
188
+ "tensor_bytes": 2139617280
189
+ },
190
+ {
191
+ "preserved": 0,
192
+ "quantized": 170,
193
+ "scale_tensors": 170,
194
+ "shard": "model-00010-of-00057.safetensors",
195
+ "tensor_bytes": 2139617280
196
+ },
197
+ {
198
+ "preserved": 0,
199
+ "quantized": 170,
200
+ "scale_tensors": 170,
201
+ "shard": "model-00011-of-00057.safetensors",
202
+ "tensor_bytes": 2139617280
203
+ },
204
+ {
205
+ "preserved": 0,
206
+ "quantized": 170,
207
+ "scale_tensors": 170,
208
+ "shard": "model-00012-of-00057.safetensors",
209
+ "tensor_bytes": 2139617280
210
+ },
211
+ {
212
+ "preserved": 0,
213
+ "quantized": 170,
214
+ "scale_tensors": 170,
215
+ "shard": "model-00013-of-00057.safetensors",
216
+ "tensor_bytes": 2139617280
217
+ },
218
+ {
219
+ "preserved": 0,
220
+ "quantized": 170,
221
+ "scale_tensors": 170,
222
+ "shard": "model-00014-of-00057.safetensors",
223
+ "tensor_bytes": 2139617280
224
+ },
225
+ {
226
+ "preserved": 0,
227
+ "quantized": 170,
228
+ "scale_tensors": 170,
229
+ "shard": "model-00015-of-00057.safetensors",
230
+ "tensor_bytes": 2139617280
231
+ },
232
+ {
233
+ "preserved": 0,
234
+ "quantized": 170,
235
+ "scale_tensors": 170,
236
+ "shard": "model-00016-of-00057.safetensors",
237
+ "tensor_bytes": 2139617280
238
+ },
239
+ {
240
+ "preserved": 0,
241
+ "quantized": 170,
242
+ "scale_tensors": 170,
243
+ "shard": "model-00017-of-00057.safetensors",
244
+ "tensor_bytes": 2139617280
245
+ },
246
+ {
247
+ "preserved": 0,
248
+ "quantized": 170,
249
+ "scale_tensors": 170,
250
+ "shard": "model-00018-of-00057.safetensors",
251
+ "tensor_bytes": 2139617280
252
+ },
253
+ {
254
+ "preserved": 0,
255
+ "quantized": 170,
256
+ "scale_tensors": 170,
257
+ "shard": "model-00019-of-00057.safetensors",
258
+ "tensor_bytes": 2139617280
259
+ },
260
+ {
261
+ "preserved": 0,
262
+ "quantized": 170,
263
+ "scale_tensors": 170,
264
+ "shard": "model-00020-of-00057.safetensors",
265
+ "tensor_bytes": 2139617280
266
+ },
267
+ {
268
+ "preserved": 0,
269
+ "quantized": 170,
270
+ "scale_tensors": 170,
271
+ "shard": "model-00021-of-00057.safetensors",
272
+ "tensor_bytes": 2139617280
273
+ },
274
+ {
275
+ "preserved": 0,
276
+ "quantized": 170,
277
+ "scale_tensors": 170,
278
+ "shard": "model-00022-of-00057.safetensors",
279
+ "tensor_bytes": 2139617280
280
+ },
281
+ {
282
+ "preserved": 0,
283
+ "quantized": 170,
284
+ "scale_tensors": 170,
285
+ "shard": "model-00023-of-00057.safetensors",
286
+ "tensor_bytes": 2139617280
287
+ },
288
+ {
289
+ "preserved": 0,
290
+ "quantized": 170,
291
+ "scale_tensors": 170,
292
+ "shard": "model-00024-of-00057.safetensors",
293
+ "tensor_bytes": 2139617280
294
+ },
295
+ {
296
+ "preserved": 0,
297
+ "quantized": 170,
298
+ "scale_tensors": 170,
299
+ "shard": "model-00025-of-00057.safetensors",
300
+ "tensor_bytes": 2139617280
301
+ },
302
+ {
303
+ "preserved": 0,
304
+ "quantized": 170,
305
+ "scale_tensors": 170,
306
+ "shard": "model-00026-of-00057.safetensors",
307
+ "tensor_bytes": 2139617280
308
+ },
309
+ {
310
+ "preserved": 0,
311
+ "quantized": 170,
312
+ "scale_tensors": 170,
313
+ "shard": "model-00027-of-00057.safetensors",
314
+ "tensor_bytes": 2139617280
315
+ },
316
+ {
317
+ "preserved": 0,
318
+ "quantized": 170,
319
+ "scale_tensors": 170,
320
+ "shard": "model-00028-of-00057.safetensors",
321
+ "tensor_bytes": 2139617280
322
+ },
323
+ {
324
+ "preserved": 0,
325
+ "quantized": 170,
326
+ "scale_tensors": 170,
327
+ "shard": "model-00029-of-00057.safetensors",
328
+ "tensor_bytes": 2139617280
329
+ },
330
+ {
331
+ "preserved": 0,
332
+ "quantized": 170,
333
+ "scale_tensors": 170,
334
+ "shard": "model-00030-of-00057.safetensors",
335
+ "tensor_bytes": 2139617280
336
+ },
337
+ {
338
+ "preserved": 0,
339
+ "quantized": 170,
340
+ "scale_tensors": 170,
341
+ "shard": "model-00031-of-00057.safetensors",
342
+ "tensor_bytes": 2139617280
343
+ },
344
+ {
345
+ "preserved": 0,
346
+ "quantized": 170,
347
+ "scale_tensors": 170,
348
+ "shard": "model-00032-of-00057.safetensors",
349
+ "tensor_bytes": 2139617280
350
+ },
351
+ {
352
+ "preserved": 0,
353
+ "quantized": 170,
354
+ "scale_tensors": 170,
355
+ "shard": "model-00033-of-00057.safetensors",
356
+ "tensor_bytes": 2139617280
357
+ },
358
+ {
359
+ "preserved": 0,
360
+ "quantized": 170,
361
+ "scale_tensors": 170,
362
+ "shard": "model-00034-of-00057.safetensors",
363
+ "tensor_bytes": 2139617280
364
+ },
365
+ {
366
+ "preserved": 0,
367
+ "quantized": 170,
368
+ "scale_tensors": 170,
369
+ "shard": "model-00035-of-00057.safetensors",
370
+ "tensor_bytes": 2139617280
371
+ },
372
+ {
373
+ "preserved": 0,
374
+ "quantized": 170,
375
+ "scale_tensors": 170,
376
+ "shard": "model-00036-of-00057.safetensors",
377
+ "tensor_bytes": 2139617280
378
+ },
379
+ {
380
+ "preserved": 0,
381
+ "quantized": 170,
382
+ "scale_tensors": 170,
383
+ "shard": "model-00037-of-00057.safetensors",
384
+ "tensor_bytes": 2139617280
385
+ },
386
+ {
387
+ "preserved": 0,
388
+ "quantized": 170,
389
+ "scale_tensors": 170,
390
+ "shard": "model-00038-of-00057.safetensors",
391
+ "tensor_bytes": 2139617280
392
+ },
393
+ {
394
+ "preserved": 0,
395
+ "quantized": 170,
396
+ "scale_tensors": 170,
397
+ "shard": "model-00039-of-00057.safetensors",
398
+ "tensor_bytes": 2139617280
399
+ },
400
+ {
401
+ "preserved": 0,
402
+ "quantized": 170,
403
+ "scale_tensors": 170,
404
+ "shard": "model-00040-of-00057.safetensors",
405
+ "tensor_bytes": 2139617280
406
+ },
407
+ {
408
+ "preserved": 0,
409
+ "quantized": 170,
410
+ "scale_tensors": 170,
411
+ "shard": "model-00041-of-00057.safetensors",
412
+ "tensor_bytes": 2139617280
413
+ },
414
+ {
415
+ "preserved": 0,
416
+ "quantized": 170,
417
+ "scale_tensors": 170,
418
+ "shard": "model-00042-of-00057.safetensors",
419
+ "tensor_bytes": 2139617280
420
+ },
421
+ {
422
+ "preserved": 0,
423
+ "quantized": 170,
424
+ "scale_tensors": 170,
425
+ "shard": "model-00043-of-00057.safetensors",
426
+ "tensor_bytes": 2139617280
427
+ },
428
+ {
429
+ "preserved": 0,
430
+ "quantized": 170,
431
+ "scale_tensors": 170,
432
+ "shard": "model-00044-of-00057.safetensors",
433
+ "tensor_bytes": 2139617280
434
+ },
435
+ {
436
+ "preserved": 0,
437
+ "quantized": 170,
438
+ "scale_tensors": 170,
439
+ "shard": "model-00045-of-00057.safetensors",
440
+ "tensor_bytes": 2139617280
441
+ },
442
+ {
443
+ "preserved": 0,
444
+ "quantized": 170,
445
+ "scale_tensors": 170,
446
+ "shard": "model-00046-of-00057.safetensors",
447
+ "tensor_bytes": 2139617280
448
+ },
449
+ {
450
+ "preserved": 0,
451
+ "quantized": 170,
452
+ "scale_tensors": 170,
453
+ "shard": "model-00047-of-00057.safetensors",
454
+ "tensor_bytes": 2139617280
455
+ },
456
+ {
457
+ "preserved": 0,
458
+ "quantized": 170,
459
+ "scale_tensors": 170,
460
+ "shard": "model-00048-of-00057.safetensors",
461
+ "tensor_bytes": 2139617280
462
+ },
463
+ {
464
+ "preserved": 0,
465
+ "quantized": 170,
466
+ "scale_tensors": 170,
467
+ "shard": "model-00049-of-00057.safetensors",
468
+ "tensor_bytes": 2139617280
469
+ },
470
+ {
471
+ "preserved": 0,
472
+ "quantized": 170,
473
+ "scale_tensors": 170,
474
+ "shard": "model-00050-of-00057.safetensors",
475
+ "tensor_bytes": 2139617280
476
+ },
477
+ {
478
+ "preserved": 0,
479
+ "quantized": 170,
480
+ "scale_tensors": 170,
481
+ "shard": "model-00051-of-00057.safetensors",
482
+ "tensor_bytes": 2139617280
483
+ },
484
+ {
485
+ "preserved": 0,
486
+ "quantized": 170,
487
+ "scale_tensors": 170,
488
+ "shard": "model-00052-of-00057.safetensors",
489
+ "tensor_bytes": 2139617280
490
+ },
491
+ {
492
+ "preserved": 0,
493
+ "quantized": 170,
494
+ "scale_tensors": 170,
495
+ "shard": "model-00053-of-00057.safetensors",
496
+ "tensor_bytes": 2139617280
497
+ },
498
+ {
499
+ "preserved": 0,
500
+ "quantized": 170,
501
+ "scale_tensors": 170,
502
+ "shard": "model-00054-of-00057.safetensors",
503
+ "tensor_bytes": 2139617280
504
+ },
505
+ {
506
+ "preserved": 0,
507
+ "quantized": 170,
508
+ "scale_tensors": 170,
509
+ "shard": "model-00055-of-00057.safetensors",
510
+ "tensor_bytes": 2139617280
511
+ },
512
+ {
513
+ "preserved": 0,
514
+ "quantized": 170,
515
+ "scale_tensors": 170,
516
+ "shard": "model-00056-of-00057.safetensors",
517
+ "tensor_bytes": 2139617280
518
+ },
519
+ {
520
+ "preserved": 0,
521
+ "quantized": 117,
522
+ "scale_tensors": 117,
523
+ "shard": "model-00057-of-00057.safetensors",
524
+ "tensor_bytes": 1472560128
525
+ },
526
+ {
527
+ "preserved": 11,
528
+ "quantized": 55,
529
+ "scale_tensors": 55,
530
+ "shard": "model-00058-of-00070.safetensors",
531
+ "tensor_bytes": 823871616
532
+ },
533
+ {
534
+ "preserved": 2,
535
+ "quantized": 55,
536
+ "scale_tensors": 55,
537
+ "shard": "model-00059-of-00070.safetensors",
538
+ "tensor_bytes": 801324032
539
+ },
540
+ {
541
+ "preserved": 0,
542
+ "quantized": 64,
543
+ "scale_tensors": 64,
544
+ "shard": "model-00060-of-00070.safetensors",
545
+ "tensor_bytes": 805502976
546
+ },
547
+ {
548
+ "preserved": 0,
549
+ "quantized": 64,
550
+ "scale_tensors": 64,
551
+ "shard": "model-00061-of-00070.safetensors",
552
+ "tensor_bytes": 805502976
553
+ },
554
+ {
555
+ "preserved": 0,
556
+ "quantized": 64,
557
+ "scale_tensors": 64,
558
+ "shard": "model-00062-of-00070.safetensors",
559
+ "tensor_bytes": 805502976
560
+ },
561
+ {
562
+ "preserved": 0,
563
+ "quantized": 64,
564
+ "scale_tensors": 64,
565
+ "shard": "model-00063-of-00070.safetensors",
566
+ "tensor_bytes": 805502976
567
+ },
568
+ {
569
+ "preserved": 0,
570
+ "quantized": 64,
571
+ "scale_tensors": 64,
572
+ "shard": "model-00064-of-00070.safetensors",
573
+ "tensor_bytes": 805502976
574
+ },
575
+ {
576
+ "preserved": 0,
577
+ "quantized": 64,
578
+ "scale_tensors": 64,
579
+ "shard": "model-00065-of-00070.safetensors",
580
+ "tensor_bytes": 805502976
581
+ },
582
+ {
583
+ "preserved": 0,
584
+ "quantized": 64,
585
+ "scale_tensors": 64,
586
+ "shard": "model-00066-of-00070.safetensors",
587
+ "tensor_bytes": 805502976
588
+ },
589
+ {
590
+ "preserved": 0,
591
+ "quantized": 64,
592
+ "scale_tensors": 64,
593
+ "shard": "model-00067-of-00070.safetensors",
594
+ "tensor_bytes": 805502976
595
+ },
596
+ {
597
+ "preserved": 0,
598
+ "quantized": 64,
599
+ "scale_tensors": 64,
600
+ "shard": "model-00068-of-00070.safetensors",
601
+ "tensor_bytes": 805502976
602
+ },
603
+ {
604
+ "preserved": 0,
605
+ "quantized": 64,
606
+ "scale_tensors": 64,
607
+ "shard": "model-00069-of-00070.safetensors",
608
+ "tensor_bytes": 805502976
609
+ },
610
+ {
611
+ "preserved": 0,
612
+ "quantized": 28,
613
+ "scale_tensors": 28,
614
+ "shard": "model-00070-of-00070.safetensors",
615
+ "tensor_bytes": 352407552
616
+ }
617
+ ],
618
+ "source": "/root/inference-v2/mini-glm-5.2/v1c-upscale/checkpoints/v1b-mtp-active-decoder-serveddata-align-1k-full-original-dims-tiled-sglang",
619
+ "weight_map_keys": 20406
620
+ }
model-00004-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17b7e70b4b94ebd344d4ae2bec764787fadca75b4fe41588e2d43b678ffba9e9
3
+ size 2140925008
model-00006-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67a7bcfed5c7e4e9524272978ed33230f260a16cbab12d42f4eba350ffa5601b
3
+ size 2152327648
model-00007-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1bb4c75595284657112df034caff5d2cbcc959117aaac2f90d31fce701b9182
3
+ size 2139659320
model-00009-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f537e2d7e2239cd644a943178fc27f3c93e1b4ecc416b550ff05b135e5c6a29f
3
+ size 2139659656
model-00010-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee7b41e64322ed42ba9a539a7b6e7c1fd339dba974e551586448ed86beeb51ab
3
+ size 2139659656
model-00011-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20b2b5dfa364441464f23b558eca3565d440cd20ade36763908abab187dce41f
3
+ size 2139659344
model-00013-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e75f7112125141ce680a14bdba19737e0513b11eb2d467d19247dd467bb10a7
3
+ size 2139659656
model-00014-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21d596f74f53549f694afcb0987677a65cddfb2fca662e2fc720163bbf7dce36
3
+ size 2139659656
model-00017-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d16d4badae257d3d532a23a51a9a7559513d0bd149daf040c8897dc5974cca2d
3
+ size 2139659656
model-00018-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b55266867143204d1f551dc708553adf461f1984b4170cbc30b2e5be8a8e67b1
3
+ size 2139659656
model-00019-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a23e943e914d0e55ed7dd0de616dec50846ec8f021e70e93a163c9dce1f85e88
3
+ size 2139659512
model-00020-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1596a3c245e26bf4f02936f1c64d8984cc9fbe74a674cc2afc69f269ffe04851
3
+ size 2139659312
model-00023-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8415deee244a8aa3993a4f38a67584611091195c61ecb1ed062c6a159708f658
3
+ size 2139659584
model-00025-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dcfde038d3ada16f0f8fa34e6a4de090f3680f43cfe1bbb52f71ada8f61626fb
3
+ size 2139659560
model-00026-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63e33ba8f3764e2a0fdeb759966375abe6ff78c49d96b5ec0a3e9e2a29694c44
3
+ size 2139659656
model-00029-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:697a6d6d76d352cfa41c120e0f5be3459ef4144896b3bb7c43280b38fcd41912
3
+ size 2139659472
model-00031-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fee39594f9404d9c23d52c70dbf689bdeed5c981d584ba41cf820dffd4cb50de
3
+ size 2139659656
model-00032-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df84d1bbbd36f772b308cd2dd8fd58bd87b8645eb0df13bde114d410a22bd9e0
3
+ size 2139659408
model-00033-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50490b0de13cf88d7c0062621817b1021eb99c03b588016691888e77dd8f348a
3
+ size 2139659392
model-00035-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4f577e8e74ba2d100077e5a5ca541f3a19a3a84a1619201d71902f8783eadae
3
+ size 2139659656
model-00037-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f457602d993e9a7b31f158fe4984d101d709e81e919f0ffbadd77e314c60a7ee
3
+ size 2139659320
model-00038-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c29e4b84cf49baf865221b596e4d00bca6243e4ff35cde0b68729be35c288570
3
+ size 2139659656
model-00039-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23e0ca533cfaf75f43e617976c5d7602034b2ccd6507b99139d70013fef40583
3
+ size 2139659656
model-00040-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:738f0a843248fef4bcf9a22493c68a0504a8491ecb39193c9cac5c52cef12449
3
+ size 2139659656
model-00041-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:526905acbf506151480dc63005459e6b755d4311b6b6446a8836cf799931fdcb
3
+ size 2139659656
model-00042-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79fe46fb5cfa3d90c79eb8d8319d34817cebd71684837548fa23cc6fec25e239
3
+ size 2139659912
model-00044-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:839ec34b4fb67d65f3dad41040a7bf4f71e114cff2be53d9b3e77eae58a22e27
3
+ size 2139659984
model-00045-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21984805b6992b40e36710875b09c29165f7406534f82c5e5703e6d5088cbaea
3
+ size 2139659656
model-00046-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9ed5586a1e5e894b6cd49e269ead882f9d08dceffb3f6b86240b687f47de3d4
3
+ size 2139659840
model-00050-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b90f8826d8275885fe7f32e18d5bf0b99e0e480d9f5c4ac59fefddc629732d9
3
+ size 2139659752
model-00051-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa7cee808841079b1287bad24e2fdc524904e7b039c248329e064ca9acc1757c
3
+ size 2139659992
model-00053-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b832ffcb6ee2f044fb02af086bca8a087092a95a6142caf5b2e2f3fedb128da
3
+ size 2139659808
model-00055-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0335c8b51ce8b01a78cb86dcd1f83c3d7ff7a5f1091931164b1168c362c2f29e
3
+ size 2139660000
model-00056-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e76ad8e4b5aeacaeb9b92fbefae8ea55dd4bc678c9a121e3ec8c444482552f71
3
+ size 2139659992
model-00057-of-00057.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8cd5e0a2f42cc495337be9dcff578642160ab32be870f278bbbb5f53f3b5bb9
3
+ size 1472589448
model-00058-of-00070.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b356554397bf30b75f49560417fa7e0671b0d7b6040690ec9570d186a48e0dcc
3
+ size 823886416
model-00060-of-00070.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:795a032e1ae0b8a4a452fa879eae47f7a95819163fcbee77bacccc5089285c42
3
+ size 805518808
model-00061-of-00070.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b572bea52fb12d0a5cd8c59f0512517d122d32c935bca5908e2632eca49566a
3
+ size 805518816
model-00062-of-00070.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38a242fdb6e9888fb837a9cbf17258f0c7700a5afb8a88f06be2496905e45131
3
+ size 805518816
model-00063-of-00070.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5b46657cda9748a50707aadd91cebfaf68280d8503f35d6095c540d37a7b213
3
+ size 805518920
model-00064-of-00070.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6ebd74b63ecad5bbc7941aded0a0d6ff3c466bc2573787f54faaefb9e491a1f
3
+ size 805518944
model-00065-of-00070.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3618e2637fc74e29eb08a3aac5aa26ae9b52b3212b0f5b059a2fdefdc5590098
3
+ size 805518944
model-00066-of-00070.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b979fdf14009f6405dedcfb622a603e622ea721ed13d242be02dc9a34b10721
3
+ size 805518936
model-00068-of-00070.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca0d3788a3162aadfd4c2b3b017beaa8f97e88b1f04407be8ae8fd8c4e05d745
3
+ size 805518944
model-00069-of-00070.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b73d3933379d23901b5d8f5532a9cf5c5422b307160b9ef69ded99c95526b667
3
+ size 805518936
model-00070-of-00070.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0f837b00c8b13e36dd9840acb5d26e7b724b96a7ee21040a6b606d2647a3fa1
3
+ size 352414504
model.safetensors.index.json ADDED
The diff for this file is too large to render. See raw diff