Build from cyankiwi/GLM-5.3-AWQ-INT4 base: REAP prune (W4A16), cyankiwi attribution

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+model.safetensors.index.json filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,6 +1,7 @@
 ---
 license: other
-base_model: zai-org/GLM-5.3
+base_model: cyankiwi/GLM-5.3-AWQ-INT4
+base_model_relation: quantized
 pipeline_tag: text-generation
 tags:
   - glm
@@ -8,36 +9,36 @@ tags:
   - moe
   - awq
   - w4a16
+  - int4
   - compressed-tensors
   - reap
   - expert-pruning
+  - hopper
 ---
 
 > [!TIP]
 > **[Support this work →](https://donate.sybilsolutions.ai)** · [X](https://x.com/0xsero) · [GitHub](https://github.com/0xsero) · [REAP paper](https://arxiv.org/abs/2510.13999) · [Cerebras REAP](https://huggingface.co/collections/cerebras/cerebras-reap)
 
-# GLM-5.3-569B-W4A16 — REAP keep-192 (AWQ / W4A16)
+# GLM-5.3-569B — REAP keep-192 (W4A16 / AWQ-INT4)
 
-> A **25%-expert-pruned GLM-5.3** (192 / 256 routed experts per layer, ~569B params) in **W4A16**
-> (compressed-tensors, AWQ-family) — **324 GB**, built for **Hopper (4× H200)** serving in vLLM/SGLang.
+> A **25%-expert-pruned GLM-5.3** (192 / 256 routed experts per layer, ~569B params) in **INT4 W4A16**
+> (compressed-tensors, AWQ), built for **Hopper (4x H200)** serving in vLLM / SGLang.
 
-The Hopper-servable sibling of [`GLM-5.3-569B-EXL3-3.0bpw`](https://huggingface.co/0xSero/GLM-5.3-569B-EXL3-3.0bpw).
-Pruned with the same **domain-protective max-over-domain saliency criterion** (each expert scored by its
-largest share of any single domain's routed mass, so every domain's specialists survive), applied
-directly to a W4A16 checkpoint.
+Pruned directly on the [cyankiwi/GLM-5.3-AWQ-INT4](https://huggingface.co/cyankiwi/GLM-5.3-AWQ-INT4) checkpoint
+with a **domain-protective max-over-domain saliency criterion** (each expert scored by its largest share of
+any single domains routed mass, so every domains specialist experts survive). Whole experts are dropped,
+kept experts renumbered, and the routers + MTP layer sliced to match.
 
 | | |
 |---|---|
-| Base | zai-org/GLM-5.3 → W4A16 (compressed-tensors, group 128) |
-| Prune | REAP, keep-192/256, all 75 MoE layers + MTP, routers sliced |
-| Size | 324 GB (fits 4× H200) |
-| KL vs BF16 | **0.349 nats** (prose 0.54 / code 0.20 / multilingual 0.25) |
+| Base | [cyankiwi/GLM-5.3-AWQ-INT4](https://huggingface.co/cyankiwi/GLM-5.3-AWQ-INT4) (compressed-tensors INT4 / AWQ) |
+| Prune | REAP, keep-192/256 (max-over-domain routed-mass saliency), all 75 MoE layers + MTP |
+| Format | INT4 W4A16, compressed-tensors (Marlin MoE kernel in vLLM) |
 
-At keep-192 the W4A16 and EXL3 3.0bpw cuts measure the same fidelity (0.349 vs 0.361 KLD on the same
-25-window full-vocabulary panel) — the prune dominates, so pick the format your hardware wants: W4A16
-for Hopper, EXL3 for Blackwell/consumer.
+Criterion and fidelity: [`0xSero/glm-5.3-reap-fidelity-study`](https://huggingface.co/datasets/0xSero/glm-5.3-reap-fidelity-study).
+This is the Hopper-servable sibling of [`GLM-5.3-569B-EXL3-3.0bpw`](https://huggingface.co/0xSero/GLM-5.3-569B-EXL3-3.0bpw).
 
-## Serving (vLLM, 4× H200)
+## Serving (vLLM, 4x H200)
 
 ```bash
 vllm serve 0xSero/GLM-5.3-569B-W4A16 --tensor-parallel-size 4 --trust-remote-code --max-model-len 131072
@@ -46,18 +47,18 @@ vllm serve 0xSero/GLM-5.3-569B-W4A16 --tensor-parallel-size 4 --trust-remote-cod
 ## Acknowledgements
 
 - **[Z.AI / zai-org](https://huggingface.co/zai-org)** for [GLM-5.3](https://huggingface.co/zai-org/GLM-5.3), the base model.
-- **[Cerebras Research](https://github.com/CerebrasResearch/reap)** for REAP — [arXiv:2510.13999](https://arxiv.org/abs/2510.13999).
-- W4A16 base quantization via **compressed-tensors** (AWQ-family).
+- **[cyankiwi](https://huggingface.co/cyankiwi)** for the [GLM-5.3-AWQ-INT4](https://huggingface.co/cyankiwi/GLM-5.3-AWQ-INT4) W4A16 base quantization this prune is built on.
+- **[Cerebras Research](https://github.com/CerebrasResearch/reap)** for REAP (Router-weighted Expert Activation Pruning) — [arXiv:2510.13999](https://arxiv.org/abs/2510.13999).
 
-Observations: [`0xSero/glm-5.3-nvfp4-reap-observations-v1`](https://huggingface.co/datasets/0xSero/glm-5.3-nvfp4-reap-observations-v1). Study: [`0xSero/glm-5.3-reap-fidelity-study`](https://huggingface.co/datasets/0xSero/glm-5.3-reap-fidelity-study). Pruning + evaluation on 8× NVIDIA RTX PRO 6000 Blackwell.
+Observations: [`0xSero/glm-5.3-reap-observations-v1`](https://huggingface.co/datasets/0xSero/glm-5.3-reap-observations-v1). Fidelity study: [`0xSero/glm-5.3-reap-fidelity-study`](https://huggingface.co/datasets/0xSero/glm-5.3-reap-fidelity-study). Pruning and evaluation ran on 8x NVIDIA RTX PRO 6000 Blackwell.
 
 ## Citation
 
 ```bibtex
 @misc{lasby2025reap,
-  title  = {REAP the Experts: Why Pruning Prevails for One-Shot MoE Compression},
-  author = {Mike Lasby and Ivan Lazarevich and Nish Sinnadurai and Sean Lie and Yani Ioannou and Vithursan Thangarasa},
-  year   = {2025}, eprint = {2510.13999}, archivePrefix = {arXiv}
+  title  = {{REAP the Experts: Why Pruning Prevails for One-Shot MoE Compression}},
+  author = {{Mike Lasby and Ivan Lazarevich and Nish Sinnadurai and Sean Lie and Yani Ioannou and Vithursan Thangarasa}},
+  year   = {{2025}}, eprint = {{2510.13999}}, archivePrefix = {{arXiv}}
 }
 ```
 

chat_template.jinja

@@ -0,0 +1,251 @@
+[gMASK]<sop>
+{%- set effective_reasoning_effort = reasoning_effort if reasoning_effort is defined and reasoning_effort in ['low', 'high'] else 'max' -%}
+{%- if effective_reasoning_effort is not none -%}<|system|>Reasoning Effort: {{ effective_reasoning_effort | capitalize }}{%- endif -%}
+{%- set clear_thinking = clear_thinking if clear_thinking is defined else false -%}
+{%- if tools -%}
+{%- macro tool_to_json(tool) -%}
+    {%- set ns_tool = namespace(first=true) -%}
+    {{ '{' -}}
+    {%- for k, v in tool.items() -%}
+        {%- if k != 'defer_loading' and k != 'strict' -%}
+            {%- if not ns_tool.first -%}{{- ', ' -}}{%- endif -%}
+            {%- set ns_tool.first = false -%}
+            "{{ k }}": {{ v | tojson(ensure_ascii=False) }}
+        {%- endif -%}
+    {%- endfor -%}
+    {{- '}' -}}
+{%- endmacro -%}
+{%- macro tool_references_to_response(refs) -%}
+    {{- '<tool_response><tools>\n' -}}
+    {%- for tr in refs -%}
+        {%- for tool in tools -%}
+            {%- if 'function' in tool -%}
+                {%- set tool = tool['function'] -%}
+            {%- endif -%}
+            {%- if tool.name == tr.name -%}
+                {{- tool_to_json(tool) + '\n' -}}
+            {%- endif -%}
+        {%- endfor -%}
+    {%- endfor -%}
+    {{- '</tools></tool_response>' -}}
+{%- endmacro -%}
+<|system|>
+# Tools
+
+You may call one or more functions to assist with the user query.
+
+You are provided with function signatures within <tools></tools> XML tags:
+<tools>
+{% for tool in tools %}
+{%- if 'function' in tool -%}
+    {%- set tool = tool['function'] -%}
+{%- endif -%}
+{% if tool.defer_loading is not defined or not tool.defer_loading %}
+{{ tool_to_json(tool) }}
+{% endif %}
+{% endfor %}
+</tools>
+
+For each function call, output the function name and arguments within the following XML format:
+<tool_call>{function-name}<arg_key>{arg-key-1}</arg_key><arg_value>{arg-value-1}</arg_value><arg_key>{arg-key-2}</arg_key><arg_value>{arg-value-2}</arg_value>...</tool_call>{%- endif -%}
+{%- macro visible_text(content) -%}
+    {%- if content is string -%}
+        {{- content }}
+    {%- elif content is iterable and content is not mapping -%}
+        {%- for item in content -%}
+            {%- if item is mapping and item.type == 'text' -%}
+                {{- item.text }}
+            {%- elif item is string -%}
+                {{- item }}
+            {%- elif item is mapping and item.type in ['image', 'image_url', 'video', 'video_url', 'audio', 'audio_url', 'input_audio'] -%}
+                {%- set media_type = item.type | replace('_url', '') | replace('input_', '') -%}
+                {{- "<reminder>You are unable to process this " ~ media_type ~ " because you don't have multi-modal input ability. Try different methods.</reminder>" }}
+            {%- endif -%}
+        {%- endfor -%}
+    {%- else -%}
+        {{- content }}
+    {%- endif -%}
+{%- endmacro -%}
+{%- macro tool_response(text) -%}
+{{- '<tool_response>' + text + '</tool_response>' -}}
+{%- endmacro -%}
+{%- macro render_tool_response(m) -%}
+{%- if m.content is string -%}
+    {{- tool_response(m.content) -}}
+{%- elif m.content and m.content is not mapping and m.content.0.type == "tool_reference" -%}
+    {{- tool_references_to_response(m.content) -}}
+{%- elif is_list_of_outputs(m) -%}
+    {%- for tr in m.content -%}
+        {%- if tr.output is iterable and tr.output is not string and tr.output is not mapping and tr.output and tr.output.0.type == "tool_reference" -%}
+            {{- tool_references_to_response(tr.output) -}}
+        {%- else -%}
+            {{- tool_response(visible_text(tr.output)) -}}
+        {%- endif -%}
+    {%- endfor -%}
+{%- else -%}
+    {{- tool_response(visible_text(m.content)) -}}
+{%- endif -%}
+{%- endmacro -%}
+{%- macro id_of(obj) -%}
+    {%- if obj.tool_call_id -%}
+        {{- obj.tool_call_id -}}
+    {%- elif obj.id -%}
+        {{- obj.id -}}
+    {%- endif -%}
+{%- endmacro -%}
+{%- macro is_list_of_outputs(m) -%}
+    {%- if m.content and m.content.0.output is defined -%}1{%- endif -%}
+{%- endmacro -%}
+{%- macro has_dup_tool_result_id(lo, hi, target) -%}
+    {%- set ns_cnt = namespace(n=0) -%}
+    {%- for k in range(lo, hi + 1) -%}
+        {%- set m = messages[k] -%}
+        {%- if is_list_of_outputs(m) -%}
+            {%- for entry in m.content -%}
+                {%- if id_of(entry) == target -%}
+                    {%- set ns_cnt.n = ns_cnt.n + 1 -%}
+                {%- endif -%}
+            {%- endfor -%}
+        {%- elif id_of(m) == target -%}
+            {%- set ns_cnt.n = ns_cnt.n + 1 -%}
+        {%- endif -%}
+        {%- if ns_cnt.n > 1 -%}{%- break -%}{%- endif -%}
+    {%- endfor -%}
+    {%- if ns_cnt.n > 1 -%}1{%- endif -%}
+{%- endmacro -%}
+{%- macro tc_id_exists(tcs, target) -%}
+    {%- set ns_f = namespace(found=false) -%}
+    {%- for tc in tcs -%}
+        {%- if id_of(tc) == target -%}
+            {%- set ns_f.found = true -%}
+            {%- break -%}
+        {%- endif -%}
+    {%- endfor -%}
+    {%- if ns_f.found -%}1{%- endif -%}
+{%- endmacro -%}
+{%- set ns = namespace(last_user_index=-1) -%}
+{%- for m in messages %}
+    {%- if m.role == 'user' %}
+        {%- set ns.last_user_index = loop.index0 -%}
+    {%- endif %}
+{%- endfor %}
+{%- for m in messages -%}
+{%- if m.role == 'user' -%}<|user|>{{ visible_text(m.content) }}
+{%- elif m.role == 'assistant' -%}
+<|assistant|>
+{%- set content = visible_text(m.content) %}
+{%- if m.reasoning_content is string %}
+    {%- set reasoning_content = m.reasoning_content %}
+{%- elif '</think>' in content %}
+    {%- set reasoning_content = content.split('</think>')[0].split('<think>')[-1] %}
+    {%- set content = content.split('</think>')[-1] %}
+{%- endif %}
+{%- if (not clear_thinking or loop.index0 > ns.last_user_index) and reasoning_content is defined -%}
+{{ '<think>' + reasoning_content +  '</think>'}}
+{%- else -%}
+{{ '<think></think>' }}
+{%- endif -%}
+{%- if content.strip() -%}
+{{ content.strip() }}
+{%- endif -%}
+{% if m.tool_calls %}
+{% for tc in m.tool_calls %}
+{%- if tc.function %}
+    {%- set tc = tc.function %}
+{%- endif %}
+{{- '<tool_call>' + tc.name -}}
+{% set _args = tc.arguments %}{% for k, v in _args.items() %}<arg_key>{{ k }}</arg_key><arg_value>{{ v | tojson(ensure_ascii=False) if v is not string else v }}</arg_value>{% endfor %}</tool_call>{% endfor %}
+{% endif %}
+{%- elif m.role == 'tool' -%}
+{%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+    {{- '<|observation|>' -}}
+    {%- set block_start = loop.index0 -%}
+    {%- set ns_blk = namespace(end=block_start) -%}
+    {%- for j in range(block_start, messages|length) -%}
+        {%- if messages[j].role == 'tool' -%}
+            {%- set ns_blk.end = j -%}
+        {%- else -%}
+            {%- break -%}
+        {%- endif -%}
+    {%- endfor -%}
+    {%- set ns_a = namespace(tool_calls=none) -%}
+    {%- if block_start > 0 and messages[block_start - 1].role == 'assistant' and messages[block_start - 1].tool_calls -%}
+        {%- set ns_a.tool_calls = messages[block_start - 1].tool_calls -%}
+    {%- endif -%}
+    {%- set ns_chk = namespace(can_sort=true) -%}
+    {%- if not ns_a.tool_calls -%}
+        {%- set ns_chk.can_sort = false -%}
+    {%- else -%}
+        {%- for k in range(block_start, ns_blk.end + 1) -%}
+            {%- set m = messages[k] -%}
+            {%- if is_list_of_outputs(m) -%}
+                {%- for entry in m.content -%}
+                    {%- set eid = id_of(entry) -%}
+                    {%- if not eid -%}
+                        {%- set ns_chk.can_sort = false -%}
+                    {%- elif has_dup_tool_result_id(block_start, ns_blk.end, eid) -%}
+                        {%- set ns_chk.can_sort = false -%}
+                    {%- elif not tc_id_exists(ns_a.tool_calls, eid) -%}
+                        {%- set ns_chk.can_sort = false -%}
+                    {%- endif -%}
+                {%- endfor -%}
+            {%- else -%}
+                {%- set tk_id = id_of(m) -%}
+                {%- if not tk_id -%}
+                    {%- set ns_chk.can_sort = false -%}
+                {%- elif has_dup_tool_result_id(block_start, ns_blk.end, tk_id) -%}
+                    {%- set ns_chk.can_sort = false -%}
+                {%- elif not tc_id_exists(ns_a.tool_calls, tk_id) -%}
+                    {%- set ns_chk.can_sort = false -%}
+                {%- endif -%}
+            {%- endif -%}
+        {%- endfor -%}
+        {%- for i in range(ns_a.tool_calls | length) -%}
+            {%- set tc_id = id_of(ns_a.tool_calls[i]) -%}
+            {%- if not tc_id -%}
+                {%- set ns_chk.can_sort = false -%}
+            {%- endif -%}
+            {%- for j in range(i + 1, ns_a.tool_calls | length) -%}
+                {%- if id_of(ns_a.tool_calls[j]) == tc_id -%}
+                    {%- set ns_chk.can_sort = false -%}
+                {%- endif -%}
+            {%- endfor -%}
+        {%- endfor -%}
+    {%- endif -%}
+    {%- if ns_chk.can_sort -%}
+        {%- for tc in ns_a.tool_calls -%}
+            {%- set tc_id = id_of(tc) -%}
+            {%- for k in range(block_start, ns_blk.end + 1) -%}
+                {%- set m = messages[k] -%}
+                {%- if is_list_of_outputs(m) -%}
+                    {%- for entry in m.content -%}
+                        {%- set eid = id_of(entry) -%}
+                        {%- if eid == tc_id -%}
+                            {%- if entry.output is iterable and entry.output is not string and entry.output is not mapping and entry.output and entry.output.0.type == "tool_reference" -%}
+                                {{- tool_references_to_response(entry.output) -}}
+                            {%- else -%}
+                                {{- tool_response(visible_text(entry.output)) -}}
+                            {%- endif -%}
+                        {%- endif -%}
+                    {%- endfor -%}
+                {%- else -%}
+                    {%- set tk_id = id_of(m) -%}
+                    {%- if tk_id == tc_id -%}
+                        {{- render_tool_response(m) -}}
+                    {%- endif -%}
+                {%- endif -%}
+            {%- endfor -%}
+        {%- endfor -%}
+    {%- else -%}
+        {%- for k in range(block_start, ns_blk.end + 1) -%}
+            {{- render_tool_response(messages[k]) -}}
+        {%- endfor -%}
+    {%- endif -%}
+{% endif -%}
+{%- elif m.role == 'system' -%}
+<|system|>{{ visible_text(m.content) }}
+{%- endif -%}
+{%- endfor -%}
+{%- if add_generation_prompt -%}
+    <|assistant|>{{- '<think>' -}}
+{%- endif -%}

generation_config.json

@@ -0,0 +1,13 @@
+{
+  "_from_model_config": true,
+  "do_sample": true,
+  "eos_token_id": [
+    154820,
+    154827,
+    154829
+  ],
+  "pad_token_id": 154820,
+  "temperature": 1.0,
+  "top_p": 0.95,
+  "transformers_version": "5.16.0.dev0"
+}

model-00001.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8e69135e3dfd9f6dae38c5fc74adce38c15a74a54441794b308e8719873ae0ed
+size 8595006928

model-00002.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aa00b52978946d0ced7aaa24fa4efd81942da3895b278a2559f7093418af0223
+size 8692606664

model-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:61b77806c7716ff1b17f4df4b0c7a9c3a44bf3efb71a2e6fb40c8e8a9b39a784
+size 8600230816

model-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:44b1bf3c17950bc1ded6c87f0ad7e92e80078c85ee105da9871cf43e8ffab54f
+size 8606754392

model-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b38d7f1e20997934c24c5095d516b882ec07fa3433885cf85f73aa0737a1aaca
+size 8591724016

model-00006.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:59a48f2991c5d7741e954deec27f560d91f132fc8b0dd6ff0ff4b58e98f8b285
+size 8594866696

model-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cfd98ec4282c630ad3c1fa008024f903102e368ad557ee6fa1f6912fc1f3d1f4
+size 8594866808

model-00008.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1a67f933cf739ee393f14ace8a6c0cf2528288fe45899c5f7429fe9363d92e9b
+size 8593585472

model-00009.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:50062f4b71e47911d1321adc40fe5f266b7ba2fd30ba998b03b9b2449d0078b1
+size 8593194288

model-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3e4992f30a7bbfa38f5c799cfeae8e2d8cf65a04cec64893a6e79eba7b2aa784
+size 8596869448

model-00011.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc0c91cc2a8aae7ee925912a79503be2a553af11b2f9a766d00bf6aa7a29e478
+size 8594866704

model-00012.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c2f09703fbfadde14e1f3f689242154f86b7277968e7a08ca30b8fa0fc986ec9
+size 8593782824

model-00013.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b087fa344da1261b61185d0463cb9a0053aaeaa8e0c69cb881f3a43b9500f4e
+size 8590832064

model-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7aa8804441cc35c028ac1bb22e622e9e3fc6232ba5ea4e0cab70c6553a2b262e
+size 8591966280

model-00015.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:01a34c98d21580fb7360cda568814f0f8c496773e9f0ebd23881cdbf86315f92
+size 8594866808

model-00016.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb087fc9fa324030e79cb5ef608a977cb6008e18b6ae57427ddc6d7c4747d9d9
+size 8594866728

model-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ca8e936d734185ff5577b4f09d4cbfca1789e3f233d49ca79ad616d0a484622
+size 8590418576

model-00018.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea638f35c68c0d95115e5c99da9d6da4c1a5b68f2f8d5d82ee061e830b64f8ef
+size 8590695768

model-00019.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c0dbe3874327609ff2dbebe53352d11bf6d4471f310017e1fe85e196146c796
+size 8596799920

model-00020.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cdd108961b4be3ad7476f25db1b4aa6d6f3c43469404c349cff0eae33ddf1993
+size 8594866824

model-00021.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:809c5ff00c8af0966021c07a56352ab361477b2a9a7a83e7f8980cf05fd53707
+size 8594866784

model-00022.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:551e50f7570c0e4c9630216a6aa2c5ffac95ddd027800c97dc71cae749810bdf
+size 8591160696

model-00023.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:912897e6ab49b9bdd040d2e6dd59f23e8f1ca9b710b268c71dd2201e1d8b4c34
+size 8596054424

model-00024.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e9f664dd1f7a84683497d256e9d98dae480286fd894e5651eed568d96ab3f8d6
+size 8593782824

model-00025.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f8db519f3ef3fbbc622e118cfbfa37fc38b97ecfc50d9b4a4ef52987b145bc24
+size 8594866808

model-00026.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:549a322be812e4706896fd86efd2230cfa4169f337655301c3bb48d0d075ad4c
+size 8594189520

model-00027.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:941f6898bf1d74d04ee41b07d3f1222860ff36e9e138e1bec7d59ec5f37b04fa
+size 8594506760

model-00028.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eed316d92934d98a733601ae9a4ef046407b968557f3fc98623aab5d93f37ab9
+size 8594866592

model-00029.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b298b0702152433374fac7367afcc92955a4a9e08ebb9b229bcf84bd427731e5
+size 8593782816

model-00030.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b75a333fac8279f12f90c0ac4e092b2f8a10261acfaa17f7e0d7eb0f1c8664b
+size 8594866824

model-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:636705fb45ca4389b633caa3a440834de5df8b565053ae18cb1b932a5a7cb6dc
+size 8596428280

model-00032.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a4b1caa7efb22a68d9d616b46201aa4be87900a2577b7e34c3ad9d12a03c0be2
+size 8590982032

model-00033.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:12d4a864bcc5a1208833480baab5dd6d266a3d6fea4dd6f14e5a5002f90e2e8f
+size 8594669936

model-00034.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:173467d6a28ee084562e2c08959fe9a24cfea370366c56492e6c61690178951c
+size 8593782816

model-00035.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0249c1835f358e4d19d6d9ab7f998c738026ab75ca41e94923322e5372f44fb3
+size 8603796416

model-00036.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47240a56be8d7c9323b2e99cf92533ac843f00d773f11fb8c91864598dbeb749
+size 8594883232

model-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b72c1e9d1b90917da67ba00d2ec7a5834e7323d4252afedf6ae215bdf7efdae9
+size 8594866832

model-00038.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e39818dc9a058e8d6091d9739b562e597dbd1a898cd3997222390c1eaa42d8e7
+size 8594866680

model-00039.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3e6a29e4c7d5dd410a8e286e15de8379d29f7d11b3294247eb0b8098b6ee875e
+size 8590578600

model-00040.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d13cb5fac2d5d7da28c37eeabcdadebcf263d49db7c9ca6cd79c34168a6a31a
+size 8599473872

model-00041.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c8950b4b97794c9952e15d1fd8a7b2dd68798f6512f06406069e2961fa5ce31
+size 8612002216

model-00042.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4deb21abc128d4892b932a189682ca646ac219668e8dcd3a5827cf4752635095
+size 8606816048

model-00043.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc89b21550c7295f5613de22ed6e3ae51e74ae4bc006107e65ce6c9cb3ea44fb
+size 8606754800

model-00044.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d8d0602518a179f5495f3dd52253075a93a4544ad074f36b786d186fb06a5d5
+size 1936629544

model.safetensors.index.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d22f89a6897c8decc1fae7a21e6e0580646ac94d2503ce59ea92f0d2eda1dbe
+size 14948995