madeby561 commited on
Commit
c8ba356
·
verified ·
1 Parent(s): 07db171

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -41,6 +41,16 @@ This is the **`-term`** sibling of [**GLM-5.2-NVFP4-REAP-504B**](https://hugging
41
 
42
  GLM-5.2 exposes **two** reasoning levels: **`high`** and **`max`**. The chat template **defaults to `max`** and treats anything else as `max`; there is no low/medium/minimal. Pass `reasoning_effort: "high"` (e.g. via `chat_template_kwargs`) for shorter, faster thinking; leave it default for `max`. This is a **heavy thinker** — at `max` it can reason for tens of thousands of tokens before answering, so give it a generous `max_tokens` (≈80–120k) or it will hit the cap mid-thought.
43
 
 
 
 
 
 
 
 
 
 
 
44
  ## Honest limitations / which sibling to pick — READ THIS
45
 
46
  - **Not A/B-validated** against the code-calibrated `-504B`. Whether the trace-recalibration actually *helps your workload* is unmeasured; for pure coding the `-504B` may be more decisive/less verbose. **Benchmark both on your own tasks.**
 
41
 
42
  GLM-5.2 exposes **two** reasoning levels: **`high`** and **`max`**. The chat template **defaults to `max`** and treats anything else as `max`; there is no low/medium/minimal. Pass `reasoning_effort: "high"` (e.g. via `chat_template_kwargs`) for shorter, faster thinking; leave it default for `max`. This is a **heavy thinker** — at `max` it can reason for tens of thousands of tokens before answering, so give it a generous `max_tokens` (≈80–120k) or it will hit the cap mid-thought.
43
 
44
+ ## What it's calibrated on (and what that means)
45
+
46
+ Calibrated **narrow, on purpose:** code + tool-calling/agentic data (evol-codealpaca, Magicoder, xLAM function-calling, SWE-smith) **plus the model's own terminating reasoning traces**. We did **not** calibrate on broad/general, multilingual, or long-document data.
47
+
48
+ - **Stronger at:** coding, tool use, and ending its own reasoning (the termination traces are the whole point of this variant).
49
+ - **Weaker at (expected):** general knowledge, other languages, niche domains — those experts scored low on a code-heavy calibration, so they got dropped.
50
+ - **Long context still works** — that lives in the attention, which isn't pruned (an internal 177k-token task scores 30/30); we just didn't add long-document calibration.
51
+
52
+ Want a broad general-purpose model instead? Calibrate on a wider mix (general + multilingual + long-context).
53
+
54
  ## Honest limitations / which sibling to pick — READ THIS
55
 
56
  - **Not A/B-validated** against the code-calibrated `-504B`. Whether the trace-recalibration actually *helps your workload* is unmeasured; for pure coding the `-504B` may be more decisive/less verbose. **Benchmark both on your own tasks.**