Instructions to use yocoms/system1-qlora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use yocoms/system1-qlora with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -33,6 +33,18 @@ in that design space. **Improvements on top of this work are very welcome** —
|
|
| 33 |
|---|---|---|---|
|
| 34 |
| [`06b/`](https://huggingface.co/yocoms/system1-qlora/tree/main/06b) | Qwen3-0.6B | LoRA r=16, α=32 | ~53 ms on GPU; ~0.4 s on CPU (fp32) |
|
| 35 |
| [`4b/`](https://huggingface.co/yocoms/system1-qlora/tree/main/4b) | Qwen3-4B-Instruct-2507 | LoRA r=16, α=32 | ~165 ms on GPU |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
|
| 37 |
## Scoring mechanism
|
| 38 |
|
|
|
|
| 33 |
|---|---|---|---|
|
| 34 |
| [`06b/`](https://huggingface.co/yocoms/system1-qlora/tree/main/06b) | Qwen3-0.6B | LoRA r=16, α=32 | ~53 ms on GPU; ~0.4 s on CPU (fp32) |
|
| 35 |
| [`4b/`](https://huggingface.co/yocoms/system1-qlora/tree/main/4b) | Qwen3-4B-Instruct-2507 | LoRA r=16, α=32 | ~165 ms on GPU |
|
| 36 |
+
| [`06b_bf16_r16/`](https://huggingface.co/yocoms/system1-qlora/tree/main/06b_bf16_r16) | Qwen3-0.6B | LoRA r=16, α=32 | ~53 ms on GPU |
|
| 37 |
+
|
| 38 |
+
**`06b_bf16_r16/` is a 2026-09-23 rebuild, not an upgrade — read this before choosing it.** Same
|
| 39 |
+
recipe, but trained on a **bf16 base rather than 4-bit NF4** (which is worth about 7 points on the
|
| 40 |
+
dev sets: training on a full-precision base beats QLoRA at this size, and it is a *training* effect,
|
| 41 |
+
not an inference one), on a **broadened corpus** that includes kev's public sources, with option
|
| 42 |
+
permutation at p=0.5. On the 231 public JevBench items it scores **0.632 against `06b/`'s 0.619 —
|
| 43 |
+
and that difference is not statistically significant** (+0.013, 95% CI [−0.035, +0.061]). It is
|
| 44 |
+
significantly better on kevsuite (+0.111 [+0.084, +0.137]) but that set is *in-distribution* for its
|
| 45 |
+
corpus, and it is **worse on abstention** (0.836 vs 0.960). Prefer `06b/` unless you specifically
|
| 46 |
+
want the kevsuite behaviour; the rebuild exists mainly as the cleanest available demonstration of
|
| 47 |
+
the training-precision effect.
|
| 48 |
|
| 49 |
## Scoring mechanism
|
| 50 |
|