card: pin transformers <5.15 in the install line
Browse files
README.md
CHANGED
|
@@ -78,9 +78,13 @@ print(tok.decode(out[0, ids.shape[1]:], skip_special_tokens=False))
|
|
| 78 |
## Installation
|
| 79 |
|
| 80 |
```bash
|
| 81 |
-
pip install glq
|
| 82 |
```
|
| 83 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 84 |
The custom CUDA kernel JIT-compiles on first use (~30s). Requires
|
| 85 |
`torch>=2.0`, `transformers>=5.0`, CUDA 12.x.
|
| 86 |
|
|
|
|
| 78 |
## Installation
|
| 79 |
|
| 80 |
```bash
|
| 81 |
+
pip install glq "transformers>=5.13.1,<5.15"
|
| 82 |
```
|
| 83 |
|
| 84 |
+
**Pin transformers below 5.15** — 5.15.0 moved gemma-4 to a per-layer config, so
|
| 85 |
+
`config.head_dim` raises and vLLM dies before loading a single weight. Verified on
|
| 86 |
+
5.14.1 with vLLM 0.27.1. Not specific to GLQ: stock bf16 gemma-4 fails the same way.
|
| 87 |
+
|
| 88 |
The custom CUDA kernel JIT-compiles on first use (~30s). Requires
|
| 89 |
`torch>=2.0`, `transformers>=5.0`, CUDA 12.x.
|
| 90 |
|