xv0y5ncu commited on
Commit
7ac6ead
·
verified ·
1 Parent(s): dca615a

card: pin transformers <5.15 in the install line

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -78,9 +78,13 @@ print(tok.decode(out[0, ids.shape[1]:], skip_special_tokens=False))
78
  ## Installation
79
 
80
  ```bash
81
- pip install glq
82
  ```
83
 
 
 
 
 
84
  The custom CUDA kernel JIT-compiles on first use (~30s). Requires
85
  `torch>=2.0`, `transformers>=5.0`, CUDA 12.x.
86
 
 
78
  ## Installation
79
 
80
  ```bash
81
+ pip install glq "transformers>=5.13.1,<5.15"
82
  ```
83
 
84
+ **Pin transformers below 5.15** — 5.15.0 moved gemma-4 to a per-layer config, so
85
+ `config.head_dim` raises and vLLM dies before loading a single weight. Verified on
86
+ 5.14.1 with vLLM 0.27.1. Not specific to GLQ: stock bf16 gemma-4 fails the same way.
87
+
88
  The custom CUDA kernel JIT-compiles on first use (~30s). Requires
89
  `torch>=2.0`, `transformers>=5.0`, CUDA 12.x.
90