Document Gemma 4 reasoning parser
Browse files
README.md
CHANGED
|
@@ -68,7 +68,8 @@ vllm serve WaveCut/gemma-4-26B-A4B-it-heretic-W4A16-G64-RTN-vllm \
|
|
| 68 |
--generation-config vllm \
|
| 69 |
--no-enable-prefix-caching \
|
| 70 |
--enable-auto-tool-choice \
|
| 71 |
-
--tool-call-parser gemma4
|
|
|
|
| 72 |
```
|
| 73 |
|
| 74 |
The checkpoint was accepted for production on AI Farm with vLLM 0.25.1,
|
|
|
|
| 68 |
--generation-config vllm \
|
| 69 |
--no-enable-prefix-caching \
|
| 70 |
--enable-auto-tool-choice \
|
| 71 |
+
--tool-call-parser gemma4 \
|
| 72 |
+
--reasoning-parser gemma4
|
| 73 |
```
|
| 74 |
|
| 75 |
The checkpoint was accepted for production on AI Farm with vLLM 0.25.1,
|