Model card: the command and the recipe
Browse files
README.md
CHANGED
|
@@ -47,29 +47,12 @@ Built and tested on 2× Radeon AI PRO R9700 (gfx1201).
|
|
| 47 |
|
| 48 |
## How this file was made
|
| 49 |
|
| 50 |
-
The exact command, run on 2026-10-01 from a radiance build directory (`radiance_home` is that
|
| 51 |
-
build's plugin directory):
|
| 52 |
-
|
| 53 |
-
```sh
|
| 54 |
-
./bin/rad-convert ~/models/Qwen/Qwen3.6-35B-A3B-FP8 -o ~/models/rad/q36-35b-a3b-fp8.v2.rad \
|
| 55 |
-
--home radiance_home --recipe ../data/recipes/q36-35b-a3b-fp8.recipe
|
| 56 |
-
```
|
| 57 |
-
|
| 58 |
-
The published file is that output under this repository's name, with the local directory removed
|
| 59 |
-
from the `created by` string in its header; the weights are the converter's bytes. The same
|
| 60 |
-
conversion with the radiance image (`docker/build.sh` in the radiance repository, commit 93bbe22)
|
| 61 |
-
reproduces them byte for byte:
|
| 62 |
-
|
| 63 |
```sh
|
| 64 |
-
|
| 65 |
-
/models/Qwen/Qwen3.6-35B-A3B-FP8 \
|
| 66 |
-
--recipe /opt/radiance/share/radiance/recipes/q36-35b-a3b-fp8.recipe \
|
| 67 |
-
-o /models/qwen3.6-35b-a3b-fp8.rad
|
| 68 |
```
|
| 69 |
|
| 70 |
-
The recipe
|
| 71 |
-
|
| 72 |
-
everything they do not name is the checkpoint's own:
|
| 73 |
|
| 74 |
```
|
| 75 |
output.weight rtn codes=fp8_e4m3 block=128x128 scale=bf16
|
|
|
|
| 47 |
|
| 48 |
## How this file was made
|
| 49 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
```sh
|
| 51 |
+
rad-convert Qwen/Qwen3.6-35B-A3B-FP8 --recipe q36-35b-a3b-fp8.recipe -o qwen3.6-35b-a3b-fp8.rad
|
|
|
|
|
|
|
|
|
|
| 52 |
```
|
| 53 |
|
| 54 |
+
The recipe (`q36-35b-a3b-fp8.recipe` in this repository); everything it does not name is the
|
| 55 |
+
checkpoint's own:
|
|
|
|
| 56 |
|
| 57 |
```
|
| 58 |
output.weight rtn codes=fp8_e4m3 block=128x128 scale=bf16
|