Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -58,11 +58,14 @@ python scripts/hf_inference_emoji_demo.py --hf_repo Potpov/grimoire-checkpoints
|
|
| 58 |
All three are verified working (torch 2.0.1 / cu118 / diffvg-from-source).
|
| 59 |
|
| 60 |
### Notes
|
| 61 |
-
- Build the VSQ from its **own** `vsq/config.yaml`
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
|
|
|
|
|
|
|
|
|
| 66 |
|
| 67 |
## Requirements
|
| 68 |
torch 2.0.1 (cu118) · diffvg (from source) · see the code repo's `install.sh` / `requirements.txt`.
|
|
|
|
| 58 |
All three are verified working (torch 2.0.1 / cu118 / diffvg-from-source).
|
| 59 |
|
| 60 |
### Notes
|
| 61 |
+
- Build the VSQ from its **own** `vsq/config.yaml`. `mnist_color/*` configs are the repo configs.
|
| 62 |
+
- `emoji/vsq` is `emoji_VSQ_hydra_small_noout` (`hydra` decoder, `single_code_representation=true`,
|
| 63 |
+
`num_segments=16`, `pred_color=true`) — the properly-trained emoji VSQ; it reconstructs emojis
|
| 64 |
+
faithfully. (An earlier push used the older `VSQ_EMOJI_COLOR`, which under-reconstructed.)
|
| 65 |
+
- **Loading the ART (stage-2) checkpoints:** strip only the *leading* `model.` prefix (a blanket
|
| 66 |
+
`replace("model.","")` also deletes the inner `.model.` in `transformer.model.layers.*` → the
|
| 67 |
+
transformer loads as random weights) and remap `.ff.3.`→`.ff.2.` (x-transformers version shift).
|
| 68 |
+
`scripts/hf_generate_demo.py:_remap_key` does this. VSQ checkpoints load with a plain leading-prefix strip.
|
| 69 |
|
| 70 |
## Requirements
|
| 71 |
torch 2.0.1 (cu118) · diffvg (from source) · see the code repo's `install.sh` / `requirements.txt`.
|