Potpov commited on
Commit
dc58d19
·
verified ·
1 Parent(s): 6f9c34d

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +8 -5
README.md CHANGED
@@ -58,11 +58,14 @@ python scripts/hf_inference_emoji_demo.py --hf_repo Potpov/grimoire-checkpoints
58
  All three are verified working (torch 2.0.1 / cu118 / diffvg-from-source).
59
 
60
  ### Notes
61
- - Build the VSQ from its **own** `vsq/config.yaml` (not the ART config's `stage1_params`, which
62
- under-specifies the VSQ architecture).
63
- - `emoji/vsq/config.yaml` was **corrected** to match the weights (`quantized_dim=512,
64
- num_codes_per_shape=1, single_code_representation=true, fsq_levels=[7,5,5,5,5]`); the originally
65
- saved config did not. `mnist_color/*` configs are the repo configs.
 
 
 
66
 
67
  ## Requirements
68
  torch 2.0.1 (cu118) · diffvg (from source) · see the code repo's `install.sh` / `requirements.txt`.
 
58
  All three are verified working (torch 2.0.1 / cu118 / diffvg-from-source).
59
 
60
  ### Notes
61
+ - Build the VSQ from its **own** `vsq/config.yaml`. `mnist_color/*` configs are the repo configs.
62
+ - `emoji/vsq` is `emoji_VSQ_hydra_small_noout` (`hydra` decoder, `single_code_representation=true`,
63
+ `num_segments=16`, `pred_color=true`) — the properly-trained emoji VSQ; it reconstructs emojis
64
+ faithfully. (An earlier push used the older `VSQ_EMOJI_COLOR`, which under-reconstructed.)
65
+ - **Loading the ART (stage-2) checkpoints:** strip only the *leading* `model.` prefix (a blanket
66
+ `replace("model.","")` also deletes the inner `.model.` in `transformer.model.layers.*` → the
67
+ transformer loads as random weights) and remap `.ff.3.`→`.ff.2.` (x-transformers version shift).
68
+ `scripts/hf_generate_demo.py:_remap_key` does this. VSQ checkpoints load with a plain leading-prefix strip.
69
 
70
  ## Requirements
71
  torch 2.0.1 (cu118) · diffvg (from source) · see the code repo's `install.sh` / `requirements.txt`.