Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -33,9 +33,8 @@ on the BEAT2 (BEATX) dataset.
|
|
| 33 |
## How the model works
|
| 34 |
|
| 35 |
RAG-Gesture denoises a body-part-factored latent sequence conditioned on
|
| 36 |
-
text (BERT), audio (wav2vec2), and a speaker embedding. At inference,
|
| 37 |
-
retrieval strategies — **discourse-relation**
|
| 38 |
-
**LLM-extracted** — pull semantically-matched motion clips from a database
|
| 39 |
of training samples. The retrieved latents are injected into the diffusion
|
| 40 |
process through *DDIM inversion + per-step insertion guidance*, biasing the
|
| 41 |
denoiser toward the retrieved semantics without sacrificing the base model's
|
|
|
|
| 33 |
## How the model works
|
| 34 |
|
| 35 |
RAG-Gesture denoises a body-part-factored latent sequence conditioned on
|
| 36 |
+
text (BERT), audio (wav2vec2), and a speaker embedding. At inference,
|
| 37 |
+
retrieval strategies — **discourse-relation** & **gesture-type** — pull semantically-matched motion clips from a database
|
|
|
|
| 38 |
of training samples. The retrieved latents are injected into the diffusion
|
| 39 |
process through *DDIM inversion + per-step insertion guidance*, biasing the
|
| 40 |
denoiser toward the retrieved semantics without sacrificing the base model's
|