m-hamza-mughal commited on
Commit
ad15b7f
·
verified ·
1 Parent(s): 4a46cb8

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -33,9 +33,8 @@ on the BEAT2 (BEATX) dataset.
33
  ## How the model works
34
 
35
  RAG-Gesture denoises a body-part-factored latent sequence conditioned on
36
- text (BERT), audio (wav2vec2), and a speaker embedding. At inference, three
37
- retrieval strategies — **discourse-relation**, **gesture-type**, and
38
- **LLM-extracted** — pull semantically-matched motion clips from a database
39
  of training samples. The retrieved latents are injected into the diffusion
40
  process through *DDIM inversion + per-step insertion guidance*, biasing the
41
  denoiser toward the retrieved semantics without sacrificing the base model's
 
33
  ## How the model works
34
 
35
  RAG-Gesture denoises a body-part-factored latent sequence conditioned on
36
+ text (BERT), audio (wav2vec2), and a speaker embedding. At inference,
37
+ retrieval strategies — **discourse-relation** & **gesture-type** — pull semantically-matched motion clips from a database
 
38
  of training samples. The retrieved latents are injected into the diffusion
39
  process through *DDIM inversion + per-step insertion guidance*, biasing the
40
  denoiser toward the retrieved semantics without sacrificing the base model's