wookiekim commited on
Commit
a09cbe5
·
verified ·
1 Parent(s): 66a4e77

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +65 -0
README.md ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Wan-AI/Wan2.1-T2V-1.3B-Diffusers
3
+ library_name: peft
4
+ license: apache-2.0
5
+ pipeline_tag: text-to-video
6
+ tags:
7
+ - text-to-video
8
+ - wan
9
+ - lora
10
+ - peft
11
+ - flow-grpo
12
+ - solace
13
+ - reinforcement-learning
14
+ ---
15
+
16
+ # Wan2.1-T2V-1.3B-SOLACE
17
+
18
+ LoRA adapter from **SOLACE** (**S**elf-c**O**nfidence reward for a**L**igning text-to-im**A**ge models via **C**onfidenc**E** optimization), CVPR 2026.
19
+
20
+ SOLACE applied to the **Wan2.1-T2V-1.3B** text-to-video model, using the model's own denoising confidence as an intrinsic reward (no external reward model at training time).
21
+
22
+ - **Base model:** [`Wan-AI/Wan2.1-T2V-1.3B-Diffusers`](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B-Diffusers)
23
+ - **Method:** SOLACE intrinsic self-confidence reward (built on Flow-GRPO)
24
+ - **Code:** https://github.com/wookiekim/SOLACE
25
+ - **Adapter type:** PEFT LoRA (rank 32) on the Wan 3D transformer
26
+
27
+ ## Usage
28
+
29
+ ```python
30
+ import torch
31
+ from diffusers import WanPipeline
32
+ from diffusers.utils import export_to_video
33
+ from peft import PeftModel
34
+
35
+ model_id = "Wan-AI/Wan2.1-T2V-1.3B-Diffusers"
36
+ lora_ckpt_path = "wookiekim/Wan2.1-T2V-1.3B-SOLACE"
37
+ device = "cuda"
38
+
39
+ pipe = WanPipeline.from_pretrained(model_id, torch_dtype=torch.bfloat16)
40
+ pipe.transformer = PeftModel.from_pretrained(pipe.transformer, lora_ckpt_path)
41
+ pipe.transformer = pipe.transformer.merge_and_unload()
42
+ pipe = pipe.to(device)
43
+
44
+ frames = pipe(
45
+ "a cat walking across a sunlit kitchen floor",
46
+ height=480, width=832, num_frames=81,
47
+ num_inference_steps=50, guidance_scale=5.0,
48
+ ).frames[0]
49
+ export_to_video(frames, "solace_wan.mp4", fps=16)
50
+ ```
51
+
52
+ ## Citation
53
+
54
+ ```bibtex
55
+ @inproceedings{kim2026solace,
56
+ title={Improving Text-to-Image Generation with Intrinsic Self-Confidence Rewards},
57
+ author={Kim, Wookyoung and others},
58
+ booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
59
+ year={2026}
60
+ }
61
+ ```
62
+
63
+ ## Acknowledgments
64
+
65
+ This work builds upon [Flow-GRPO](https://github.com/yifan123/flow_grpo) by Jie Liu et al.