README.md

metadata

title: WorldCrafter
emoji: 🌍
colorFrom: gray
colorTo: red
sdk: gradio
sdk_version: 6.28.0
app_file: app.py
python_version: '3.12'
startup_duration_timeout: 1h
short_description: Camera-controlled video world model with 3D-aware memory

WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory

Interactive demo of TencentARC/WorldCrafter-Fast — the distilled 6-step variant of WorldCrafter. Give it a start image (or just a prompt) plus a camera action script, and it explores the scene, keeping geometry consistent across chunks through a camera-queryable implicit 3D-aware memory.

• Paper: https://huggingface.co/papers/2609.24984
• Code: https://github.com/TencentARC/WorldCrafter
• Weights: WorldCrafter-Fast (distilled, 6 steps, CFG 1.0)

Output is 384×640 at 16 fps, generated in 33-frame chunks.

Camera actions

One action per chunk, e.g.

forward1x2
yaw_left30x3
backward1

Movement	Actions	Short forms
Forward / backward	forward1, backward1	f1, b1
Left / right	left1, right1	l1, r1
Up / down	up1, down1	same
Turn left / right	yaw_left30, yaw_right30	yl30, yr30
Look up / down	pitch_up15, pitch_down15	pu15, pd15

xN repeats an action, & combines movement and rotation in one chunk (forward2&right2&yaw_left45), reverseN retraces the previous N chunks. Keep total translation per chunk at or below 5. Optional headers @dtype, @sampling, @last_frame must precede the actions.

Credits and license

Model, example images, prompts and camera scripts are from the official WorldCrafter repository and are redistributed here under the WorldCrafter license (see LICENSE.txt), which permits copying and distribution for academic purposes only. The underlying Helios-Base components are Apache-2.0. Copyright (C) 2026 THL A29 Limited, a Tencent company.

@article{yu2026worldcrafter,
  title   = {WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory},
  author  = {Yu, Wangbo and Liu, Kunhao and Hu, Wenbo and Yuan, Shenghai and Feng, Chaoran
             and Zhou, Haiyang and Huang, Yukun and Wang, Yiran and Zhao, Wang
             and Luo, Yingmin and Shan, Ying},
  journal = {arXiv preprint arXiv:2609.24984},
  year    = {2026}
}