Spaces:
Running on Zero
Running on Zero
File size: 2,503 Bytes
4f64144 5cfafaa 4f64144 5cfafaa 4f64144 5cfafaa | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 | ---
title: WorldCrafter
emoji: 🌍
colorFrom: gray
colorTo: red
sdk: gradio
sdk_version: 6.28.0
app_file: app.py
python_version: "3.12"
startup_duration_timeout: 1h
short_description: Camera-controlled video world model with 3D-aware memory
---
# WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
Interactive demo of [`TencentARC/WorldCrafter-Fast`](https://huggingface.co/TencentARC/WorldCrafter-Fast) —
the distilled 6-step variant of WorldCrafter. Give it a start image (or just a prompt) plus a
camera action script, and it explores the scene, keeping geometry consistent across chunks
through a camera-queryable implicit 3D-aware memory.
- Paper: https://huggingface.co/papers/2609.24984
- Code: https://github.com/TencentARC/WorldCrafter
- Weights: [`WorldCrafter-Fast`](https://huggingface.co/TencentARC/WorldCrafter-Fast) (distilled, 6 steps, CFG 1.0)
Output is 384×640 at 16 fps, generated in 33-frame chunks.
## Camera actions
One action per chunk, e.g.
```
forward1x2
yaw_left30x3
backward1
```
| Movement | Actions | Short forms |
| --- | --- | --- |
| Forward / backward | `forward1`, `backward1` | `f1`, `b1` |
| Left / right | `left1`, `right1` | `l1`, `r1` |
| Up / down | `up1`, `down1` | same |
| Turn left / right | `yaw_left30`, `yaw_right30` | `yl30`, `yr30` |
| Look up / down | `pitch_up15`, `pitch_down15` | `pu15`, `pd15` |
`xN` repeats an action, `&` combines movement and rotation in one chunk
(`forward2&right2&yaw_left45`), `reverseN` retraces the previous N chunks. Keep total
translation per chunk at or below 5. Optional headers `@dtype`, `@sampling`, `@last_frame`
must precede the actions.
## Credits and license
Model, example images, prompts and camera scripts are from the official
[WorldCrafter repository](https://github.com/TencentARC/WorldCrafter) and are redistributed
here under the WorldCrafter license (see `LICENSE.txt`), which permits copying and
distribution **for academic purposes only**. The underlying Helios-Base components are
Apache-2.0. Copyright (C) 2026 THL A29 Limited, a Tencent company.
```bibtex
@article{yu2026worldcrafter,
title = {WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory},
author = {Yu, Wangbo and Liu, Kunhao and Hu, Wenbo and Yuan, Shenghai and Feng, Chaoran
and Zhou, Haiyang and Huang, Yukun and Wang, Yiran and Zhao, Wang
and Luo, Yingmin and Shan, Ying},
journal = {arXiv preprint arXiv:2609.24984},
year = {2026}
}
```
|