Experimental sample
Cyborg
Recorded pose sequence · generated performer · source dancer inset
An experiment in live performance
Sync Up,
Move In,
Create Live
XRDance turns a dancer’s movement and spoken direction into an evolving generative stage partner—performed live, on the same stage.
Accepted · ACM SIGGRAPH Asia 2026 Real-Time Live!
XRDance · Project filmGenerative performance, in real time
01 / Motion transfer studies
Your movement,
infinite worlds
Recorded dancer motion guides each generated performance, carrying a shared choreography into distinct imagined scenes.
Experimental sample
Spacewoman on the Moon
Recorded pose sequence · generated performer · source dancer inset
Experimental sample
Spaceman on a future city walkway
Recorded pose sequence · generated performer · source dancer inset
Experimental sample
Ninja in a bamboo forest
Recorded pose sequence · generated performer · source dancer inset
These are offline motion-transfer samples, not live stage footage. They use a recorded pose sequence; generated movement can differ from the source dancer. Clips are silent, and pauses during display and model loading are omitted.
02 / The system
A stage partner that listens, watches and responds.
XRDance is a projected augmented-reality performance system built around exchange. Camera imagery and optional skeletal motion condition a local video generator; spoken direction can steer the appearance of what comes next.
The system keeps capture, inference and display on one workstation. Generation overlaps video playout, so dancers can keep moving while the imagined scene develops.
01
Move
Camera imagery sets the scene. Optional depth-camera tracking follows one dancer’s skeletal motion.
02
Imagine
A resident video model synthesizes new stage imagery from visual and motion guidance.
03
Direct
Local speech recognition updates the text prompt at generation boundaries.
04
Respond
The projected image becomes a changing partner for the next movement.
03 / ACM SIGGRAPH Asia 2026
Further long-run pose-overlay results →Real-Time Live!
XRDance has been accepted for presentation in the Real-Time Live! program at ACM SIGGRAPH Asia 2026 in Kuala Lumpur, Malaysia, 1–4 December 2026.
The project’s extended abstract draft is available here. It describes the system, measured implementation and current validation limits.