SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generation

1University of Toronto 2Vector Institute

arXiv 2024


Ablation on timesteps w/ Co-tracker (Paper Fig. 15)

Note: due to the Cotracker's superior ability to track moving artifacts, generated videos numerically seem to follow input trajectory even though visual quality is impaired at timesteps 20, 10, and 1.

Input Trajectory

Timestep [30, 45] (Our choice)

Timestep 50

Timestep 40

Timestep 30

Timestep 20

Timestep 10

Timestep 1