SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generation

1University of Toronto 2Vector Institute

arXiv 2024


Ablation on U-Net layers (Paper Fig. 14)

Input Trajectory

Mid 2-3 (Our choice)

Bottom 1

Bottom 2

Bottom 3

Mid 1

Mid 2

Mid 3

Top 1

Top 2

Top 3

Input Trajectory

Mid 2-3 (Our choice)

Bottom 1

Bottom 2

Bottom 3

Mid 1

Mid 2

Mid 3

Top 1

Top 2

Top 3

Input Trajectory

Mid 2-3 (Our choice)

Bottom 1

Bottom 2

Bottom 3

Mid 1

Mid 2

Mid 3

Top 1

Top 2

Top 3

Input Trajectory

Mid 2-3 (Our choice)

Bottom 1

Bottom 2

Bottom 3

Mid 1

Mid 2

Mid 3

Top 1

Top 2

Top 3

Input Trajectory

Mid 2-3 (Our choice)

Bottom 1

Bottom 2

Bottom 3

Mid 1

Mid 2

Mid 3

Top 1

Top 2

Top 3

Input Trajectory

Mid 2-3 (Our choice)

Bottom 1

Bottom 2

Bottom 3

Mid 1

Mid 2

Mid 3

Top 1

Top 2

Top 3