Deforum Stable Diffusion

Weeks after Stable Diffusion went public in August 2022, Deforum launched as a Colab notebook that turned text prompts into animated video, adding Stable Diffusion's far better image quality to the animation lineage of Disco Diffusion, VQGAN+CLIP, and PyTTI.

The signature technique is prompt travel: schedule different prompts at different timestamps and watch the model morph between them, with camera controls to zoom, pan, and fly through generated landscapes. It quickly became an Automatic1111 extension. Deforum became the creative backbone of a generation of AI artists who later moved into filmmaking; the morphing transitions, surreal prompt travels, and infinite zooms of early AI video originate here.