Feb 2024 – Dec 2024
A timeline of intentions
Sora's storyboard, remix and the collage-in-a-card reference hack.
OpenAI's Sora let you lay out a film as cards on a timeline, each describing a moment, and filled in everything in between. It also let you remix, extend and blend clips. The films made with it were impressive, but they still took hundreds of attempts and a lot of traditional post-production.
Tutorials2
Sora has a secret super power: the storyboard
Theoretically Media · YouTube · Dec 2024
How it worked
- Write hyper-descriptive prompts (film stock, lens, lighting) and accept a roughly 300:1 generated-to-used ratio.
- At launch, lay caption cards on the Storyboard timeline, each optionally seeded with an image or clip, and let the model fill the gaps.
- Use Remix to replace or remove elements, Re-cut to extend a good moment, Blend to merge two clips, Loop for seamless cycles.
- Paste several reference images as one collage into a storyboard card, the community's stand-in for a reference system Sora never had.
- Rotoscope out the strays in After Effects, unify with grain and grade, and upscale in Topaz.
Example Films1
Related on the timeline2