All workflows
The agent as director

Since Oct 2025 · Trending

The agent as director

Describe the film; an agent plans the shots, picks the models and propagates the edits.

Through 2026 the apps stopped waiting for a prompt per shot. You brief an agent, it proposes a story and shot list, chooses a different model for each shot, generates, and carries an edit across the whole sequence. The same agents are reachable from coding tools like Claude Code and ChatGPT Codex through vendor MCP servers, and from inside Premiere Pro and After Effects through plugins. The filmmaker's job becomes the brief, the taste and the continuity.

Tutorials3

Claude-built pose and depth previs for Seedance

Tim Simmons · On X · Jul 2026

How it works

  1. Plan. The agent turns a brief into concept, story structure, character sheets and a shot list (Runway Agent, invideo Agent One's creative-director and DOP agents, Luma Agents' Brainstorm mode, Vidu Agent, Dreamina Octo).
  2. Route. Each shot goes to the model that fits it, chosen by the agent rather than the user: first as hand-wired node canvases (Runway Workflows, Oct 2025; Freepik Spaces, Nov 2025), then as agents that build the canvas themselves (Krea Node Agent, Mar 2026; Runway Agent Workflows, Jul 2026) and as a routing API (Runway Media Router, Jul 2026).
  3. Edit. Change one frame and the agent propagates it across shots (Aleph 2.0 and Edit Studio, May 2026); talk to the cut turn by turn (Gemini Omni in Flow, May 2026).
  4. Remember. Persistent project context: Pika Agents' memory, invideo's characters and rules, Runway Projects and Brand Kits (Aug 2026), Magnific Agents that share what they learn across a team.
  5. Connect a coding agent. Vendor MCP servers (fal Mar 2026, Higgsfield Apr, Runway May, Pika May, Magnific Jun, Kling Jul; Replicate and ElevenLabs earlier) let Claude Code, Codex or Cursor hold the script in a repo, call a different model per shot, fan out variants in parallel, generate dialogue and assemble with ffmpeg or Remotion. This is how long-form pieces are now orchestrated shot by shot. The same agents (Claude Fable, Codex Sol and Astra) also build the tools the apps lack: Sam Wasserman's free suite (May–Aug 2026) covers script breakdown, a cork board, a planning canvas, gray-box and motion previs, storyboard references, dailies triage with local quality checks, stem separation, a prompt studio and an MCP server that drives DaVinci Resolve, each app with its own MCP so Claude Code or Codex can run it.
  6. Work inside the editor. Runway's plugins put Gen-4.5, Seedance 2.5, Kling 3.0, Veo 3.1 and Aleph 2.0 into the Premiere Pro and After Effects timeline (Sep 2026); Adobe's own Firefly AI Assistant (Apr 2026) drives Premiere and Photoshop from a chat.

Example Films7

More making-ofs3

How films were actually made, from the people who made them.

Related on the timeline6

Sources & further reading18
NextHybrid: film the actors, generate the worldIn use now