Vibe directing: letting a sentence edit a video timeline without trampling your hand edits
Disclosure up front: we build ClickPop, an AI video studio, and this post is about a design problem we hit while building its editor. The lessons apply to anyone putting an agent and a human in the same document. "Vibe directing" is our shorthand for a simple idea: you say what should change ("tighter open", "warmer grade", "captions only on the hook") and the edit happens on the timeline in…
"Vibe directing" is an approach where you specify what should change in a video (such as tighter opening, warmer color grading, or adding captions) and the editing happens directly on the timeline in front of you. The story of implementing this concept comes from ClickPop, an AI video studio, and addresses a design challenge they encountered while building their editor.
The key lessons learned are:
1. Plan in text, render later: Render the video only after you have a solid plan. An AI agent reads a brief, creates a script and storyboard, and only proceeds after confirmation. Changing storyboards or scripts is cheap, but changing rendered shots requires a re-roll.
2. The timeline is the source of truth, not the chat: Telling an agent to make a video warmer or punchier based on a text conversation often leads to problems. The agent should speak the language of editor's actions (trim, move, split, add effects, etc.) instead of its own private language.
3. Respect what the human touched: If a user manually edits a clip and then asks the agent to make the ending punchier, the agent should preserve the hand-edited layer. It should read the diff (the differences) since its last pass and plan around the manual edits rather than over them.
4. Small, scoped requests are better than global re-rolls: Asking for a general improvement invites a full rebuild. Instead, make specific requests like "make the hook better," "redo shot 4," or "remove filler words." Scoped requests are simpler, predictable, and reversible.
5. Check the output against the brief: Agents can claim they did something, but you need to verify if the result matches the original brief. Check the length, sound, captions, and framing before posting. Acceptance checks should be based on the brief, not the agent's summary of its actions.
6. Hand the wheel back: Vibe directing doesn't replace human editors. After the AI makes a first cut, the user takes over the timeline and makes fine trims manually. The agent respects any manual edits on the next pass, creating a seamless handoff between AI and human editors.
Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.