Urgent.News

What's breaking now, across thousands of outlets.

AI

Front-load the free work — turning a 90-minute recording into short clips

The obvious way to cut a 90-minute recording into short clips is to hand the whole thing to a model and ask it to find the good parts. I tried that. It's expensive and the output degrades as it goes. Why the obvious way fails 90 minutes of transcript is an enormous amount of context, and long context degrades judgement . The model starts confusing similar passages, loses track of what it already…

The most efficient way to transform a 90-minute recording into numerous short clips is to first process the material locally, before feeding it to a model. This approach proved to be much more cost-effective than sending the entire recording to a model, as the model's output diverges quickly due to complex context. After transcribing the recording and converting the word-level transcript to phrase-level markdown, the model can analyze the condensed content in a single pass, significantly reducing costs.

The pipeline consists of five steps: transcription, phrase-level packing, candidate segment selection, scene detection, and silencing. The most expensive step, where human judgment is required, is selecting relevant segments based on topic. Before rendering the final clips, it is essential to save the selection details, including timestamps and reasons, in a file for future reference.

This checkpointing technique ensures that rendering can be repeated cheaply, allowing for adjustments such as aspect ratios without having to restart the process. The pipeline is designed for iterative use, making it more efficient and adaptable to changes.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

Where the money actually goes when you generate at scale

After a few months of running generation through an agent, the surprising thing wasn't the cost per call. It was how much of the spend went to work I didn't need to do.

  • Utilize cheaper model tiers for initial decision-making
  • Implement local tools for tasks not requiring the model
  • Pilot each batch of generation to estimate costs and identify issues

How to Quickly Understand and Improve AI Agent Design

Coding with agents really has surfaced a bunch of problems and challenges we never ran into when writing code by hand. Agents work even faster than you'd expect.

  • AI agents work faster than anticipated, presenting both advantages and challenges.
  • Preliminary design testing by humans can streamline AI-human collaboration.
  • Difficulty in grasping AI's intricate design details requires new communication methods.

More from Monday 24 August →