B-roll: Automatically Edit Videos with Chat

As entrepreneurs, we have to get great at putting our story out. And competing for that attention often means improving the quality of your content.

Engaging videos that people want to share are typically edited down their most exciting and information-dense moments. But the work to get it there is time-consuming and complex.

As a 2 person team, we needed to find a way to reduce the time it takes to share our content. That’s why we developed FFMPerative: Chat to Edit Video.

And now we open-sourced a colab notebook to share, which can help you automatically edit videos from raw clips in your Google Drive!

How it works

Three LLMs help in this video editing pipeline:

• Writer 📝: Models like Video-LLaMA can generate rich descriptions for each raw video clip in your input directory on Google Drive.
• Director 🎬 : We prompt chatGPT to generate a sequence of shots for a short video using context from the descriptions.
• Editor 🎞 : FFMPerative is used to generate and assemble the clips according to the planned sequence.

We hope to enable other indie hackers to showcase their stories with ease. Check out the repo, create your b-roll with the colab for free!