Modern Creator
Ryan | AI Content Automations · YouTube

I Made This Talking Head Video Using Only Claude & Remotion

A YouTube creator maps the three-tool, three-gate content engine, Claude Code, Remotion, and WhisperX, that auto-edits his talking-head videos from raw footage to a finished MP4.

Posted
2 months ago
Duration
Format
Tutorial
educational
Views
18K
375 likes
Big Idea

The argument in one line.

Chaining three free tools, Claude Code as builder, Remotion as renderer, WhisperX as timer, into a gated pipeline can auto-edit a talking-head video end-to-end, which is what makes running several channels off one offer realistic.

Who This Is For

Read if. Skip if.

READ IF YOU ARE…
  • You already record talking-head YouTube or short-form videos and want to remove manual editing time from the process.
  • You're comfortable directing an AI coding assistant (Claude Code or Codex) through a multi-step technical setup.
  • You're weighing whether to run several content channels at once and editing time is the bottleneck.
SKIP IF…
  • You have no interest in installing or maintaining developer tools like Remotion and WhisperX yourself.
  • You're looking for a no-code, drag-and-drop editing solution.
TL;DR

The full version, fast.

A creator breaks down the pipeline behind his automated talking-head edits: Claude Code (or Codex) installs and runs everything, Remotion renders video from code instead of a timeline, and WhisperX produces word-level timestamps so visuals match exact spoken words. The system runs as a gated workflow: gate one cleans audio and removes dead air with a dedicated QA check, gate two handles scene movement (avatar glide left, right, or full-screen takeover), and gate three adds motion graphics matched to each sentence. The larger point is that automating this frees a creator to run multiple channels off one offer, since editing time stops being the bottleneck.

Free for members

Chat with this breakdown — free.

Sign in and you get 23 free chat messages on us — ask for the hook, quote a framework, find the exact transcript moment, generate a markdown action plan. Bring your own key when you want unlimited.

Create a free account →
Chapters

Where the time goes.

00:0000:47

01 · The 3-part promise

States the hook, then names the three tools and their roles: Claude Code as builder, Remotion as editor, WhisperX as the listener who times sentences to visuals.

00:4701:38

02 · Why build this: the multi-channel content machine

Reframes the automation as a scaling tool, running several YouTube and Instagram channels, including faceless ones, off one offer, and teases the money question.

01:3801:54

03 · Meet the creator, and the free-vs-paid fork

Ryan introduces himself and a $2M client-results claim, then splits the rest of the video into a free path (this video) and a paid path (his community).

01:5402:23

04 · Step 1: pick Claude Code or Codex

Either desktop AI coding assistant works as the builder role; the choice between them doesn't matter much.

02:2303:20

05 · Step 2: install Remotion + WhisperX

Remotion is framed as a code-based replacement for a drag-and-drop editor like CapCut; WhisperX is introduced as the tool that gives word-level timestamps.

03:2003:51

06 · Word-level timing: why alignment matters

Explains why matching the exact word to the exact visual (not just the sentence) is what keeps a viewer's attention, using a sugar-cookie example mid-explanation.

03:5104:42

07 · Step 3: gated workflows begin — Gate 1, clean audio

WhisperX times every word and strips dead air and misspoken takes before anything else happens; a dedicated Claude Code QA pass checks the cleanup before the video advances.

04:4205:44

08 · Gate 2 (scene movement) and Gate 3 (motion graphics)

Gate 2 governs how scenes move (avatar glide left, right, or full-screen takeover); Gate 3 decides what motion graphic represents the spoken idea, illustrated with a USA-vs-Belgium example.

05:4406:37

09 · The payoff and the ask

Recaps the three tools and three gates, then pitches the paid community alongside the free copy-paste prompt for building it yourself.

Atomic Insights

Lines worth screenshotting.

  • A three-tool pipeline, Claude Code, Remotion, and WhisperX, can cut dead air, build a word-synced beat map, and render a finished MP4 without a human touching a timeline.
  • WhisperX's core value is word-level timestamps, not just sentence-level captions, because visuals need to change on the exact word being spoken.
  • The individual tools in an automated editing pipeline are free and simple; the real moat is the custom harness that makes them work together, which took the creator a month to build.
  • Automated editing is a scaling tool, not a one-video trick: it's what makes running several YouTube and Instagram channels, including faceless ones, realistic for one person.
  • A gated workflow processes video in a strict order, clean audio first, then scene movement, then motion graphics, and later gates only run once the earlier gate passes QA.
  • Retention drops when a viewer hears an instruction and the matching visual doesn't appear at the same moment; audio-visual pairing is treated as a first-class editing rule, not decoration.
  • Motion graphics are chosen to match the literal content of a sentence: a data-heavy topic gets a moving graph, a lighter topic gets an illustrative cutout style.
  • Running a dedicated QA check on the audio-cleanup gate before advancing a video prevents a small error from compounding through every later editing stage.
  • Choosing Claude Code over Codex, or the reverse, is a low-stakes decision; both handle the 'builder' role in this pipeline equally well.
  • The creator sells the same pipeline two ways: free instructions plus a copy-paste prompt for anyone willing to build it themselves, and a paid community for anyone who wants it pre-built.
Takeaway

A three-tool, three-gate pipeline auto-edits talking-head video.

WHAT TO LEARN

Claude Code as builder, Remotion as renderer, and WhisperX as timer can auto-edit a talking-head video end to end, as long as the work runs through a strict gated order: audio, then scenes, then motion graphics.

01The 3-part promise
  • A single Claude Code + Remotion + WhisperX pipeline can cut dead space, build a beat map, and render straight to an uploadable MP4 without manual editing.
  • Claude Code (or Codex) acts as the builder, Remotion renders the video from code, and WhisperX times sentences to visuals, three tools each doing one job.
02Why build this: the multi-channel content machine
  • The real payoff isn't the single video, it's running the same automated edit across multiple YouTube and Instagram channels, including faceless ones, that all funnel into one offer.
  • Automating the edit is what makes running several channels at once realistic, since the bottleneck stops being editing time.
03Meet the creator, and the free-vs-paid fork
  • Connecting off-the-shelf tools is the easy part; the actual engineering work is the harness that makes them cooperate, which took the creator a month to build.
04Step 1: pick Claude Code or Codex
  • Either Claude Code or Codex works as the builder role, the choice between them doesn't matter much, so don't stall on picking one.
05Step 2: install Remotion + WhisperX
  • Remotion replaces a traditional drag-and-drop editor: it's a free React framework that builds and renders video from code instead of a timeline.
  • WhisperX exists to solve one problem, giving word-level timestamps so the right visual can be matched to the exact word being spoken, not just the sentence.
06Word-level timing: why alignment matters
  • Good editing pairs what a viewer hears with a matching visual at the same instant; mismatched timing between narration and visuals is what kills retention.
07Step 3: gated workflows begin — Gate 1, clean audio
  • Gate 1 of the pipeline is entirely about audio, WhisperX times every word and strips dead air and misspoken takes before anything else happens.
  • A dedicated QA pass on the audio cleanup runs before a video advances, because an error at gate 1 compounds through every downstream gate.
08Gate 2 (scene movement) and Gate 3 (motion graphics)
  • Gate 2 governs how scenes physically move (avatar glide left, right, or full-screen takeover); gate 3 decides what motion graphic represents the spoken idea.
  • Motion graphics are chosen to fit the content of a sentence rather than a fixed template, a data-heavy topic gets a moving chart, a lighter one gets an illustrative style.
09The payoff and the ask
  • The overall discipline is sequential gating, clean audio first, then scene movement, then motion graphics and sound last, skipping the order breaks the result.
Glossary

Terms worth knowing.

Claude Code / Codex
Desktop AI coding assistants that write and run the setup commands for the pipeline; either works as the 'builder' role that installs and wires up the other tools.
Remotion
A free, open-source React framework that builds and renders video from code, replacing a drag-and-drop editor like CapCut or Premiere.
WhisperX
A free speech-to-text tool that produces word-level timestamps, used to align visuals and captions to the exact word being spoken.
Gated workflow
An editing pipeline broken into sequential stages, audio, scene, motion graphics, where each stage must pass a check before the next one runs.
Beat map
A mapping of every spoken word or phrase to a matching on-screen visual, generated from the word-level transcript.
Resources

Things they pointed at.

00:23toolClaude Code
02:23toolRemotion
02:23toolWhisperX
01:54toolOpenAI Codex
Quotables

Lines you could clip.

00:00
I made this high retention edit using only Claude and Remotion.
cold-open hook that states the entire premise in one lineTikTok hook↗ Tweet quote
01:16
I wonder how much money you'd make.
short, punchy transition line with a money-curiosity hookIG reel cold open↗ Tweet quote
01:38
My clients have earned a collective $2 million from my tools and training.
standalone credibility/proof statnewsletter pull-quote↗ Tweet quote
05:15
This is where my system determines the visual representation of the spoken script.
crisp one-line definition of the core mechanismTikTok hook↗ Tweet quote
The Script

Word for word.

Read-along

Don't just watch it. Burn it in.

See every word as it's spoken — crank it to 2× and still catch all of it. The same dual-channel trick behind Amazon's Kindle + Audible.

metaphoranalogystory
I made this high retention edit using only Claude and Remotion. It does three important things that will change the way you create content forever. Number one, it takes your raw video and cuts out all the dead spaces so you never have to worry about doing this manually again.
Number two, it creates a beat map so every spoken word gets paired with a matching visual. And number three, it renders the entire video from motion graphics, transitions, B -roll, and sound effects into one uploadable MP4. All of this is done with Clodcode, Remotion, and WhisperX.
Clodcode is the builder, Remotion is the editor, and WhisperX is the listener who perfectly times your sentences to visuals. So once the core engine is installed, you can keep upgrading it with new motion graphics, new styles, and endless customizations. But what I find most special is that you'll soon realize how fast you can start building a YouTube channel.
Actually, I think you'll find yourself asking one important question. What if I had multiple YouTube and Instagram channels, some that are even faceless channels, and they all were pointing to one high converting offer? Good question.
I wonder how much money you'd make. So now I'm going to show you how to do it in three steps because the video you're watching now was also edited by AI. But before I do that, there's a free way to do this and a paid way.
And if we haven't met yet, my name is Ryan and I build content engines for a living. My clients have earned a collective $2 million from my tools and training. This is pretty much what I do all day.
So the freeway is what I'll cover in this video and the paid way is in my school community where you can skip all of the headaches and start using this today. At a high level, you're just connecting a few tools, but the programming harness that makes those tools work together is what took me a month to build. All right, here we go.
Step one is to make sure you have access to the paid desktop application of Cloud Code or Codex. Both work perfectly for this, so go with your preference and don't overthink it. I currently use Cloud Code, but I've also used Codex for the same project and both gave me exceptional results.
Step two, you'll want to install Remotion and WhisperX. But don't worry about chasing down those repos because I already put them in the description of this video for you. And even better, I put a simple prompt in the description that you can give to Cloud Code or Codex so it can start installing these for you.
So think of Remotion in the same way you think of video editing software like CapCut, except you won't be doing the editing. Remotion is a free React -based video creation framework that builds, animates, and renders videos using code instead of a traditional video editor. So this means no more dragging and dropping media into editing software because Cloud Code or Codex will do it for you using Remotion.
Clawed plus free motion is why you're seeing my motion graphics appear on screen and why my video slides to the left or slides to the right. But that's just scratching the surface, so more on that later. Next, make sure you have WhisperX installed.
WhisperX is a free speech -to -text alignment tool that gives your videos accurate word level timestamps. This is important because you'll want the right image, video, or animation to represent the words your viewers are hearing. So WhisperX creates a sentence -based timeline that this possible.
For example, right now I'm talking about homemade sugar cookies and how I like to pull them out of the oven two to three minutes before they're done. This keeps them soft and chewy and it's way better than store -bought. You're seeing sugar cookie animations and probably developing a craving.
Sorry about that. And that's the whole point of good editing. A viewer audibly hears instruction while seeing the visual representation of those instructions at the same time.
Fail to do that and the video loses retention. But one more important feature about WhisperX, it lets you perfectly match captions on screen like you're seeing below. Now, you don't need captions for YouTube videos, but if you're editing a short or Instagram reel, then you'll want the captions.
Okay, step three, and this is a big one. Develop your engine with gated workflows, and here's what I mean. The first gate of my content engine is exclusively about cleaning up the audio.
This means that WhisperX is doing its word timing and removing dead air. For example, I use a teleprompter for my talking head videos because it helps me speak in a more organized way. But if you're like me, you'll likely misspeak often or you'll have dead air between sentences.
So once WhisperX is installed, you can tell Cloud Code or Codex to remove the misspoken words and dead air. This gives you a clean video and audio file in one. But this audio cleanup has to be perfect or the rest of your video will be off.
So I built a Claude Code QA process that checks before gate one completes. Then and only then does the video go to gate two, which is the scene gate. I chose to have three main scene gates, the avatar glide left, the avatar glide right, and the avatar takeover, which is just me talking on full screen.
But if I ever wanted a full B -row takeover with an image or a video, I can absolutely make that. adjustment. It all comes down to your editing preferences, so don't overthink it.
There are plenty of videos on YouTube that performed well with or without a ton of edits. So gate one is clean audio, gate two is clean scene movements, and the final gate is motion graphics. This is where my system determines the visual representation of the spoken script.
If I'm talking about the price of oil, maybe I'm showing a moving graph. If I'm talking about how I'm sad that the US just got eliminated by Belgium in the World Cup, maybe I'd have this engaging paper cutout style. Or if I simply want a faceless YouTube channel in a documentary style, then maybe my editing will be slower and dramatic.
There's no wrong answer. So let's recap. If you want to start using my content engine today, join my school.
It's the first link in the description. You'll get immediate access to the engine. You'll keep it forever and you can cancel at any time.
If you want to start the journey of building this yourself, I put the prompt in the description as well. Now remember, Cloud Code or Codex is your editor while Remotion is your renderer and WhisperX is your audio engineer. And finally, gated workflows are your best friend.
So make sure the audio is clean first. Then the animated scenes come second. So they match the audio and the motion graphics plus sound effects and music come third.
So they put that little cherry on top. Don't leave without subscribing because I have a ton of motion graphic tutorials coming that will upgrade your content. Thanks for watching.
The Hook

The bait, then the rug-pull.

The video opens with a bold claim: a full high-retention edit produced with nothing but Claude and Remotion, no manual editor. What follows is the exact three-tool, three-gate system that makes it possible.

Frameworks

Named ideas worth stealing.

04:19model

The 3-Gate Content Engine

  1. Gate 1: Clean Audio
  2. Gate 2: Clean Scene Movement
  3. Gate 3: Motion Graphics

A sequential, QA-gated pipeline where each stage, audio cleanup, scene movement, motion graphics and sound, must pass before the next one runs.

Steal forany automated or semi-automated video-editing pipeline that chains multiple AI or rendering tools together
00:23model

Builder / Editor / Listener tool roles

  1. Claude Code or Codex = builder
  2. Remotion = editor/renderer
  3. WhisperX = listener/audio engineer

Splits an automated editing system into three tool roles defined by function rather than brand name.

Steal forscoping which AI tool handles which job when wiring together a multi-tool automation pipeline
CTA Breakdown

How they asked for the click.

VERBAL ASK
05:53product
If you want to start using my content engine today, join my school. It's the first link in the description.

Pitched mid-recap, softened by offering the free DIY path (the same setup prompt) right alongside the paid pitch rather than gating the free content behind the sell.

MENTIONED ON CAMERA
FROM THE DESCRIPTION
PRIMARY CTAWhere the creator wants you to go next.
OTHER LINKSAlso linked in the description.
Storyboard

Visual structure at a glance.

hook
hookhook00:00
tool roles intro
promisetool roles intro00:42
growth chart
valuegrowth chart01:02
free vs paid split
valuefree vs paid split01:39
step 1: pick your assistant
valuestep 1: pick your assistant02:01
step 2: Remotion
valuestep 2: Remotion02:11
gate 1 checklist
valuegate 1 checklist04:51
3-gate diagram
value3-gate diagram05:30
join the engine
ctajoin the engine06:00
Frame Gallery

Visual moments.

One-click upgrade to your Google

Get more breakdowns in your search results

Add Modern Creator as a preferred source and Google shows you more of our breakdowns in Search, Top Stories, and AI Overviews. It only changes what you see, and you can undo it in your Google settings anytime.

Add to Preferred SourcesOpens your Google source preferences with us pre-loaded. Tick the box and you're done.
Watch next

More from this channel + related breakdowns.