# How to edit video with Claude

Canonical URL: https://getvidiyo.app/blog/how-to-edit-video-with-claude
Last updated: 2026-10-08
Author: Ajay Pawriya (https://getvidiyo.app/about)
Published: 2026-10-08
Category: Editing with AI

> TL;DR: Claude reads text and still images, not video files, so you edit with Claude by connecting it to an editor that shows it the transcript and chosen frames, then applies its edits. In Vidiyo, sign in to Claude Code with your Pro or Max plan, import footage and type what you want, like "cut the ums and long pauses".

Image: Vidiyo editor with a vertical talking-head video and a plan card in the AI panel: punch in 18% on the key line, count up to 160 GB, lo-fi music under the voice, with separate lists for what was asked and what was assumed

Claude makes a good assistant editor for one reason: it can read a whole transcript, follow a brief like "start on the strongest line", and look at a frame to check its own work. What it can't do is open an MP4. This guide covers how to close that gap, first with Vidiyo and then with a do-it-yourself setup.

## Can Claude edit a video file directly?

No, not on its own. Claude accepts text and still images in JPEG, PNG, GIF and WebP, and reads only the first frame of an animation, according to [Anthropic's vision docs](https://platform.claude.com/docs/en/build-with-claude/vision). To edit video with Claude, another tool has to decode the footage, transcribe it, choose frames to show Claude and turn its decisions into cuts.

That tool can be a purpose-built editor or a folder of scripts. Either way, the edit is only as good as what Claude gets to see. If it only gets the transcript, it can cut words. If it also gets frames, it can check that a caption isn't sitting on your face after a zoom.

## What do you need to edit video with Claude?

You need a Claude plan that includes Claude Code, Claude Code signed in on your Mac, and an editor that connects to it. Pro and Max both include Claude Code, and [Anthropic says](https://support.claude.com/en/articles/11145838-using-claude-code-with-your-pro-or-max-plan) usage is shared across Claude and Claude Code, so editing draws on the limits you already have.

| What you need | Why |
|---|---|
| Claude Pro or Max | Includes Claude Code; usage counts toward the plan's shared limits |
| Claude Code, signed in | Vidiyo runs Claude through it, after `claude auth login` |
| An Apple Silicon Mac on macOS 14 or later | Vidiyo's system requirement |
| Footage that cuts to 5 minutes or less | Vidiyo's timeline limit |

## How do I edit a video with Claude in Vidiyo?

Connect Claude once, import your footage, then type requests in the chat panel. Vidiyo transcribes the audio on your Mac, gives Claude the transcript, measurements and the frames it asks for, and applies each edit to a normal timeline. Nothing Claude does is locked: you can change any of it by hand.

1. Install Claude Code and run `claude auth login` in Terminal. The [connect Claude guide](https://getvidiyo.app/docs/connect-claude) walks through it.
2. In Vidiyo, open Settings → Assistant and set chat to Claude.
3. Import footage. Drag files in, or right-click a folder in Finder and choose **Edit in Vidiyo**.
4. Type a request, for example: "Cut the ums and long pauses, then add word-by-word captions."
5. For a bigger job, switch the composer to plan mode. Claude shows a plan card that separates what you asked for from what it assumed, and waits for your approval.
6. Watch the result. Each request is one undo step, so ⌘Z takes the whole request back.
7. Ask "review it before I export". A separate critic pass pins its notes to the timeline as comments, and you can hand any comment back with **Fix with AI**.

## What can you ask Claude to do to a video?

Most requests fall into cuts, captions, framing, motion and sound. Phrase them the way you'd brief a person. Claude picks the tool, and Vidiyo works out exact frames from its measurements, so you rarely need timecodes. These are typical requests and what each one does on the timeline.

| You type | What happens |
|---|---|
| "Cut the long pauses" | Removes pauses the audio confirms as silent, keeping a little padding around words |
| "Keep only the best take of each line" | Finds repeated takes in the transcript and keeps one complete take |
| "Start on the strongest line" | Removes warm-up like "hey guys, so today" before the hook |
| "Punch in on the key lines" | Splits out those lines and scales in about 10 to 18%, face kept in frame |
| "Put a counter on 160 GB" | Adds an animated counter timed to the spoken word |
| "Keep the music under my voice" | Measures loudness and ducks the music under your dialogue |
| "Review it before I export" | Runs the critic and pins each finding as a comment |

## How does Claude see what's in the video?

Claude sees three things: transcript text with word IDs, still frames it requests, and measurements Vidiyo takes. Frames arrive one to six at a time, or as a labelled contact sheet of the moments where edits tend to break: the opening, just after cuts, text entrances, layout changes and the final frame.

The measurements cover what a single picture can't. Vidiyo measures faces, caption boxes and on-screen text, plus loudness against a -14 LUFS social target. After every edit, checks run for captions over faces, cropped faces, dead air, a slow opening and raw [jump cuts](https://getvidiyo.app/glossary/jump-cut), and Claude has to fix errors before it calls the edit done. That's what we mean when we say the AI watches the frames: it checks the composed result, not only the words.

## How do I edit video with Claude without Vidiyo?

You can run Claude Code in a folder with your footage and ask it to write and run ffmpeg commands. That works well for simple jobs: trimming, joining clips, re-encoding, burning in captions, or cutting silences found with ffmpeg's `silencedetect` filter. It costs nothing beyond your plan and everything stays scriptable.

A workable loop:

1. Put the footage in a folder and start Claude Code there.
2. Ask it to find silences with `silencedetect`. Its defaults only flag silences of 2 seconds or more below -60 dB ([ffmpeg docs](https://ffmpeg.org/ffmpeg-filters.html)), so ask it to tune both for speech.
3. Ask it to export a few stills around each cut and read them, so it can check framing.
4. Watch the render yourself and describe what to change.

The trade-offs are real. There's no timeline to nudge by hand, every change means a re-render, and Claude only sees the frames you remember to extract. Captions, music ducking and motion graphics each become a small scripting project. For a one-off trim it's a fine approach. For a weekly video, an editor built around this loop saves you the plumbing.

## What are the limits of editing with Claude?

The main limit is your plan's usage. A fully produced edit, with cuts, captions, b-roll, motion and sound, takes many steps and can use a noticeable share of your limits, while a pause-only pass is light. Claude can also misjudge taste calls, such as which take is funnier, so the plan card and your own review still matter.

Vidiyo's own limits apply too: the timeline maxes out at 5 minutes, output is 1080p at 30 fps, and it runs only on Apple Silicon Macs. If your plan is ChatGPT rather than Claude, the same editor runs through Codex; see [how to edit video with ChatGPT](https://getvidiyo.app/blog/how-to-edit-video-with-chatgpt).

## Honest limits

- Every request uses your Claude plan's usage limits, which are shared with Claude on the web and desktop.
- Timelines max out at 5 minutes, and export is 1080p at 30 fps.
- Vidiyo runs only on Apple Silicon Macs with macOS 14 or later.

## Frequently asked questions

### Can I edit video with a Claude Pro plan?

Yes. Claude Pro and Max both include Claude Code, and Vidiyo runs its chat editor through that sign-in. Editing counts toward the same usage limits as your other Claude chats.

### Does Claude watch my whole video?

No. Claude reads the transcript, looks at the still frames it asks for, and gets measurements such as face positions and loudness. Your footage stays on your Mac; only transcript excerpts and those frames go to Claude under your plan.

### Do I need an Anthropic API key to edit video with Claude in Vidiyo?

No. Vidiyo uses your Claude Code sign-in, so there is no API key and no second subscription. Only the optional thumbnail generator needs your own OpenAI or Gemini key.

### Can I still edit by hand after Claude makes changes?

Yes. Claude edits the same timeline with the same tools you use, so every cut, caption and keyframe stays editable. Each request is one undo step.

## Related

- [Edit video by chatting](https://getvidiyo.app/features/chat-video-editing)
- [Agentic video editing](https://getvidiyo.app/glossary/agentic-video-editing)
- [How do I connect Claude to Vidiyo?](https://getvidiyo.app/docs/connect-claude)
- [Can Claude edit videos?](https://getvidiyo.app/claude-video-editor)
- [How to edit video with ChatGPT](https://getvidiyo.app/blog/how-to-edit-video-with-chatgpt)

## Sources

- [Using Claude Code with your Pro or Max plan](https://support.claude.com/en/articles/11145838-using-claude-code-with-your-pro-or-max-plan) (accessed 2026-10-08)
- [Vision (Claude API docs)](https://platform.claude.com/docs/en/build-with-claude/vision) (accessed 2026-10-08)
- [FFmpeg filters documentation: silencedetect](https://ffmpeg.org/ffmpeg-filters.html) (accessed 2026-10-08)

Download Vidiyo for Mac (free during the beta): https://getvidiyo.app/download