Animate an anime fight short in code from AI-drawn stills

Vishal had Claude Code write a three.js animation engine and render a 69-second anime fight, 1,656 frames, from image-model drawings and ElevenLabs audio, with no video model.

Done withClaude CodeinElevenLabs· Nov 12, 2026

What they did

Vishal, writing on Medium, set Claude Code (on the Fable 5.2 model) one rule: make a 60 to 70 second original anime fight with no video model, where still images are allowed but everything that moves is animated in code. Claude Code proposed the story, then built a compositing engine in three.js, rendered frames through headless Chrome and encoded them with ffmpeg. Character model sheets, backgrounds and eight-frame sprite sheets came from Codex and ChatGPT image generation, drawn on chroma green so a keyer Claude wrote could cut them out. Voices and sound clips came from ElevenLabs and the music from Gemini. Claude measured the track's beats with a Python script and wrote the shot list in beats. The author wrote no code and only gave direction.

How it went

The finished short runs 69 seconds over 40 shots and 1,656 frames at 1080p, from 31 stills and 56 animation frames, with about 2,000 lines of code, in roughly three hours across two passes. Claude wrote a checker that confirmed 38 of 38 cuts sit within a frame of the beat and every big sound hit lines up with the picture. The author's two complaints after the first cut were stiff motion from only three poses per move and synthesized hit sounds; sprite sheets and library clips fixed both. Codex hit its usage limit after 31 of 33 images, and stacked glows once washed a sky scene out to white.

Worth knowing

Claude can read still frames but cannot watch video or hear audio, so it checks timing by measurement and contact sheets and leaves the feel of motion and the mix to the human. The image and sound tools ran on paid plans. The voices have no lip-sync. The write-up itself was drafted by Claude from the project logs.

Try it

With Claude Code· 7 parts to fill in

Make a [length] second original [style] animated short about [story seed]. Rule: no video models. Still drawings from [my image model] are allowed, but everything that moves must be animated in code. Build a compositing engine in [three.js or my tool], render frames with headless Chrome and encode with ffmpeg. Design the characters first as model sheets, then ask me for sprite sheets for each move. Use sound clips from [my sound library] and cut every shot on the beats of [music track]. Make each frame a pure function of its frame number. When the first cut is done, measure cut timing and audio sync, show me a contact sheet, list what you could not check, and wait for my notes.

Square brackets are the parts to fill in. The prompt is ours; the story is theirs.

Where they said it

Related