scenepilotLLM/scenepilot
ScenePilot turns your AI coding assistant into a full video production studio, open source
ScenePilot is an open-source system that lets AI coding assistants like Claude Code or Cursor handle an entire video production — research, scripting, asset generation, editing, and final rendering — from a single plain-language request. Instead of a hardcoded orchestrator, the AI agent itself reads YAML pipeline manifests and Markdown skill files to decide what to do at each stage. It can produce real videos with zero paid API keys using free TTS and free stock/archival footage, or scale up with paid generation providers for higher production value.
What it does
- A documentary montage pipeline builds a searchable corpus from free open archives like Archive.org, NASA, and Wikimedia Commons, retrieving actual motion footage rather than just animating still images.
- Every production follows a fixed seven-stage flow — research, proposal, script, scene plan, assets, edit, compose — with a dedicated Markdown 'director skill' guiding the agent through each stage.
- Provider choices for video, image, TTS, and music generation are scored across seven weighted dimensions (task fit, output quality, control, reliability, cost efficiency, latency, continuity), and the winning choice with its reasoning is logged.
- Before rendering, the system validates that the delivery promise is met and screens for 'slideshow risk'; after rendering, it runs ffprobe checks, frame sampling, and audio analysis, and only presents the video if it passes.
- Built-in budget governance sets a default total cap of $10 and pauses for approval on actions above a $0.50 threshold to prevent unexpected spending.
Why it matters
It removes the need to stitch together multiple separate AI tools manually for video production, and shows that real, footage-based videos are achievable using only free and open-source components. Its auditable, logged decision trail also offers a concrete example for anyone trying to verify how and why an AI-generated video ended up the way it did.
Terms in this repo
- TTS · Text-to-speech, technology that converts written text into spoken audio
- CLIP · An AI model that understands images and text together, enabling semantic search
- ffprobe · An FFmpeg tool used to inspect video and audio file properties
- Remotion · A rendering engine that programmatically builds video using React code
- YAML manifest · A configuration file that defines a pipeline's stages and settings
Repository description (English)
🔥 Turn any URL into clean, structured, LLM-ready content. The open-source web fetching & extraction API.
Open on GitHubTrending repos
- vorssaint/vorssaint-utilsOne free menu bar app replaces a dozen paid Mac utilities
- Alishahryar1/free-claude-codeA local proxy that lets coding AI agents run on 49 free or cheap model providers instead of one paid service
- freestylefly/awesome-gpt-image-2A library of 532 reverse-engineered prompts that turn GPT-Image2 into a predictable image-making tool
- block/buzzAn open-source workspace where humans and AI agents chat, code, and review in the same rooms
- NousResearch/hermes-agentNous Research's Hermes is an AI agent that gets smarter the more you use it
- virgiliojr94/book-to-skillA tool that turns technical book PDFs into on-demand reference skills for AI coding agents
- VoltAgent/awesome-agent-skillsA single hub collecting over 1000 'how-to' manuals that make AI coding assistants act like experts
- anthropics/claude-plugins-communityA shared shelf where anyone's Claude add-ons get listed for install