Gemini + Claude = How to Reverse Engineer ANY AI Video
SeaDance 2.0: Simplifying Video Creation
Introduction to the Workflow
- Nova introduces a new workflow using Gemini and Claude to streamline video creation, addressing the common struggle of finding effective prompts.
Utilizing Gemini for Technical Breakdown
- The process begins with uploading a video to Gemini, which is chosen for its superior understanding of visual motion and lighting.
- Users can obtain detailed breakdowns including shot types, lens compression, lighting direction, and depth of field from Gemini's output.
- This method transforms complex visual elements into understandable technical blueprints, allowing users to learn filmmaking techniques while working.
Setting Up Claude Skills
- Nova explains how to set up Claude skills that convert raw data into formatted prompts suitable for SeaDance 2.0.
- Four key files are involved: skill.md (instruction manual), camera Bible (cinematography expertise), SeaDance capabilities (specific language), and prompt examples.
Merging Scenes with Claude
- After pasting the breakdown from Gemini into Claude, it processes the technical data without needing further explanation.
- Nova demonstrates merging separate scenes into a unified 15-second prompt for use in SeaDance.
Generating Final Video with SeaDance
- The final generation utilizes Clone Viral as an all-in-one hub for accessing various models; users can guide motion through text or frame references.
- By applying this workflow, Nova successfully replicates high-end cinematic quality without guesswork.
Applying Techniques to Personal Projects
- Nova shares personal experience using this method on a battle scene from Instagram, emphasizing how breaking down professional styles aids in personal storytelling.
Conclusion and Resources
- The video wraps up by encouraging viewers to utilize the shared Claude skill and Gemini prompt available in the description for their projects.