I gave Seedance 2.0 my entire storyboard. Here's what happened.

I gave Seedance 2.0 my entire storyboard. Here's what happened.

How to Create a Storyboard and Turn It into a Movie

Introduction to Storyboarding

  • The video begins with the creator explaining their experience of using AI to generate a movie from a single storyboard prompt.
  • Key topics include creating storyboards, incorporating oneself as a character, and comparing two AI tools: Nano Banana 2 and GPT Image 2.

Creating the Initial Storyboard

  • The creator suggests using ChatGPT or any LLM for generating prompts. An example prompt is provided: "Make me a storyboard of 5 by 5 panels" featuring an astronaut in a cryopod.
  • The AI generates a complete story based on the initial reference, emphasizing that users can customize prompts for specific narratives.

Using AI Tools for Visualization

  • Results from Nano Banana 2 are described as cartoonish, while GPT Image 2 yields more realistic images. The creator expresses preference for GPT Image 2 due to its superior results.
  • Viewers are encouraged to share their preferences between the two tools in the comments section.

Personalizing the Main Character

  • To insert oneself as the main character, one must create a character sheet by taking photos from various angles and expressions.
  • After uploading these images to Cloud along with prompts, users can generate storyboards featuring themselves in different scenarios.

Comparing Outputs from Different Tools

  • Both Nano Banana 2 and GPT Image 2 outputs are compared again; personal preference leans towards GPT Image 2 for its quality.
  • A Nike commercial storyboard is introduced, showcasing how easy it is to create storyboards without personal characters.

Exploring Various Storyboard Styles

  • Examples of different styles are presented: Nike commercial (Nano Banana), Pixar-style parrot flying around NYC (comparison between both tools).
  • A manga-style Sherlock Holmes storyboard illustrates differences in detail and style between outputs from both tools.

Final Storyboard Example

  • A parkour-themed storyboard shows variations in output quality between Nano Banana 2 and GPT Image 2.

Turning Storyboards into Short Movies

  • The process of converting storyboards into short films using SeaDance 2.0 on Hit Film is introduced.
  • A simple prompt is used: "Generate a photorealistic cinematic video following the attached storyboard," ensuring character consistency through attached images.

Evaluating Video Outputs

  • Initial results show satisfactory adherence to storyboards but highlight some glitches that need fixing during editing.

Regenerating Videos for Improvement

  • Multiple generations of videos are attempted with varying degrees of success; transitions and glitches are noted as areas needing improvement.

Editing Techniques Discussed

  • Editing strategies involve mixing scenes from different generated videos to enhance overall quality. Specific examples illustrate how cuts improve narrative flow.

Conclusion on Workflow Efficiency

  • This method saves time and credits compared to frame-by-frame generation while providing conceptual proofing capabilities for clients or projects.
  • However, generating frame-by-frame offers more control over transitions despite being more time-consuming and credit-intensive.

Call-to-action

  • Viewers are invited to share thoughts on this workflow approach and check out additional resources on creating cinematic commercials using AI.
Video description

In this video I tested a completely different AI video workflow — instead of generating scenes one by one, I built a full storyboard first and fed the entire thing to the AI with a single prompt. I tested this across 5 different projects For each project I used 2 AI tools to generate the storyboard: GPT Image 2 Nano Banana 2 Then fed the storyboard into Seedance 2.0 to generate the final video. Let's be honest about when this works and when it doesn't