VIDEO
HIGHLIGHT
Log InSign up
I asked AI to make a Music Video... the results are trippy
SummaryTranscriptChat

I asked AI to make a Music Video... the results are trippy

Tuning out of Starlight

The speaker reflects on the fleeting nature of life and the feeling of being restrained. They question the worthiness of others and express fear about the past approaching.

Reflection on Life

Summarize any video like this, free
  • The innocent lifetime flickers and flashes onto a canvas.
  • Nobody seems worth it, despite the sophisticated feeling.
  • The view is restrained, and the past is nearing closer, causing fear.

Cutting the Bullshit

The speaker urges to cut through deception and asks who is truly independent.

Urging Honesty

  • Let's cut the bullshit.
  • Who is truly independent?

The Air Ain't Free

Reflecting on how things have changed, particularly with age, and questioning what makes a person beautiful or overrated.

Changes in Perspective

  • The air isn't as free as it used to be, but that's alright at eighteen years old.
  • What makes a beautiful person with hideous dreams?

Verging on the Side of the Road

Contemplating being on a path that leads back home while acknowledging that things are getting weighed down.

Nearing an End

  • While the lining isn't silver, they are verging on the side of the road leading home.
  • The edge of "us" is getting weighed down.
  • Realizing that the end is near.

Delirious Illusions

Describing a person as a droplet of paint trickled off their canvas and exploring the concept of delirious illusions.

Analyzing Illusions

  • A person is like a droplet of paint flowing backwards through the river of color.
  • Analyzing illusions to see them clearer, appealing to lonely prisoners.

Initiating Vision

Encouraging the initiation of vision and blending the universe together in time.

Creating Vision

  • What's your vision? Initiate your shading and blend the universe together in time.
  • It gets easier to piece yourself back together.

Not Giving a Damn

Expressing a desire not to care about someone or their inhibitions, while acknowledging that they taught about love not being for everybody.

Not Caring

  • They don't want to give a damn about someone or their inhibitions.
  • Acknowledging that love is not for everybody, but starting to see the world in the right light.

A Simple Symphony

Reflecting on life as a simple symphony or painting, with an infinite path but also acknowledging personal struggles.

Life's Complexity

  • Life is like a simple symphony or painting with an infinite path.
  • Personal world crumbling and collapsing into emptiness.
  • Waiting for someone to interfere and bring meaning to the blank slate.

Turn any video into a summary like this

YouTube links, meetings, lectures. With transcripts, search, and chat.

Start for free
Video description

In this video, I utilized artificial intelligence to generate an animated music video for the song Canvas by Resonate. This tool allows anyone to generate beautiful images using only text as the input. My question was, what if I used song lyrics as input to the AI, can I make perfect music synchronized videos automatically with the push of a button? Let me know how you think the AI did in this visual interpretation of the song. After getting caught up in the excitement around DALL·E2 (latest and greatest AI system, it's INSANE), I searched for any way I could use similar image generation for music synchronization. Since DALL·E2 is not available to the public yet, my search led me to VQGAN + CLIP (Vector Quantized Generative Adversarial Network and Contrastive Language–Image Pre-training), before settling more specifically on Disco Diffusion V5.2 Turbo. If you don't know what any of these words or acronyms mean, don't worry, I was just as confused when I first started learning about this technology. I believe we're reaching a turning point where entire industries are about to shift in reaction to this new process (which is essentially magic!). Important note: While this AI is impressive, it still required additional input beyond just the song lyrics to achieve the music video I was looking for. For example, I added keyframes for camera motion throughout the generated world. These keyframes were manually synchronized to the beat by me. I also specified changes to the art style at different moments of the song. Since many of the lyrics are quite non-specific, even a human illustrator would have a hard time making visual representations. To make the lyrics more digestible by the AI, I sometimes modified the phrase to be more coherent, such as specifying a setting or atmosphere. This was my first time working with DDV5, and I'm very happy with the results! There were many times where my jaw dropped upon seeing what the AI came up with. I haven't felt this sense of wonder from technology since I first experienced a HD videogame as a child. If you would like to learn more about how this video was made, try this yourself, or ask me any questions, I'll post a more detailed explanation of how to get started on Patreon (link below). The post is free to the public, no need to pay. If you do want to support me and become a member that would be much appreciated, you'll also automatically be entered into the end screen minigames where you earn points on each video and move up the leaderboard! Join on Patreon to automatically have your name included in the next video: https://www.patreon.com/doodlechaos Want to add lyrics and color beat blocks to your Disco Diffusion project like I did in my video? Here is my code: https://www.patreon.com/posts/67249569 My social media: Twitter: https://twitter.com/doodlechaos Discord: https://discord.com/invite/7FCrWAzDY7 Tiktok: https://www.tiktok.com/@doodlechaos Shorts Channel: https://www.youtube.com/channel/UCMqgJk1o2eWE7WeNtRIfnpg Instagram Shorts: https://www.instagram.com/doodlechaos_shorts/ Email: contact@doodlechaos.com While Disco Diffusion is based on the contributions of many, show some love to the two most prominent contributors: https://twitter.com/somnai_dreams https://twitter.com/gandamu_ml Music: [Indie Dance] - Rezonate - Canvas [Monstercat EP Release] : https://www.youtube.com/watch?v=i0Ew3cl1gyc