When you wish upon a star(from Disney's Pinocchio) but AI generates art for every lyric😱

in Alien Art Hive2 years ago (edited)

▶️ Watch on 3Speak


So, considering how the last post i made about AI generating art from music lyric prompts, was recieved so well, I decided to make yet another one BUT with a much more wholesome track this time!

Remember that classic OST(original soundtrack) you hear at the beginning of every Disney movie intro?...

This one?...

Well, its actually an original song that was written for the iconic and timeless, Disney animation: Pinocchio.

Hence, using Dream studio's stable diffusion AI software, i was able to create a bunch of stunning and otherworldly portraits, using only lyrics from the same song: When you wish upon a star by Leigh Harline.


Yup! You heard me right! Each and every SINGLE art you'll see in the video, have been uniquely created using lines from the song, as a set of prompts for the AI to generate a portrait.

Take for instance the first line from the song: When you wish upon a star. Using that as a prompt resulted in something like this:

InShot_20221019_105804724.jpg

Pretty neat ey huh?

To be honest, throughout the entire process, I couldn't help but feel this overwhelming sense of nostalgia and wholesomeness. There's just so much beauty and hope in this song! And everytime i listen to it, its like i'm magically taking back to those earlier, simple, and CAREFREE, days of my childhood😌

Ahh...


Anyway, for the music, i selected the version by Cynthia Erivo from the new live action adaptation, Pinocchio 2022.

Here's the trailer, incase you missed it btw

Okay so, enough said now, how about we go ahead and watch the video to see just how capable AIs can be today!!

You can the lyrics to the song below.


When you wish upon a star
By Leigh Hairline

•••

When you wish upon a star
Makes no difference who you are
Anything your heart desires
Will come to you

If your heart is in your dream
No request is too extreme
When you wish upon a star
As dreamers do

Fate is kind
She brings to those to love
The sweet fulfillment of
Their secret longing

Like a bolt out of the blue
Fate steps in and sees you through
When you wish upon a star
Your dreams come true

THANKS FOR READING AND KEEP EXPLORING!


▶️ 3Speak

Sort:  

Awesome Video, some great art! Did you use purely the lyrics or add some other little prompts to keep it on the theme?

I mostly used the lyrics as they were however, some lines of the songs were just way too VAGUE, that I had to add additional descriptions to the prompt. For example:

The line: No request is too extreme, was tweaked a bit into something like - Girl requesting for something extreme.

And the other line, Fate is kind, I tweaked a little by telling the AI - Illustration of a person receiving the glorious kindness of fate.

And I think I did the same for one more line like so. Lol, it was important to do so for those raw, unclear lyrics because if I didn't, heck, the AI could end up summoning a painting of the devil!🤣

However, for songs like What a wonderful world which has pretty descriptive lyricism, I strictly used the lyrics as they were.

Yeah, makes sense, I was wondering if the AI had picked those images based on the very vague lines, made sense to add a little extra description to push it in the same general direction as the rest of the images!

Great piece, thanks for sharing! Love the concept also!

You have selected some great songs to try this out with!

I know right! Thanks!

You can never go wrong with a Disney classic 😁

Thank you for sharing this post on HIVE!

Your content got selected by our fellow curator slothlydoesit & you received a little thank you upvote from our non-profit curation initiative. Your post will be featured in one of our recurring curation compilations which is aiming to offer you a stage to widen your audience within the DIY scene of Hive.

Next time make sure to post / cross-post your creation within the DIYHub community on HIVE and you will receive a higher upvote!

Stay creative & hive on!