. Good morning, everyone! Good morning! I'm excited to be here. I really have one main goal in mind, and that's for this workshop to be interactive. I want it to be fun, and I want you guys to walk away with something tangible. So we can actually switch to the slides.
Slide show. It should be live now. If you guys want to go ahead and go to this link that I have up on the screen or use your phone to go to the QR code, I have some notes for you guys at that URL. But those are my stated goals for this workshop.
I want to really probably start by asking you guys some questions so I can get some interactions going. But I'm glad you guys came. Thank you for coming. I really do appreciate it. The music stuff is something I have been into for a long time, like lifelong musician, artist.
But the AI music stuff is something I just started paying attention to. With regard to the tools I'm going to show you today, maybe about a month or so ago. So basically what this workshop is going to be about is I'm going to start with the insights that I've gained by doing all the research over the last 30 days, and then we'll get straight into the tools so you guys can again walk away with something tangible.
Let's start with -- okay, I know it's early, and I'm still groggy myself. So, you know, you don't have to necessarily go crazy here. But by show of hands, how many of you have ever used a music generation model, period? Okay, nice. About half you guys. That's dope. By show of hands, how many of you guys use -- I had someone in the crowd already say that they used boomy.
Have you guys ever used boomy before? No, no, no boomy. Okay, that's your OG if you use boomy because it was from like two years ago. But it was a music generation model that was actually pretty cool, but didn't get as complex as the music generation models we have today.
How many of you guys have ever used Suno or Udio by show of hands? Okay, nice. Okay, so you guys will be familiar with what I'm going to do today. Hopefully, I can show you guys some like advanced prompting techniques at the least. But for the most part, that's -- those are the tools that we're going to be focused on.
I was doing this earlier asking some of the AV crew what you guys favorite artists are. My man here right here in the middle, if you could name your favorite artists of all time, what would it be? Who would it be? Yes. Miles Davis. Okay. And correct me if I'm wrong because that's a little bit out of my league.
Like blues, R&B, jazz. Okay. Okay. I think I have something special for you today then. So let's start. I can get into a little bit of what we're going to do as well. And I actually would like to say -- because I've already talked about my workshop goal. What I would actually like to say is that I am not a classically trained musician.
I wrote my first song when I was 13. But I welcome any discourse you guys have in terms of like accuracy, right? So if you guys feel like you're actually wrong, like that's cool. I welcome that. And I actually have something for you on that link that I showed earlier where you can submit questions or comments live while we're doing this to either correct me or submit a question or whatever.
So that was one of the main things I wanted to say. I try to be as accurate as possible. But if I say something wrong, you know, feel free to call me out. I'm comfortable with that. I'm cool with that. And actually, let me make sure I have my stuff pulled up.
If you guys can go to this link, there's a link on there that says poll. If you guys can go fill out that poll. I think there's like two or three questions on there. If you guys could go to that link now and start submitting your answers, I'd really, really appreciate that.
Because it -- again, I want this to be really interactive. But I also want to tailor it to specifically what you guys want to know about AI music generation. if you guys could make your way over to that link and submit. Would really, really appreciate it. Now I've done some housekeeping.
I can kind of get into my journey here. I would say I'm way more of a -- first of all, my name is Flo, as you guys may or may not know. I'm way more of a songwriter than like a software engineer. But I have a lot of respect for what you guys do.
I know enough Python to be dangerous. But beyond that, I'm not really that good at software design or engineering. But I, over the pandemic, took a lot of time out to learn how to write scripts. And I'm really, really big into automation. So I use Python for automation for a lot of myself daily personal life stuff and stuff for work as well.
The other thing I would say is I'm really, really big into experimentation. Flo is actually my artist's name. And if you go on Google or YouTube or Spotify, Apple Music, you can actually look me up and find my music. But the truth is, I have a very eclectic taste.
And I, like, have experimented in a lot of different genres. So I -- a couple years ago, I decided that I wanted to do some split testing, which is pretty odd for an artist. But I did want to do some split testing. And what I really found out was that the same song under two different artists can behave wildly -- can perform wildly differently.
So I literally would take the same recording, like I'm a self-taught engineer, would record at my home or other studios, and upload it under two different artist names. And depending on the cover art, the marketing, who you try and target when you're when you're posting online in terms of the daily content, I would see that songs would perform differently.
So what I basically did was start creating these, quote, unquote, pin names and putting out music that way. And I actually have a pin name that has way more streams than my actual artist name. So if you look at me as an artist, I don't have that many streams.
But I have a couple pin names that have been like viral. I have one that's got like five million streams over the last couple months. And it's just instrumental music. So I'm an artist that does like R&B and hip hop. But I've experimented with like EDM. I actually have a song with some like country influence, believe it or not.
So I've just experimented a lot. And that's kind of how we got here today. I was -- I like to say I was experimenting with multiple genres way before AI music got here. But I love AI music for that reason. In this workshop, we'll cover AI music generation and demystifying it.
I kind of like distilling better. But you know, TajiBT gave me this word. So I put it in the slides. And we're going to get hands on with Suno and Udio and talk about turning ideas into songs. And then actually, I have a question about this later on. But I really want to talk about opportunities for using AI music.
I'm super passionate about like distribution. And for like regular everyday artists to be able to make an income from their music. So if any of you guys are actually artists, like I would love to get into those type of discussions. Let's see. Have you guys -- did anybody actually fill out the thing that I was asking about?
Let's see. Oh, I'm disconnected. Break a leg. Because I really can start throwing in little tidbits here and there about what you guys want to learn about. I put what -- like one of the options that I put for the poll is like an advanced option where we can like actually pull down some of the music that Suno is generating, get stems for that music and start to like mix and master.
So I don't know if you need -- if any of you guys would actually be interested in that. But I put that as -- yeah. Okay. Awesome. Yeah. That was the hardest thing about preparing for this. It's like I just don't know exactly who's going to be in the crowd and what level they're at.
So I tried to like come up with a couple different tracks just for this presentation alone. But yeah, I just needed you guys feedback. So nice. We did get a bunch of submissions. And it looks like prompt techniques. Okay. Tweaking. A lot of prompt techniques. Okay. Cool. I have this guy that I call like the prompt master.
How many -- by show of hands, how many of you guys are in the Suno or Udio Discord server? Nobody. Oh, yeah. Oh, you're in there? Okay. Nice. Yeah. Even for you, I think I'll have a treat. Because like there's a couple of people in there that have posted since the beginning of Suno and Udio.
And then there's this one guy who's like been able to do some really, really cool like banjo music and bagpipe music that's insane. But the prompts are very unintuitive in my opinion. So you kind of have to see it to, you know, understand what it's doing. So we'll definitely get into that.
I'll make sure that I include a lot of prompting stuff. Thank you for everyone that just came in. I appreciate you guys joining. Okay. So this actually gets into -- you might notice that -- you might notice that -- okay. It did actually work. But I still might play it from my computer.
So this is where we start with the insights that I've learned by studying AI music and how it got to this point over the last couple months. And then I'll get into -- it's kind of painful, but I have to play some videos for you for you guys to catch up to where I'm at in terms of like understanding and how this whole thing developed.
So we'll have some videos to watch, but maybe five or six minutes of videos. when people say AI music, I think that could mean a lot of different things. And when I first started doing my research, it was really frustrating that someone -- everyone meant something slightly different. So what I've tried to do is compartmentalize the definitions of AI music and tidy up -- like, I guess, really tidy up the definitions.
Because there was a lot of, like, blurred lines when I started doing the research. And the way that I compartmentalize this was to say that we have text to music, where you're generating short samples and full songs using text prompts. You have audio to music. And this is where you're taking an existing sound and transforming it into actual music.
And you have, like, style transfer, which is basically voice conversion. And voice conversion is actually the first thing that came across when I found AI music last year, actually. So it's been like a long time coming. But I didn't really start doing the research until recently. But I think what most people call AI music is really actually just voice conversion.
Well, it's hard to say that now. But maybe when I started doing research, it was. But I would say that the general consumer, what they call AI music is mostly just style transfer, where someone, like, took their voice and converted it to another voice. And that actually gets into the first video.
And I'll go ahead and play it now. You guys may have seen this video. It's actually pretty pretty cool. Thanks to music. You might notice that I sound like Kanye West. No, you could we turn it up just a little bit in the house? Because this one's a little bit low.
He gets a little louder later, but you'll catch it. You might notice that I sound like Kanye West. No, Yeezy didn't record a voiceover for me for this video. I didn't learn how to do impressions. This is AI. So let me come back to my original voice for a second, because this is crazy.
Today on Metaverse, I posted AI Kanye covering popular song. Here's an example of him singing Day Night. So that's clearly crazy. And I started thinking, you know, what are the implications of this for the music industry? Now all you have to do is record reference vocals and replace it with a trained model of any musician you like, which is exactly what I did.
I found this Kanye style beat on YouTube. I wrote eight bars and I'm going to record them now. And then I'm going to have AI Kanye replace me. I got a fantasy that's beautiful, that's dark and twisted, but I attacked the whole religion all because of my ignorance. What was I thinking?
That was some bitch shit. I lost Adidas, but I'm still Yeezy. Back in the kitchen, man, I'm a genius. Boys in the hood, just like I'm easy. Kanye, Weezy, South Side of Chicago, life ain't easy. All praise be the Lord, Jesus, Donda, please rest easy. All right, let me cut it there, let me cut it there.
So let's hear those vocals I just recorded now with Kanye over there. Yeah. I got a fantasy that's beautiful, that's dark and twisted, but I attacked the whole religion all because of my ignorance. What was I thinking? That was some bitch shit. I lost Adidas, but I'm still Yeezy.
Back in the kitchen, man, I'm a genius. Boys in the hood, just like I'm easy. Kanye, Weezy, South Side of Chicago, life ain't easy. All praise be the Lord, Jesus, Donda, please rest easy. All right, let me cut it there, let me cut it there. So you guys kind of get the gist of what he was doing there.
But I think a lot of times when we hear AI music, AI music, that's what it is. It's like someone taking the regular songwriting process where you go get production or do the production yourself. You write the lyrics and then record your own vocals. And then what people are calling AI music is really just style transfer or voice conversion where they're taking that voice and turning it into someone else's.
So this is actually the first shout out to this guy's name is Roberto Nixon, if I'm not mistaken. And I saw this video and it kind of I think it just definitely changed the trajectory of what I was doing at the time. I dropped everything and was like I have to figure out how the heck he just did this Kanye voice thing.
So I pretty much followed the steps in this video. I dove into some discord servers and some subreddits and that's how I really figured out how to do this for myself. So I think that's one compartment that I've kind of like created for AI music and put it to the side.
The other one -- I have a couple more examples of this as well. I think the next one is how many of you guys were familiar -- by show of hands, how many of you guys heard that Drake AI song that went viral last year? Okay, we got a couple people.
Nice. So I'll play it. I don't want to play the whole thing. But again, this is another example of voice conversion. And a lot of people were saying, oh, my God, he pressed a button and generated a whole Drake song. And that's not really the truth. This kid, his name is Ghostwriter, the person behind the song.
And he did an interview where he talked about the process of creating the song. And it was all him, except for the actual vocals. He like changed his voice to sound like Drake in The Weeknd. I'll play a little bit of it. I'm a slave with a knife in my back.
What's with that, ay? 21. I love home that my brother, that's my stack, ay? Bet you, I made that shit, ay? And I'm a slave with a knife, my back. What's with that, ay? 21. I love home that my brother, that's my stack, ay? Bet you, I made the beat, so you know that it's gonna slap, ay?
Yeah, it's gonna slap, ay? Tell him, bring it back. Talking to a diva, oh yeah, she on my nerves. That's actually my favorite part, but I'm gonna cut it off. Um, so the Drake song was interesting to me because I kind of saw it unravel. Like, I think I found the video or heard the song when it was like under a thousand views, uh, being posted in some of those subreddits that that I was talking about.
Uh, but it went super viral. I think he got like nine million streams in the first 24 hours. He was on his way, this guy, uh, Ghostwriter, was on his way to charting, of course, before the RIA got ahold of it and was like, we're shutting this down. So he got DMCA'd and the song got wiped from everywhere.
Uh, you can still find it on the internet, but it pretty much got wiped from everywhere. And, uh, I just thought like, man, this is really gonna change everything. But again, everybody was calling it and saying it was AI music without, uh, being specific about what kind of AI music it was.
Um, so I have a couple more videos to show you guys, but I just wanted to go over the Drake one because I thought that was pretty cool. This next one is actually my favorite example of voice conversion that I've seen to date. Let me backtrack a little bit.
These two songs that I just played or videos that I just played are from a rough, roughly a year ago. I think March of last year, April of last year. Since then, the voice conversion tools have gotten 10 times better. And like when I listened to the Kanye West one back then, it was amazing.
It literally blew my mind. No, no lie. And today I kind of listened to it and I'm like, wow, it sounds, it's really already facty. It's, it's bad. It doesn't exactly sound like a natural human Kanye West. But today they have stuff that sounds almost exactly, you know, like Kanye West.
I think, and I say the kids because when I joined the Discord server is literally a bunch of like 14, 15, 16 year olds doing this, uh, these, these conversions. Um, but, uh, the kids have gotten a lot better at like, uh, training, training, uh, these, um, models, these voice models.
Uh, so the next one is actually my favorite, uh, example of voice conversion. How many, by show of hands, how many of you guys in here are familiar with Randy Travis? Yeah, I knew I was going to get y'all back there. Yes, sir. Yes, sir. Okay. So, Randy Travis, uh, and forgive me because I'm not exactly sure how this happened, but he lost his voice some time ago.
And, uh, Randy Travis and his team kind of saw this AI thing unraveling or an unfolding and decided to sit down, write a song, uh, produce a song, and then use this voice conversion technique for, uh, Randy to sing the song without him actually singing the song. So this is one of my favorite examples.
I think also in the last year or so, the, the not, maybe temperament is not the best word, but the general public opinion about AI music has shifted a little bit. It hasn't gotten too much better. It's really taboo. Honestly, like I was a little bit, uh, nervous about doing this conference because like people just do not like AI music at all.
Don't want it in their lives. But since then, this, this Randy Travis song came out a couple of months ago or a couple of weeks ago, I think it was. And when I looked at the YouTube comments of this video, the feedback was overwhelmingly positive. People were like in the comments saying, I'm, I'm a 75 year old man.
I'm bawling tears right now listening to this Randy Travis song. Um, like, they were like, I, we don't care how we get Randy. As long as we get them back, we'll, we'll take AI or not. You know what I mean? So it's just a really cool example of, I think how voice conversion can be used in the, in the right way, you know, by, by the original artists.
So I'll go ahead and play some of this as well. Oh, my God. Hello. Hello. Okay. Sorry. I apologize to the ready Travis fans in the back. I'm going to cut them off a little bit. I do want to keep it going. Even though I'm not super into country music, I thought it was really touching that he was able to get with his team and use AI to create new original music.
I thought that was really cool. So that pretty much takes care of the style transfer stuff. I've showed you guys some examples. The next thing I want to get into is text to music. And I'll go over full songs as opposed to the short samples that I was talking about.
If you go, again, just want to remind you guys, if you go to the link, aietalk.com/music and send me a question on there, I can see it pop up on my screen. So I can answer it in motion. I also want to repeat it out loud for the transcription and all that good stuff.
Okay. So text to music. Text to music. Text to music. I'm going to show you guys a couple examples. I broke text to music down even a little bit further by having -- I have a couple folders here. And I think the way I did text to music was -- yeah, meme songs and samples.
Okay. By show of hands, how many of you guys have heard about this Drake and Kendrick Lamar beef going on? Okay. Dang. Okay. Okay. Y'all are up on game. I appreciate y'all. Okay. So, for anyone who hasn't been paying attention, just know that one man said very disparaging words about another man and then the internet ran with it.
So I don't have to catch you up on 18 million songs that these men have recorded now. I couldn't even keep up with myself, to be honest with you. But yeah, so basically, the internet ran with this whole concept of BBL Drizzy. And Kendrick Lamar said a lyric in one of these songs that they had back and forth over the last couple weeks where he called Drake BBL Drizzy.
I don't want to explain BBL to y'all. I ain't going to lie to you. So hopefully you understand what a BBL is and they call him BBL Drizzy. And it's funny because, like, it can be taken a couple different ways, but I'll just play the music so I'm not rambling too much.
BBL Drizzy. BBL Drizzy. I'm going in. No diddy. I'm going in. No diddy. My grandma would probably cuss me out for turning that off early, but I'm going to cut it there. And basically say that this song was -- to me, this is really what gets to what AI music is.
Because there's a comedian named King Wallonius who logged into Udio, one of the tools I'm going to tell you about, typed in a prompt, typed in some lyrics, if I'm not mistaken, and generated this song. He didn't get in the studio, he didn't record his vocals, there was no voice conversion, he just typed in some words and got this BBL Drizzy song.
And I think this is like a monumental moment in music as well because it was one of the first times I saw something like this go viral. And I think -- I mean, we can, if you guys are interested, we can get into some of the legality of AI-generated music and the copyrights around it.
But I think this moment where he created this BBL Drizzy song in viral, it's been used in a bunch of different songs now, it's like monumental. But this is text to music, there was no prior recording, he just generated this song, one-shot prompt to a song. I think I might have had one more good example for -- I'll play this for a little bit.
Eleven Labs is another AI startup that has now entered the text to music space, and this is a song that they generated. Again, no prior recordings, this is just text, music came out the other end and it went viral on Twitter. We were having fun, programming young, dreaming that one day we'd make it work.
Lines of code we'd write all night, hoping that one day we'd get it right. Can we teach them -- Oh, he was about to get into it. I cut off a little too early. But basically, this is a sort of meta song because it's an AI model singing about GPUs.
And I thought that was pretty cool. But yeah, another text to music song that I would kind of put into the meme song category. With that being said, I think I had -- oh, yeah. So, audio to music. These are actually the most interesting examples and also the shortest, if I'm not mistaken.
So, I'll get into some of these. These are really cool. I think the people who are like musicians or artists who have a lot of talent already, like musical talent already are into -- oh, let me play this -- into this style of music generation because it takes an existing sound and -- You might notice that I sound like -- A new Yeezy track goes -- Into another song.
An existing sound and turned it into music, sorry. So, this is using stable audio. It's another tool. It's not Suno or Udio, but it is called Stable Audio. And I think this is the first tool I saw that had this feature publicly available where you could put audio in and get a song out or get music out, maybe not a full song.
But I really like this because I think it unlocks a lot of different ways to create music. So, I think that's -- I might have one more example to show you guys. This one was cool. This is also from the Suno team as opposed to Stable Audio. This one is pretty good.
Nice. Okay. So, I thought that was pretty cool because literally all he recorded was his fingers drumming like that on the desk and then out came this full song with the guitar and all these other instruments. So, you guys kind of get the gist of what audio to audio model generation can be like.
And I want to say with that, we can get directly into actually generating some songs ourselves. Okay, we can talk about how it works, but you guys didn't really seem so much interested in, like, the technical side when I was looking at the poll. So, I could briefly touch on it, but I think -- by show of hands, how many of you guys saw that Suno and Udio have been -- are getting sued this week?
Yeah. You guys saw that? Yeah. The RIAA just filed a complaint against both services. So, and what they're alleging is that these AI models are trained on massive music data sets that are copyrighted and we are -- well, not we. Don't put me in no indictments. I do not want to be -- that's another thing I didn't mention at the beginning, but I have no affiliation to Suno, Udio, Sable Audio, Bumi, no one.
Like, I just liked this stuff and learned it and figured it out and wanted to do a presentation on it. But what they're alleging is that Suno and Udio are infringing on their copyrights by training on this music. Yeah, we had a comment from the audience saying that the last generation sounded like Tom Petty.
If you are more interested in how these models actually work, the architecture, transformers versus diffusion, I have a link on the page that I mentioned earlier. If you click on the notes button and scroll all the way to the bottom, I have compiled a list of all of the music model papers.
So, if you guys are interested, you can find it there. Okay. So, what I want to do now as we get into Udio and Suno, there is a lot less people than I thought there was going to be, so this will work well, hopefully. But there's a business card on the table in front of you, and that business card has a secret code on it.
This is a little PvP, survival of the fittest, like, may the best man win. But if you take that secret code, go to the link that I showed earlier, let me put it on the screen again, and click on the gateway button. There should be a green gateway button that looks like this.
If you put in that code, what will pop up is a username and a password. If you use that username and password to sign into any of these services, let me try and make it a little bigger than that. If you want to get into Udio, you can use Google, Discord, Twitter, Apple, I have signed up for all the services.
If you want to get into Suno, you can do Discord, Google, or Hotmail, Microsoft, whatever they're calling it nowadays. And then you can sign into - so, what I did for this presentation, so you guys could generate music freely, because I know in the show notes for this workshop, I put that you guys should have your own account, but I also thought it would be cool if we could do unlimited generations as opposed to what they give you on the free account.
So, what I did was I signed up and paid for a premiere account for Udio and Suno and gave you guys a login just now. So, if you go log in, you can generate music as we're talking about the next couple steps. Just know that, like, I think 2FA is on Apple, if I'm not mistaken.
So, there might be some difficulty getting in, but just try and get into one of these services, then log into Udio or Suno. And the URL for that, I think I have it here, is Udio.com, once you've signed into one of the other authorization services, or S-U-N-O.com will get you into one of these sites.
Worked? Nice. Awesome. We got somebody in. Oh, another person. Awesome. Awesome. Awesome. Hey, PVP. Some of you guys might not make it. But yeah, I just wanted to do that so you guys had - and actually what I'm going to do as well, when you guys are in your seats generating songs, there's another link on this AIETalk.com/music page where it says submissions.
What I want to do - we might be tight on time - but what I want to do is have everyone who generates songs here in person to submit to this link. It's basically just a Google form. So you generate some music, take the link - the share link to that music on either service, click on this link here, submissions, and submit your song.
And I think what I'm going to do at the end is just take like a random number generator, and two people will be selected to get access - like keep access to these two accounts that I set up. So one of you guys will walk away with like a Suno account, and one of you guys will walk away with an Udio account.
And like I said, I paid for the premiere. I didn't pay for the whole year. After they got sued, I was like, yeah, I might not want to invest. So I just went ahead and did 30 days. Okay. So, we can get into some of the techniques. While we're on this topic, and you guys are hopefully generating in your seats as well, does anyone here have a birthday this week?
Nice! My man, Randy Travis. What's your name? Patrick. Okay. I think what we're going to do is generate a birthday song for Patrick, and I'm going to do that from my account. Wait, one more time? Yes, absolutely. Patrick, my man. Randy Travis. Oh, they're going to block that fan.
And music. I'm not even going to try. There you go. Yeah, they just -- I don't know. Udio may not be as bad about this, but if you put artist names, and obviously now because they're being sued, but if you put artist names, they have a content filter. You know what I mean?
They don't. Absolutely. I'm going to talk about that as well, like ways to kind of get around the filters. But, yeah, that definitely works. We had a comment from the audience that basically said, if you like change the spelling up a little bit, and then put like the style of music that the artist is related to, you can skate.
It's an attorney. It's an attorney. It's an attorney. Oh, shit. Oh, you're the one suing Suno and Udia. Birthday song for Patrick. Let's put in some -- Patrick, what do you like? What kind of music do you like? Which is -- what genre? Rock. One more time. Rock or Billy.
Rock or Billy. I'll be honest with you. I'm lost. Let's go ahead and generate a song from my boy Patrick. And then I'm going to take the same prompt. I'm kind of getting into some of the prompting techniques here, but you guys are able to see this screen, I hope, and see what I'm doing.
And then we'll play a song. Couldn't generate that song description named Randy Travis. What about Tandy Ravis? Ravis? Who is Ravis? Listen, brother. Just give me my song. All right. So, I'm not monologuing the whole time. I'm going to go ahead and wrap it up. But the way I think of these two different services is that Udia is more like a songwriting partner.
They have an experimental model that you guys now have access to if you log into that Premiere account that I paid for. But the default Udia experience is that you generate 30 seconds of music at a time. And you can either extend that idea, remix that idea, or there's a third option I did right here and you can scrap it.
Because a lot of times, you know, you get weird stuff when you're not great at prompting. But you can also use inpainting to modify specific sections of a song. Like if you want to change or tweak one or two little things. And then now they have this feature within Udia where you can do the audio to audio and it allows you to upload music.
So, I -- if you are an artist and you write songs or have written a song before or spoken word or anything, I would urge you to try to take one of your creations -- especially if you've recorded it, it gets crazy. If you've recorded some music before, you should take the tempo, the key that that song is in, and your lyrics, and put it into Udia and see what comes out the other end.
It's blown my mind a couple of times. I've taken a couple of my own songs and put them in, and it gets crazy what comes out the other side. Like, Udia does me better than I do me sometimes. Honestly. So, it's a really cool experience if you have, like, pre-existing music you can really play with Udia a lot.
And then the way that I think about Suno is your in-house music producer. I like to describe it in a way that I feel like somewhere in the system prompt of Suno's model, they have, like, top 40 music in there. Because it always comes out really polished and clean.
And maybe it's the way that the data that they put into the model in the first place. But my experience with Suno has been that it just comes out really, really clean. Top 40-ish. One thing it's gotten really, really good at lately, this is, like, a side note, is that when I first -- I personally have onboarded, like, I think a dozen or so people over the last couple of weeks, because I wanted to understand what is the actual use case for these services.
So, I just started onboarding friends and family, some of my music friends, some people that are not into music at all. And what I found when -- a couple of weeks ago was that, like, when I would generate songs, if you're not super specific and counting the syllables in each line of the song, when you're getting into the custom mode of Suno, it'll -- the timing of the beat and the artist's, quote unquote, the vocals lyrics gets super off, really, really, really off.
But they've gotten really good about this lately. Like, the last couple of songs I've generated from Suno aren't off. They -- the song structure is a lot better, because that's another tip we'll get into. The song structure really has improved a lot in Suno over the last couple of weeks.
But it's more or less the same, just the outputs are a little bit different from Udiya. And now we get into the tutorial. So, have you guys -- anyone submitted any songs yet? Let me see. Let me recheck. I was just generating some music for my boy Patrick. We're going to play that in a second.
But that was the basic tutorial. You kind of -- it's about as simple as it gets. Like, it really, really lowers the barrier to entry for creating music. And I think we can get into some other stuff about -- like, more conversations about that. But I think for now, I'll just say that it lowers the barrier and makes it easier to create stuff for, you know, specific situations.
Okay, nice. We have a couple of submissions. We do have a couple of submissions. But the gist of it is, you go to Udiya.com, you log in, you go to this -- oh, they used to have -- oh, I guess here at the top, it always says create. Then you can type in -- what's another one?
The AI Engineer World's Fair. Let me start over. Let me start over. A song about the AI Engineer World's Fair. And I know the organizer Benjamin Dunphy really likes old school hip-hop. Boom bap. So, I'll generate a song. So, you come in, you type in your prompt, you hit create.
There's a couple of different options out here. Again, if you have a free account, you won't see this experimental, longer song. You'll be defaulted to the Udiya 32 model. But you can come in and write your own lyrics on top of this prompt that you just put in. Or you can select to only have an instrumental generated as opposed to a full song with lyrics and everything.
So at its core, that's how it works. For pretty much all these services as well. There's not too much beyond that that you need to know to start generating music. I would argue that there's a lot more that you need to know if you want to get good at it, but that's pretty much how we generate music on both services.
And what I like to do, just to get a nice even comparison, is use the same exact prompt. I'll refresh the page, because, like, for some reason, they're really buggy sometimes. Where if you generate song after song without refreshing the page, you get, like, extensions of songs as opposed to a brand-new song, but I will go ahead and create based on this prompt.
And then I'm going to come back, because we've now gone over the basic tutorial, I'm going to come back and look at some questions, because I know some questions came in. Nice. And in the meantime, while I'm getting my thoughts together, I'm going to play my song, or the song that was created for Patrick.
Wishing him a happy birthday. Oh, Moderation Air. They didn't like your, um, my Randy Travis. Let's go ahead and play this one, for a little bit. It's your day, Patrick, we're singing loud for you. Oh, yes, oh, yes, it's true. It's your time, Patrick, celebrate the whole day through.
Yeah, yeah, yeah, happy birthday, ooh yeah, oh we know Patrick, you love that rock and roll, oh yeah, yeah, oh yeah, and country hits, you feel it in your soul, oh yeah, oh yes, oh yeah, Patrick, what do you think? Patrick said it's the theme song for his sitcom.
I'm going to play these other two quick, I just want to hear what they sound like. Real quick, if you click on the actual song name, you can see the lyrics on the Suno side. I'm going to try the other version. I'm going to try the other version, see if, uh, was that more your speed, Patrick?
Oh, awesome, okay, all right. Oh, we got five minutes left. Oh, we got five minutes left. I'm going to try the other version, see if, uh, was that more your speed, Patrick? Oh, awesome, okay, all right. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left.
Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left.
Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, we got five minutes left. Oh, yeah. Let's see what the AI engineer world's fair is on.
Actually, let's address these questions because we only have a couple of minutes left. And then I'll get into the notes real quick because I did want to show you guys some of the prompt stuff. The truth is that, like, I have everything under the notes section, like, pretty much everything I talked about today.
Also, when the recording becomes available, you can come back to the same page, get access to the recording, and then I'll hopefully have the transcript up in, like, an hour. Because I recorded it myself. But if you come here to this page, aietalk.com/music, and click on the notes section, and you want to not listen to me talk about the prompts, you can find the prompt stuff yourself.
Not quite all the way at the bottom, but here close to the bottom. And this is a GPT prompt, meaning you literally can go to ChatGPT, use this prompt. It got a little bit weird. Like, for some reason, when I use these closing brackets in GitHub, it, like, basically disappears.
The whole -- like, you won't even see lyrics anymore. But basically, what you can do is -- I think even this would work. Like, GPT-4 is now smart enough to do this. You can take and you can put in this template and then actually fill in the top here with a song description, and GPT will actually produce some coherent lyrics.
And it allows for better music generation when you come in with the lyrics as opposed to giving it a general topic and hoping it comes up with good lyrics itself, you can kind of tweak the lyrics yourself before you start to generate. So that's the GPT prompt. And then for the music model prompts, these are pretty much just examples of what we just did with Patrick and the AI engineer World's Fair song.
It's just like a general description of a song that you want to hear, that you want to generate, and then it pops out the other end. Super pressed for time. There are some official Udio and Suno tips that are very useful as well. And then here -- I kind of want to get into the prompt master thing, actually.
Phillip asked, is there a way to do voice transfer of a more generic voice rather than a specific voice, referring to the voice conversion stuff that we talked about earlier? And I think the end of that question got cut off. Because you said like -- Yeah, like -- Are you talking about doing voice conversion training -- like training models yourself, like going to one of the services or downloading the tools?
You literally can just take and blend multiple voices. So the way that it works is like you need -- depending on what service or model you're using or what training tool set you're using, you need like minimum six seconds of someone's voice to start training, and you get like a kind of coherent model after that.
But what you can essentially do is just six seconds of your voice, six seconds of his voice, six seconds of Eminem, and it kind of like blends it together. Or you can just go to a TTS service and get like an actual like robot voice, like someone -- a voice that doesn't belong to a real person, and then use that to train on.
So, yeah, for copyright purposes, yeah, you can do that. Dang, they got to wrap it up. Okay. Okay. What recommendation do you have to help advocate for the responsible and ethical use of -- yeah, sorry about that. I don't know why the questions are getting cut off. Oh, ethical use of AI music.
That's a good one. I'm going to be honest, I'm going to plead the fifth because I'm not a lawyer. I'm going to be completely honest. I'm going to be completely honest. Oh. Yeah, yeah. Good point. What tool generates the best cloned voice that can match emotional tone like Kendrick Lamar's Euphoria?
Three switches. The best cloned voice. I would definitely look into RVC. You can use RVC in the cloud. You don't have to -- like, when you Google RVC, there comes up a bunch of tutorials on how to run it yourself locally. You do not have to do that. You can run it in the cloud.
Because you need some decent hardware, like computer hardware to do it. But definitely look into RVC. It's the best right now. Can we have access to the slides? Yeah. And my time is up shortly. Oh, did my thing go to sleep? It did go to sleep. Oh. To log into Udio or Suno?
No. Really? Oh. Okay. Okay. Sorry. That's my blunder. That was pretty much it. Rate your music is something you definitely should check out. Like, what someone basically reverse engineered is that these models were trained on labels from rate your music. So you can almost reverse engineer exactly what sound you want by going to rate your music, typing in an artist name, typing in a genre, or really just typing in what you want to hear, and then using whatever labels they put on that music, you put it back into the model itself, like Suno or Udio, stable audio sometimes, I think.
And you can get very, very close to a specific sound. I don't want to say specific artists, but like, yeah, you can get pretty close. Yes. And I was going to get into, like, the law thing. You want me to differentiate between ethics and law, and I understand. But I was going to get into it a little bit, but we kind of ran out of time.
So I apologize for that. If you guys would like -- I love to talk about this stuff all day. If you want to approach me after the workshop, and we chop it up all day about this stuff, I love it. Yeah. And then what I'll do for giving away the accounts, maybe I'll do, like, a live stream or something like that, and grab everybody's e-mail who submitted, because I think we had -- nice, we had 12 submissions.
Let me refresh. I think we had 12 submissions, and I'll pick somebody and just, like, send you guys -- I'll change the username and password so everybody can't log into your stuff, and then I'll give you the accounts. But yeah, I appreciate you guys for coming. I hope you guys got something out of this and walked away with some music, generated some stuff, and I think I'll play a song to go out.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.
I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song. I'm going to play a song.