Google MusicLM: How to Make Generative AI Music
Along with thenew update to Google Bardand the upcomingGenerative AI experience in Search, Google also announced MusicLM, an AI music generation model at Google I/O 2023. Luckily, we already have access to MusicLM, and in this article, we have tested and explained its potential and capabilities. Google says it’s an experimental AI tool that can create music based on your text input, but it’s only limited to 20 seconds. Nevertheless, to learn more about Google MusicLM, head to our explainer below.
What is Google’s MusicLM AI Tool?
MusicLM is a text-to-music generation model developed by Google as part of its AI Test Kitchen program. It creates high-fidelity music from simple text descriptions similar to a natural-language prompt. MusicLM generatesmusic at 24kHzwith a higher sampling rate, which means the generated audio is high quality. Also, the AI-powered music generation by MusicLM is very fast, almost instant.
The Google MusicLM AI model has been trained on adataset of 5,500 uniquely created musicby sound artists working at Google Arts and Culture Lab. The music is further captioned with rich text descriptions by human experts in the music field. Google has publicly released the dataset — calledMusicCapsto support future research.
You can basically create your own music with simple text prompts. If you have got an idea about a particular type of music, but are unable to put your finger on it, MusicLM can drive your imagination and deliver what you want. Currently, MusicLMgenerates two tracks for your inputfor up to 20 seconds. But according to itsresearch paper, it’s capable of creating coherent music for up to 5 minutes.
How to Use Google MusicLM to Generate AI Music
With that said, let’s go ahead and learn how to use Google MusicLM to generate AI soundtracks.
-
Head over to theMusicLM websiteby Google and click on “Get Started.”
-
Now, click on “Register your interest” and join the waitlist. Users are being approved instantly so no need to wait further.
-
Next,sign in with the Google account, and you will have access to MusicLM right away.
-
Now, go ahead andenter text descriptionsto create the music of your music. For example, I started with the below prompt and I got a nice relaxing music.
-
Next, I entered the below prompt to generatemusic for the workout. It did a decent job at that.
-
You can also enterlonger promptswith more descriptions. And the output was quite good.
-
Finally, you can enterabstract promptsas well. This description is from Salvador Dalí’s The Persistence of Memory painting.
-
And for those wondering how we got the samples embedded above, you can download the AI music with ease. Click the “three dots” icon next to the generated tracks andselect the “Download” optionfrom the pop-up menu.
Google MusicLM Hands-on: First Impressions
While exploring Google MusicLM, it became clear that MusicLM is still an early demo of what AI can do in the music industry. Sometimes, it surprised me with its melodious output, and often, the generated music turned out to bedecent to average. In itsofficial video, Google demonstrated that MusicLM can create good music in different variations modeled on popular songs. However, in our testing, MusicLM completely failed to output similar results.Prompt: Jazz with saxophone bella ciao
It may be because Google has not fully released the model as it’s still part of the experimental AI Test Kitchen initiative. In the future, you mayget an option to upload your own humming audioand ask MusicLM to add a saxophone and render the music in jazz. I also asked it to create a fusion of Western rock and Indian classical music and the output was bad.
To sum up, for an early demo, MusicLM is indeed an exciting AI project for musicians, but to make it truly outstanding, it will require a larger quality dataset, rich text descriptions, and added capabilities like the option toupload your own music samples. We await the release of new models and capabilities from both Google and OpenAI for AI music generation.
Arjun Sha
Passionate about Windows, ChromeOS, Android, security and privacy issues. Have a penchant to solve everyday computing problems.
Add new comment
Name
Email ID
Δ
01
02
03
04
05
