We're thrilled to have worked with Holly Herndon to train a model finetuned on her vocal style to share with all of you.

Playing with Holly’s model, you can use additional controls to get vocalizations that contour the music or "color" the instruments with a timbre that resembles Holly's voice

Magenta RT now supports what we call *audio injection* - a novel method for real-time audio input

You can use audio injection to transform and add layers to prerecorded music!

Realtime interactive generative models FTW!

Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM!

* Live Jamming with audio input 🎤🎸🎵
* Personalize your own models 🔧
* Tech report 📜

Links below in the 🧵...

Be a Prompt DJ 🎧🎶: Play it like a live instrument. Use prompts and advanced controls to vary the instrumentation, texture, and genre. Incorporate with a DJ set to apply effects and mix with other loops.

Jam Along 🎸🥁: Create dynamic backing tracks that are different every time, varying and evolving as you play on top.

What can you do with it?

Dig in the crate 🎛️💡 : Explore new sounds by blending and merging genres, moods, instruments, or anything you can think of. Sample the stream of music to spark your own inspiration or help you get past a creative block.

New VST/AU Plugin! 🚨

Play with Lyria RealTime directly from inside your favorite DAW with “The Infinite Crate” 🎧🎶

With a VST plugin you can feed audio directly into your DAW for sampling, live performance, or even a practice partner to jam with.

💾 Get it here: g.co/magenta/infinite-crate

Pleasantly surprised with how easy/fun it is to "vibe code" new musical experiences in AI Studio.

I'm not much of a JS guy, but had Gemini help me make a "Kaoss Pad" emulator using the Lyria RealTime API to explore musical latent spaces in realtime.

Jam of the day #14: mbira DnB 16th note tornado

Sometimes less is more with prompts

Remix here: aitestkitchen.withgoogle.com/tools/music-...

Discord: discord.gg/googlelabs
#MusicFXDJ

Jam of the day #13: Chiptune drumline madness

Happy Monday!

Remix here: aitestkitchen.withgoogle.com/tools/music-...
Discord: discord.gg/googlelabs
#MusicFXDJ

Jam of the day #12: Adding a synth breakdown and going deeper with the house...

Extending discord user Georgia's extension of my jam of the day #11...

Remix here: aitestkitchen.withgoogle.com/tools/music-...

Discord: discord.gg/googlelabs
#MusicFXDJ

Jam of the day #11: Bluegrass trap tablaphone

Love the transition, some pretty wild sounds in there

Remix here: aitestkitchen.withgoogle.com/tools/music-...

Discord: discord.gg/googlelabs
#MusicFXDJ

Jam of the day #10: Blue man group vibes. Not sure how I found my way into this part of latent space but I like it.

Feels like more of an abstract mixture than a linear combination.

Remix here: aitestkitchen.withgoogle.com/tools/music-...

Discord: discord.gg/googlelabs
#MusicFXDJ