Researcher at Stability AI.
Musician at BRNRT Collective.
Previously at Dolby and Universitat Pompeu Fabra.
artintech.substack.com
www.jordipons.me
That flexibility is what makes new sounds possible.
But if we release a neural synthesizer and one prompt doesn’t sound as you expect, you’ll be mad at us.
So we’ll just keep the new neural synthesizers to ourselves.
That flexibility is what makes new sounds possible.
But if we release a neural synthesizer and one prompt doesn’t sound as you expect, you’ll be mad at us.
So we’ll just keep the new neural synthesizers to ourselves.
In this post I share are its main ideas: artintech.substack.com/p/ace-step-1...
1. DIFFUSION MODEL: supports multiple tasks.
2. LANGUAGE MODEL: reprompting & semantic tokens generation.
3. DATA PREPARATION: 27M songs.
4. OPEN WEIGHTS: supports LoRAs.
In this post I share are its main ideas: artintech.substack.com/p/ace-step-1...
1. DIFFUSION MODEL: supports multiple tasks.
2. LANGUAGE MODEL: reprompting & semantic tokens generation.
3. DATA PREPARATION: 27M songs.
4. OPEN WEIGHTS: supports LoRAs.
It is an open-source music model that claims to perform on par with Suno.
1. HeartCodec: low-rate audio tokens
2. HeartMuLa: autoregressive model
3. HeartTranscriptor: lyrics tokens
4. HeartCLAP: text & reference-audio tokens
artintech.substack.com/p/heartmula-...
It is an open-source music model that claims to perform on par with Suno.
1. HeartCodec: low-rate audio tokens
2. HeartMuLa: autoregressive model
3. HeartTranscriptor: lyrics tokens
4. HeartCLAP: text & reference-audio tokens
artintech.substack.com/p/heartmula-...
- artintech.substack.com/p/interactiv...
- www.youtube.com/watch?v=U8dc...
- aiformusicworkshop.github.io
- www.universalmusic.com/universal-mu...
- artintech.substack.com/p/interactiv...
- www.youtube.com/watch?v=U8dc...
- aiformusicworkshop.github.io
- www.universalmusic.com/universal-mu...
If its current state feels like ‘slop,’ consider creating something different yourself.
While this essay has focused on Interactive AI Music, I’m sure there’s still much more to discover.
Over the break, I wrote a post defining Interactive AI Music, a term that brings together my favorite artistic projects in AI and music.
artintech.substack.com/p/interactiv...
If its current state feels like ‘slop,’ consider creating something different yourself.
While this essay has focused on Interactive AI Music, I’m sure there’s still much more to discover.
Over the break, I wrote a post defining Interactive AI Music, a term that brings together my favorite artistic projects in AI and music.
artintech.substack.com/p/interactiv...
Over the break, I wrote a post defining Interactive AI Music, a term that brings together my favorite artistic projects in AI and music.
artintech.substack.com/p/interactiv...
“On Shared Musical Agency”
with Martin Heinze (marts~)
artintech.substack.com/p/on-shared-...
“On Shared Musical Agency”
with Martin Heinze (marts~)
artintech.substack.com/p/on-shared-...
But AI art does not need to be like that.
I strongly believe that AI can be used to create art that was previously impossible and that it will be equally appealing as previous art forms.
But AI art does not need to be like that.
I strongly believe that AI can be used to create art that was previously impossible and that it will be equally appealing as previous art forms.
"SAM Audio Explained"
artintech.substack.com/p/sam-audio-...
"SAM Audio Explained"
artintech.substack.com/p/sam-audio-...
I enjoy that first day when I don’t yet grasp their artistic practice or fully follow what they say.
But as we interact, our language becomes similar. Especially in how we refer to concepts/ideas.
I’m not sure if that’s good or bad.
I enjoy that first day when I don’t yet grasp their artistic practice or fully follow what they say.
But as we interact, our language becomes similar. Especially in how we refer to concepts/ideas.
I’m not sure if that’s good or bad.
Ethics are important, but being compelling is just as important. If it isn’t, there’s little reason to use AI for artistic creation.
Ethics are important, but being compelling is just as important. If it isn’t, there’s little reason to use AI for artistic creation.
Nature rarely repeats itself.
Yet, we play the same music and films over and over.
Generative art changes every time you experience it.
What if generative AI ends up feeling more NATURAL than the static media of today?
Nature rarely repeats itself.
Yet, we play the same music and films over and over.
Generative art changes every time you experience it.
What if generative AI ends up feeling more NATURAL than the static media of today?
I don't understand the need for separate AI devices.
Maybe glasses could work to help our posture, but having a camera on your face is awkward.
I don't understand the need for separate AI devices.
Maybe glasses could work to help our posture, but having a camera on your face is awkward.
artintech.substack.com/p/gantasmo-a...
Uniquely address the AI live performance challenge with XR and explore AI music through the uncanny sound.
artintech.substack.com/p/gantasmo-a...
Uniquely address the AI live performance challenge with XR and explore AI music through the uncanny sound.
I'm against BAD (AI) art.
I'm against BAD (AI) art.
Celebrating 20 years of Freesound in an essay.
artintech.substack.com/p/freesound-...
Celebrating 20 years of Freesound in an essay.
artintech.substack.com/p/freesound-...
1. Tools
2. Narratives
3. Power asymmetries
Apart from these, what else do you think holds artists back?
artintech.substack.com/p/why-artist...
1. Tools
2. Narratives
3. Power asymmetries
Apart from these, what else do you think holds artists back?
artintech.substack.com/p/why-artist...