Researcher at Stability AI.
Musician at BRNRT Collective.
Previously at Dolby and Universitat Pompeu Fabra.
artintech.substack.com
www.jordipons.me
In this post I share are its main ideas: artintech.substack.com/p/ace-step-1...
1. DIFFUSION MODEL: supports multiple tasks.
2. LANGUAGE MODEL: reprompting & semantic tokens generation.
3. DATA PREPARATION: 27M songs.
4. OPEN WEIGHTS: supports LoRAs.
In this post I share are its main ideas: artintech.substack.com/p/ace-step-1...
1. DIFFUSION MODEL: supports multiple tasks.
2. LANGUAGE MODEL: reprompting & semantic tokens generation.
3. DATA PREPARATION: 27M songs.
4. OPEN WEIGHTS: supports LoRAs.
It is an open-source music model that claims to perform on par with Suno.
1. HeartCodec: low-rate audio tokens
2. HeartMuLa: autoregressive model
3. HeartTranscriptor: lyrics tokens
4. HeartCLAP: text & reference-audio tokens
artintech.substack.com/p/heartmula-...
It is an open-source music model that claims to perform on par with Suno.
1. HeartCodec: low-rate audio tokens
2. HeartMuLa: autoregressive model
3. HeartTranscriptor: lyrics tokens
4. HeartCLAP: text & reference-audio tokens
artintech.substack.com/p/heartmula-...
- artintech.substack.com/p/interactiv...
- www.youtube.com/watch?v=U8dc...
- aiformusicworkshop.github.io
- www.universalmusic.com/universal-mu...
- artintech.substack.com/p/interactiv...
- www.youtube.com/watch?v=U8dc...
- aiformusicworkshop.github.io
- www.universalmusic.com/universal-mu...
If its current state feels like ‘slop,’ consider creating something different yourself.
While this essay has focused on Interactive AI Music, I’m sure there’s still much more to discover.
Over the break, I wrote a post defining Interactive AI Music, a term that brings together my favorite artistic projects in AI and music.
artintech.substack.com/p/interactiv...
If its current state feels like ‘slop,’ consider creating something different yourself.
While this essay has focused on Interactive AI Music, I’m sure there’s still much more to discover.
Over the break, I wrote a post defining Interactive AI Music, a term that brings together my favorite artistic projects in AI and music.
artintech.substack.com/p/interactiv...
Over the break, I wrote a post defining Interactive AI Music, a term that brings together my favorite artistic projects in AI and music.
artintech.substack.com/p/interactiv...
“On Shared Musical Agency”
with Martin Heinze (marts~)
artintech.substack.com/p/on-shared-...
“On Shared Musical Agency”
with Martin Heinze (marts~)
artintech.substack.com/p/on-shared-...
But AI art does not need to be like that.
I strongly believe that AI can be used to create art that was previously impossible and that it will be equally appealing as previous art forms.
But AI art does not need to be like that.
I strongly believe that AI can be used to create art that was previously impossible and that it will be equally appealing as previous art forms.
"SAM Audio Explained"
artintech.substack.com/p/sam-audio-...
"SAM Audio Explained"
artintech.substack.com/p/sam-audio-...
I enjoy that first day when I don’t yet grasp their artistic practice or fully follow what they say.
But as we interact, our language becomes similar. Especially in how we refer to concepts/ideas.
I’m not sure if that’s good or bad.
I enjoy that first day when I don’t yet grasp their artistic practice or fully follow what they say.
But as we interact, our language becomes similar. Especially in how we refer to concepts/ideas.
I’m not sure if that’s good or bad.
Ethics are important, but being compelling is just as important. If it isn’t, there’s little reason to use AI for artistic creation.
Ethics are important, but being compelling is just as important. If it isn’t, there’s little reason to use AI for artistic creation.
> arxiv.org/abs/2508.11694
> arxiv.org/abs/2508.11694
> www.aisongcontest.com/all-particip...
> www.aisongcontest.com/join
> www.aisongcontest.com/all-particip...
> www.aisongcontest.com/join
Labour exploitation? You are assuming all generative AI artists train their models in a specific way. But most AI artists actually license trained data or use their own training data.
Labour exploitation? You are assuming all generative AI artists train their models in a specific way. But most AI artists actually license trained data or use their own training data.
Nature rarely repeats itself.
Yet, we play the same music and films over and over.
Generative art changes every time you experience it.
What if generative AI ends up feeling more NATURAL than the static media of today?
Nature rarely repeats itself.
Yet, we play the same music and films over and over.
Generative art changes every time you experience it.
What if generative AI ends up feeling more NATURAL than the static media of today?
I don't understand the need for separate AI devices.
Maybe glasses could work to help our posture, but having a camera on your face is awkward.
I don't understand the need for separate AI devices.
Maybe glasses could work to help our posture, but having a camera on your face is awkward.