youtu.be/-c1YyP3oyTQ?...

Here's me scraping unskillfully on a "violin".

In this micro-experiment, I try to extract playable instrument models from a single audio recording. You can play with a handful of the models in your browser!

blog.cochlea.xyz/resonancemod...

Text-to-music is amazing, but it sucks all the fun out for me, as a musician. I'm using machine learning to "extract" models that can be controlled in real-time. My goal is to give them all the subtlety and richness that you'd get from a real acoustic instrument.

A fun little WebAudio + MediaPipe toy for October 🛸 🧟

blog.cochlea.xyz/theremin.html

blog.cochlea.xyz/rnn-instrume...

arxiv.org/abs/2505.05654

I wrote a paper summarizing the work I've been pursuing toward a sparse audio codec!

I'd like to post this to the CS -> Sound section of arxiv, if possible, so if anyone would be willing to "endorse" me, shoot me a message and I'll share the code!

blog.cochlea.xyz/toward-a-spa...

This play-able scatterplot (clicking on points plays a sound) maps many points from an audio event decoder onto a 2D plane using t-SNE. I find it both fun to play with and pretty to look at!

blog.cochlea.xyz/scatter.html

I've added accelerometer support to the spring-mass synthesis toy. Try it out on your phone!

blog.cochlea.xyz/string.html

I believe that one key to sparse audio representations will be baking "resonance priors" into models; even many synth sounds are aping some real-world system. As such, I've gotten interested in physical modeling, and built this fun little Web Audio toy to learn more!

blog.cochlea.xyz/string.html