julia wilkins 👩🏽‍💻🎵
juliawilkins.bsky.social
julia wilkins 👩🏽‍💻🎵
@juliawilkins.bsky.social
Now: Audio & Multimodal ML PhD in the Music and Audio Research Lab @ NYU
Prev: Data Developer at Sonos and Northwestern, Research Intern at Adobe + Bosch Research
weights and biases (wandb.ai), will you be my valentine? 👩‍💻💘
February 14, 2025 at 3:19 AM
So awesome to see the evolution of SFX generation from the Adobe titans!
🎥 Introducing MultiFoley, a video-aware audio generation method with multimodal controls! 🔊
We can
⌨️Make a typewriter sound like a piano 🎹
🐱Make a cat meow like a lion roars! 🦁
⏱️Perfectly time existing SFX 💥 to a video.

arXiv: arxiv.org/abs/2411.17698
website: ificl.github.io/MultiFoley/
November 27, 2024 at 6:25 PM