@riccardofosco.bsky.social
Sound effects, audio & video | PhD at @ISPAMM, @Sapienza | Former @C4DM, @QMUL
A great work with Christian Marinoni, @emilianpos.bsky.social, @mcomunita.bsky.social, Luca Cosmo, Joshua D. Reiss and @dacom.bsky.social
December 20, 2024 at 6:20 PM
A great work with Christian Marinoni, @emilianpos.bsky.social, @mcomunita.bsky.social, Luca Cosmo, Joshua D. Reiss and @dacom.bsky.social
This project explores how to generate realistic sound effects for a silent video. Our model combines:
🔹 Video-based RMS envelope prediction, and
🔹 Audio synthesis with Stable Audio and ControlNet, enabling high-quality sound design synchronized to the visual input.
🔹 Video-based RMS envelope prediction, and
🔹 Audio synthesis with Stable Audio and ControlNet, enabling high-quality sound design synchronized to the visual input.
December 20, 2024 at 6:19 PM
This project explores how to generate realistic sound effects for a silent video. Our model combines:
🔹 Video-based RMS envelope prediction, and
🔹 Audio synthesis with Stable Audio and ControlNet, enabling high-quality sound design synchronized to the visual input.
🔹 Video-based RMS envelope prediction, and
🔹 Audio synthesis with Stable Audio and ControlNet, enabling high-quality sound design synchronized to the visual input.