Viswanath (Vish) Sivakumar
seasonedschemer.bsky.social
Viswanath (Vish) Sivakumar
@seasonedschemer.bsky.social
ML and neural interfaces research, Meta Reality Labs
Wrapped up several of @srushnlp.bsky.social's puzzles over recent weekends. RASPy (and the original RASP language) was particularly elegant.
April 14, 2025 at 3:04 PM
Live demos are hard, letting anyone try out the demo is harder. Hardware makes all of this doubly so.

Thank you to everyone who dropped by our posters, engaged in discussions, and tried out the surface EMG demo. We were humbled by the interest! #NeurIPS2024
December 14, 2024 at 11:21 PM
8/

And and that's not all!

Here's another large dataset we just released - emg2pose - focused on hand pose estimation using sEMG. emg2pose has 193 participants over 370 hours & >50 behavioral categories w/ hand motion capture ground truth.

arxiv.org/abs/2412.02725
github.com/facebookrese...
December 5, 2024 at 9:55 PM
7/

Our baseline model built using standard techniques from the Speech Recognition literature shows that, with some personalization on top of a model pretrained with 100 subjects, we can quite accurately enable typing with sEMG, eventually without a physical keyboard.
December 5, 2024 at 9:55 PM
6/

Towards that goal, we now release emg2qwerty - a wrist sEMG dataset collected while touch typing on a QWERTY keyboard. With 108 subjects, 1,135 sessions, 346 hours, and 5.2 million keystrokes, this is quite large by neuroscience standards.

arxiv.org/abs/2410.20081

github.com/facebookrese...
December 5, 2024 at 9:55 PM