Our @dondersinst.bsky.social funded collaboration project EnvisionBoxBaby is in full swing. Leveraging object detection for eye tracking-object dynamics.

With @babajideowoyele.bsky.social @Davide Ahmar, @sabinehunnius.bsky.social @carorowland.bsky.social @yayun23.bsky.social

In preparation of teaching and supervision coming years I have created a webpage that provides a bit of a landing page for students to see what me and my colleagues are up to, to help carve out projects: www.wimpouw.com/collaborate....

Postprint: osf.io/987fm_v1 To appear in Proceedings of Cog Sci 2025

DIMS Dashboard for Exploring Dynamic Interactions and Multimodal Signals.

The interdisciplinary @graceqmiao.bsky.social in the lead here! Developing a dynamic dashboard for a quali-quanti social neuroscience research cycle!

Its full of multimodal signal processing and analyses - continuous and peak-based. Methods & results (and prereg) were fully written in Rmarkdow.

This was a lot of work, and were happy it now has a peer-reviewed stamp. wimpouw.github.io/kineticsvoice/

The package automatically detects gestures using a CNN classifier generating gesture segments and ELAN files, further performing gesture kinematic feature and DTW analysis, as to then visualizes everything interactively with a dashboard app (see paper for the server version).
osf.io/preprints/ps...

Update re pypi package envisionHGdetector! Our preprint "EnvisionHGdetector: A Computational Framework for Co-Speech Gesture Detection, Kinematic Analysis, and Interactive Visualization" is now out! osf.io/preprints/ps...

@jamestrujillo.bsky.social @gdemelo.bsky.social @babajideowoyele.bsky.social

We (with Annika Schiefner) put a new EnvisionBox module online for creating stimuli where one wants to dynamically block the signal potential of different facial gestures, mouthings, or articulatory information. Maybe helpful for some!

envisionbox.org/embedded_Sti...

github.com/WimPouw/Auto...

23-27June: The EnvisionBox team @jamestrujillo.bsky.social @babajideowoyele.bsky.social is organizing a summer school on social signal processing again this year! In Amsterdam - hosted by @jamestrujillo.bsky.social

Well send out an official sign-up announcement via the envisionbox newsletter soon.

working gif of example output

for training your own model, here is a runthrough from beginning to end based on open source pipeline NoddingPigeon: envisionbox.org/embedded_Hum...