Shan-Yuan Teng
tengshanyuan.info
Shan-Yuan Teng
@tengshanyuan.info
Assistant Professor at National Taiwan University (NTU, Taipei). PhD, University of Chicago (Human-Computer Interaction, Virtual/Augmented Reality, Wearable, Haptics) https://lab.tengshanyuan.info/
Want to try? We are excited to demonstrate the device during Interactivity at #CHI25 and we will present the paper on Wednesday, 30 Apr, 10 am "Sensing and Haptics". See video, paper, and links to program: seeingwiththehands.com
Seeing with the Hands
A sensory substitution that supports manual interactions
seeingwiththehands.com
April 23, 2025 at 4:57 PM
We further let participants *choose* which tactile perspective to use for a handshaking task. All chose to *use both devices*, and most stated that the eyes' provides an overview, and the hands' provides details. We were really impressed by how they were able to fluently utilize these new senses!
April 23, 2025 at 4:57 PM
Our user studies including Blind & Low Vision participants focus on daily tasks (e.g., grasping). Without extensive training (~15 min), most completed without touching unintended objects. Compared to using the eyes' perspective, participants found the hands' provides a more ergonomic way of seeing.
April 23, 2025 at 4:57 PM
In contrast to the more traditional way of sensory substitution which captures vision from the *eyes’ perspective*, we propose seeing from the *hands' perspective*, and explore its unique benefits for manual tasks, e.g., hands are natural and easy to move around.
April 23, 2025 at 4:57 PM
December 6, 2024 at 10:00 PM