In #AR, using real-time on-device 3D Gaussian splatting, we create the illusion that physical changes occur instantaneously, while a hidden robot fulfills the “reality promise” moments later, updating the physical world to match what users already perceive visually. 🤖

Even virtual agents’ actions can have physical effects, with motion paths that divert attention from the hidden robot. 🐝


Beyond materializing physical objects (seemingly out of thin air), users can manipulate out-of-reach objects via RealityGoGo — creating the illusion of telekinesis. 🪴

In #VR, users can experience “magical” interactions, such as moving distant virtual objects with the Go-Go technique. How might we similarly extend people’s abilities in the physical world? 🪄

Excited to share Reality Promises, our #UIST2025 paper, led by the amazing Mo Kari ✨

Check out Lauren Wang’s #UIST2025 poster on GhostObjects: life-size, world-aligned virtual twins for fast and precise robot instruction, with real-world lasso selection, multi-object manipulation, and snap-to-default placement.

This is the first piece in her ongoing work on #AR for #HRI 🤖👓

📢 Find Judy Fan (@judithfan.bsky.social) at #CogSci2025 during Poster Session 1 (⏰Tomorrow, 1–2:15 PM | 📍Salon 8) to learn about our work on understanding multimodal communication and how people form linguistic and gestural abstractions in collaborative physical tasks.

This is a qualitative study of how simple interactive mechanisms—filtering, overlaid annotations, and counterfactual image edits—might address existing challenges with static CV explanations, such as information overload, semantic-pixel gap, and limited opportunities for exploration.

Check out Indu Panigrahi’s LBW at #CHI2025: “Interactivity x Explainability: Toward Understanding How Interactivity Can Improve Computer Vision Explanations.”

🔗 Project Page: ind1010.github.io/interactive_XAI
📄 Extended Abstract: arxiv.org/abs/2504.10745