We just released AnySense, an iPhone app for effortless data acquisition and streaming for robotics. We leverage Apple’s development frameworks to record and stream:

1. RGBD + Pose data
2. Audio from the mic or custom contact microphones
3. Seamless Bluetooth integration for external sensors

How well do Multimodal LLMs consider visual information when creating plans to complete household activities? To answer this, we put a few multimodal LLMs on a pair of smart glasses and had participants try to solve cooking tasks while taking instructions from them.

How well do Multimodal LLMs consider visual information when creating plans to complete household activities? To answer this, we put a few multimodal LLMs on a pair of smart glasses and had participants try to solve cooking tasks while taking instructions from them.

1/ I am seeing a lot of comments on the slashing of NIH support along the lines of “universities should just spend their huge endowments.”

I’m the last person to cheer on the institutional stratification rising endowments have contributed to. But let me explain why this is not a solution.

Does everyone in your community agree on some folk knowledge that isn’t published anywhere? Put it in a paper! It’s a pretty valuable contribution

Introducing Generative Omnimatte:

A method for decomposing a video into complete layers, including objects and their associated effects (e.g., shadows, reflections).

It enables a wide range of cool applications, such as video stylization, compositions, moment retiming, and object removal.

No, ChatGPT won't help in the classroom, won't save teachers time, and doesn't represent a set of skills students need to learn.

On OpenAI's latest nonsense:

buttondown.com/maiht3k/arch...

Hello world! I'm a PhD student at CMU in robotics, at the intersection of vision and robot manipulation.

If you like robots & makers here's a thread starter packs!

go.bsky.app/9xL642E

I am trying to create a robotics and ai starter pack on bluesky: go.bsky.app/DfAoaJ1

Very incomplete please comment with suggestions (or just if you're missing and want to be added!)