Ben Duffy
benduffymmm.bsky.social
Ben Duffy
@benduffymmm.bsky.social
Building robots which can see through walls and humanoids.
Co-founder at http://bearcover.de and http://themtank.org
https://youtube.com/@BenDuffyMMM
- Putting it all together for red cube picking instead of purple ball kicking
- talking about ALOHA (ACT) and LeRobot
- Steve Wozniak coffee test
- Running through what happened in November and December and plans for January
February 21, 2025 at 10:10 AM
- Analogies between this and sock picking
- 4 different approaches to both: visual servoing, motion planning (classic robotics), reinforcement learning, imitation learning
- hardcoded keyfrrame for side grasp and front grasp
- first accidental almost a autonomous sock grasp
February 21, 2025 at 10:10 AM
Also:

- getting up from the ground
- face tracking in camera and just waving (but no pan tilt control for this application)
February 5, 2025 at 11:07 AM
Public notion page detailing my daily progress towards this and harder tasks:
bright-trollius-2c1.notion.site/Humanoid-Log...
Humanoid Log | Notion
The what
bright-trollius-2c1.notion.site
February 2, 2025 at 6:53 PM
Let's see if I can exhaust of him his possibilities. Hardware limits applications but most humanoid problems are software related which is my focus.

Therefore autonomous sock picking is the goal! 😅😜
February 2, 2025 at 6:53 PM
Later I run face detection and go through all his actions. Then we SSH in, run some code to do even more actions like "hurdles", "greet", "wave", "calib", "left kick". Especially during hurdles it is clear that he is quite an impressive machine for his cost.
February 2, 2025 at 6:53 PM
Also have a public notion log and plans of everything I am doing with him and related to humanoids:
bright-trollius-2c1.notion.site/Humanoid-Log...

I like this idea of building in public, keeps you accountable and also shows the progression from meagre beginnings to the State of the Art (SoTA)
https://bright-trollius-2c1.notion.site/Humanoid-Log-158fd6bd98918073a60cd01d66f0f522…
January 30, 2025 at 10:52 PM
In this part we go through all of his degrees of freedom comparing to human muscles + bones, cover some of his electronics and specific details and open the series.

But I think the real niche is to talk about all humanoid software, which is lacking, I will cover in the future:
January 30, 2025 at 10:52 PM