Social Humanoid makes a Unitree G1 react to people, no mocap
Vongani Maluleke's framework pairs high-level social reasoning with low-level control on a Unitree G1, and Angjoo Kanazawa says this is the part robotics has not solved.
Vongani Maluleke has released Social Humanoid, a framework for socially responsive human and humanoid interaction, deployed on a Unitree G1. She describes it as a hierarchical system that combines high-level social reasoning with low-level control, so the robot can interact with a human partner rather than just execute a task next to one.
our hierarchical system combines high-level social reasoning with low-level control
The detail that makes it interesting is what is missing. There is no mocap (motion capture, the suits and marker systems labs normally use to feed a robot a clean read of where a person's body is). Angjoo Kanazawa, posting about the work, says Maluleke built it on her previous human motion sequence model to let a humanoid react to humans socially, with no mocap.
Why the no mocap part matters
Almost every humanoid demo that involves a person nearby treats the person as an obstacle or a remote operator. Reading a human as a social partner, in real time, from whatever the robot can sense, is a different problem. Kanazawa's framing is blunt about where the field actually is.
Don't worry, robotics isn't solved yet bc they're not socially intelligent at all.
That is a researcher's take on the gap, not a review of this system.
Shown versus claimed
The post is an introduction with a video attached. Maluleke's description covers the architecture and the platform. There are no success rates, no trial counts, no comparison against a baseline and no details on how long the interactions run or how many different people the robot was tested with in the sources available. Whether the behaviour holds up outside the clip nobody knows yet.
Kanazawa added that Maluleke is on the job market and will be at CoRL, which is where a good chunk of this week's robot learning work has landed, including the CoRL keynote reveal Jim Fan trailed. Expect more detail from the authors there rather than from the thread.
Don’t worry, robotics isn't solved yet bc they’re not socially intelligent at all.
Sound like you were at the demo
One email a day. Under three minutes. The demos, the deployments and the part the press release left out.