What Would Jim Henson Do? Roleplaying Human-Robot Collaborations Through Puppeteering
In this article, researcher James Dwyer and Dr Valeria Macalupú, Postdoctoral Research Fellow, both from QUT (Queensland University of Technology)’s Human Robot Interaction research program, examine an innovative approach to designing and testing human robot collaborations through puppeteering.
The kinematic puppet is a tangible, low-cost, and adaptable tool that merges physical prototyping with virtual simulation, enabling users to intuitively explore robotic movements. By integrating 3D-printed modular joints with a real-time digital twin in Unreal Engine, this system offers a hands-on way to refine robot-assisted procedures—particularly in fields like Robot-Assisted Surgery (RAS).
Presented at HRI2025, the demonstration not only showcased the tool’s potential but also won ‘Best Demo’ at the conference! Special congratulations to our researchers—James Dwyer, Stine Johansen, Jared Donovan, Rafael Gomez FDIA, and Markus Rittenbruch—on this achievement!
This research highlights the power of creative methodologies—like puppeteering—to make cutting-edge technology more accessible. It also reinforces the importance of presenting work early to refine ideas and uncover unexpected applications.
What Would Jim Henson Do? Roleplaying Human-Robot Collaborations Through PuppeteeringView all resources