Published by Penn Today
Authored by Jacob Williamson-Rea
A robot can assemble a car door or pack a box much faster and more efficiently than any human, but such single-purpose machines struggle when asked to perform in challenging environments that contain elements such as stairs or tunnels.
Robotics researchers are aiming to design robots that can sense and interact with features of never-before-seen environments to give machines increasing autonomy. To achieve this, robots must be able to sense features of unpredictable and new environments and then interact fluidly within them.
Penn’s ModLab explores how robots can adapt to their surroundings and solve problems for which they weren’t explicitly programmed. The lab, directed by professor Mark Yim, is part of the GRASP Lab and is based at PERCH in the Pennovation Center.
An individual SMORES-EP module. The electro-permanent magnets on the module’s wheels mean they can connect with and manipulate other modules.
ModLab has recently published a new study on its SMORES-EP system, or Self-Assembling Modular Robots for Extreme Shapeshifting. Composed of individual cube-shaped modules that sport protruding wheels, the modules can self-assemble to form various structures thanks to hinged faces that contain electro-permanent magnets. An early demonstration showed that SMORES-EP can use objects such as blocks or ramps to accomplish tasks or self-reconfigure to a shape more appropriate for a task.
Now the updated SMORES-EP system can autonomously analyze an environment, and then reconfigure and transform its shape to navigate through any environment, even entirely new ones.
Yim, a professor in the Department of Mechanical Engineering and Applied Mechanics in the School of Engineering and Applied Science, and Tarik Tosun, a recent Ph.D. graduate of Yim’s lab, published the study demonstrating these new abilities in the journal Science Robotics. They collaborated with professors Hadas Kress-Gazit and Mark Campbell, co-directors of the Autonomous Systems Laboratory at Cornell University’s Sibley School of Mechanical and Aerospace Engineering, along with lab members Jonathan Daudelin and Gangyuan Jing.
Penn’s Tosun and Yim previously used an algorithm to teach the SMORES-EP how to bypass an obstacle. To adapt to challenging environments, the robot used building blocks to construct ramps and bridges that let it overcome obstacles. Humans do this often; we use ladders to reach high places, or use a bridge to cross a river. The SMORES-EP can now perform tasks without tools by transforming its shape based on an environment. This would be the equivalent of a human stretching 30 feet high instead of using a ladder.
“We’ve put together a system that allows the robot to enter a new environment and then reconfigure appropriately in order to gain access to the capabilities it needs to complete tasks,” says Tosun.
The SMORES-EP robot constantly 3D maps the environment in which it has been placed, while simultaneously using environment characterization tools and algorithms. The robot also has an interactive system connected to a library of configurations and behaviors. The library contains options for different kinds of bodies the robot could transform into based on different limitations recognized in an environment, for instance transforming into a snake-like configuration after encountering stairs.
A high-level planning framework allows the user to provide a task in structured English, so if Tosun instructs SMORES-EP to retrieve a brightly colored object and then place it in a designated area, the robot can transform itself into an appropriate shape to overcome constraints or obstacles along the way.
“Say a desired object is placed in an area that’s too narrow for the current configuration to drive into,” says Tosun. “Using environment characterization tools, the system can process 3D map data to classify the current environment as having the ‘tunnel’ property, and then search its library for a configuration capable of operating in a tunnel. If it finds one, it can use a reconfiguration algorithm to transform from the current configuration into an appropriate shape, and retrieve the object.”
“The robot could begin in a car configuration, to drive around and explore, and then when it comes upon an object it has been tasked with retrieving from a tunnel, the robot then reconfigures into a shape with an arm to reach into the tunnel,” Tosun adds.
Read the full article in Penn Today
Related News
“Penn ModLab is developing robots that can change their shapes in response to surroundings” by Daily Pennsylvanian
Featured People
PhD, MEAM '19 - Waymo
Director, GRASP Lab; Faculty Director, Design Studio (Venture Labs); Asa Whitney Professor, MEAM