How does a robotic arm or a prosthetic hand learn a complex task like grasping and rotating a ball? The challenge for the human, prosthetic or robotic hand has always been to correctly learn to control the fingers to exert forces on an object.
The sensitive skin and nerve endings that cover our hands have been attributed with helping us learn and adapt to our manipulation, so roboticists have insisted on incorporating sensors into robotic hands. But–given that you can still learn to handle objects with gloves on– there must be something else at play.
This mystery is what inspired researchers in the ValeroLab in the Viterbi School of Engineering to explore if tactile sensation is really always necessary for learning to control the fingers.
The researchers Romina Mir, Ali Marjaninejad, Andrew Erwin and Professor Francisco Valero-Cuevas within Alfred Mann Department of Biomedical Engineering asked: how do the sensors that are part of the hand (its nature) interplay with how a hand is trained (nurtured) to learn complex tasks?
In a paper in the journal Science Advances, the team addresses the classic “nature versus nurture” question using computational modeling and machine learning.
The paper, “Curriculum Is More Influential Than Haptic Information During Reinforcement Learning of Object Manipulation Against Gravity,” builds on the lab’s previous work related to hand evolution and artificial intelligence. It demonstrates that the sequence of learning, also known as the “curriculum,” is critical for learning to occur.
In fact, the researchers note that if the curriculum takes place in a particular sequence, a simulated robotic hand can learn to manipulate with incomplete or even absent tactile sensation.
For this study, the team employed software to simulate a three-fingered robotic hand to “provide a counter-example to the long-held notion that tactile sensation is always necessary,” Valero-Cuevas says, and also “emphasizes the importance of the sequence of rewards for training,” commented Romina Mir, who is one of two first authors and a Ph.D. student in the ValeroLab.
“Reward guides development of the system,” said corresponding author, Francisco Valero-Cuevas, who is also a professor in the Division of Biokinesiology and Physical Therapy at USC.
He added, “…just like biological systems are a product of their experience. This link between machine learning and biology is a powerful connection that may enable progress of artificial intelligence systems that can learn and adapt in the physical world.”
In this collaboration between the Viterbi School of Engineering and the University of California in Santa Cruz (UCSC), doctoral students Parmita Ojaghi (UCSC) and Romina Mir (USC) co-led this work in collaboration with Prof. Michael Wehner (UCSC). Ali Marjaninejad and Andrew Erwin (USC) also contributed to this work.
More information:
Pegah Ojaghi et al, Curriculum is more influential than haptic feedback when learning object manipulation, Science Advances (2025). DOI: 10.1126/sciadv.adp8407
University of Southern California
Citation:
Tactile sensors are less important than the order of learning experiences for robotic hands, study shows (2025, April 4)
retrieved 4 April 2025
from https://techxplore.com/news/2025-04-tactile-sensors-important-robotic.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.
