New sensation

New sensation is part of the Look back feature from the Spring 2023 issue of Michigan Engineer magazine.

Our cover story for the fall 2019 issue invited readers into a hopeful future for the millions of individuals suffering from limb loss. Mind-controlled prostheses offer to give amputees reliable, intuitive control of advanced robotic hands using only thought. The technology has developed in the past few years in some key ways.

At the center of this work is a convergent team of U-M researchers with backgrounds in engineering, medicine, kinesiology and other areas. They work closely with upper-limb amputees and later decided to join the team as research participants to test prosthetic hands and control algorithms repeatedly, with the hopes of one day making the lives of people with similar injuries a little bit easier.

“Every time I’ve had the opportunity to talk to a potential future user of this technology, whether it’s a person with a spinal cord injury or a person with an amputation, I always learn something that we can take with us into making a better design,” said Cindy Chestek, an associate professor of biomedical engineering. “It’s really important to start talking with future users very early on in the process of designing anything.”

In this 2019 photo, research participant Karen Sussex performs tests in the lab.

Karen Sussex is one of those future users, and she’s continued to work with the group since our last story. Back then, she would meet with the researchers in a small room off a zigzagging, nondescript medical hallway between hospital buildings and be hooked up to a large computer cart in order to operate one of the prosthetic hands. Now, she meets the team in a large, modern research lab outfitted with motion capture technology in the newly renovated Kinesiology Building (formerly the Natural Sciences Building) and the computer needed to operate the hand now fits in a backpack. Sussex even had the opportunity to get outside, walk across the street to Panera Bread, open the doors with the prosthesis, and grab and carry the bag holding her lunch back to the lab.

One of the primary components of this team’s research is the regenerative peripheral nerve interface, or RPNI, which is a tiny piece of muscle surgically attached to the end of a nerve in the patient’s arm. The nerve grows into this piece of muscle, and soon neural signals meant for the patient’s phantom hand instead cause the RPNI muscle to contract and relax in different ways. This generates easily detectable signals that can be recorded by implanted electrodes and then interpreted and used for controlling the advanced robotic hands.

One advantage of the team’s RPNI technology was the reliability of the signals they could record. This meant that a user would only need to briefly train the control algorithm on the first day, and could use the hand for months without needing to retrain. This was in contrast with most commercially available myoelectric prosthetic systems that require daily retraining. Now, thanks to Sussex’s persistence with the research, the team has shown that this reliability lasts up to three years.

Another exciting branch of this work has been finding a way to not just receive signals from the brain via the RPNI, but also to send signals back and provide sensation for the participant, which Sussex has been testing out.

“We can actually modulate the signal properties and move sensation from one side of her hand to the other. So she feels like it’s moving,” said Deanna Gates, an associate professor of kinesiology and biomedical engineering. “And in another participant, when we stimulated the RPNIs, he was able to improve performance by getting stimulation during movement.”

A researcher uses an ultrasound wand on a research participant.

By being able to feel what that they are touching, participants would be better able to choose how to hold something as well as how much pressure to use. The sensation could also improve proprioception, or the ability to intuit where the hand is in physical space.

While the functionality of the RPNI interface is progressing, the limitations of the robotic hands connected to that interface have been a challenge. One hand the team has used offers a great range of motion, but is large and heavy, which is hard for Sussex to use. The hand she uses most is smaller and lighter, but doesn’t offer the same range of motion. To address this, the team is developing a virtual reality setup that would allow participants to practice with a virtual prosthesis.

Moving forward, the team continues to work on improving their algorithms and reducing the size of the computer needed to operate the hand. Their ideal setup would be a system about the size of a bandage that would go on the arm and send signals wirelessly to the hand. They will also continue studying stimulation to understand how that can help the participant better use their prosthesis.

Listen to our 2020 podcast on this research:

New sensation

More Michigan Engineer Look Back stories

Moving out

Focused ambitions

Peecycling

Bittersweet business