Scirobotics Abb0467
Scirobotics Abb0467
Replacing the human hand with artificial devices of equal capability and effectiveness is a long-standing challenge.
Even the most advanced hand prostheses, which have several active degrees of freedom controlled by the electrical
signals of the stump’s residual muscles, do not achieve the complexity, dexterity, and adaptability of the human
hand. Thus, prosthesis abandonment rate remains high due to poor embodiment. Here, we report a prosthetic
hand called Hannes that incorporates key biomimetic properties that make this prosthesis uniquely similar to a
human hand. By means of an holistic design approach and through extensive codevelopment work involving re-
searchers, patients, orthopaedists, and industrial designers, our proposed device simultaneously achieves accurate
anthropomorphism, biomimetic performance, and human-like grasping behavior that outperform what is required
in the execution of activities of daily living (ADLs). To evaluate the effectiveness and usability of Hannes, pilot
trials on amputees were performed. Tests and questionnaires were used before and after a period of about 2 weeks,
in which amputees could autonomously use Hannes domestically to perform ADLs. Last, experiments were conducted
to validate Hannes’s high performance and the human likeness of its grasping behavior. Although Hannes’s speed
is still lower than that achieved by the human hand, our experiments showed improved performance compared
with existing research or commercial devices.
and provide reasonably functional performances, the devices still do formance, and human-like grasping, which have been demonstrated
not incorporate several of the abovementioned fundamental properties in previous studies to be key aspects that determine the overall
of a human hand. The adaptability of these devices to different “goodness” of a prosthesis (4, 5, 8, 10–12, 15–17, 19, 22, 24). These
shapes and force distributions among the fingers is typically limited characteristics have been implemented using a holistic biomimetic
to static grasping, which results in an ineffective and unnaturally design approach as shown in Fig. 2 and Movie 1.
low grasp robustness (11, 42), particularly when the grasped object
is perturbed and/or moves within the prosthetic hand. The main Hannes’s high anthropomorphism
reason for this limitation is that these devices are designed with tra- Hannes is shown in Fig. 1B. Figure 3A shows the dimensions, kine-
ditional robotic “stiff” approaches, where the adaptability of the matics, and ranges of motion (ROMs) of Hannes in direct comparison
hand during an interaction relies on feedback control that hardly with a 50th percentile human hand used as reference for the design
implements the high interaction ability typical of a human hand. (46); see also table S1 for details. Figure 3A shows the extremely high
Furthermore, the kinematics of these prostheses represent a gross anthropomorphism of Hannes: A maximum discrepancy of 4.8%
simplification of that of a real hand, resulting in low levels of anthro- can be observed in the proximal-intermediate diameter of the middle
pomorphism. For some devices, the approximations include the sup- finger, demonstrating the exceptionally high resemblance with the
pression of some critical degrees of freedom (DOFs). For example, reference hand model. Regarding the kinematics, Fig. 3B shows that
in the Michelangelo hand, only the metacarpophalangeal (MCP) joint all finger DOFs are implemented except the distal interphalangeal
is responsible for flexing or extending each of the fingers, whereas (DIP) joint, which is omitted and set to a fixed angle because of a
other devices do not include finger abduction/adduction. Similarly, design trade-off between functionality and the complexity of imple-
in other poly-articulated hands, such as the BeBionic hand, the joints mentation. The thumb exhibits different kinematics such that the
of each finger are coupled by a linear kinematic relationship that interphalangeal (IP) and MCP joints are locked, whereas abduction
governs the coordination of the fingers’ joints (4). These approxi- is actuated and rotation is passive.
mations in poly-articulated prostheses make the grasp and interac- Last, for a comprehensive comparison, Fig. 3C shows the angular
tion much less effective, adaptable, and robust than the grasp and excursions of Hannes’s DOFs compared with the DOFs of the human
interaction of their biological counterpart: adaptable grasping in- hand and the Michelangelo prosthesis, which has been used as the
creases the contact area and therefore the manipulation stability gold standard due to its advanced anthropomorphism compared
(43). Such design choices have further implications for the capability with that of other existing prosthetic hands (4, 38). Apart from
of implementing human-like movements and an appropriate syner- the locked DIP joints, Hannes’s ROMs are, overall, close to those of
gic coordination between the joints: It follows that the overall bio- the human hand and substantially more biomimetic than those of the
mimicry of such systems remains rather limited. Researchers have Michelangelo prosthesis.
attempted to solve these issues by developing self-adapting mechanism
A
Emg processing board
DC motor
Magnetic plug
connector
sEMG sensors
Battery pack
Fig. 1. Hannes system. It is composed of three main components, i.e., a myoelectric poly-articulated prosthetic hand, a passive F/E wrist module, and a myoelectric
interface/controller. (A) Architecture: The DC motor and the motor control board are embedded within the myoelectric hand, whereas the sEMG-based myoelectric interface/
controller is housed within the socket. The F/E wrist is placed between these two modules. (B) Views of the Hannes hand without glove. (C to G) Gloved device performing
ADLs: (C) a precision grasp of a pen, (D) a lateral grasp of a business card, (E) a power grasp of a compliant object, (F) a lateral grasp of a marker, and (G) a power grasp of a tool.
that increase proportionally with the muscular activation. The con- previously, the biomimetic performance and human-like grasping
trol parameters are tuned for each person to achieve fine motion and behavior were assessed experimentally.
force control of the device on each patient.
Biomimetic performance superior to that required by ADLs
Experimental evaluation Force and velocity experiments were carried out to determine
The results from the experimental evaluation presented in this section Hannes’s performances in regulating the grasp through EMG control.
validate that Hannes is able to satisfy the requirements mentioned The force capabilities of Hannes are reported in Fig. 4A. It can be ob-
earlier. Although anthropomorphism is assumed by design, as shown served that the prosthesis starts moving as soon as the EMG closure
nspired Design A
B io-i pp
ic ro
ist a
l
Ho
ch
e
TY Movie 1. Summary of Hannes hand.
SI EIG PE
CI
ZE H
LO
W HA
VE
S
the grasping of the objects in Fig. 5 (A and B). The analysis of the
human hand postures revealed correlations (r > 0.8, P < 0.01) be-
tween (i) the MCP flexions of adjacent fingers and (ii) the abduction
CS
FO
results are consistent with data in the literature (23, 47, 48).
NE
RC
KI
TY N
AD ON AVI IST
R
AS ST
LI IO
TA UR R,
BI AT
B N
SS
more evident for Hannes, showing large correlations even for the
index-little pair. Furthermore, the PIP and DIP joints exhibit cor-
relations within each finger and with the immediate neighbor
A
Palm Fingers
1.2
1
Normalised dimensions
0.8
0.6
0.4 th
50 Percentile
(Proximal-Intermediate) Diameter
0.2 (Intermediate-Distal) Diameter
(From Tip to Crotch) Length
0
Depth Width Length Thumb Index Middle Ring Little
B Joint Description
100
ROM (deg)
50
0
IMCP IPIP IDIP MMCP MPIP MDIP RMCP RPIP RDIP LMCP LPIP LDIP TMCP TIP
Fig. 3. Anthropometry of Hannes. The high fidelity in the reproduction of biomimetic anthropomorphism in Hannes is shown by directly comparing the size, shape, and
kinematic model of Hannes with anthropometric data and kinematics of a typical human hand and the Michelangelo prosthesis that is used as a gold standard. (A) Di-
mensions of Hannes and a comparison with the 50th percentile human hand; in addition, refer to table S1. (B) Kinematic model and nomenclature of Hannes and the
human hand. (C) ROM of the 50th percentile human hand, Hannes, and Michelangelo prosthesis.
synergies for grasping tasks, with the exception of the thumb move- Analyzing PC2 for the human hand, the PIP joints are extended at
ments in PC2 (23); see also Movie 3 and fig. S1. To analyze the first PC2max, while they progressively flex toward PC2min. In Hannes’s
two PCs in detail, Fig. 5 (F and G) presents how these PCs combine second synergy, there is also a predominant effect on the PIP joints,
to form different postures for grasping the nine objects in the trials. although the motion is reversed, i.e., from extension at PC2min to
These postures can be determined by the points that identify each flexion at PC2max. Analyzing the thumb, instead, there is a rotation
single object, displayed in the plane formed by PC1 and PC2. Figure 5 component in the human hand that is not present in Hannes. Although
(F and G) shows that the MCP finger joints are completely extended there are differences between the PCs computed for the human hand
at PC1min, whereas the fingers fully flex at the rightmost point, which and Hannes, the plots in Fig. 5 (F and G) clearly show that the objects
confirms the discussion above for PC1; see also Movie 3 and fig. S1. are mostly distributed on the PC1 axis for Hannes, in contrast to the
case for the human hand. Last, the motion of the DIP joints in our with the reference prosthesis. Participants #1 and #2 performed bet-
human data for both PC1 and PC2 is very small, which has been ter with Hannes, with decreases in the time needed to perform the
confirmed by previous studies (47, 49) and validates our design task of about 10 and 30%, respectively, whereas participant #3 per-
choice of keeping them locked. formed better with the reference hand: The timings obtained during
T0, T1, and T2 were longer than those obtained during TB, although
Pilot clinical trials show the high potential of Hannes there was a marginal increase of about 15% as shown in Fig. 6 (note
The evaluation was conducted on three participants by executing tests that for the Minnesota test, negative values indicate an improvement
and using questionnaires that are specifically meant to measure pros- and positive values indicate deterioration). This result can be ex-
thesis use ability. Table S2 provides the obtained scores for the three plained by the fact that, with respect to other participants, partic-
participants with the reference hand during the baseline assessment ipant #3 only had experience with a tridigital hand and was not
(TB) and with the Hannes system during the study (T0, T1, and T2); familiar with a poly-articulated hand. In detail, although the tridigital
see Materials and Methods for details. Figure 6 also summarizes hand was already represented into his body schema (50), the ring
the improvement/deterioration in the tests and questionnaires and little fingers of Hannes were not: Two weeks of training are
scores from the baseline to the end of the study by reporting the insufficient to shape neural plasticity so as to incorporate a poly-
difference between the scores recorded at T2 and the scores re- articulated prosthesis into body representation (51). Participant #1
corded at TB. performed better with Hannes from the beginning of the experi-
The results obtained with the Minnesota Manual Dexterity Test, mental procedure (M ± SD: 132 ± 6 s at T0 versus 137.33 ± 15.31 at
Placing only (MMDT-P), which measures the time required to TB; table S2), possibly because the participant was an expert user of
move a set of objects, were, on average, better with Hannes than a poly-articulated hand and thus did not experience difficulty in adapt-
ing to Hannes’s grasp. However, despite the initial performance, all
participants improved their results on the Minnesota test with
Hannes during the training (from T0 to T2; see table S2). Similar
results were obtained for the Southampton Hand Assessment Pro-
cedure (SHAP) test: The scores obtained at TB and T2 were compa-
rable across the participants, and in many cases, there was an increase
from TB to T2 (see the positive values in Fig. 6). The results from
this test for participant #1 were overall more neutral, probably be-
cause this participant was already an expert user of poly-articulated
hands. Critical results were only obtained for the lateral grasp with
participants #1 and #3 due to a technical issue experienced during
75 0
0 -4
Angular velocity (rad/s)
50 0
0 - 4
MPIP R PIP R PIP
100 4
position (%)
Motor
50 0
0 -4
0 10 20 0 10 20 0 1 2 0 1 2 0 1 2
Fig. 4. Force and velocity experiments. Direct evaluation of the force and velocity capabilities of Hannes and the controllability of the force regulation. (A) Regulation
of the force (left) and power grasps (right) regulated through direct EMG control. In the EMG plots, the red lines indicate opening EMG sensor activity, and the blue lines
indicate closure EMG sensor activity. The red and blue dotted lines indicate the activation thresholds for opening and closure EMG sensor activities, respectively. In the bottom
plot, the normalized motor position ranges from 0 to 100% and denotes motor positions that correspond to fully open and fully closed hand, respectively. In this test, the
grasp occurs at about half the motor travel, i.e., when the motor position assumes a value of around 50%. (B) Angular velocities of the main articulation of Hannes during a
full-speed closure. The black lines indicate the median values. The shaded areas indicate the SD.
C TROT TIP I MCP I DIP M MCP M DIP R MCP R DIP L MCP L DIP D TROT TIP I MCP I DIP MMCP MDIP R MCP R DIP L MCP L DIP
TMCP I ABD I PIP MABD M PIP R ABD R PIP L ABD L PIP TMCP I ABD I PIP MABD MPIP R ABD R PIP L ABD L PIP
1
T ABD
T ROT
0.9
T MCP
T IP 0.8
I ABD
I MCP 0.7
I PIP
I DIP 0.6
M ABD
M MCP 0.5
M PIP
M DIP 0.4
R ABD
R MCP 0.3
R PIP
R DIP 0.2
L ABD
L MCP 0.1
Hannes L PIP Human
0
E 100
Explained variance (%)
80
Hannes
60 Human
40
0
PC1 PC2 PC3 PC4 PC5 PC6 PC7 PC8
Key
PC1 Min 1 PC1 Max Ball PC1 Min 1 PC1 Max
Screwdriver
Mug
Battery
-1 -2 1 2 -1 -2 1 2
Mouse
Credit card
-1 -1
Marker
Water bottle
-2 -2
PC2 Min PC2 Min
Fig. 5. Kinematic analysis of Hannes and its synergistic behavior. Static and dynamic kinematic behavior of Hannes and its resemblance to that of the human hand
by direct comparison of postures, correlation patterns, and synergies, and their combination while grasping the different objects. (A and B) The static postures of Hannes
and the human hand, respectively, for each grasped object. Patterns of correlation in the joint angles during the grasping of nine objects are shown in (C) for Hannes and
in (D) for the human hand. (E) Comparison of the Pareto plot of the variances for each PC (up to the eighth). (F) Scatter plot of the Hannes postures projected along PC1
and PC2. (G) Scatter plot of the human hand postures projected along PC1 and PC2. The markers indicate the median position of the three participants ((73) credited for
the hand and mesh models of the human). The 3D views of the postures of Hannes and the human hand on the right and left in (F) and (G), aligned with the horizontal
axis, are the postures with minimum and maximum values of PC1. The top and bottom postures, aligned with the vertical axis, correspond to the maximum and minimum
values of PC2, respectively.
fix. The execution of these tests by amputated participants and the Beyond these tests, the questionnaires provide a qualitative evalu-
correct accomplishment of lateral and precision grasps by the ation of the independence of the user in the execution of ADLs.
Hannes hand can be observed in movies S1 and S2, respectively. Specifically, the Orthotics and Prosthetics User Survey Upper Extremity
Please note that the grasps shown in movie S2 are performed by a Functional Status (OPUS-UEFS) questionnaire measures functional
healthy participant. activities executed by amputees with a prosthesis. As reported in
Fig. 6, for participant #1, the reference hand enabled higher scores (Fig. 6 and table S2). Last, according to the final evaluation question-
and therefore seemed more desirable, according to this questionnaire. naire (table S3), participants #1 and #2 greatly appreciated Hannes.
Participant #2 showed an improvement with the use of Hannes,
whereas participant #3 improved their scores with Hannes with respect
to the scores achieved with the reference hand. DISCUSSION
The Disabilities of the Arm, Shoulder, and Hand (DASH) question- An analysis of the anthropomorphism of Hannes showed that the
naire returns measurements of the level of impairment in functional vast majority of the dimensions are reproduced with high fidelity,
activities of the upper limb with scores ranging from 0 (functional in addition to the kinematics, which replicate most of the DOFs
activity like in a natural hand) to 100% (no function at all). According (Fig. 3, A and B). An exception is the approximation in the design
to this questionnaire (Fig. 6 and table S2), participants #1 and #2 for the fixation of the digits’ distal DOFs. However, when compared
performed better with the reference prosthesis (scored with 0), whereas with other hand joints, the DIP joint contributes minimally to the
for participant #3, the level of functionality was unchanged. The functionality of the hand. By extracting the data in (47), it can be
change in the DASH scores cannot be represented as a percentage; simply demonstrated that this joint, considering the first three syn-
thus, in Fig. 6, we report the difference between the scores at T2 and ergies, among the five fingers, has an average ROM that is about
TB (note that for the DASH, negative values indicate an improve- four times smaller than that of the other DOFs. The smaller signifi-
ment and positive values deterioration). cance of this DOF means that it is appropriate to keep the DIP
The Trinity Amputation and Prosthesis Experience Scales locked and does not undermine biomimicry and effectiveness. In
(TAPES) questionnaire, which considers the degree of satisfaction addition, Hannes exhibits MCP ROMs that are very similar to those
in the utilization of a prosthesis, promotes the Hannes system over of a human hand in most digits; this difference is higher for the PIP
the reference hand in the case of participants #2 and #3, as the scores joints. Provided that grasping tasks are involved, this kinematic dis-
improve by three and five points, respectively (Fig. 6), whereas partici- crepancy does not represent a problem, because the maximum flex-
pant #1 achieves a slightly higher score with the reference prosthesis ions measured for these DOFs in the range of the objects tested are
smaller than the mentioned ROMs: The maximum measured IPIP,
MPIP, RPIP, and LPIP flexions across all the participants and grasped
objects are 51.9°, 47.1°, 39.8°, and 44.2°, respectively, which are
smaller than the available ROMs reported in Fig. 3C. This result
provides evidence that Hannes has exceptionally high levels of anthro-
pomorphism, even when compared with state-of-the-art devices,
such as the Michelangelo prosthesis. Last, the mass of the device is
480 g, which is close to that of its biological counterpart (52). Note
TESTS QUESTIONNAIRES
-50 50 50 -50
Improvement
-40 40 40 -40 Deterioration
-30 30 30 -30
Subject #1
-20 20 20 -20 Subject #2
T2-TB variation (%)
Subject #3
-10 10 10 -10
0 0 0 0
10 -10 -10 10
20 -20 -20 20
30 -30 -30 30
40 -40 -40 40
50 -50 -50 50
od
n
rip
ge
e
er
t
F
-P
al
k
ra
or
or
or
io
Io
AD
or
w
ric
DT
ip
sa
PT
te
ns
Sp
Sc
Sc
Po
W
AP
Tr
he
SU
La
M
H
te
A
ES
FS
SH
SH
S
AP
SH
M
Sp
AP
Ex
P
S
EF
DA
UE
P
A
DA
DA
SH
TA
P
AP
-U
SH
SH
-
A
US
US
SH
SH
OP
OP
Fig. 6. Rate of improvement of the scores for the tests and questionnaires. The differences between the scores at T2 and TB are reported for each participant in
histogram format for a direct visualization of the rates of improvement. These rates—for the MMDT-P and SHAP tests (left), and the OPUS-UEFS, TAPES, and DASH questionnaires
(right)—are reported. The difference is indicated as the percentage variation for all the tests and questionnaires except for DASH; the improvement/deterioration is indi-
cated by the T2-TB negative/positive values for the MMDT-P and the DASH and T2-TB positive/negative values in other cases.
material technologies. Hence, we decided to set the reference weight hand and Hannes are responsible for moving the same set of joint
value to the weight of a human hand. angles, with the exception of the thumb motion in PC2, there are
Hannes is also very biomimetic in terms of performance: Its differences in their respective patterns. However, this is not an issue,
mechatronic design is such that its performance is very close to because previous studies demonstrated that, in a human hand, only
that exhibited by a human hand. The results show that the device the first synergy requires an assumption of repeatable behavior,
outperforms the velocity levels and grasping forces needed for the whereas the trends of higher-order synergies can substantially vary
execution of ADLs. The user can modulate the force when grasping depending on the boundary conditions (56). In this study, these dif-
an object, which is necessary for dexterity and grasp robustness (11, 12). ferences are mainly caused by imperfections in the kinematic model
In addition, the delay between a muscle contraction and a hand actu- of Hannes, which is clearly not identical to that of a human hand,
ation is about 10 ms, which is smaller than the physiological electro- particularly in terms of the thumb and the idiosyncrasies among the
mechanical delay (54) and cannot be perceived by the user. This participants’ hands (57). Furthermore, PC2 and PC3 for Hannes
feature, combined with the high motion speed achieved by Hannes, assume plausible biomimetic behavior. Hence, these results provide
is fundamental for the desired high effectiveness of the prosthesis key evidence for the exceptional biomimicry of the grasping postures
(5, 10) and crucial for achieving embodiment of the device (19). To of Hannes and demonstrate its ability to reproduce synergistic human-
the best of the authors’ knowledge, the levels of force achieved by like grasping behavior. Attempts to reproduce such a characteristic
Hannes are superior to those of most existing research and commercial in prosthetic hands were made in (25); however, because the kine-
poly-articulated devices, with the exception of the lateral grasp of the matics of that device roughly approximated that of a human hand,
Michelangelo prosthesis (table S4). Few prostheses can achieve high- the resulting behavior could not be compared with that of a human
er speeds—for example, (34, 44)—but only at the expense of force, hand. This issue was overcome in (35); however, the performance
which is often much smaller than the reference ADL level (5). From levels were well below the required biomimetic force and speed values.
the performance perspective, the key property of the presented de- In contrast, Hannes exhibits high levels of biomimicry during
sign, as compared with other existing designs, relies on the concur- grasping, as shown in Fig. 1 (C1 to C5), Movies 1 and 2, and movie
rent achievement of high scores in weight, force, and velocity levels S1. Furthermore, the presented approach based on direct hardware
(table S4), as well as highly anthropomorphic shape, size, and kine- implementation of PCs strongly facilitates the implementation of
matics and highly robust grasping capabilities (Movie 1). To achieve biomimetic control: The high human likeness achieved in this work
the final goal, however, the aforementioned features must be combined is realized using a simple direct proportional control. This means
with highly biomimetic synergistic behavior, as discussed next. that evolutions of this design, which will include the capability of
PCA was conducted on both the human hand and Hannes for reproducing more PCs—through, e.g., the implementation of more
direct comparison. The correlation matrix in Fig. 5C shows that degrees of actuation—will pave the way to strategies that can seam-
Hannes exhibited a similar correlation pattern to the human hand. lessly and optimally exploit the potential offered by the proposed
precision grasps. Please note that the grasps shown in this video are which implements simultaneous synergistic kinematic behavior, con-
performed by healthy participants. Participants #1 and #3 had poor figuration adaptability, and robust grasping through a combination
scores with Hannes, whereas participant #2 had marginally better of movement coordination and a uniform force distribution, as in-
scores. spired by (25). The detailed mechanical model of Hannes is reported
The questionnaire scores were, on average, comparable with those in the Supplementary Materials.
obtained with the reference prosthesis. Although such results appear The evaluation of the mentioned static and dynamic biomimetic
to be not as promising as those obtained for the tests, the three partici- properties have been evaluated by means of lab tests that included
pants verbally confirmed that they truly appreciated the high resem- the use of motion capture systems and force sensors for the mea-
blance of Hannes with a human hand in terms of human-like behavior surement of velocity and kinematic behavior and grasp forces, re-
and anthropomorphism, as shown in Movies 1 and 2 and movie S1. spectively. In addition, the obtained kinematic data were also used
In addition, the participants were very satisfied with the usability, for PCA on both the human hand and Hannes.
overall effectiveness, and robustness during the trials. This was con- A pilot clinical trial was performed with the primary goal of de-
firmed by the results of the final evaluation questionnaires, which fining Hannes’s functionality, safety, and reliability and assessing the
had high scores for two out of three participants (tables S2 and S3). potential benefits regarding the quality of life of amputees. Three
The contradiction between the positive direct user feedback and the amputated participants could autonomously use Hannes at home to
average questionnaire scores can be explained by the fact that question- perform ADLs for a period of about 2 weeks. Tests and questionnaires
naires focus on effectiveness in the execution of everyday activities were used before and after this phase.
and assume that the participant has become familiar with the de-
vice by developing appropriate grasping strategies. This familiar- Hannes’s mechatronics
ity requires consistent training and use that can only be achieved Poly-articulated prosthetic hand
with more time than the time allowed in this study: 16 days. Much Hannes’s palm houses the main components of the hand—an
better results are therefore expected with longer training times. In electric actuator, a control board, sensors, and the transmission
contrast, the test results showed that the potential of the device to mechanism—whereas the F/E extension flexible wrist is located at
effectively execute grasping tasks is very high, apart from the afore- the base of the device. The power train consists of a compact, high-
mentioned lateral grip issue; in addition, considering the relatively power-density DC motor coupled to a custom-made hypocycloid
short training time, the scores are promising and show the very high gearbox. A 3D view of the assembly is shown in Fig. 7A. The pow-
potential of Hannes. er train actuates the leader wire, thus transmitting the force FA and
One of the main limitations of this study is that the Hannes system speed to the cable-based mechanism housed in the palm. The leader
has been tested on a small number of participants. However, the par- wire originates from the motor and ends in the thumb, passing
ticipant sample is representative of the potential end-users because through two differential elements mounted onto linear guides
A Follower wire 1
Encoder
Linear guide
B C
Abduction / Adduction axis Preload mechanism Abduction /
Adduction axis Preload mechanism
MCP pin
Guiding pulleys
D E
Extension wire
Flexion wire
Compression springs
Guiding pulleys
Fig. 7. Hannes’s mechatronics. The core mechatronics of the Hannes hand in its components: palm, digits, and wrist. (A) 3D view of the hand (left) and cross section of the
transmission mechanism located in the palm (right). The leader wire, follower wire 1 (index and middle fingers), and follower wire 2 (ring and little fingers) are shown in red,
green, and yellow, respectively. (B) Finger kinematics (left) and mechanical design (right). (C) Thumb kinematics (left) and mechanical design (right). (D) Detailed cross
section of the F/E wrist integrated in Hannes and (E) the F/E wrist in three configurations: (left) maximum extension, (middle) neutral position, and (right) maximum flexion.
by the ratio of the respective levers. When the motor unwinds the form force distribution along the finger to mimic the first human
leader wire, the follower wire slackens, with a consequent exten- kinematic synergy.
sion of the return spring and finger. When the follower wire is Thumb
tensioned with force F Aj , fig. S4, two resulting lever arms act on The thumb comprises an active abduction/adduction joint that op-
the MCP and PIP joints, making it possible to set appropriate joint erates similarly to the MCP joint of the fingers, whereas the IP and
torques for these articulations. In particular, the MCP torque is DIP joints are locked, as shown in Fig. 7C. In addition, the thumb
designed to be about twice the torque of the PIP joint, which per- rotation is implemented by a custom-made spring-based plunger
mits the regulation of the activation timing of each joint and a uni- mechanism, Fig. 7C, that can lock the finger in three equally spaced
Fig. 8. Experimental setup of the motion capture analysis of Hannes and a human hand. Healthy participants and Hannes in the designed experimental setup per-
forming grasps of objects of different size and shape. (A to C) Participants #1 to #3 grasping different objects, respectively. (D to F) Hannes grasping different objects.
Hannes is controlled by the healthy participant using EMG control.
stable positions (fig. S2) to perform different grasp styles, as shown HD-BTA by Vernier). The motor position was regulated through
in Fig. 1 (C1 to C5), Movie 1, and movie S1. The closure timing direct EMG control to either regulate the prosthesis to move slowly
of the thumb can be synchronized with the fingers by means of a and regulate the grasp force, as shown in Fig. 4A (left), or to per-
screw-based mechanism that acts on the preload of the corre- form power grasps with maximum speed to evaluate the maximum
to start a trial, they were asked to grasp one of the nine objects as prosthetic hand for a period of 16 days for domestic use and daily
they would consider most appropriate, hold the object for 1 s, and utilization.
place the object back in its original position (Fig. 8, A to C). The The same tests used for baseline assessment were repeated with
procedure was repeated five times for each of the objects. The order the Hannes hand before the training procedure (T0), at the end of
in which the objects were grasped was randomized for each partici- the training period (T1), and at the end of the study (T2). Question-
pant. Each participant was tested on different days at different naires (see the “Clinical evaluation measures” section) were pre-
times. The total duration of the experiment was about 1.5 hour sented at TB and T2.
per participant, with a break of a few minutes at the halfway point. Figure S3 depicts the experimental protocol and its various phases.
The participants could choose to rest at the end of each trial. The training consisted of a 4-hour procedure repeated for 4 days
The same procedure was repeated using a right-hand Hannes pros- and involved accomplishing a set of tasks combining generic ma-
thesis (Fig. 8, D to F). Hannes was placed in a fixed configuration nipulation and the execution of several ADLs. Table S6 reports the
by attaching the prosthesis to a stump locked to a fixed frame. executed tasks.
The participant was asked to place an object within Hannes’s reach Clinical evaluation measures
so that the object could be grasped in a natural manner. Hannes was The clinical evaluation consisted of monitoring parameters collected
commanded to open/close using the EMG interface consisting of from the tests and questionnaires during different phases. We used
two EMG sensors mounted onto the right arm with an elastic band. two tests and four questionnaires. Specifically, the used tests were
The object was held for 1 s and then placed back in its original posi- the MMDT-P and the SHAP. The first test assesses the ability to
tion by the participant. The procedure was designed to focus on the move small objects, and the score is the total number of seconds
postures during grasping; reaching movements were not considered. required to complete the chosen number of test trials (68). The second
Principal components analysis test measures the ability of the amputee in using a prosthetic hand,
Correlation analysis was first conducted on the Hannes and human and the scores range from 0 to 100, where 100 corresponds to the
hand angle data to assess the extent to which the angular posi- typical functionality of a healthy limb (69) and are calculated for the
tions covaried with respect to each other, according to the kine- overall hand function (index of function) or for specific postures
matic model in Fig. 3B. PCA was then performed to obtain two (i.e., spherical, tripod, power, lateral, tip, and extension).
full sets of postural synergies: one set for Hannes and one set for the The questionnaires provide a qualitative evaluation of the inde-
human hand. The data were processed using the procedure ex- pendence of the user in the execution of ADLs. The used question-
plained in the “Angle extraction” section provided in the Supple- naires were as follows:
mentary Materials. 1) the OPUS-UEFS module (70), which evaluates the efficacy in
carrying out daily tasks, such as general self-care and the usage of
Pilot clinical trials domestic tools; the scores indicate how easily participants perform
Movie S1. Amputees performing clinical tests with Hannes. 27. K. Xu, H. Liu, Y. Du, X. Zhu, Design of an underactuated anthropomorphic hand
Movie S2. Healthy participants performing precision and lateral grasps with Hannes. with mechanically implemented postural synergies. Adv. Robot. 28, 1459–1474
References (74–76) (2014).
28. J. B. Rosmarin, H. H. Asada, Synergistic design of a humanoid hand with hybrid DC
REFERENCES AND NOTES motor - SMA array actuators embedded in the palm, in 2008 IEEE International Conference
on Robotics and Automation (IEEE, Pasadena, CA, 2008), pp. 773–778.
1. R. Vinet, Y. Lozac’h, N. Beaudry, G. Drouin, Design methodology for a multifunctional
29. M. C. Carrozza, G. Cappiello, S. Micera, B. B. Edin, L. Beccai, C. Cipriani, Design of a cybernetic
hand prosthesis. J. Rehabil. Res. Dev. 32, 316–324 (1995).
hand for perception and action. Biol. Cybern. 95, 629–644 (2006).
2. C. Pylatiuk, A. Kargov, S. Schulz, Design and evaluation of a low-cost force feedback
30. C. Cipriani, M. Controzzi, M. C. Carrozza, The SmartHand transradial prosthesis.
system for myoelectric prosthetic hands. JPO J. Prosthet. Orthot. 18, 57–61 (2006).
J. Neuroeng. Rehabil. 8, 29 (2011).
3. H. Bouwsema, C. K. van der Sluis, R. M. Bongers, Learning to control opening and closing
31. M. Grebenstein, A. Albu-Schäffer, T. Bahls, M. Chalon, O. Eiberger, W. Friedl, R. Gruber,
a myoelectric hand. Arch. Phys. Med. Rehabil. 91, 1442–1446 (2010).
S. Haddadin, U. Hagn, R. Haslinger, H. Höppner, S. Jörg, M. Nickl, A. Nothhelfer, F. Petit,
4. J. T. Belter, J. L. Segil, A. M. Dollar, R. F. Weir, Mechanical design and performance
J. Reill, N. Seitz, T. Wimböck, S. Wolf, T. Wüsthoff, G. Hirzinger, The DLR hand arm system,
specifications of anthropomorphic prosthetic hands: A review. JRRD. 50, 599–618
in 2011 IEEE International Conference on Robotics and Automation (IEEE, Shanghai, China,
(2013).
2011), pp. 3175–3182.
5. R. F. Weir, in Standard Handbook of Biomedical Engineering and Design (McGraw-Hill,
32. Y. Kurita, Y. Ono, A. Ikeda, T. Ogasawara, Human-sized anthropomorphic robot hand
New York, USA, 2004), p. 32.1–32.61.
with detachable mechanism at the wrist. Mech. Mach. Theory 46, 53–66 (2011).
6. G. K. Patel, C. Castellini, J. M. Hahne, D. Farina, S. Dosen, A Classification Method
33. E.-H. Kim, S.-W. Lee, Y.-K. Lee, A dexterous robot hand with a bio-mimetic mechanism.
for Myoelectric Control of Hand Prostheses Inspired by Muscle Coordination. IEEE Trans.
Int. J. Precis. Eng. Manuf. 12, 227–235 (2011).
Neural Syst. Rehabil. Eng. 26, 1745–1755 (2018).
34. P. Slade, A. Akhtar, M. Nguyen, T. Bretl, Tact: Design and performance of an open-source,
7. M. Zecca, S. Micera, M. C. Carrozza, P. Dario, Control of Multifunctional Prosthetic Hands
affordable, myoelectric prosthetic hand, in 2015 IEEE International Conference on Robotics
by Processing the Electromyographic Signal. Crit. Rev. Biomed. Eng. 45, 383–410 (2017).
and Automation (ICRA) (IEEE, Seattle, WA, USA, 2015), pp. 6451–6456.
8. E. A. Biddiss, T. T. Chau, Upper limb prosthesis use and abandonment: A survey of the last
35. P. Weiner, J. Starke, F. Hundhausen, J. Beil, T. Asfour, The KIT Prosthetic Hand: Design and
25 years. Prosthet. Orthot. Int. 31, 236–257 (2007).
Control, in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
9. C. Castellini, Chapter 19 - Upper limb active prosthetic systems – Overview, in Wearable
(IEEE, Madrid, 2018), pp. 3328–3334.
Robotics (Elsevier, 2020), pp. 365–376.
36. H. Ritter, R. Haschke, in Humanoid Robotics and Neuroscience: Science, Engineering and
10. H. A. Varol, S. A. Dalley, T. E. Wiste, M. Goldfarb, Biomimicry and the Design of Multigrasp
Society, G. Cheng, Ed. (CRC Press/Taylor & Francis, Boca Raton, FL, 2015), Frontiers in
Transradial Prostheses, in The Human Hand as an Inspiration for Robot Hand Development,
Neuroengineering.
R. Balasubramanian, V. J. Santos, Eds. (Springer International Publishing, Cham, 2014),
37. S. J. Day, S. P. Riley, Utilising three-dimensional printing techniques when providing
vol. 95 of Springer Tracts in Advanced Robotics, pp. 431–451.
unique assistive devices: A case report. Prosthet. Orthot. Int. 42, 45–49 (2018).
11. M. Controzzi, C. Cipriani, M. C. Carrozza, Design of Artificial Hands: A Review, in The Human
38. Ottobock, Michelangelo Prosthetic Hand (2020); https://shop.ottobock.us/Prosthetics/
Hand as an Inspiration for Robot Hand Development, R. Balasubramanian, V. J. Santos, Eds.
Upper-Limb-Prosthetics/Michelangelo-Axon-Bus-System/Michelangelo-Hand-
(Springer International Publishing, Cham, 2014), vol. 95 of Springer Tracts in Advanced
AxonHook/Michelangelo-Hand/p/8E500~5L-M.
Robotics, pp. 219–246.
39. Ottobock, BeBionic Hand (2020); www.ottobockus.com/prosthetics/upper-limb-
12. L. Biagiotti, F. Lotti, C. Melchiorri, G. Vassura, How Far Is the Human Hand? A Review on
prosthetics/solution-overview/bebionic-hand/.
Anthropomorphic Robotic End-effectors (2004), pp. 1–21.
40. Ossür, iLimb Ultra (2019); www.ossur.com/prosthetic-solutions/products/touch-
13. A. Bicchi, Hands for dexterous manipulation and robust grasping: A difficult road toward
55. C. R. Mason, J. E. Gomez, T. J. Ebner, Hand synergies during reach-to-grasp. 73. M. Schröder, T. Waltemate, J. Maycock, T. Röhlig, H. Ritter, M. Botsch, Design
J. Neurophysiol. 86, 2896–2910 (2001). and evaluation of reduced marker layouts for hand motion capture. Comput. Animat. Virt. W.
56. E. Todorov, Z. Ghahramani, Analysis of the synergies underlying complex hand 29, e1751 (2017).
manipulation, in The 26th Annual International Conference of the IEEE Engineering in 74. S. B. Godfrey, K. D. Zhao, A. Theuer, M. G. Catalano, M. Bianchi, R. Breighner, D. Bhaskaran,
Medicine and Biology Society (San Francisco, CA, 2004), vol. 2, pp. 4637–4640. R. Lennon, G. Grioli, M. Santello, A. Bicchi, K. Andrews, The SoftHand Pro: Functional evaluation
57. A. Naceri, A. Moscatelli, R. Haschke, H. Ritter, M. Santello, M. O. Ernst, Multidigit force of a novel, flexible, and robust myoelectric prosthesis. PLOS ONE 13, e0205653 (2018).
control during unconstrained grasping in response to object perturbations. 75. Prensilia, Azzurra IH2 user manual; www.prensilia.com/portfolio/ih2-azzurra/.
J. Neurophysiol. 117, 2025–2036 (2017). 76. T. E. Wiste, S. A. Dalley, T. J. Withrow, M. Goldfarb, in 2009 IEEE International Conference on
58. J. L. Segil, R. F. f. Weir, Design and validation of a morphing myoelectric hand posture Rehabilitation Robotics (IEEE, Kyoto, Japan, 2009), pp. 675–681.
controller based on principal component analysis of human grasping. IEEE Trans. Neural
Syst. Rehabil. Eng. 22, 249–257 (2014). Acknowledgments: We thank the volunteers who participated in the study; A. Veronelli for
59. J. L. Segil, R. Kaliki, J. Uellendahl, R. F. f. Weir, A myoelectric postural control algorithm contribution to the mechanical design in the initial phase of the project; A. F. Kleppa,
for persons with transradial amputations: A consideration of clinical readiness. IEEE Robot. A. Marinelli, S. Scarpetta, and A. Cimolato for support in conducting the experiments and the
Automat. Mag. 27, 77–86 (2020). production of the material; V. Squeri, M. L. D’Angelo, and P. Randi for help in the clinical trials;
60. T. Pistohl, C. Cipriani, A. Jackson, K. Nazarpour, Abstract and proportional F. Tessari for support in revising the mechatronics section; M. Chiappalone and G. Barresi for
myoelectric control for multi-fingered hand prostheses. Ann. Biomed. Eng. 41, valuable advice on writing the paper; G. Berretta, S. Stedman, and D. Farina for the support in
2687–2698 (2013). the preparation of the videos. We also thank M. Zambelli for key advice on the development
61. G. C. Matrone, C. Cipriani, E. L. Secco, G. Magenes, M. C. Carrozza, Principal components and revision of the device and L. De Bartolomeis, G. Diamanti, and F. Poli for support in the
analysis based control of a multi-DoF underactuated prosthetic hand. J. Neuroeng. industrial design of the device. Funding: This work was supported by the INAIL under grant
Rehabil. 7, 16 (2010). agreement PPR1A. Author contributions: M.L. conceived and designed the study and
62. M. Dyson, J. Barnes, K. Nazarpour, Myoelectric control with abstract decoders. J. Neural coordinated the scientific and technical aspects of this work. N.B. conducted the mechatronic
Eng. 15, 056003 (2018). integration, tested the device, and performed all the clinical trials. S.T. conducted the
63. J. L. Segil, R. F. Weir, Novel postural control algorithm for control of multifunctional mechanical development of the systems. L.L. developed part of the electronics and conducted
myoelectric prosthetic hands. J. Rehabil. Res. Dev. 52, 449–466 (2015). the PCA. M.C. developed the electronics. A.L. conducted the mechanical development of the
64. L. A. Wheaton, Neurorehabilitation in upper limb amputation: Understanding how systems and coordinated the mechanical engineering team in the final phase of the project.
neurophysiological changes can affect functional rehabilitation. J. Neuroeng. Rehabil. 14, M.S. analyzed the outcome of the clinical trials. A.N. coordinated the “Human-like synergistic
41 (2017). behavior” experiments. J.A.S. conceived and designed the study and co-coordinated the
65. M. Grebenstein, M. Chalon, G. Hirzinger, R. Siegwart, Antagonistically driven finger project with M.L. in its initial phase. R.S. was clinical and technical advisor. E.G. was clinical and
design for the anthropomorphic DLR Hand Arm System, in 2010 10th IEEE-RAS technical advisor and coordinated the clinical trials. L.D.M. conceived and designed the study
International Conference on Humanoid Robots (IEEE, Nashville, TN, USA, 2010), and revised the work. M.L., L.L., A.L., M.S., and A.N. wrote the manuscript. N.B. and S.T.
pp. 609–616. contributed to the writing of the paper. N.B., M.S., A.N., L.L., and S.T. prepared the figures; N.B.,
66. D. Formica, S. K. Charles, L. Zollo, E. Guglielmelli, N. Hogan, H. I. Krebs, The passive A.N., and E.G. prepared the videos. M.L. and L.D.M. revised the manuscript and coordinated the
stiffness of the wrist and forearm. J. Neurophysiol. 108, 1158–1166 (2012). review process. M.L., J.A.S., and L.D.M. supervised the teams involved in the study and
67. Ottobock, MyoHand VariPlus Speed (2020); www.ottobock-export.com/en/prosthetics/ collected the funding to perform the study. All the authors have read and approved the
products-from-a-to-z/arm-prosthetics/myohand-variplus-speed/. manuscript in its final form. Competing interests: M.L., N.B., S.T., A.L., E.G., and L.D.M. are
68. J. Desrosiers, A. Rochette, R. Hébert, G. Bravo, The minnesota manual dexterity listed as inventors in the following patent applications: PCT application no. PCT/
Science Robotics (ISSN 2470-9476) is published by the American Association for the Advancement of Science. 1200 New York Avenue
NW, Washington, DC 20005. The title Science Robotics is a registered trademark of AAAS.
Copyright © 2020 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim
to original U.S. Government Works