Actuators and Sensors From Introduction To Robotics by S K Saha
Actuators and Sensors From Introduction To Robotics by S K Saha
Actuators are devices which drive a robot including its grippers. They are like the
muscles of a human arm and hand. While the human arm provides motion, the hand
is used for object manipulation. As illustrated in Fig. 2.3, the same is true with a
robot. Its arm, be Cartesian or anthropomorphic or of other type, which are explained
in Section 2.2, provides motion, whereas its gripper, which is equivalent to a human
hand, manipulates objects. Both require some kind of actuator system powered by
electricity or compressed air or pressurized fluid. These systems are presented in this
chapter, along with different types of grippers used in robotic applications.
An actuator system comprises of several subsystems, namely,
(i) a power supply;
(ii) a power amplifier;
(iii) a servomotor; and
(iv) a transmission system.
The connections between all the actuator components are depicted in Fig. 3.1.
Pp: Primary source of power (electricity or pressurized fluid or compressed air); Pc: Input control
power (usually electric); Pa: Input power to motor (electric or hydraulic or pneumatic type);
Pm: Power output from motor; Pu: Mechanical power required; Pda, Pds, and Pdt: Powers lost in
dissipation for the conversions performed by the amplifier, motor, and transmission
Fig. 3.1 An actuator system
1. Electric Actuators The primary input power supply is the electric energy
from the electric distribution system.
2. Hydraulic Actuators They transform hydraulic energy stored in a reservoir
into mechanical energy by means of suitable pumps.
3. Pneumatic Actuators They utilize pneumatic energy, i.e., compressed air,
provided by a compressor and transform it into mechanical energy by means of
pistons or turbines.
A portion of the motor input power Pa is converted to the output as a mechanical
power Pm, and the rest Pds is dissipated because of mechanical, electrical, hydraulic,
or pneumatic motor losses. In a robotic application, an actuator should have the
following characteristics:
∑ Low inertia
∑ High power-to-weight ratio
∑ Possibility of overload and delivery of impulse torques
∑ Capacity to develop high accelerations
∑ Wide velocity ranges
∑ High positioning accuracy
∑ Good trajectory tracking and positioning accuracy
Based on wide application of electric actuators in industrial robots and their easy
availability in the stores next door selling
toys or repairing photocopiers, washing
Who is ABB?
machines, etc., they are presented first. It
ABB is a Zurich, Switzerland-based
will be followed by hydraulic and pneumatic multinational company operating in
actuators. While hydraulic actuators are power and automation technology
suitable for applications where the areas. It was formed in 1988 through
requirement is high power-to-weight ratio, the merger of ASEA of Sweden and
pneumatic actuators are often used by Brown, Boveri and Cie of Switzerland.
It has operations in more than 100
electrically actuated robots for their grippers countries, and is one of the major
requiring only on-off motions of the jaws. industrial robot manufacturers in the
Use of a pneumatic gripper makes the robot world.
system a little lighter and cost effective.
[Courtesy: http://www.polulu.com]
Fig. 3.2 Stepper motor (Bipolar, 200 Steps/Rev, 20 ¥ 30 mm, 3.9 V, 0.6 A/Phase)
Step
1 2 3 4 5 6 7 8 Rotation
Phases
CW
P1 1 0 –1 –1 –1 0 1 1
P2 1 1 1 0 –1 –1 –1 0
CCW
As the rotor indexes round a specific amount for each control pulse, any error
in positioning is noncumulative. To know the final position of the rotor, all that
is required is to count the number of pulses fed into the stator’s phase winding of
the motor. The number of pulses per unit time determines the motor speed. The
rotor can be made to index slowly, coming to rest after each increment or it can
move rapidly in a continuous motion termed slewing. Maximum dynamic torque
in a stepper motor occurs at low pulse rates. Therefore, it can easily accelerate a
load. Once the required position is achieved and the command pulses cease, the shaft
stops without the need for clutches or brakes. The actual rotational movements or
step angles of the shaft are obtainable typically from 1.8° to 90° depending on the
particular motor choices. Thus, with a nominal step angle of 1.8°, a stream of 1000
pulses will give an angular displacement of 1800° or five complete revolutions. They
have also a low velocity capability without the need for gear reduction. For instance,
if the previously mentioned motor is driven by 500 pulses per second, it will rotate
at 150 rpm. Other advantages of the stepper motor are that the motor inertia is often
low, and also if more than one stepper motor is driven from the same source then
they will maintain perfect synchronizations.
Some disadvantages of stepper motors are that they have a lower output and
efficiency compared to other motors, namely, dc and ac, and drive inputs and
circuitry have to be carefully designed in relation to the torque and speed required.
There are various types of stepper motors which are based on the nature of a motor’s
rotor, e.g., variable reluctance, permanent magnet, and hybrid. A good account of
stepper motors is given in de Silva (2004), whereas an online video showing their
46 Introduction to Robotics
Starting torque
(Standstill
torque)
No-load
speed
0 Speed
1 WR stands for Web Reference given at the end of the list of References. They mainly contain the links
to online materials including videos, which are expected to enhance the understanding of a concept to the
reader.
Actuators and Grippers 47
poles. When one of the phases, say AA¢, is excited due to a dc current passing through
the coils around the poles, the rotor positions itself to complete the flux path shown
in Fig. 3.5(a). Note that there is a main flux
Holding Torque vs. Detent Torque
path through the aligned rotor and stator
Holding torque is the amount of
teeth, with secondary flux paths occurring as
torque that the motor produces when
indicated. When rotor and stator teeth are it has rated current flowing through
aligned in this manner, the reluctance is the windings but the motor is at rest,
minimized and the rotor is at rest in this whereas the detent torque is the amount
position. This flux path can be considered of torque that the motor produces when
it is not energized, i.e., no current is
rather like an elastic thread and always trying
flowing through the windings.
to shorten itself. The rotor will move until
the rotor and stator poles are lined up. This is
termed as the position of minimum reluctance. To rotate the motor counterclockwise,
the phase AA¢ is turned off and phase BB¢ is excited. At that point, the main flux path
has the form indicated in Figs. 3.5(b-c). This form of a stepper motor generally gives
step angles of 7.5° or 15°, which are referred as half-stepping and full-stepping,
respectively. Note that a disadvantage of variable-reluctance stepper motors is that it
has zero holding torque when the stator windings are not energized (power off)
because the rotor is not magnetized. Hence, it has no capacity to hold a load in
power-off mode unless mechanical brakes are employed.
residual poles of the stator. In this position, the rotor is locked unless a turning force
is applied. If the coils are energized and, in the first pulse, the magnetic polarity of
the poles of the coil A is reversed, the rotor will experience a torque and will rotate
counterclockwise, as shown in Fig. 3.6(b). The reverse poles are shown as A¢.
If the coil B poles are now reversed to B¢, as shown in Fig. 3.6(c), the rotor will
again experience a torque, and once more the poles of the rotor are positioned midway
between the stator poles. Thus, by switching the currents through the coils, the rotor
rotates by 45°. If in the first pulse, the poles of the coil B had been reversed then the
motor would have rotated clockwise. With this type of motor, commonly produced
step angles are 1.8°, 7.5°, 15°, 30°, 34°, 90°.
3. Hybrid Stepper Motor Hybrid stepper motors are the most common variety
of stepper motors in engineering applications. They combine the features of both the
variable reluctance and permanent-magnet
motors, having a permanent magnet encaged
in iron caps which are cut to have teeth, as
shown in Fig. 3.7. A hybrid stepper motor
has two stacks of rotor teeth on its shaft (WR-
Stepper, 2013). The two rotor stacks are
magnetized to have opposite polarities, while
two stator segments surround the two rotor Fig. 3.7 Hybrid stepper motor
stacks. The rotor sets itself in the minimum
reluctance position in response to a pair of stator coils being energized. Typical step
angles are 0.9° and 1.8°.
From the descriptions of stepper motors, it is, therefore, apparent that the rate at
which the pulses are applied determines the motor speed, the total number of pulses
determines the angular displacement, and the order of energizing the coils in the first
instance determines the direction of rotation. It is because of this ease of driving
using direct digital control that stepper motors are well suited for use in a computer-
controlled robot, although the motor does require interfacing with a high-current
pulse source.
Actuators and Grippers 49
Step
1 2 3 4 Rotation
Phases
CW
P1 0 –1 0 1
P2 1 0 –1 0
CCW
3.1.2 dc Motors
People in their daily lives experience electric motors, whether they are dc (often
battery operated) motors to run a child’s toy or ac (mains operated) motors to turn
the blenders in the kitchen, etc. The first commercial electrically driven industrial
robot was introduced in 1974 by the Swedish giant corporation ASEA. Traditionally,
roboticists have employed electrically driven dc (direct-current) motors for robots
because, not only are powerful versions available, but they are also easily controllable
with relatively simple electronics. Although direct current is needed, batteries are
rarely used (for nonmobile robots) but instead the ac supply is rectified into a suitable
dc equivalent. The operation of any electric motor is based upon the principle
which states that a conductor will
experience a force if an electric
current in that conductor flows at
right angles to a magnetic field.
Therefore, to construct a motor, two
basic components are required. One
to produce the magnetic field usually
termed the stator, and another to act
as the conductor usually termed the
armature or the rotor. The principle
is shown in Fig. 3.9(a) for one
element of a dc motor, whereas a
two-pole dc motor is shown in Fig.
3.9(b). The magnetic field may be
created either by field coils wound on
the stator or by permanent magnets.
The field coils, if used, would be
provided with an electric current to
create magnetic poles on the stator.
In Fig. 3.9(a), the current is supplied
to a conductor via the brushes and
commutators. The current passing
through the field produces a torque,
or more accurately static torque on
the conductor, which can be given Fig. 3.9 dc motors
by
t = 2fr sin s (3.3a)
where f is the magnetic force exerted on the conductor, r is the radius of the rotor,
and s is the angle between the flux density vector of stator magnetic field b and the
unit vector normal to the plane of the coil n, as shown in Fig. 3.9(a). The angle s is
known as torque angle. In view of Lorentz’s law, the imbalanced magnetic force f
that is generated on the conductor, normal to the magnetic plane is given by
f = Bial (3.3b)
in which B is the flux density of the original field, ia is the current through the
conductor, i.e., coil rotor or armature formed by the conductors, and l is the length of
Actuators and Grippers 51
the conductor. Substituting Eq. (3.3b) into Eq. (3.3a), the torque τ generated in the
rotor is given by
t = Aia b sin s (3.3c)
In Eq. (3.3c), A ≡ 2lr, which is nothing but the face area of the planar rotor, as
shown in Fig. 3.9(a). Moreover, unit vectors b and n represent the field direction and
normal to the plane of the rotor.
According to Eq. (3.3c), t is maximum when s = 90°. Moreover, the higher the
voltage supplied to the stator coils of the motor, the faster the motor turns, providing
a very simple method of speed
control. Similarly, varying the current
to the armature controls the torque.
Reversing the polarity of the voltage
causes the motor to turn in the
opposite direction. Some larger
robots utilize field control dc motors,
i.e., motors in which the torque is
controlled by manipulating the
current to the field coils. These motors
allow high power output at high
speeds and can give a good power-to-
weight ratio. A typical specification
of a dc motor is given in Table 3.4,
whereas its speed-torque characteristic
curve is shown in Fig. 3.10 for
Fig. 3.10 Speed-torque speed
different voltage values. characteristics of a dc motor
Brand Parvalux
Manufacturer part no. PM2 160W511109
Type Industrial dc Electric Motors
Shaft size (S, M, L) M
Speed (rpm) 4000 rpm
Power rating (W) 160 W
Voltage rating (Vdc) 50 V(dc)
Input current 3.8 A
Height (mm) 78 mm
Width (mm) 140 mm
Length (mm) 165 mm
Note that the shape of steady-state speed-torque curves will be modified depending
on how the windings of the rotor and the stator are connected. There are three typical
ways to do that, namely, shunt-wound motor, series-wound motor, and compound-
wound motor. Figure 3.11 shows the above three windings.
52 Introduction to Robotics
In a shunt-wound motor, the armature windings and field windings are connected
in parallel, as shown in Fig. 3.11(a). At steady state, the back electromotive force
(e.m.f.) depends directly on the supply voltage. Since the back e.m.f. is proportional
to the speed, it follows that the speed controllability is good with the shunt-wound
configuration. In series-wound motors, as the name suggests, they are connected
in series. This is shown in Fig. 3.11(b). The relation between the back e.m.f. and
supply voltage is coupled through both the armature windings and the field windings.
Hence, its speed controllability is relatively poor. But in this case, a relatively large
current flows through both windings at low speeds of the motor, giving higher starting
torque. Also, the operation is approximately at constant power. In the compound-
wound motor, a part of the field windings is connected with the armature windings
in series and the other part is connected in parallel, as shown in Fig. 3.11(c). This
kind of motors provides a compromise performance between the extremes of speed
controllability and higher starting torque characteristics, as provided by the shunt-
wound and series-wound motors, respectively. Table 3.5 summarizes the properties
derived from the above three types of windings. For an industrial robot, in general,
it is said that the current excited field control methods involve too slow a response
Actuators and Grippers 53
time and incur losses that make permanent-magnet fields and armature control more
attractive, which are explained next.
The cylindrical motor operates in a similar manner to that already described for
other dc motors except that there are no field coils, whereas the disk motor has a large
diameter, short-length armature of nonmagnetic material. It is the cylindrical motor
that is more commonly used in industrial robots.
2. Brushless Permanent-Magnet dc Motors A problem with dc motors is that
they require a commutator and brushes in order to periodically reverse the current
through each armature coil. The brushes make sliding contacts with the commutators
and as a consequence sparks jump between the two and they suffer wear. Brushes
54 Introduction to Robotics
thus have to be periodically changed and the commutator resurfaced. To avoid such
problems, brushless motors have been designed. Essentially, they consist of a
sequence of stator coiled and a permanent magnet rotor. A current-carrying conductor
in a magnetic field experiences a force; likewise, as a consequence of Newton’s third
law of motion, the magnet will also experience an opposite and equal force. With the
conventional dc motor, the magnet is fixed and the current-carrying conductors made
to move. With the brushless permanent-magnet dc motor the reverse is the case, the
current-carrying conductors are fixed and the
magnetic field moves. The rotor is a ferrite or
ceramic permanent magnet. In concept,
brushless dc motors are somewhat similar to
permanent-magnet stepper motors explained
in Section 3.1.1 and to some type of ac
motors, as in Section 3.1.3. Figure 3.13
shows the basic form of such a motor. The
current to the stator coils is electronically
switched by transistors in sequence round
the coils, the switching being controlled by
Fig. 3.13 Brushless permanent-
the position of the rotor so that there are magnet dc motor
always forces acting on the magnet causing
it to rotate in the same direction.
The brushless motors have many advantages over conventional dc motors. For
example,
∑ They have better heat dissipation, heat being more easily lost from the stator
than the rotor.
∑ There is reduced rotor inertia. Hence, they weigh less and low mass for a
specified torque rating.
∑ The motors in themselves are less expensive.
∑ They are more durable and have longer life.
∑ Low maintenance.
∑ Lower mechanical loading.
∑ Improved safety.
∑ Quieter operation.
∑ They are of smaller dimensions of comparable power.
∑ The absence of brushes reduces maintenance costs due to brush and commutator
wear, and also allows electric robots to be used in hazardous areas with flammable
atmospheres such as are found in spray-painting applications.
One disadvantage is that the control systems for brushless motors are relatively
expensive due to sensing and switching.
3. dc Servomotors and their Drivers Servomotors are motors with motion
feedback control, which are able to follow a specified motion trajectory. In a dc
servomotor, both angular position and speed might be measured using, say, shaft
encoders, tachometers, resolvers, potentiometers, etc., and compared with the desired
position and speed. The error signal which is the difference between the desired
minus actual responses is conditioned and compensated using analog circuitry or
Actuators and Grippers 55
Note that the control of a dc motor is achieved by controlling either the stator field
flux or the armature flux. If the armature and field windings are connected through
the same circuit, i.e., one of the winding types shown in Fig. 3.11, both techniques
are implemented simultaneously. Two methods of control are armature control and
field control. In armature control, the field current in the stator circuit is kept constant
and the input voltage to the rotor is varied in order to achieve a desired performance.
In the field control, on the other hand, the armature voltage is kept constant and input
voltage to the field circuit is varied. These winding currents are generated using a
motor driver. It is a hardware unit that generates necessary current to energize the
windings of the motor. By controlling the current generated by the driver, the motor
torque can be controlled. By receiving feedback from a motion sensor (encoder
tachometer, etc.), the angular position and the speed of the motor can be controlled.
The drive unit of a dc servomotor primarily consists of a driver amplifier
(commercially available amplifiers are
linear amplifier or pulse-width- Impedance vs. Inertia Matching
modulation, i.e., PWM, amplifier), with In electrical systems, impedance matching is
additional circuitry and a dc power to equate the input impedance of a load (or
supply. The driver is commanded by a output impedance) with the input impedance
control input provided by a host to maximize the power transfer. Similarly,
in a motor-gearbox load configuration, the
computer through an interface (input/ inertia (or mechanical impedance) of the
output) card. A suitable arrangement is load seen by the motor should be the same
shown in Fig. 3.15. Also, the driver as its inertia in order to obtain maximum
parameters like amplifier gains are power transfer or acceleration.
56 Introduction to Robotics
software programmable and can be set by the host computer. The control computer
receives a feedback signal of the motor motion, through the interface board, and
generates a control signal, using a suitable control law explained in Chapter 10. The
signal is then provided to the drive amplifier, again through the interface board. An
interface board or Data Acquisition (DAQ) card is a hardware module with Digital-
to-Analog (DAC) and Analog-to-Digital (ADC) capabilities built-in. These are
generally parts of a robot’s control system, as mentioned in Section 2.1.3.
Voltage
Time
On Off On Off On Off
Fig. 3.16 Duty cycle of a PWM signal
Actuators and Grippers 57
[Courtesy: http://www.maxonmotor.in/
maxon/view/content/ec-max-motors]
(a) A dc servomotor (b) Maxon’s driver for its servomotor
Fig. 3.17 A dc servomotor and its driver controller
3.1.3 ac Motors
Until recently, ac (alternating current) motors have not been considered suitable for
robots because of the problems involved in controlling their speeds. In its simplest
form, an ac motor consists of external electromagnets around a central rotor, but
without any form of mechanical switching mechanism for the electromagnets.
However, because alternating current (such as the mains electricity supply) is
constantly changing polarity (first flowing one way, then the opposite way, several
times a second, e.g., 50 in India, and 60 in the USA), it is possible to connect the
ac supply directly to the electromagnets. The alternating reversal of the direction
of current through the coils will perform the same task of polarity changing in ac
motors. The magnetic field of the coils will appear to rotate (almost as if the coils
themselves were being mechanically rotated).
A typical specification of an ac motor is given in Table 3.6. Moreover, speed-
torque characteristics of ac motors are shown in Fig. 3.19. Typical advantages of an
ac motor over its dc counterpart are listed below:
∑ Cheaper.
∑ Convenient power supply.
∑ No commutator and brush mechanism. Hence, virtually no electric spark
generation or arcing (safe in hazardous environment like spray painting and
others)
∑ Low power dissipation, and low rotor inertia.
∑ High reliability, robustness, easy maintenance, and long life.
Some of the disadvantages are the following:
∑ Low starting torque.
∑ Need auxiliary devices to start the motor.
∑ Difficulty of variable-speed control or servo control unless modern solid-state
and variable-frequency drives with field feedback compensation are used.
Brand ABB
Manufacturer part no. 1676687
Type Industrial single and three-phase electric motors
Supply voltage 220 – 240 Vac 50 Hz
Output power 180 W
Input current 0.783 A
Shaft diameter 14 mm
Shaft length 30 mm
Speed 1370 rpm
Rated torque 1.3 Nm
Torque starting 1.3 Nm
Height 150 mm
Length 213 mm
Width 120 mm
Actuators and Grippers 59
[Courtesy: www.electricmotors.machinedesign.com/guiEdits/
Content/bdeee11/bdeee11_7.aspx]
Fig. 3.19 Typical speed-torque characteristics for four
different designs of an ac induction motor
Alternating current (ac) motors can be classified into two groups, single-
phase and poly-phase, with each group being further subdivided into induction or
asynchronous and synchronous motors. Single-phase motors tend to be used for low
power requirements while poly-phase motors are used for higher powers. Induction
motors tend to be cheaper than synchronous motors and are thus very widely used.
1. Single-phase Squirrel-cage Induction Motor It consists of a squirrel-cage
rotor, this being copper or aluminum bars that fit into slots in end rings to form
complete electrical circuits, as shown in Fig. 3.20. There are no external electrical
connections to the rotor. The basic motor consists of this rotor with a stator having a
set of windings. When an alternating current
passes through the stator windings, an alternative dc motor or ac motor?
magnetic field is produced, which appears like a The dc motors are easy to control
rotating magnetic field. The rotating field in the compared to the ac motors. Hence,
the former is preferred in robotic
stator intercepts the rotating windings, thereby applications.
generating an induced current due to mutual
induction or transformer action (hence, the name
induction motor). The resulting secondary magnetic flux interacts with the primary,
rotating magnetic flux, thereby producing a torque in the direction of rotation of the
stator field. This torque drives the rotor. As the rotor speed increases, initially the
motor torque also increases because of secondary interactions between the stator
circuit and the rotor circuit even though the relative speed of the rotating field with
respect to the rotor decreases, which reduces the rate of change of flux linkage and,
60 Introduction to Robotics
hence, the direct transformer action. Note that the relative speed is termed as slip rate
given by
w f - wm
S= (3.4)
wf
where wf and wm are the speed of the field and motor’s rotor, respectively. Quite
soon, the maximum torque will be reached. Further increase in the rotor speed (i.e., a
decrease in slip rate) sharply decreases the motor torque, until at synchronous speed
(zero slip rate), the motor torques becomes zero.
For a single-phase supply, when the rotor is stationary initially, the forces on the
current-carrying conductors or the rotor in the magnetic field of the stator are such as
to result in no net torque. Hence, the
motor is not self-starting. A number of Not Self-Starting of a
methods are used to make the motor self- Single-Phase Motor?
starting and give this initial impetus to The stator winding of a single-phase motor
start it. For example, to provide the can only produce the field (flux), which is
starting torque, most single-phase motors only alternating but not rotating. Hence, it
cannot produce any rotation.
have a main and auxiliary winding. The
auxiliary winding current from the main
winding is phase-shifted. Connecting a capacitor in series with the auxiliary winding
causes the motor to start rotating. The rotor rotates at a speed determined by the
frequency of the alternating current applied to the stator. For a constant frequency
supply to a two-pole single-phase motor, the magnetic field will alternate at this
frequency. This speed of rotation of the magnetic field is termed synchronous speed.
The rotor will never quite match this frequency of rotation, typically differing from
it by about 1 to 3%. For a 50 Hz supply, the speed of rotation of the rotor, i.e., wm,
will be almost 50 revolutions per second.
2. Three-phase Induction Motor As shown in Fig. 3.21(a), it is similar to
the single-phase induction motor but has a stator with three windings located 120°
apart, each winding being connected to one of the three lines of the supply. Because
the three phases reach their maximum currents at different times, the magnetic field
Actuators and Grippers 61
can be considered to rotate round the stator poles, completing one rotation in one full
cycle of the current. The rotation of the field is much smoother than with the single-
phase motor. The three-phase motor has a great advantage over the single-phase
motor in being self-starting. The direction of rotation is reversed by interchanging
any two of the line connections, thus changing the direction of rotation of the
magnetic field.
3. Synchronous Motor A synchronous motor has a stator similar to those
described above for induction motors, but a rotor is a permanent magnet as shown
in Fig. 3.21(b). The magnetic field produced by the stator rotates and so the magnet
rotates with it. With one pair of poles per phase of the supply, the magnetic field
rotates through 360° in one cycle of the supply and so the frequency of rotation with
this arrangement is the same as the frequency of the supply. Synchronous motors are
used when a precise speed is required. They are not self-starting and some system
has to be employed to start them.
[Courtesy: http://motorsforautomation
portal.info/kuka-robot-servo-motor/]
Fig. 3.22 A typical ac servomotor
Brand Siemens
Manufacturer part no. 1FK7042-5AF21-1PA3
Type ac synchronous servomotor
Supply voltage 230 V 50 Hz
Power rating 820 W
Maximum output torque 2.6 Nm
Output speed 3000 rpm
Shaft diameter 19 mm
Stall torque 3 Nm
Height 96 mm
Length 162 mm
Width 90 mm
Encoder system for motor 14-bit resolver (with DRIVE-CLiQ-interface)
motions are with the help of an electrically powered rotary motor, as explained in
sections 3.1.1–3.1.3, coupled with transmission mechanisms like nut and ball-screw,
cam-follower, rack-and-pinion, etc. These devices inherently have problems of
friction and backlash. Additionally, they add inertia and flexibility to the driven load,
thereby generating undesirable resonances and motion errors. Proper inertia matching
is also essential. In order to avoid the above difficulties of using a transmission
system, direct rectilinear electromechanical actuators are desirable. They can be
based on any of the principles mentioned for the rotary actuators, i.e., stepper or dc
or ac motors. In these actuators, flat stators and rectilinearly moving elements (in
place of rotors) are employed. These types of actuators are also referred to as electric
cylinders in line with hydraulic or pneumatic cylinders that are explained next.
∑ Few backlash problems occur due to the stiffness and incompressibility of the
fluid, especially, when the actuator acts as the joint itself. Large forces can be
applied directly at the required locations.
∑ They generally have a greater load-carrying capacity than electric and pneumatic
robots.
∑ No mechanical linkage is required, i.e., a direct drive is obtained with mechanical
simplicity.
∑ Self-lubricating (low wear) and non-corrosive.
∑ Due to the presence of an accumulator, which acts as a ‘storage’ device, the
system can meet sudden demands in power.
∑ Hydraulic robots are more capable of withstanding shock loads than electric
robots.
Disadvantages
∑ Leakages can occur to cause loss in performance, and general contamination of
the work area. There is also higher fire risk.
Actuators and Grippers 65
∑ The power pack can be noisy, typically about 70 decibel (dBA) or louder if not
protected by an acoustic muffler.
∑ Changes in temperature alter the viscosity of How noisy is 70 decibels?
the hydraulic fluid. Thus, at low temperatures,
fluid viscosity will increase, possibly, causing The level of 70 decibels is
about the noise level of heavy
sluggish movement of the robot.
traffic.
∑ For smaller robots, hydraulic power is usually
not economically feasible as the cost of hydraulic
components do not decrease in proportion to size.
∑ Servo control of hydraulic systems is complex and is not as widely understood
as electric servo control.
Hydraulic systems power the strongest and the stiffest robots and, hence, the
bulk modulus of the oil is an extremely important attribute to be selected. A high
bulk modulus implies a stiff, quickly responding system with a corresponding quick
pressure build-up, while a low bulk modulus may result in a system that is too loose
because of the high compressibility of the oil. Hydraulic systems or circuits have
always four essential components: a reservoir to hold the fluid, pumps to move it,
valves to control the flow, and an actuator to carry out the dictates of the fluid on some
load. Rotary hydraulic actuators are also available in the market. A commercially
available hydraulic cylinder is shown in Fig. 3.25(a), whereas its design using
software is available in WR-Hydraulic (2013). A video of such cylinders is also
available at WR-Hydraulic-video (2013).
Brand Rexroth
Manufacturer part no. CDL1M00/32/18/50/C1X/B1CHUMS
Type Cylinder-rod ends bearing
Body Carbon steel
Bore size 32 mm
Stroke 50 mm
Port size G 1/4
Static proof pressure 240 bar
Working pressure 160 bar
Maximum force at 160 bar 12.8 kN
Maximum flow at 0.1 mm/s 4.8 l/min
Overall length 200 mm
Overall length (piston extended) 250 mm
Rod-end diameter 18 mm
Rod-end thread size 18 mm
Seal material NBR/Pollyurethane
Recommended hydraulic medium Mineral-oil-based fluids
Hydraulic fluid operating temperature range –20 to +80o C
66 Introduction to Robotics
[Courtesy: www.meritindustriesltd.com]
[Courtesy: www.festo.com]
(a) Hydraulic cylinder (b) Pneumatic cylinder
Fig. 3.25 Commercially available cylinders
due to overload and providing compliance that may be required in many practical
applications.
Brand SMC
Manufacturer part no. MHC2-25D
Type Gripper (double acting)
Bore 25 mm
Operating angle 30° (open) to –10° (Closed)
Pressure range 1 to 6 Bar
Connection port size M5 m
Temperature range 0 to 60°C
Media Non lubricated air
Holding moment 1.4 Nm at 5 bar
Repeatability at closing position ±0.1 mm
Maximum operating frequency 80 cpm (cycles per minute)
at power levels under about 1.5 kW unless there is danger due to possible ignition
of explosive materials. At ranges between 1-5 kW, the availability of a robot in
a particular coordinate system with specific characteristics or at a lower cost
may determine the decision. Reliability of all types of robots made by reputable
manufacturers is sufficiently good that this is not a major determining factor.
3.5 GRIPPERS
Grippers are end-effectors, as introduced in Section 2.1.1, which are used to grasp
an object or a tool, e.g., a grinder, and hold it. Tasks required by the grippers are
to hold workpieces and load/unload from/to a machine or conveyer. Grippers can
be mechanical in nature using a combination of mechanisms driven by electric,
hydraulic, or pneumatic powers, as explained in earlier sections. Grippers can be
classified based on the principle of grasping mechanism. For example, grippers can
hold with the help of suction cups, magnets, or by other means. A gripper is then
accordingly referred to as pneumatic gripper, magnetic gripper, etc. Another way to
classify a gripper is based on how it holds an object, i.e., based on grasping the object
on its exterior (external gripper) or interior (internal gripper) surface.
3.5.1 Mechanical Grippers
As shown in Fig. 2.4(a), mechanical grippers have their jaw movements through
pivoting or translational motion using a transmission element, e.g., linkages or gears,
etc. This is illustrated in Fig. 3.27. The gripper can be of single or double type.
While the former has only one gripping device at the robot’s wrist, the latter type has
two. The double grippers can be actuated independently and are especially useful in
machine loading and unloading. As illustrated in Groover et al. (2012), suppose a
particular job calls for a raw part to be loaded from a conveyor onto a machine and
the finished part to be unloaded onto another conveyor. With a single gripper, the
robot would have to unload the finished part before picking up the raw part. This
would consume valuable time in the production cycle because the machine would
remain idle during these handling motions. With a double gripper, the robot can pick
up the part from the incoming conveyor with one of its gripping devices and have
it ready to exchange for the finished part on the machine. When the machine cycle
is completed, the robot can reach in for the finished part with the available grasping
70 Introduction to Robotics
device, and insert the raw part into the machine with the other grasping device. The
amount of time spent in exchanging the parts or the time to keep the machine idle is
minimized.
A gripper uses its fingers or jaws to hold an object, as illustrated in Fig. 3.28.
The function of a gripper mechanism is to translate some form of power input, be it
electric, hydraulic or pneumatic, into the grasping action of the fingers against the
part. Note that there are two ways a gripper can hold an object, i.e., either by physical
constriction as shown in Fig. 3.28(a) or by friction, as demonstrated in Fig. 3.38(b).
In the former case, contacting surfaces of the fingers are made of approximately
the same shape of the part geometry, while in the latter case the fingers must apply
sufficient force to retain the part against gravity or accelerations. The friction method
of holding a part is less complex and hence less expensive. However, they have to be
designed properly with its surfaces having sufficient coefficient of friction so that the
parts do not slip during motion. Example 3.6 illustrates the situation.
Rotational
Drive or Gripper
system Transmission
Pivoting or motion
Linear Linkages, gears, translational
Electric, hydraulic,
cams, cables, etc.
pneumatic
Gripper
Vacuum cup
Object
110187.12
p= = 175.35 N/m 2 (3.7)
2 ¥ p ¥ (0.1)2
SUMMARY
A robot is moved by actuators. Different forms of actuators, namely, electric, hydraulic
and pneumatic types are explained. For electric motors, their typical specifications and
speed-torque characteristics are presented. How to select a suitable motor is also outlined.
Besides, grippers used to hold an object in order to transfer it to a new location are
explained. Important aspects to select an appropriate gripper are also highlighted.
Actuators and Grippers 75
EXERCISES
3.1 Name the components of a joint actuating system.
3.2 What is an actuator?
3.3 Give the requirements of an actuator for robotic applications.
3.4 What are different actuators?
3.5 List the advantages and disadvantages of electric motors.
3.6 What are the types of stepper motors?
3.7 Why are dc motors preferred as servomotors?
3.8 Describe the functional differences of steppers, dc, and ac motors.
3.9 Draw a typical speed-torque plot of a dc motor.
3.10 Distinguish a stable operating point from the unstable one of a dc motor.
3.11 When are hydraulic actuators preferred in a robot system?
3.12 What fluid is used in hydraulic actuators and what is the pressure range?
3.13 State different types of hydraulic actuators.
3.14 What are the risks of using hydraulic actuators?
3.15 What is the function of direction control valve?
3.16 List any three advantages and disadvantages of a pneumatic actuator.
3.17 State the typical applications of pneumatic actuators.
3.18 Why are pneumatic actuators preferred in factory set-up robots?
3.19 Why is a storage tank necessary in pneumatic actuators?
3.20 Which component basically provides the mechanical motion?
3.21 How is a motor selected?
3.22 What is a mechanical gripper? Show a sketch to hold a cylindrical object.
3.23 What are the limitations of friction-based grippes?
3.24 State one example for the use of a hook.
3.25 What is the main drawback of using adhesive gripper?
WEB-BASED EXERCISES
Based on Web search, find the answers to the following questions:
3.26 Find at least three manufacturers of dc and ac electric motors. What are their prices?
3.27 What is a typical value of the dc motor constant?
3.28 Find out if there is any software that can provide motor specifications based on the load
and speed requirement of a robot. Name it.
3.29 Find out two companies who make direct-drive motors.
3.30 Name three companies who make both pneumatic and hydraulic actuators. What are the
prices for these actuators?
4
Sensors, Vision and
Signal Conditioning
Sensors in robots are like our nose, ears, mouth, and skin, whereas vision or robot
vision can be thought of as our eyes. Based on the function of human organs, for
example, eyes, skin, etc., terminology like vision, tactile, etc., have cropped up in
robot sensors. Robots, like humans, must gather extensive information about their
environment in order to function effectively. They must pick up an object and know
it has been picked up. As the robot arm moves through the 3-dimensional Cartesian
space, it must avoid obstacles and approach items to be handled at a controlled speed.
Some objects are heavy, others are fragile, and others are too hot to handle. These
characteristics of objects and the environment must be recognized, and fed to the
computer that controls a robot’s movement. For example, to move the end-effector
of a robot, with or without a payload along a desired trajectory and to exert a desired
force on an object, the end-effector and sensors (normally located at the joints and at
the end-effector) work in coordination with the robot controller (a microprocessor, or
a computer or a microcontroller).
Note that in industrial applications of robots, as explained in Chapter 2, sensors
must play important roles. For example, they must at least provide the following
functions:
1. Safe Operation Sensors must protect human workers who work in the vicinity
of the robot or other equipment. For example, one can provide a sensor on the floor
of a work cell where a robot is working so that if anybody steps in the robot’s power
should be switched off.
2. Interlocking This is required to coordinate the sequence of operations on a
component. For example, unless a turning is done on a component, it should not be
transferred to the conveyor.
3. Inspection This is essential for Sensor vs. Transducer
quality control. For example, one can Sensor and transducer are used
use a vision system to measure the interchangeably to denote a sensor-
transducer unit. They are the functional
length of a component to check if it is stages of sensing. First, a measurand
within the acceptable tolerance or not. is felt or sensed before it is transduced
or converted from one type of energy to
4. Part Configuration If a robot is another for various purposes including the
used to weld two parts of a car body, measurement of physical parameters like
the sensors must identify the correct position, velocity, etc.
Sensors, Vision and Signal Conditioning 77
configurations, i.e., position and orientation of the parts, before the robot starts
welding.
There could be other scenarios like identifying the color code of a particular car
model before painting with that color is done by the robot, etc.
wiper and end leads of the device changes in proportion to the displacement, x and q
for linear and angular potentiometers, respectively.
3. LVDT The Linear Variable Differential Transformer (LVDT) is one of the most
used displacement transducers, particularly when high accuracy is needed. It generates
an ac signal whose magnitude is related to the displacement of a moving core, as
indicated in Fig. 4.4. The basic concept is that of a ferrous core moving in a magnetic
field, the field being produced in a manner similar to that of a standard transformer.
There is a central core surrounded by two identical secondary coils and a primary
coil, as shown in Fig. 4.4. As the core changes position with respect to the coils, it
changes the magnetic field, and hence the voltage amplitude in the secondary coil
changes as a linear function of the core displacement over a considerable segment. A
Rotary Variable Differential Transformer (RVDT) operates under the same principle
as the LVDT is also available with a range of approximately ±40°.
4. Synchros and Resolver While encoders give digital output, synchros and
resolvers provide analog signal as their
What are arc-minute
output. They consist of a rotating shaft
and arc-second?
(rotor) and a stationary housing (stator).
Their signals must be converted into the They are the measures of small angles.
one degree = 60 arc-minutes and
digital form through an analog-to-digital
one arc-minute = 60 arc-seconds.
converter before the signal is fed to the
computer.
As illustrated in Fig. 4.5, synchros and resolvers employ single-winding rotors
that revolve inside fixed stators. In a simple synchro, the stator has three windings
oriented 120° apart and electrically connected in a Y-connection. Resolvers differ
from synchros in that their stators have only two windings oriented at 90°. Because
synchros have three stator coils in a 120° orientation, they are more difficult than
resolvers to manufacture and are, therefore, more costly.
Modern resolvers, in contrast, are available in a brushless form that employ a
transformer to couple the rotor signals from the stator to the rotor. The primary
winding of this transformer resides on the stator, and the secondary on the rotor.
Other resolvers use more traditional brushes or slip rings to couple the signal into the
rotor winding. Brushless resolvers are more rugged than synchros because there are
no brushes to break or dislodge, and the life of a brushless resolver is limited only by
its bearings. Most resolvers are specified to work over 2 V to 40 V rms (root mean
square) and at frequencies from 400 Hz to 10 kHz. Angular accuracies range from 5
arc-minutes to 0.5 arc-minutes.
of the angle q between the rotor-coil axis and the stator-coil axis. In the case of a
synchro, the voltage induced across any pair of stator terminals will be the vector
sum of the voltages across the two connected coils. For example, if the rotor of a
synchro is excited with a reference voltage, V sin (w t), across its terminal R1 and R2,
the stator’s terminal will see voltages denoted as V0 in the form:
V0(S1 − S3) = V sin (w t) sin q (4.2a)
V0(S3 − S2) = V sin (w t) sin (q + 120°) (4.2b)
V0(S2 − S1) = V sin (w t) sin (q + 240°) (4.2c)
where S1, S2, etc., denotes the stator terminals. Moreover, V and w are the input
amplitude and frequency, respectively, whereas q is the shaft angle. In the case of a
resolver, with a rotor ac reference voltage of V sin (w t), the stator’s terminal voltages
will be
V0(S1 − S3) = V sin (w t) sin q (4.3a)
V0(S4 − S2) = V sin (w t) sin (q + 90°) = V sin (w t) cos q (4.3b)
As said earlier, the output of these synchros and resolvers must be first digitized.
To do this, analog-to-digital converters are used. These are typically 8-bit or 16-
bit. An 8-bit means that the whole range of analog signals will be converted into a
maximum of 28 = 256 values.
4.2.2 Velocity Sensors
Velocity or speed sensors measure by taking consecutive position measurements at
known time intervals and computing the time rate of change of the position values or
directly finding it based on different principles.
1. All Position Sensors Basically, all position sensors when used with certain
time bounds can give velocity, e.g., the number of pulses given by an incremental
position encoder divided by the time consumed in doing so. But this scheme puts
some computational load on the controller which may be busy in some other
computations.
2. Tachometer Such sensors can directly find the velocity at any instant of time,
and without much of computational load. This measures the speed of rotation of
an element. There are various types of tachometers in use but a simpler design is
based on the Fleming’s rule, which states ‘the voltage produced is proportional to the
rate of flux linkage.’ Here, a conductor (basically a coil) is attached to the rotating
element which rotates in a magnetic field (stator). As the speed of the shaft increases,
the voltage produced at the coil terminals also increases. In other ways, as shown in
Fig. 4.6, one can put a magnet on the rotating shaft and a coil on the stator. The
voltage produced is proportional to the speed of rotation of the shaft. This information
is digitized using an analog-to-digital converter and passed on to the computer.
3. Hall-effect Sensor Another velocity-measuring device is the Hall-effect
sensor, whose principle is described next. If a flat piece of conductor material, called
Hall chip, is attached to a potential difference on its two opposite faces, as indicated
in Fig. 4.7 then the voltage across the perpendicular faces is zero. But if a magnetic
field is imposed at right angles to the conductor, the voltage is generated on the two
84 Introduction to Robotics
other perpendicular faces. Higher the field value, higher the voltage level. If one
provides a ring magnet, the voltage produced is proportional to the speed of rotation
of the magnet.
where F is force, DR is the change in resistance of the strain gauge, A is the cross-
sectional area of the member on which the force being applied, E is the elastic
modulus of the strain-gauge material, R is the original resistance of the gauge, and
G is gauge factor of the strain gauge. Then, the acceleration a is the force divided by
mass of the accelerating object m, i.e.,
F DRAE
a= = (4.5)
m RCm
It is pointed out here that the velocities
What is Gauge Factor?
and accelerations that are measured using
It is a measure of sensitivity for the strain
position sensors require differentiations.
gauges, and defined by
It is generally not desirable, as the 1 DR
noise in the measured data, if any, will G=
e R
be amplified. Alternatively, the use of
where G is the gauge factor, and e is
integrators to obtain the velocity from strain.
the acceleration, and consequently the
position, are recommended. Integrators tend to suppress the noise.
Example 4.2 Change in Resistance
If the gauge factor G = 2, resistance of the unreformed wire R = 100 W, and strain
e = 10–6, then change in resistance is given by
DR = GeR = 2 × 10–6 × 100 = 0.0002 W (4.6)
capacitive switch has the same four elements as the inductive sensor, i.e., sensor (the
dielectric media), oscillator circuit, detector circuit, and solid-state output circuit.
The oscillator circuit in a capacitive switch operates like one in an inductive
switch. The oscillator circuit includes capacitance from the external target plate
and the internal plate. In a capacitive sensor, the oscillator starts oscillating when
sufficient feedback capacitance is detected. Major characteristics of the capacitive
proximity sensors are as follows:
∑ They can detect non-metallic targets.
∑ They can detect lightweight or small objects that cannot be detected by
mechanical limit switches.
∑ They provide a high switching rate for rapid response in object counting
applications.
∑ They can detect limit targets through nonmetallic barriers (glass, plastics, etc.).
∑ They have long operational life with a virtually unlimited number of operating
cycles.
∑ The solid-state output provides a bounce-free contact signal.
Capacitive proximity sensors have two major limitations.
∑ The sensors are affected by moisture and humidity, and
∑ They must have extended range for effective sensing.
Capacitive proximity sensors have a greater sensing range than inductive
proximity sensors. Sensing distance for capacitive switches is a matter of plate
area, as coil size is for inductive proximity sensors. Capacitive sensors basically
measure a dielectric gap. Accordingly, it is desirable to be able to compensate for
the target and application conditions with a sensitivity adjustment for the sensing
range. Most capacitive proximity sensors are equipped with a sensitivity adjustment
potentiometer.
2. Semiconductor Displacement Sensor As shown in Fig. 4.14, a
semiconductor displacement sensor uses a semiconductor Light Emitting Diode
(LED) or laser as a light source, and a Position-Sensitive Detector (PSD). The laser
[Courtesy: http://www.sensorcentral.com/displacement/
laser02.php]
beam is focused on the target by a lens. The target reflects the beam, which is then
focused on to the PSD forming a beam spot. The beam spot moves on the PSD as
the target moves. The displacement of the workpiece can then be determined by
detecting the movement of the beam spot.
4.4 VISION
Vision can be defined as the task of
extracting information about the external Computer Vision vs. Computer Graphics
world from light rays imaged by a camera Computer vision can be thought of as
or an eye. Vision, also referred in the ‘inverse computer graphics.’ Computer
literature as computer vision or machine graphics deals with how to generate images
from a specification of the visual scene (e.g.,
vision or robot vision, is a major subject objects, scene structures, light sources),
of research and many textbooks, e.g., by whereas computer vision inverts this process
Haralick and Shapiro (1992, 1993), and to infer the structure of the world from the
others. A good coverage on the topic has observed image(s).
also appeared in Niku (2001). There are
also dedicated journals, e.g., Computer Vision, Graphics, and Image Processing, and
conferences in the area of robot vision. The area is so vast that it cannot be covered
in one section or chapter of a book. However, an attempt is made here to introduce
the basic concepts and techniques so that one is able to understand the systems and
methodologies used in robot vision. For detailed study and research, other references
in the area should be consulted.
Note in Fig. 4.1 that the vision systems or vision sensors are classified as external
noncontact type. They are used by robots to let them look around and find the parts,
for example, picking and placing them at appropriate locations. Earlier, fixtures
were used with robots for accurate positioning of the parts. Such fixtures are very
expensive. A vision system can provide alternative economic solution. Other tasks
of vision systems used with robots include the following:
1. Inspection Checking for gross surface defects, discovery of flaws in labeling,
verification of the presence of components in assembly, measuring for dimensional
accuracy, checking the presence of holes and other features in a part.
2. Identification Here, the purpose is to recognize and classify an object rather
than to inspect it. Inspection implies that the part must be either accepted or rejected.
3. Visual Servoing and Navigation Control The purpose here is to direct the
actions of the robot based on its visual inputs, for example, to control the trajectory
of the robot’s end-effector toward an object in the workspace. Industrial applications
of visual servoing are part positioning, retrieving parts moving along a conveyor,
seam tracking in continuous arc welding, etc.
All of the above applications someway require the determination of the
configuration of the objects, motion of the objects, reconstruction of the 3D geometry
of the objects from their 2D images for measurements, and building the maps of the
environments for a robot’s navigation. Coverage of vision system is from a few
millimetres to tens of metres with either narrow or wide angles, depending upon the
Sensors, Vision and Signal Conditioning 91
system needs and design. Figure 4.15 shows a typical visual system connected to an
industrial robot.
The task of the camera as a vision sensor is to measure the intensity of the light
reflected by an object, as indicated in Fig. 4.16, using a photosensitive element
termed pixel (or photosite). A pixel is capable of transforming light energy into
electric energy. The sensors of different types like CCD, CMOS, etc., are available
depending on the physical principle exploited to realize the energy transformation.
Depending on the application, the camera could be RS-170/CCIR, NTSC/PAL (These
are American RS-170 monocolor, European/Indian CCIR monocolor, NTSC color,
PAL color television standard signal produced by the video cameras, respectively)
progressive scan, variable scan, or line scan. Five major system parameters which
govern the choice of camera are field of view, resolution, working distance, depth of
field, and image data acquisition rate. As a rule of thumb, for size measurement, the
sensor should have a number of pixels at least twice the ratio of the largest to smallest
object sizes of interest.
92 Introduction to Robotics
Both the CCDs and CID chips use large transfer techniques to capture an image.
In a CCD camera, light impinges on the optical equivalent of a Random Access
Memory (RAM) chip. The light is absorbed in a silicon substrate, with charge build-
up proportional to the amount of light reaching the array. Once sufficient amount of
energy has been received to provide a picture, the charges are read out through built-
in control registers. Some CCD chips use an interline charge-transfer technique.
Others use frame-transfer approach, which is more flexible for varying the integration
period.
The CID camera works on a similar principle. A CID chip is a Metal Oxide
Semiconductor (MOS) based device with multiple gates similar to CCDs. The video
signal is the result of a current pulse from a recombination of carriers. CIDs produce
Sensors, Vision and Signal Conditioning 95
a better image (less distortion) and use a different read-out technique than CCDs
which require a separate scanning address unit. CIDs are, therefore, more expensive
than CCDs. The principle difference between a CCD and a CID camera is the method
of generating the video signal.
2. Lighting Techniques One of the key questions in robot vision is what
determines how bright the image of some surface on the object will be? It involves
radiometry (measurement of the flow and transfer of radiant energy), general
illumination models, and surface having both diffuse and specular reflection
components. Different points on the objects in front of the imaging system will
have different intensity values on the image, depending on the amount of incident
radiance, how they are illuminated, how they reflect light, how the reflected light is
collected by a lens system, and how the sensor camera responds to the incoming light.
Figure 4.20 shows the basic reflection phenomenon. Hence, proper illumination of
the scene is important. It also affects the complexity level of the image-processing
algorithm required. The lighting techniques must avoid reflections and shadow unless
they are designed for the purpose of image processing. The main task of lighting is to
create contrast between the object features to be detected. Typical lighting techniques
are explained below.
Direct Incident Lighting This simple lighting technique can be used for non-
reflective materials which strongly scatter the light due to their matte, porous, fibrous,
non-glossy surface. Ideally, a ring light is chosen for smaller illuminated fields that
can be arranged around the lens. Shadows are avoided to the greatest extent due to the
absolutely vertical illumination. Halogen lamps and large fluorescence illumination
can be used too.
Diffuse Incident Lighting Diffused light is necessary for many applications,
e.g., to test reflective, polished, glossy, or metallic objects. It is particularly difficult
if these surfaces are not glossy, perfectly flat, but individually shaped, wrinkled,
curved, or cylindrical. To create diffused lighting, one may use incident light with
diffusers, coaxial illumination, i.e., light is coupled into the axis of the camera by
means of a beam splitter or half-mirror, or the dome-shaped illumination where light
is diffused by means of a diffused coated dome in which the camera looks through
an opening in the dome onto the workpiece.
96 Introduction to Robotics
Lateral Lighting Light from the side can be radiated at a relatively wide or narrow
angle. The influence on the camera image can be significant. In an extreme case, the
image information can almost be inverted.
Dark Field Lighting At first sight, images captured using dark field illumination
seem unusual to the viewer. The light shines at a shallow angle. According to the
principle of angle of incidence equals the angle of reflection, all the light is directed
away from the camera. The field of view, therefore, remains dark. Inclined edges,
scratches, imprints, slots, and elevations interfere with the beam of light. At these
anomalies, the light is reflected towards the camera. Hence, these defects appear
bright in the camera image.
Backlighting Transmitted light illumination is the first choice of lighting when it
is necessary to measure parts as accurately as possible. The lighting is arranged on
the opposite side of the camera, the component itself is put in the light beam.
Example 4.5 Pixel Processing
Assume a vidicon tube generates a signal for 512 lines of a faceplate. If the sampling
capability of an ADC is 100 nanoseconds, i.e., the time required to process one pixel,
and 1/30 seconds are required to scan all 512 lines then scanning rate for each line is,
1
= 65.1 microsecond per line (4.11)
(30 ¥ 512)
Hence, the number of pixels which can be processed per line is given below:
65.1 ¥ 10 -6
= 651 pixels per line (4.12)
100 ¥ 10 -9
recognize an object within the image field. It is divided into several sub-processes,
which are discussed below:
Image Data Reduction Here, the objective is to reduce the volume of data.
As a preliminary step in the data analysis, the schemes like digital conversion or
windowing can be applied to reduce the data. While the digital conversion reduces
the number of gray levels used by the vision system, windowing involves using
only a portion of the total image stored in the frame buffer for image processing
and analysis. For example, in windowing, to inspect a circuit board, a rectangular
window is selected to surround the component of interest and only pixels within that
window are analyzed.
Histogram Analysis A histogram is a representation of the total number of pixels
of an image at each gray level. Histogram information is used in a number of different
processes, including thresholding. For example, histogram information can help in
determining a cut-off point when an image is to be transformed into binary values.
Thresholding It is the process of dividing an image into different portions or
levels by picking a certain grayness level as a threshold. Comparing each pixel value
with the threshold, and then assigning the pixel to the different portions or level,
depending on whether the pixel’s grayness level is below the threshold (‘off’ or 0, or
not belonging) or above the threshold (‘on’ or 1, or belonging).
Masking A mask may be used for many different purposes, e.g., filtering operations
and noise reduction, and others. It is possible to create masks that behave like a low-
pass filter such that higher frequencies of an image are attenuated while the lower
frequencies are not changed very much. This is illustrated in Example 4.8. Thereby,
the noise is reduced. Masking an image considers a portion of an imaginary image
shown in Fig. 4.23(a), which has all the pixels at a gray value of 20 except the one at
a gray level of 100. The one with 100 may be considered noise. Applying the 3 ¥ 3
mask shown in Fig. 4.23(b) over the corner of the image yields the following value:
(m1 A + m2 B + m3C + m4 E + m5 F + m6 G + m7 I + m8 J + m9 K )
X= = 29 (4.14)
S
where S ∫ m1 + m2 + � + m9 = 9, and values of A, B, …, and m1, m2, … are shown
in Figs. 4.23 (a) and (b), respectively. As a result of application of the mask, the pixel
with the value of 100 changes to 29, as indicated in Fig. 4.23(c). The large difference
between the noisy pixel and the surrounding pixels, i.e., 100 vs. 20, becomes much
smaller, namely, 29 vs. 20, thus reducing the noise. With this characteristic, the mask
acts as a low-pass filter. Note that the above reduction of noise has been achieved
using what is referred as neighborhood averaging, which causes the reduction of the
sharpness of the image as well.
Edge Detection Edge detection is a general name for a class of computer programs
and techniques that operate on an image and result in a line drawing of the image.
The lines represent changes in values such as cross section of planes, intersections
of planes, textures, lines, etc. In many edge-detection techniques, the resulting edges
are not continuous. However, in many applications, continuous edges are preferred,
which can be obtained using the Hough transform. It is a technique used to determine
the geometric relationship between different pixels on a line, including the slope
of the line. Consider a straight line in the xy-plane, as shown in Fig. 4.24, which is
expressed as
y = mx + c (4.15)
where m is the slope and c is the intercept. The line represented by Eq. (4.15) can
be transformed into a Hough plane of m – c with x and y as its slope and intercept,
respectively. Thus, a line in the xy-plane with a particular slope and intercept will
transform into a point in the Hough plane. For the Hough or m-c plane, if a line
passes through (m1, c1), as shown in Fig. 4.24(b), it represents a point (x1, y1) in the
x-y plane of Fig. 4.24(a). In that way, all lines through a point in the Hough plane
will transform into a single line in the x-y plane. Alternatively, if a group of points
is collinear, their Hough transform will all intersect. By examining these properties
in a particular case, it can be determined whether a cluster of pixels is on a straight
line or not, whereupon the orientation of an object in a plane can be determined by
calculating the orientation of a particular line in the object.
above, region growing and splitting, and others. While region growing works based
on the similar attributes, such as gray-level ranges or other similarities, and then try
to relate the regions by their average similarities, region splitting is carried out based
on thresholding in which an image is split into closed areas of neighborhood pixels
by comparing them with thresholding value or range.
Morphology Operations Morphology operations are a family of operations
which are applied on the shape of subjects in an image. They include many different
operations, both for binary and gray images, such as thickening, dilation, erosion,
skeletonization, opening, closing, and filing. These operations are performed on an
image in order to aid in its analysis, as well as to reduce the ‘extra’ information that
may be present in the image. For example, Fig. 4.25(a) shows the object which after
skeletonization is shown in Fig. 4.25(b).
Similarly, one can find n0,1 as the summation of y-coordinates which is same as
the summation of each pixel area multiplied by its distance from the x-axis. Hence, it
is similar to the first moment of the area relative to the x-axis. Then, the location of
the center of the area relative to the x-axis can be calculated immediately as
1 n0,1
y– = Â y= (4.19a)
Area n0,0
Following Eq. (4.19a), one can also find the location of the center of the area
relative to the y-axis as
1 n1,0
x– = Â x= (4.19b)
Area n0,0
In a similar manner, one can also find the second moment of area with respect to
x and y axes by putting p = 2; q = 0, and p = 0; q = 2, respectively. Note here that the
first moments are independent of orientation, whereas the second moments are not.
Object Recognition The next in image analysis is to identify the object that the
image represents based on the extracted features. The recognition algorithm should
be powerful enough to uniquely identify the object. Typical techniques used in the
industries are template matching and structural technique.
In template matching, the features of the object in the image, e.g., its area,
diameter, etc., are compared to the corresponding stored values. These values
constitute the stored template. When a match is found, allowing for certain statistical
variations in the comparison process, the object has been properly classified. For
example, the area of an image given by the moment n0,0 can be used to determine
nature of the object, and to distinguish it from other objects that have different
areas. Similarly, the first and second moments can be used to identify an object’s
position and orientation so that it can be picked up by the robot. Note that, instead of
calculating the moment values which change as the object moves, a look-up table can
be prepared. For example, the moment of inertia of an object varies significantly as
the object rotates about its center. Hence, the values of n2,0 and n0,2 will also change.
Since each orientation creates a unique value, a look-up table that contains these
values can later be used to identify the orientation of the object.
An important aspect here is that similar shapes,
as shown in Fig. 4.27 cannot be distinguished with
their first and second moments, as they are similar
or close to each other. In such a situation, a small
difference between the two objects may be
exaggerated through higher-order moments,
Fig. 4.27 Two similar objects
making identification of the object possible.
Structural techniques of pattern recognition rely on the relationship between
features or edges of an object. For example, if the image of an object can be subdivided
in four straight lines connected at their end points, and the connected lines are at right
angles then the object is a rectangle. This kind of technique is known as syntactic
pattern recognition.
In case depth information of an object is required, it can be obtained either by
using a range finder in conjunction with a vision system, or using a stereo vision. The
details of these systems are beyond the scope of this book. Readers are encouraged to
look at Haralick and Shapiro (1992) and others.
4.4.3 Hierarchy of a Vision System
The collection of processes involved in visual perception are often perceived as a
hierarchy spanning the range from ‘low’ via ‘intermediate’ to ‘high-level’ vision. The
notion of ‘low’ and ‘high’ vision are used routinely, but there is no clear definition of
Sensors, Vision and Signal Conditioning 103
user. Further grouping is essential at this stage since one may still need to be able
to decide which lines group together to form an object. To do this, it is necessary to
further distinguish lines which are part of the object structure, from those which are
part of a surface texture, or caused by shadows. High-level systems are, therefore,
object oriented, and sometimes called ‘top-down’. High-level visual processes are
applied to a selected portion of the image, rather than uniformly across the entire
image, as done in low- and intermediate-level visions. They almost always require
some form of knowledge about the objects of the scene to be included.
4.4.4 Difficulties in Vision and Remedies
A vision system cannot uniquely represent or process all available data because of
computational problem, memory, and processing-time requirements imposed on the
computer. Therefore, the system must compromise. Other problems include variation
of light, part-size, part placement, and limitations in the dynamic ranges available in
typical vision sensors. A vision system requires specialized hardware and software.
It is possible to purchase just the hardware with little or no vision application
programming. In fact, a few third-party programs are available. A hardware-only
approach is less expensive and can be more flexible for handling usual vision
requirements. But, since this approach requires image processing expertise, it is only
of interest to users who wish to retain the responsibility of image interpretation. It
is usual practice to obtain the hardware and application software together from the
supplier. However, the user might still need custom programming for an application.
Sensors, Vision and Signal Conditioning 105
Major vision system suppliers specialise in providing software for only a few
application areas.
Every vision system requires a sensor to cover the visual image into an electronic
signal. Several types of video sensors are used, including vidicon cameras, vacuum
tube devices, and solid-state sensors. Many of these vision systems were originally
designed for other applications, such as television so the signal must be processed to
extract the visual image and remove synchronization information before the signal
is sent to the computer for further processing. The computer then treats this digital
signal as the array pixels, and processes this data to extract the desired information.
Image processing can be very time consuming. For a typical sensor of 200,000
or more pixels, a vision system can take many seconds, even minutes, to analyze
the complete scene and determine the action to be taken. The number of bits to be
processed is quite large, for example, a system with 512 × 512 pixels array and an
8-bit intensity per pixel yields over two million of bits to be processed. If continuous
image at a 30 FPS frame rate were being received, data bytes would be received at
an 8 MHz rate. Few computers can accept inputs at these data rates and, in any case,
there would be no time left to process the data. When higher resolution system, color
system, or multiple camera systems are considered, data-handling requirements
become astronomical. Several methods can be used to reduce the amount of data
handled and, therefore, the processing time. They are explained as follows:
(a) One approach is the binary vision, which is used when only black-and-white
information is processed (intensity variations and shades of gray are ignored).
In binary vision, a picture is converted into a binary image by thresholding, as
illustrated in Fig. 4.29. In thresholding, a brightness level is selected. All data
with intensities equal to or higher than this value are considered white, and all
other levels are considered black.
(b) Another method of shortening process time is to control object placement so
that objects of interest cannot overlap in the image. Complicated algorithms
to separate images are then not necessary, and the image-processing time is
reduced.
(c) A third approach reduces data handling by processing only a small window of
the actual data; that is, the object is located in a predefined field of view. For
example, if the robot is looking for a mark on the printed circuit board, the
system can be held in such a way that the mark is always in the upper right
corner.
(d) A fourth approach takes a statistical sample of data and makes decisions on this
data sample. Unfortunately, all of these approaches ignore some of the available
data and, in effect, produce a less robust system. Processing time is saved, but
some types of complex objects cannot be recognized.
Note that some of the above steps are actually a part of image processing explained
in Section 4.4.2.
the voltages at the two input leads are nearly equal. If a large voltage differential vi
(say, 10 V) at the input then according to Eq. (4.22), the output voltage should be
extremely high. This never happens in practice, because the device saturates quickly
beyond moderate output voltages in the order of 15 V. From Eqs (4.22–4.23), it is
clear that if the –ve input lead is grounded, i.e., vin = 0 then
vo = Kvip (4.24a)
and if the +ve input lead is grounded, i.e., vip = 0 then
vo = –Kvin (4.24b)
This is the reason why vip is termed non-inverting input and vin is termed inverting
input.
4.5.2 Filters
A filter is a device that allows through only
Dynamic System vs. Analog Filter
the desirable part of a signal, rejecting
the unwanted part. Unwanted signals can The way an analog sensor is defined, any
dynamic system can be interpreted as an
seriously degrade the performance of a
analog filter.
robotic system. External disturbances,
error components in excitations, and noise generated internally within system
components and instrumentation are such spurious signals, which may be removed
by a filter. There are four broad categories of filters, namely, low-pass filters, high-
pass filters, band-pass filters, and band-reject (or notch) filters, which are shown in
Fig. 4.31.
1 1 1 1
the carrier signal is varied in proportion to the amplitude of the data signal
(modulating signal), while keeping the amplitude of the carrier signal constant. This
is called Frequency Modulation (FM). An FM is less susceptible to noise than AM.
In Pulse-Width Modulation (PWM), the carrier signal is a pulse sequence, and its
width is changed in proportion to the amplitude of the data signal, while keeping
the pulse spacing constant. This is shown in Fig. 4.32(d). The PWM signals can be
used directly in controlling a process without having to demodulate them. There
also exists Pulse-Frequency Modulation (PFM), where the carrier signal is a pulse
sequence. Here, the frequency of the pulses is changed in proportion to the value
of the data signal, while keeping the pulse width constant. It has the advantages of
ordinary FM.
Demodulation or detection is the process of extracting the original data signal
from a modulated signal. A simple and straightforward method of demodulation is
by detection of the envelope of the modulated signal.
4.5.4 Analog and Digital Conversions
Most sensors have analog output while much data processing is done using digital
computers. Hence, devices for conversion between these two domains have to be
performed. These can be achieved using an analog-to-digital converter (ADC) and a
digital-to-analog converter (DAC), as mentioned in Chapter 2. Explanation on DAC
is given first as some ADC uses DAC as its component.
1. Digital-to-Analog Converter (DAC) The function of a digital-to-analog-
convertor or DAC is to convert a sequence of digital words stored in a data register,
typically in the straight binary form, into an analog signal. A typical DAC unit is
an active circuit in the integrated circuit (IC) form and consists of a data register
(digital circuits), solid-state switching circuits, resistors, and op-amps powered by an
external power supply. The IC chip that represents the DAC is usually one of many
components mounted on a Printed Circuit Board (PCB), which is the I/O board or
card. This board is plugged into a slot of the PC having DAQ. A typical commercial
DAC is shown in Fig. 2.10.
2. Analog-to-Digital Converter (ADC) An analog-to-digital converter or ADC,
on the other hand, converts an analog signal into the digital form, according to an
appropriate code, before the same is used by a digital processor or a computer. The
process of analog-to-digital conversion is more complex and time consuming than
the digital-to-analog conversion. ADCs are usually more costly, and their conversion
rate is slower than DACs. Several types of ADCs are commercially available.
However, their principle of operation may vary depending on the type. A typical
commercial ADC is shown in Fig. 2.8.
Note that the most fundamental property of any DAC or ADC is their number of
bits for which it is designed, since this is a basic limit on resolution. Units of 8 to
12 bits are most common even though higher bits are also available. Both DAC and
ADC are elements in typical input/output board (or I/O board, or data acquisition
and control card, i.e., DAC or DAQ), which are usually situated on the same digital
interface board.
110 Introduction to Robotics
If one adds sine and cosine functions together, the original signal can be
reconstructed. Equation (4.25) is called a Fourier series, and the collection of
different frequencies present in the equation is called the frequency spectrum or
frequency content of the signal. Even though the signal is in amplitude-time domain,
the frequency spectrum is in the amplitude-frequency domain. For example, for the
function, f(t) = sin(t) of Fig. 4.34(a), which consists of only one frequency with
Sensors, Vision and Signal Conditioning 111
constant amplitude, the plotted signal would be represented by a single line at the
given frequency, as shown in Fig. 4.34(b). If the plot with given frequency and
amplitude is represented by the arrow in Fig. 4.34(b), the same sine function can be
reconstructed. The plots in Fig. 4.35 are similar and represent the following:
1
f(t) = Â sin(nt ) (4.26)
n =1,3,...,15 n
where w = 1.
Amplitude Amplitude
1 1
Time 1 Frequency
Amplitude Amplitude
Time 1 3 5 7 15 Frequency
of the mass that must be accelerated and decelerated by the drive motors of the wrist
and arm. So, it directly affects the performance of the robot. It is a challenge to
sensor designers to reduce size and weight. An early wrist force-torque sensor, for
example, was about 125 mm in diameter but was reduced to about 75 mm in diameter
through careful redesign.
12. Environmental Conditions Power requirement and its easy availability
should be considered. Besides, conditions like chemical reactions including
corrosion, extreme temperatures, light, dirt accumulation, electromagnetic field,
radioactive environments, shock and vibrations, etc., should be taken into account
while selecting a sensor or considering how to shield them.
13. Reliability and Maintainability Reliability is of major importance in all
robot applications. It can be measured in terms of Mean Time To Failure (MTTF) as
the average number of hours between failures that cause some part of the sensor to
become inoperative. In industrial use, the total robot system is expected to be available
as much as 98 or 99% of the working days. Since there are hundreds of components
in a robot system, each one must have a very high reliability. Some otherwise good
sensors cannot stand the daily environmental stress and, therefore, cannot be used
with robots. Part of the requirement for reliability is ease of maintenance. A sensor
that can be easily replaced does not have to be as reliable as one that is hidden in the
depths of the robot. Maintainability is a measure in terms of Mean Time To Repair
(MTTR).
14. Interfacing Interfacing of sensors with signal-conditioning devices and the
controller of the robot is often a determining factor in the usefulness of sensors.
Nonstandard plugs or requirements for nonstandard voltages and currents may make
a sensor too complex and expensive to use. Also, the signals from a sensor must be
compatible with other equipment being used if the system is to work properly.
15. Others Other aspects like initial cost, maintenance cost, cost of disposal and
replacement, reputation of manufacturers, operational simplicity, ease of availability
of the sensors and their spares should be taken into account. In many occasions, these
nontechnical considerations become the ultimate deciding factor in the selection of
sensors for an application.
SUMMARY
Necessity of sensors in robotics, different types of sensors used in robotic applications
and the selection criteria are presented in this chapter. Functional aspects, rather than
their mathematical models, are emphasized so that the reader is able to decide which
sensor to use and when. Different sensors are classified from their functional uses, for
example, position, velocity, acceleration, force, sensors, etc. Special attention has been
paid to vision system, its elements, how it can be processed, etc. Signal-conditioning
units, their characteristics, and when to use what are also explained. Finally guidelines
are provided to select appropriate sensors.
Sensors, Vision and Signal Conditioning 115
EXERCISES
4.1 Define sensitivity and linearity.
4.2 Distinguish accuracy from repeatability.
4.3 State the physical characteristics in sensor selection.
4.4 What are the essential components of a sensor?
4.5 Why are the terms internal and external used to classify sensors?
4.6 Classify internal sensors.
4.7 Name some velocity sensors?
4.8 Why are position sensors not preferred to obtain velocity and acceleration?
4.9 Is there any advantage of external sensors over internal types?
4.10 Name some contact and noncontact type sensors.
4.11 What are the advantages of capacitive proximity sensors?
4.12 What is a machine vision?
4.13 What are the major components in a vision system?
4.14 What is the sensor component in a vision system?
4.15 What are different types of cameras? Explain the vidicon camera.
4.16 What are the typical difficulties in a vision system?
4.17 What is thresholding in vision?
4.18 Why is signal processing important?
4.19 Name at least three devices used in signal conditioning.
4.20 Define different types of filters.
4.21 What are the characteristics one should check while selecting a sensor?
4.22 What is Hough transform?
4.23 What are the static characteristics a sensor should have?
WEB-BASED EXERCISES
Based on Web search, find the answers for the following questions:
4.24 Name at least five commercial companies who make different types of sensors. List the
sensors against each company’s name.
4.25 What are the typical prices of encoders, tachogenerators, and accelerometers?
4.26 What is the price of a CCD camera?
4.27 Name two camera companies and mention which camera you will select for industrial
robot system involved in accurate pick-and-place operation?
4.28 Name a robot manufacturing company who implements vision system in their robots.
4.29 Give a typical significance of a force/torque sensor.
4.30 What command MATLAB uses for digital filtering and image processing?