Chapter Four

Interactions in HCI
 Chapter Four : Interactions in HCI
 Contents of the lecture
 Interaction
 Models of interaction
 Ergonomics/Human Factor
 Interaction Styles
 Introduction to Interaction

•  From a computer science perspective, the focus is on interaction and

specifically on interaction between one or more humans and one or more
computational machines.

• The classical situation that comes to mind is a person using an interactive

graphics program on a workstation. But it is clear that varying what is
meant by interaction, human, and machine leads to a rich space of
possible topics, some of which, while we might not wish to exclude them
as part of human-computer interaction, we would, nevertheless, wish to
identify as peripheral to its focus.
 Interactions…
•
Take the notion of machine. Instead of workstations, computers may be in the form of
embedded computational machines, such as parts of spacecraft cockpits or
microwave ovens. Because the techniques for designing these interfaces bear so much
relationship to the techniques for designing workstations interfaces, they can be
profitably treated together.
•But if we weaken the computational and interaction aspects more and treat the design
of machines that are mechanical and passive, such as the design of a hammer, we are
clearly on the margins, and generally the relationships between humans and hammers
would not considered part of human-computer interaction. Such relationships clearly
would be part of general human factors, which studies the human aspects of all
designed devices, but not the mechanisms of these devices.
•Human-computer interaction, by contrast, studies both the mechanism side and the
human side, but of a narrower class of devices.
•For more Information's:
https://web.archive.org/web/20140817165957/http://old.sigchi.org/cdg/cdg2.html#2_1
 Interactions …

• Human–computer interaction (commonly referred to as HCI)

researches the design and use of computer technology, focused on the
interfaces between people (users) and computers. Researchers in the field
of HCI both observe the ways in which humans interact with computers
and design technologies that let humans interact with computers in novel
ways.
• As a field of research, human-computer interaction is situated at the
intersection of computer science, behavioral sciences, design, 
media studies, and several other fields of study
 Interactions …
• As  the book of “The Psychology of Human-Computer Interaction” explains
unlike other tools with only limited uses (such as a hammer, useful for
driving nails but not much else), a computer has many uses and this takes
place as an “open-ended dialog between the user and the computer “.
• The notion of dialog links human-computer interaction to human-to-human
interaction, an analogy which is crucial to theoretical considerations in the
field.
• Humans interact with computers in many ways; and the interface between
humans and the computers they use is crucial to facilitating this interaction.
 What is the term Ergonomics is about ?
Definitions of Ergonomics
• Ergonomics word derived form Greek word i.e Ergon [work] and nomos
[natural flaws ].
• Ergonomics it is the study of people in there working environment
• Ergonomics is the study of psychology and systems constraint which is
concern in HCI.
• The discipline of science that deals with the relationship of human being with
the system .
• Ergonomics is the science designing user interaction with equipment and work
places to fit to the user .
 Ergonomics …

Human anthropometry in relation to workspace design

Arrangement of displays and controls, link analysis
Human cognitive and sensory limits
Sensory and perceptual effects of CRT and other display technologies, legibility,
display design
Control design
Fatigue and health issues
Furniture and lighting design
Temperature and environmental noise issues
Design for stressful or hazardous environments
Design for the disabled
 Ergonomics..

•
 Human factors or ergonomics

• Human factors is the application of psychological and physiological

principles to the engineering and design of products, processes, and systems.
• The goal of human factors is to :
 Reduce Human Error
 Increase productivity, and enhance safety
 And comfort with a specific focus on the interaction between the human and
the thing of interest.
Ergonomics
 Interactions …
• Humans interact with computers in many ways;
• The interface between humans and computers is crucial to facilitate
this interaction.
• Desktop applications, internet browsers, handheld computers, ERP,
and computer kiosks make use of the prevalent graphical user interfaces
(GUI) of today.
ERP…
 What is interface ?

• In computing, an interface is a shared boundary across which two or more

separate components of a computer system exchange information. The exchange
can be between software, computer hardware, peripheral devices, humans, and
combinations of these.
 Interfaces ….
• Desktop applications, internet browsers, handheld computers, and computer
kiosks make use of the prevalent graphical user interfaces (GUI) of today.
• (VUI) are used for speech recognition and synthesizing systems, and the
emerging multi-modal and Gestalt User Interfaces (GUI) allow humans to
engage with embodied character agents in a way that cannot be achieved with
other interface paradigms.
• Sources : https://uxmisfit.com/2019/04/23/ui-design-in-practice-gestalt-
principles/
 (VUI)…
•

e r f ac e s
t
Voice user in
 Interactions…
• The growth in human-computer interaction field has been in quality of
interaction, and in different branching in its history.
• Instead of designing regular interfaces, the different research branches
have had different focus on the concepts of multimodality rather than
unimodality, intelligent adaptive interfaces rather than command/action
based ones, and finally active rather than passive interfaces.
 Interactions….
• An important facet of HCI is the securing of user satisfaction (or simply
End User Computing Satisfaction). “Because human–computer interaction
studies a human and a machine in communication, it draws from
supporting knowledge on both the machine and the human side.
• On the machine side, techniques in computer graphics, 
operating systems, programming languages, and development
environments are relevant.
• On the human side, communication theory, graphic and 
industrial design disciplines, linguistics, social sciences, 
cognitive psychology, social psychology, and human factors such as 
computer user satisfaction are relevant.
 Interactions…
• Due to the multidisciplinary nature of HCI, people with
different backgrounds contribute to its success. HCI is also
sometimes termed as:
human–machine interaction (HMI), 
man–machine interaction (MMI) or
 Computer–human interaction (CHI).
 Interactions...
• Poorly designed human-machine interfaces can lead to many unexpected
problems.
• A classic example of this is the Three Mile Island accident, a nuclear
meltdown accident, where investigations concluded that the design of the
human–machine interface was at least partly responsible for the disaster.
• Sources : https://en.wikipedia.org/wiki/Three_Mile_Island_accident
 Interactions…

• Similarly, accidents in aviation have resulted from manufacturers’

decisions to use non-standard flight instrument or throttle quadrant
layouts: even though the new designs were proposed to be superior in
basic human–machine interaction, pilots had already ingrained the
“standard” layout and thus the conceptually good idea actually had
undesirable results.
 Brainstorming questions
• Dear Students ,what do you think?
• Human–computer interaction studies the ways in which humans make, or
don’t make, use of computational artifacts, systems and infrastructures. In
doing so, much of the research in the field seeks to improve human-
computer interaction by improving the usability of computer interfaces. 
• How usability is to be precisely understood, how it relates to other social
and cultural values and when it is, and when it may not be a desirable
property of computer interfaces is increasingly debated ???
Usability …
 Research Directions…

 Much of the research in the field of human-computer interaction takes an

interest in:
 Methods for designing novel computer interfaces, thereby optimizing a
design for a desired property such as, e.g., learnability or efficiency of use.
 Methods for implementing interfaces, e.g., by means of software libraries.
 Methods for evaluating and comparing interfaces with respect to their
usability and other desirable properties.
 Methods for studying human computer use and its sociocultural
implications more broadly.
 Research Directions…
• Models and theories of human computer use as well as conceptual
frameworks for the design of computer interfaces, such as, e.g., cognitivist
 user models, Activity Theory or ethnomethodologically accounts of
human computer use.
• Perspectives that critically reflect upon the values that underlie
computational design, computer use and HCI research practice.
 Interaction styles

 Interaction is communication between computer and human (user)

For a successful enjoyable communication interface style has its own
importance .Interface styles including
• Command line interface
• Menus
• Natural language Question answer and query dialog
• Form fills and spreadsheets
• WIMP
• Point and click
• Three-dimensional interfaces.
 Style of User interfaces
• Command line
• the oldest of the interfaces and It involves the computer responding
to commands typed by the operator.
• has the drawback that it requires the operator to remember a range of
different commands and is not ideal for novice users
• But it can be quick to use as long as the user knows the correct
commands.
 Styles of User interfaces…
• Graphical User Interface(GUI)
• allows users to interact with electronic devices through Windows, Icons,
Menus, Pointing, Graphics
• GUIs were introduced in reaction to the perceived steep learning
curve of command-line interfaces
• The actions in a GUI are usually performed through direct manipulation of the
graphical elements
• Provides users with basic level of familiarity
• They are essential to produce good interfaces
• GUI enhance the efficiency and ease of use of computer system.
• But, memory requirement is high
 Style of User interfaces …

• Menu driven
• Offers the user lists of
options which they can
select by pressing a
particular key on the
keyboard, often on a
touch-screen device.
• Is easy to use but getting
to one particular option
can often involve
working through many
different menu screens

Common in cash machines e.g.

ATM
 Types of User interfaces
• Form based
• uses text-boxes, drop-down menus, text areas, check boxes,
radio boxes and buttons to create an electronic form which a
user completes in order to enter data into a system.
• commonly used on websites to gather data from a user, or in call
centers to allow operators to quickly enter information gathered
over the phone.
 Style of User interfaces …
• Natural language
• users interacts with the computer by talking to it
• Sometimes referred to as a 'conversational interface', this
interface simulates having a conversation with a computer.
 Style of User interfaces …
• Gesture-driven interface
• A recent innovation in user-interfaces
• controlled by a human making physical gestures which are then
detected by the computer
• E.g. Sixth sense device - gesture-based wearable computer
system which uses cameras to detect human motion to
determine what the user wants to do
 Menu driven Interface
•
Three-dimensional interfaces.
 Design Principles

• The user interacts directly with hardware for the

human input and output such as displays, e.g. through a 
graphical user interface. The user interacts with the computer over this
software interface using the given input and output (I/O) hardware.
• Software and hardware must be matched, so that the processing of the user
input is fast enough, the latency of the computer output is not disruptive to
the workflow.
Design principle
Gesture recognition..
 When evaluating a current user interface, or designing a new user interface,
it is important to keep in mind the following experimental design principles:

 Early focus on user(s) and task(s): Establish how many users are needed to
perform the task(s) and determine who the appropriate users should be; someone
who has never used the interface, and will not use the interface in the future, is
most likely not a valid user. In addition, define the task(s) the users will be
performing and how often the task(s) need to be performed.
Empirical measurement:  Test the interface early on with real users who come
in contact with the interface on a daily basis. Keep in mind that results may vary
with the performance level of the user and may not be an accurate depiction of the
typical human-computer interaction.
 Design principles…
• Establish quantitative usability specifics such as: the number of users
performing the task(s), the time to complete the task(s), and the number of
errors made during the task(s).
 Iterative design: After determining the users, tasks, and empirical
measurements to include, perform the following iterative design steps:
  Iterative Design Steps…

1. Design the user interface

2. Test
3. Analyze results
4. Repeat
Notice: Repeat the iterative design process until a sensible, user-
friendly interface is created
 Methodologies

• A number of diverse methodologies outlining techniques for human–

computer interaction design have emerged since the rise of the field in the
1980s.
• Most design methodologies stem from a model for how users, designers,
and technical systems interact.
• Early methodologies, for example, treated users’ cognitive processes as
predictable and quantifiable and encouraged design practitioners to look
to cognitive science results in areas such as memory when designing user
interfaces.
•
 Methodologies…
• Modern models tend to focus on a constant feedback and conversation
between users, designers, and engineers and push for technical systems to
be wrapped around the types of experiences users want to have, rather
than wrapping user experience around a completed system.
 Methodologies'…
• Activity theory: used in HCI to define and study the context in which
human interactions with computers take place. Activity theory provides a
framework to reason about actions in these contexts, analytical tools with
the format of checklists of items that researchers should consider, and
informs design of interactions from an activity-centric perspective.
 Methodologies…
• User-centered design: user-centered design (UCD) is a modern, widely practiced
design philosophy rooted in the idea that users must take center-stage in the design
of any computer system. Users, designers and technical practitioners work together
to articulate the wants, needs and limitations of the user and create a system that
addresses these elements.
• Often, user-centered design projects are informed by ethnographic studies of the
environments in which users will be interacting with the system. This practice is
similar but not identical to participatory design, which emphasizes the possibility for
end-users to contribute actively through shared design sessions and workshops.
 Methodologies…

• Principles of user interface design: these are seven principles of 

user interface design that may be considered at any time during the design of
a user interface in any order:
tolerance,
simplicity,
visibility,
affordance,
consistency,
structure and
feedback.
 Methodologies…
• Value sensitive design: Value Sensitive Design (VSD) is a method for
building technology that account for the values of the people who use the
technology directly, as well as those who the technology affects, either
directly or indirectly.
• VSD uses an iterative design process that involves three types of
investigations: conceptual, empirical and technical.
 Methodologies..
• Conceptual investigations aim at understanding and articulating the various
stakeholders of the technology, as well as their values and any values conflicts that
might arise for these stakeholders through the use of the technology.
• Empirical investigations are qualitative or quantitative design research studies
used to inform the designers’ understanding of the users’ values, needs, and
practices.
• Technical investigations : can involve either analysis of how people use related
technologies, or the design of systems to support values identified in the
conceptual and empirical investigations
 Human–computer interface

• The human–computer interface can be described as the point of communication

between the human user and the computer. The flow of information between the
human and computer is defined as the loop of interaction. The loop of interaction
has several aspects to it, including:
 Visual Based: The visual based human computer inter-action is probably the most
widespread area in HCI research.
 Audio Based: The audio based interaction between a computer and a human is
another important area of in HCI systems. This area deals with information
acquired by different audio signals.
 Human–computer interface

 Task environment: The conditions and goals set upon the user.
 Machine environment: The environment that the computer is connected
to, e.g. a laptop in a college student’s dorm room.
 Areas of the interface: Non-overlapping areas involve processes of the
human and computer not pertaining to their interaction. Meanwhile, the
overlapping areas only concern themselves with the processes pertaining
to their interaction.
 Human–computer interface

 Input flow: The flow of information that begins in the task environment,
when the user has some task that requires using their computer.
 Output: The flow of information that originates in the machine environment.
 Feedback: Loops through the interface that evaluate, moderate, and confirm
processes as they pass from the human through the interface to the computer
and back.
 Fit: This is the match between the computer design, the user and the task to
optimize the human resources needed to accomplish the task.
Human–computer interface
 Topics in HCI include:

• User customization: End-user development studies how ordinary users

could routinely tailor applications to their own needs and use this power to
invent new applications based on their understanding of their own
domains. With their deeper knowledge of their own knowledge domains,
users could increasingly be important sources of new applications at the
expense of generic systems programmers (with systems expertise but low
domain expertise).
 Topics in HCI include…

• Embedded computation: Computation is passing beyond computers into every

object for which uses can be found. Embedded systems make the environment
alive with little computations and automated processes, from computerized cooking
appliances to lighting and plumbing fixtures to window blinds to automobile
braking systems to greeting cards. To some extent, this development is already
taking place. The expected difference in the future is the addition of networked
communications that will allow many of these embedded computations to
coordinate with each other and with the user. Human interfaces to these embedded
devices will in many cases be very different from those appropriate to workstations
 Topics in HCI include…

 Augmented reality The fundamental idea of AR is to combine , or mix, the view of the real
environment with additional, virtual content that is presented through computer graphics.
 Its convincing effect is achieved by ensuring that the virtual content is aligned and registered with the
real objects.

 As a person moves in an environment and their perspective view of real objects changes, the virtual
content should also be presented from the same perspective.

 Examples of augmented reality experiences include Snapchat lenses and the game Pokémon Go. 
 Topics in HCI include…

• Social computing: In recent years, there has been an explosion of social

science research focusing on interactions as the unit of analysis. Much of
this research draws from psychology, social psychology, and sociology.
For example, one study found out that people expected a computer with a
man’s name to cost more than a machine with a woman’s name. 
• Other research finds that individuals perceive their interactions with
computers more positively than humans, despite behaving the same way
towards these machines.
 Topics in HCI include…

• Knowledge-driven human-computer interaction: In human and

computer interactions, there usually exists a semantic gap between human
and computer’s understandings towards mutual behaviors. 
Ontology (information science), as a formal representation of domain-
specific knowledge, can be used to address this problem, through solving
the semantic ambiguities between the two parties
 Home work
• 1. how gesture recognition works and why it is important?
• 2. how ERP works and explain special considerations to be taken ?
• 3. how 3_D User Interface(3D UI) works ? Is it paradigm shifter ?
 how gesture recognition works and why it is important?

• Gesture recognition is an alternative user interface for providing real-

time data to a computer. Instead of typing with keys or tapping on a touch
screen, a motion sensor perceives and interprets movements as the
primary source of data input. This is what happens between the time a
gesture is made and the computer reacts.
• 1. A camera feeds image data into a sensing device that is connected to a
computer. The sensing device typically uses an infrared sensor or
projector for the purpose of calculating depth,
 Gestures..
• 2. Specially designed software identifies meaningful gestures from a
predetermined gesture library where each gesture is matched to a
computer command.
• 3. The software then correlates each registered real-time gesture, interprets
the gesture and uses the library to identify meaningful gestures that match
the library.
• 4. Once the gesture has been interpreted, the computer executes the
command correlated to that specific gesture.
 How ERP works and explain special considerations to be taken ?

• When ERP is delivered in a cloud-based software-as-a-service (SaaS)

 model, it runs on a network of remote servers instead of inside a
company’s server room. The cloud provider patches, manages and updates
the software several times a year – rather than having to start from scratch
with overhauling an onsite system. Also, a company is always up to date
on the most recent ERP software.
• The cloud offers a more affordable alternative for ERP because it
eliminates the need for bespoke software, onsite hardware and additional
IT staff.
 r 4
p te
h a
f c f o r !!
d o u s !
En y o i o n
 han k n t
t te
T r A
 ou
y
