Computer Architecture

Computer Organization
• Attributes of a • Instruction set, number of
system visible to bits used to represent
the programmer various data types, I/O
• Have a direct mechanisms, techniques
impact on the for addressing memory
logical execution of
a program
Computer Architectural
Architecture attributes include:

Organizational Computer
attributes include: Organization
• Hardware details
transparent to the
programmer, control • The operational units and
signals, interfaces between their interconnections that
the computer and realize the architectural
peripherals, memory specifications
technology used
IBM System
370 Architecture
 IBM System/370 architecture
 Was introduced in 1970
 Included a number of models
 Could upgrade to a more expensive, faster model without having to abandon
original software
 New models are introduced with improved technology, but retain the same
architecture so that the customer’s software investment is protected
 Architecture has survived to this day as the architecture of IBM’s mainframe
product line
Structure and Function

 Hierarchical system
 Structure
 Set of interrelated subsystems
 The way in which components
 Hierarchical nature of complex relate to each other
systems is essential to both their
 Function
design and their description
 The operation of individual
 Designer need only deal with a components as part of the
particular level of the system at a structure
time
 Concerned with structure and
function at each level
Function
 A computer can perform four
basic functions:

● Data processing
● Data storage
● Data movement
● Control
 The
Computer
Structure
  CPU – controls the operation of
the computer and performs its data
There are four processing functions
main structural  Main Memory – stores data
components
of the computer:  I/O – moves data between the
computer and its external
environment

 System Interconnection – some

mechanism that provides for
communication among CPU, main
memory, and I/O
  Control Unit
CPU  Controls the operation of the CPU and
hence the computer
Major structural
 Arithmetic and Logic Unit (ALU)
components:  Performs the computer’s data processing
function

 Registers
 Provide storage internal to the CPU

 CPU Interconnection
 Some mechanism that provides for
communication among the control unit,
ALU, and registers
 Summary
Introduction

Chapter 1
 Computer Organization
 Structure
 CPU
 Computer Architecture  Main memory
 Function
 I/O
 Data processing
 System interconnection
 Data storage  CPU structural components
 Data movement  Control unit
 Control  ALU
 Registers
 CPU interconnection
+
Internet Resources

http://www.williamstallings.com/Com
puterOrganization/
History of Computers
First Generation: Vacuum Tubes
 ENIAC
 Electronic Numerical Integrator And Computer
 Designed and constructed at the University of Pennsylvania
 Started in 1943 – completed in 1946
 By John Mauchly and John Eckert

 World’s first general purpose electronic digital computer

 Army’s Ballistics Research Laboratory (BRL) needed a way to supply trajectory tables for
new weapons accurately and within a reasonable time frame
 Was not finished in time to be used in the war effort

 Its first task was to perform a series of calculations that were used to help determine
the feasibility of the hydrogen bomb

 Continued to operate under BRL management until 1955 when it was disassembled
John von Neumann
EDVAC (Electronic Discrete Variable Computer)
 First publication of the idea was in 1945

 Stored program concept

 Attributed to ENIAC designers, most notably the mathematician John von
Neumann
 Program represented in a form suitable for storing in memory alongside
the data

 IAS computer
 Princeton Institute for Advanced Studies
 Prototype of all subsequent general-purpose computers
 Completed in 1952
Structure of von Neumann Machine
Structure
of
IAS
Computer
 Registers
Memory buffer register • Contains a word to be stored in memory or sent to the I/O unit
(MBR) • Or is used to receive a word from memory or from the I/O unit

Memory address register • Specifies the address in memory of the word to be written from or read
(MAR) into the MBR

Instruction register (IR) • Contains the 8-bit opcode instruction being executed

Instruction buffer register • Employed to temporarily hold the right-hand instruction from a word in
(IBR) memory

• Contains the address of the next instruction pair to be fetched from

Program counter (PC) memory

Accumulator (AC) and • Employed to temporarily hold operands and results of ALU operations
multiplier quotient (MQ)
Commercial Computers
UNIVAC
 1947 – Eckert and Mauchly formed the Eckert-Mauchly Computer
Corporation to manufacture computers commercially

 UNIVAC I (Universal Automatic Computer)

 First successful commercial computer
 Was intended for both scientific and commercial applications
 Commissioned by the US Bureau of Census for 1950 calculations

 The Eckert-Mauchly Computer Corporation became part of the UNIVAC

division of the Sperry-Rand Corporation

 UNIVAC II – delivered in the late 1950’s

 Had greater memory capacity and higher performance

 Backward compatible
 Was the major manufacturer of
punched-card processing equipment

 Delivered its first electronic stored-

program computer (701) in 1953
 Intended primarily for scientific
applications

 Introduced 702 product in 1955

 Hardware features made it suitable
IBM
to business applications

 Series of 700/7000 computers

established IBM as the
overwhelmingly dominant
computer manufacturer
History of Computers
Second Generation: Transistors
 Smaller

 Cheaper

 Dissipates less heat than a vacuum tube

 Is a solid state device made from silicon

 Was invented at Bell Labs in 1947

 It was not until the late 1950’s that fully transistorized computers
were commercially available
 Table 2.2
Computer Generations

Computer Generations
Second Generation Computers

 Introduced:  Appearance of the Digital

 More complex arithmetic and Equipment Corporation (DEC) in
logic units and control units 1957
 The use of high-level
programming languages  PDP-1 was DEC’s first computer
 Provision of system software
 This began the mini-computer
which provided the ability to:
phenomenon that would become
 load programs so prominent in the third
 move data to peripherals and generation
libraries
 perform common
computations
 IBM
7094
Configuration
History of Computers
Third Generation: Integrated Circuits

 1958 – the invention of the integrated circuit

 Discrete component
 Single, self-contained transistor
 Manufactured separately, packaged in their own containers, and soldered
or wired together onto masonite-like circuit boards
 Manufacturing process was expensive and cumbersome

 The two most important members of the third generation were the
IBM System/360 and the DEC PDP-8
Microelectronics
  A computer consists of gates,
Integrated memory cells, and
interconnections among these
Circuits elements

 The gates and memory cells are

 Data storage – provided by constructed of simple digital
memory cells electronic components

 Data processing – provided by  Exploits the fact that such

gates components as transistors, resistors,
and conductors can be fabricated
 Data movement – the paths among from a semiconductor such as silicon
components are used to move data
from memory to memory and from  Many transistors can be produced at
memory through gates to memory the same time on a single wafer of
silicon
 Control – the paths among
components can carry control  Transistors can be connected with a
signals processor metallization to form
circuits
 Wafer,
Chip,
and
Gate
Relationship
Chip Growth
Moore’s Law
1965; Gordon Moore – co-founder of Intel

Observed number of transistors that could be put on

a single chip was doubling every year

Consequences of Moore’s law:

The pace slowed to a
doubling every 18
months in the 1970’s
The cost of Computer
but has sustained that computer logic
The electrical
Reduction in
path length is becomes smaller
rate ever since and memory and is more power and Fewer interchip
shortened,
circuitry has convenient to use cooling connections
increasing in a variety of
fallen at a requirements
operating speed environments
dramatic rate
 LSI
Large
Scale
Later Integration

Generations
VLSI
Very Large
Scale
Integration

ULSI
Semiconductor Memory Ultra Large
Microprocessors Scale
Integration
 Semiconductor Memory

In 1970 Fairchild produced the first relatively capacious semiconductor memory

Chip was about the size of Could hold 256 bits of
Non-destructive Much faster than core
a single core memory

In 1974 the price per bit of semiconductor memory dropped below the price per bit of core
There has been a continuing and rapid decline in memory
Developments in memory and processor technologies
memory cost accompanied by a corresponding increase
changed the nature of computers in less than a decade
in physical memory density

Since 1970 semiconductor memory has been through 13 generations

Each generation has provided four times the storage density of the previous generation, accompanied by declining
cost per bit and declining access time
 Microprocessors
 The density of elements on processor chips continued to rise
 More and more elements were placed on each chip so that fewer and fewer
chips were needed to construct a single computer processor

 1971 Intel developed 4004

 First chip to contain all of the components of a CPU on a single chip
 Birth of microprocessor

 1972 Intel developed 8008

 First 8-bit microprocessor

 1974 Intel developed 8080

 First general purpose microprocessor
 Faster, has a richer instruction set, has a large addressing capability
 Microprocessor Speed
Techniques built into contemporary processors include:

• Processor moves data or instructions into a conceptual

Pipelining pipe with all stages of the pipe processing
simultaneously

Branch • Processor looks ahead in the instruction code fetched

from memory and predicts which branches, or groups

prediction of instructions, are likely to be processed next

Data flow • Processor analyzes which instructions are dependent

on each other’s results, or data, to create an optimized

analysis schedule of instructions

Speculative • Using branch prediction and data flow analysis, some

processors speculatively execute instructions ahead of
their actual appearance in the program execution,

execution holding the results in temporary locations, keeping

execution engines as busy as possible
 Performance
Balance
 Adjust the organization and Increase the number of
bits that are retrieved at
architecture to compensate one time by making
DRAMs “wider” rather
for the mismatch among the than “deeper” and by
using wide bus data
capabilities of the various paths
components
 Architectural examples Reduce the frequency of
memory access by
include: incorporating
increasingly complex
and efficient cache
structures between the
processor and main
memory

Increase the interconnect

Change the DRAM
bandwidth between
interface to make it
processors and memory
more efficient by
by using higher speed
including a cache or
buses and a hierarchy of
other buffering scheme
buses to buffer and
on the DRAM chip
structure data flow
Typical I/O Device Data Rates
Improvements in Chip Organization
and Architecture
 Increase hardware speed of processor
 Fundamentally due to shrinking logic gate size
 More gates, packed more tightly, increasing clock rate
 Propagation time for signals reduced

 Increase size and speed of caches

 Dedicating part of processor chip
 Cache access times drop significantly

 Change processor organization and architecture

 Increase effective speed of instruction execution
 Parallelism
Problems with Clock Speed and Login
Density
 Power
 Power density increases with density of logic and clock speed
 Dissipating heat

 RC delay
 Speed at which electrons flow limited by resistance and capacitance
of metal wires connecting them
 Delay increases as RC product increases
 Wire interconnects thinner, increasing resistance
 Wires closer together, increasing capacitance

 Memory latency
 Memory speeds lag processor speeds
Processor
Trends
Multicore
The use of multiple processors on
the same chip provides the
potential to increase performance
without increasing the clock rate

Strategy is to use two simpler

processors on the chip rather than
one more complex processor

With two processors larger

caches are justified

As caches became larger it made

performance sense to create two
and then three levels of cache on
a chip
Many Integrated Core (MIC)
Graphics Processing Unit (GPU)
MIC GPU
 Leap in performance as well as the  Core designed to perform parallel
challenges in developing software operations on graphics data
to exploit such a large number of
cores  Traditionally found on a plug-in
graphics card, it is used to encode
 The multicore and MIC strategy and render 2D and 3D graphics as
involves a homogeneous collection well as process video
of general purpose processors on a
single chip  Used as vector processors for a
variety of applications that require
repetitive computations
 Overview ARM
 Results of decades of design effort on
complex instruction set computers (CISCs) Intel
 Excellent example of CISC design

 Incorporates the sophisticated design

principles once found only on mainframes
and supercomputers

 An alternative approach to processor design

is the reduced instruction set computer
x86 Architecture
(RISC)

 The ARM architecture is used in a wide

variety of embedded systems and is one of
the most powerful and best designed RISC
based systems on the market

 In terms of market share Intel is ranked as CISC

the number one maker of microprocessors
for non-embedded systems
RISC
Embedded Systems
Requirements and Constraints
Small to large systems,
implying different cost
constraints and different needs
for optimization and reuse

Relaxed to very strict

Different models of requirements and
computation ranging from combinations of different
discrete event systems to quality requirements with
hybrid systems respect to safety, reliability,
real-time and flexibility

Different application
characteristics resulting in
static versus dynamic loads,
slow to fast speed, compute Short to long life times
versus interface intensive
tasks, and/or combinations
thereof

Different environmental
conditions in terms of
radiation, vibrations, and
humidity
Possible Organization of an Embedded System
System Clock
Performance Factors
and
System Attributes
 Benchmarks
For example, consider this high-level language statement:

A = B + C /* assume all quantities in main memory */

With a traditional instruction set architecture, referred to as a complex instruction

set computer (CISC), this instruction can be compiled into one processor
instruction:

add mem(B), mem(C), mem (A)

On a typical RISC machine, the compilation would look something like

this:
load mem(B), reg(1);
load mem(C), reg(2);
add reg(1), reg(2), reg(3);
store reg(3), mem (A)
 Desirable Benchmark Characteristics

Written in a high-level language, making it portable across

different machines

Representative of a particular kind of programming style,

such as system programming, numerical programming, or
commercial programming

Can be measured easily

Has wide distribution

System Performance Evaluation
Corporation (SPEC)
 Benchmark suite
 A collection of programs, defined in a high-level language
 Attempts to provide a representative test of a computer in a particular
application or system programming area

 SPEC
 An industry consortium
 Defines and maintains the best known collection of benchmark suites
 Performance measurements are widely used for comparison and research
purposes
  Best known SPEC benchmark suite

 Industry standard suite for processor

intensive applications
SPEC  Appropriate for measuring performance for
applications that spend most of their time
doing computation rather than I/O

CPU2006  Consists of 17 floating point programs

written in C, C++, and Fortran and 12 integer
programs written in C and C++

 Suite contains over 3 million lines of code

 Fifth generation of processor intensive suites

from SPEC
  Gene Amdahl [AMDA67]

 Deals with the potential speedup of a

program using multiple processors compared
to a single processor
Amdahl’s  Illustrates the problems facing industry in the
development of multi-core machines
Law  Software must be adapted to a highly
parallel execution environment to exploit
the power of parallel processing

 Can be generalized to evaluate and design

technical improvement in a computer system
Amdahl’s Law
Little’s Law
 Fundamental and simple relation with broad applications

 Can be applied to almost any system that is statistically in steady

state, and in which there is no leakage

 Queuing system
 If server is idle an item is served immediately, otherwise an arriving item
joins a queue
 There can be a single queue for a single server or for multiple servers, or
multiples queues with one being for each of multiple servers

 Average number of items in a queuing system equals the average

rate at which items arrive multiplied by the time that an item
spends in the system
 Relationship requires very few assumptions
 Because of its simplicity and generality it is extremely useful
 Summary Computer Evolution
and Performance
Chapter 2
 Multi-core
 First generation computers  MICs
 Vacuum tubes
 GPGPUs
 Second generation computers
 Transistors  Evolution of the Intel x86
 Third generation computers
 Embedded systems
 Integrated circuits
 ARM evolution
 Performance designs
 Microprocessor speed
 Performance assessment
 Performance balance
 Clock speed and instructions per
second
 Chip organization and
 Benchmarks
architecture
 Amdahl’s Law