Cloud Computing _IT492

— Chapter 4 —
Part I: Fundamental Cloud Computing
Cloud-Enabling Technology

Text Book: “Cloud Computing: Concepts, technology and Architecture

by Thomas Earl, Zaigham Mahmood and Ricardo puttini

1
 Outlines
 Broadband networks and internet architecture

 Data center technology

 Virtualization technology

 Web technology

 Multitenant technology

2
 Broadband networks and internet
architecture
 All clouds must be connected to a network

 Internetworks, or the Internet, allow for the remote

provisioning of IT resources and are directly supportive of
ubiquitous (universal) network access.

 Cloud consumers have the option of accessing the cloud using

only private and dedicated network links in LANs.

 The potential of cloud platforms therefore generally grows in

parallel with advancements in Internet connectivity and
service quality.
3
 Broadband networks and internet
architecture
Internet Service Providers (ISPs)

 Internet’s largest backbone networks, established and

deployed by ISPs, are interconnected by core routers.

 ISP network interconnects to other ISP networks and various

organizations.

4
Broadband networks and internet
architecture
Internet Service Providers (ISPs)

5
 Broadband networks and internet
architecture
Internet Service Providers (ISPs)

 The concept of the Internet was based on a decentralized

provisioning and management model.

 ISPs can freely deploy, operate, and manage their networks in

addition to selecting partner ISPs for interconnection.

 Governmental and regulatory laws dictate the service

provisioning conditions for organizations and ISPs both
within and outside of national borders.

6
 Broadband networks and internet
architecture
An abstraction of the internetworking structure of the
Internet.
 Worldwide connectivity is enabled through a hierarchical
topology composed of Tiers 1, 2, and 3.

 The core Tier 1 is made of large-scale, international cloud

providers that oversee massive interconnected global
networks, which are connected to Tier 2’s large regional
providers.

 The interconnected ISPs of Tier 2 connect with Tier 1

providers, as well as the local ISPs of Tier 3.

7
 Broadband networks and internet
architecture
An abstraction of the internetworking structure of the
Internet.

8
 Broadband networks and internet
architecture

 The communication links and routers of the Internet and ISP

networks are IT resources that are distributed among
countless traffic generation paths.

 Two fundamental components used to construct the

internetworking architecture are:

 Connectionless packet switching (datagram networks).

 Router-based interconnectivity.

9
 Broadband networks and internet
architecture
Connectionless Packet Switching

 Connectionless Packet Switching: Datagram Networks

 End-to-end (sender-receiver pair) data flows are divided into

packets of a limited size.

 Packets are processed through network switches and routers,

then forwarded from one intermediary node to the next.

10
 Broadband networks and internet
architecture
Router-Based Interconnectivity

 A router is a device that is connected to multiple networks

through which it forwards packets
 Each packet is individually processed

 Use multiple alternative network routes.

 Routers manage network traffic and evaluate the most efficient

hop for packet delivery, since they are privy to both the packet
source and packet destination.

11
Broadband networks and internet
architecture
Router-Based Interconnectivity

12
 Broadband networks and internet
architecture
Physical Network

 IP packets are transmitted through underlying physical

networks that connect adjacent nodes, such as Ethernet, ATM
network, and the 3G mobile.

 Physical Networks comprise a:

 Data link layer that controls data transfer between

neighboring nodes,
 Physical layer that transmits data bits through both wired

and wireless media.

13
 Broadband networks and internet
architecture
Transport Layer Protocol

 Transport layer protocols, such as

 Transmission Control Protocol (TCP)
 User Datagram Protocol (UDP),

 use the IP to provide standardized, end-to-end communication

support that facilitates the navigation of data packets across
the Internet.

14
 Broadband networks and internet
architecture

Application Layer Protocol

 Protocols such as HTTP, SMTP for e-mail, BitTorrent for P2P

use transport layer protocols to standardize and enable specific
data packet transferring methods over the Internet.

 Many other protocols also fulfill application-centric

requirements and use either TCP/IP or UDP as their primary
method of data transferring across the Internet and LANs.

15
Broadband networks and internet
architecture
Internet Reference Model and the protocol stack.

16
 Broadband networks and internet
architecture

Summary of Key Points

 Cloud consumers and cloud providers typically use the Internet

to communicate, which is based on a decentralized
provisioning and management model and is not controlled by
any centralized entities.

 The main components of internetworking architecture are

connectionless packet switching and router-based
interconnectivity, which use network routers and switches.

17
 Outlines
 Broadband networks and internet architecture

 Data center technology

 Virtualization technology

 Web technology

 Multitenant technology

18
18
 Data center technology

 Grouping IT resources in close proximity with one another,

 Allows for power sharing, higher efficiency in shared IT

resource usage, and improved accessibility for IT personnel.

 Modern data centers exist as specialized IT infrastructure used

to house centralized IT resources, such as servers, databases,
networking and telecommunication devices, and software
systems.

19
Data center technology

Data center 20
 Data center technology

 Data centers are typically comprised of the following

technologies and components:
 Virtualization
 Standardization and Modularity
 Automation
 Remote Operation and Management
 High Availability
 Security-Aware Design, Operation, and Management Facilities
 Computing Hardware
 Storage Hardware
 Network Hardware

21
 Data center technology

Virtualization
 Data centers consist of both physical and virtualized IT
resources.

 The physical IT resource layer refers to the facility

infrastructure that houses computing/networking systems and
equipment, together with hardware systems and their
operating systems

22
 Data center technology

Virtualization
 The resource abstraction and control of the virtualization
layer is comprised of operational and management tools that
are often based on virtualization platforms that abstract the
physical computing and networking IT resources as virtualized
components that are easier to allocate, operate, release,
monitor, and control.

23
Data center technology

Virtualization
 Hypervisor
 A hypervisor or
virtual machine
monitor (VMM)
is computer
software or
hardware, that
creates and runs
virtual machines.
 VIM
 Virtualization
infrastructure
management

24
 Data center technology

Standardization and Modularity

 Data centers are:

 Built upon standardized commodity hardware and designed with
modular architectures
 Aggregating multiple identical building blocks of facility infrastructure
and equipment to support scalability, growth, and speedy hardware
replacements.

25
 Data center technology

Standardization and Modularity

 Modularity and standardization are key requirements for

reducing investment and operational costs: acquisition,
deployment, operation, and maintenance processes.

26
 Data center technology

Automation

 Data centers have specialized platforms that automate tasks

like provisioning, configuration and monitoring without
supervision.

 Advances in data center management platforms and tools

leverage autonomic computing technologies to enable self
configuration and self-recovery.

27
 Data center technology

Remote Operation and Management

 Most of the operational and administrative tasks of IT

resources in data centers are commanded through the
network’s remote consoles and management systems.

 Technical personnel are required to perform highly specific

tasks: equipment handling and cabling or hardware-level
installation and maintenance.

28
 Data center technology

High Availability

 Data centers are designed to operate with increasingly higher

levels of redundancy to sustain availability

 Data centers usually have redundant, cabling, and

environmental control subsystems in anticipation of system
failure, along with communication links and clustered
hardware for load balancing.

29
 Data center technology

Computing Hardware

 Several computing hardware technologies are integrated into

these modular servers, such as:
 Support for different hardware processing architectures, such as x86-
32bits, x86-64.
 A power-efficient multi-core CPU architecture that houses hundreds of
processing cores in a space as small as a single unit.
 Redundant components, such as hard disks, power supplies, network
interfaces, and storage controller cards.

30
 Data center technology

Storage Hardware

 Data centers have specialized storage systems that maintain

enormous amounts of digital information in order to fulfill
considerable storage capacity needs.
 These storage systems are containers housing numerous hard
disks that are organized into arrays.
 Storage systems usually involve the following technologies:
 Hard Disk Arrays
 I/O Caching
 Hot-Swappable Hard Disks
 Storage Virtualization
 Fast Data Replication Mechanisms

31
 Outlines
 Broadband networks and internet architecture

 Data center technology

 Virtualization technology

 Web technology

 Multitenant technology

32
32
 Virtualization Technology

 Virtualization is the process of converting a physical IT

resource into a virtual IT resource.
 Most types of IT resources can be virtualized, including:
 Server
 A physical server can be abstracted into a virtual server
 Virtual server ↔ virtual machine
 Storage
 A physical storage device can be abstracted into a virtual storage
device or a virtual disk
 Network
 Physical routers and switches can be abstracted into logical network
fabrics
 Power
 A physical and power distribution units can be abstracted into what
are commonly referred to as virtual
33
Creating A new Virtual Server

34
 Virtualization Technology

 Creating a new virtual server through virtualization software is

the allocation of physical IT resources, followed by the
installation of an operating system.

 Virtual servers use their own guest operating systems.

 Virtualization software runs on a physical server called a host

or physical host.

35
 Virtualization Technology

 The virtualization software functionality encompasses system

services that are related to virtual machine management.

 This software is sometimes referred to as a virtual machine

manager or a virtual machine monitor (VMM), but most
commonly known as a hypervisor.

i.e., including Hyper-V, VMware, VirtualBox, or Citrix XenServer,

36
 Virtualization Technology

Hardware Independence
 Virtualization is a conversion process that translates unique IT
hardware into emulated and standardized software-based
copies.

 Through hardware independence, virtual servers can easily be

moved to another virtualization host, automatically resolving
multiple hardware-software incompatibility issues.

37
 Virtualization Technology

Server Consolidation
 The coordination function that is provided by the virtualization
software allows multiple virtual servers to be simultaneously
created in the same virtualization host.

 Virtualization technology enables different virtual servers to

share one physical server.

 This process is called server consolidation and is used to

increase hardware utilization, load balancing, and optimization
of available IT resources.

38
Virtualization Technology

Server Consolidation

39
 Virtualization Technology

Resource Replication
 Virtual servers are created as virtual disk images that contain
binary file copies of hard disk content.

 Virtual disk images are accessible to the host’s operating

system, can be used to replicate, migrate, and back up the
virtual server.

40
 Virtualization Technology

Resource Replication
 The ease of manipulation and replication is one of the most
features of virtualization technology as it enables:

 The creation of standardized virtual machine images configured to

include virtual hardware capabilities, guest operating systems, …. .
 Increased agility in the migration and deployment of a virtual machine’s
new instances by being able to rapidly scale out and up.
 The support of business continuity with efficient backup and restoration
procedures.

41
 Virtualization Technology

Operating System-Based Virtualization

 Is the installation of virtualization software in a pre-existing
operating system, which is called the host operating system.

42
 Virtualization Technology

Operating System-Based Virtualization

Operating system-based virtualization can introduce demands

and issues related to performance overhead such as:

 The host operating system consumes CPU, memory, and other

hardware IT resources.
 Hardware-related calls from guest operating systems need to
traverse several layers to and from the hardware, which
decreases overall performance.
 Licenses are usually required for host operating systems, in
addition to individual licenses for each of their guest operating
systems.
43
 Virtualization Technology

Hardware-Based Virtualization
 Represents the installation of virtualization software directly
on the physical host hardware which is engaged with operating
system-based virtualization.

44
 Virtualization Technology

Virtualization software
 Virtualization software is typically referred to as a hypervisor
for this type of processing.

 A hypervisor has a simple user-interface that requires a

negligible amount of storage space.

 It exists as a thin layer of software that handles hardware

management functions to establish a virtualization
management layer.

45
 Virtualization Technology

Hardware-Based Virtualization
 One of the main issues of hardware-based virtualization
concerns compatibility with hardware devices. This include:

 The virtualization layer is designed to communicate directly

with the host hardware.
 Hardware device drivers may not be as available to hypervisor
platforms as they are to operating systems.
 Host management and administration features may further not
include the range of advanced functions that are common to
operating systems.

46
 Virtualization Technology

Virtualization Management
 Many administrative tasks can be performed more easily using
virtual servers as opposed to using their physical counterparts.

 Modern virtualization software provides several advanced

management functions that can automate administration tasks
and reduce the overall operational on virtualized IT resources.

 Virtualized IT resource management is often supported by

virtualization infrastructure management (VIM) tools that
manage virtual IT resources and rely on a centralized
management module.
47
 Summary of Key Points

 Server virtualization is the process of abstracting IT hardware

into virtual servers using virtualization software.

 Virtualization provides hardware independence, server

consolidation, and resource replication, and further supports
resource pooling and elastic scalability.

 Virtual servers are realized through either operating system-

based or hardware-based virtualization.

48
 Outlines
 Broadband networks and internet architecture

 Data center technology

 Virtualization technology

 Web technology

 Multitenant technology

49
49
 Web Technology

 Cloud computing relies on internet.

 Web technology is generally used as both the implementation

medium and the management interface for cloud services

50
 Web Technology

Resources vs. IT Resources

 Artifacts accessible via the World Wide Web are referred to as
resources or Web resources.
 A resource on the Web can represent a wide range
of artifacts accessible via the World Wide Web.
 For example, a JPG image file accessed via a Web browser is
considered a resource.
 An IT resource, within the context of cloud computing,
represents a physical or virtual IT-related artifact that can be
software or hardware-based.

51
 Web Technology

Basic Web Technology

 The World Wide Web is a system of interlinked IT resources
that are accessed through the Internet.

 The two basic components of the Web are the Web browser
client and the Web server.

 Other components, such as proxies, caching services, gateways

are used to improve Web application characteristics such as
scalability and security.

52
 Web Technology

Basic Web Technology

Three fundamental elements comprise the technology
architecture of the Web:
 Uniform Resource Locator (URL) – A standard syntax used for creating
identifiers that point to Web based resources, the URL is often structured
using a logical network location.
 Hypertext Transfer Protocol (HTTP) – This is the primary communications
protocol used to exchange content and data throughout the World Wide
Web.
 Markup Languages (HTML, XML) – Markup languages provide a
lightweight means of expressing Web-centric data and metadata.

53
 Web Technology

Web Applications
 A distributed application that uses Web-based technologies is
typically considered a Web application.

 Applications running in a web browser

 Rely on web browsers for the presentation of user-

interfaces

54
 Web Technology

Web Applications

Architectural abstraction for Web applications

55
 Summary of Key Points

 Web technology is very commonly used for cloud service

implementations and for front-ends used to remotely manage
cloud-based IT resources.

 Fundamental technologies of Web architecture include the

URL, HTTP, HTML, and XML.

56
 Outlines
 Broadband networks and internet architecture

 Data center technology

 Virtualization technology

 Web technology

 Multitenant technology

57
57
 Multitenant Technology

 The multitenant application design was created to enable

multiple users (tenants) to access the same application
simultaneously.

 Each tenant has its own view of the application that it uses,
administers, and customizes as a dedicated instance of the
software.

 Multitenant applications ensure that tenants do not have access

to data and configuration information that is not their own.

58
 Multitenant Technology

 Tenants can individually customize features of the

application, such as:
 User Interface – Tenants can define a specialized “look and feel” for
their application interface.
 Business Process – Tenants can customize the rules, logic, and
workflows of the business processes that are implemented in the
application.
 Data Model – Tenants can extend the data schema of the application to
include, exclude, or rename fields in the application data structures.
 Access Control – Tenants can independently control the access rights
for users and groups.

59
 Multitenant Technology

 Common characteristics of multitenant applications include:

 Usage Isolation – The usage behavior of one tenant does not

affect the application availability and performance of other
tenants.
 Data Security – Tenants cannot access data that belongs to other
tenants.
 Recovery – Backup and restore procedures are separately
executed for the data of each tenant.
 Application Upgrades – Tenants are not negatively affected by
the synchronous upgrading of shared software artifacts.

60
 Multitenant Technology

 Common characteristics of multitenant applications include:

 Scalability – The application can scale to accommodate increases

in usage by existing tenants and/or increases in the number of
tenants.
 Metered Usage – Tenants are charged only for the application
processing and features that are actually consumed.
 Data Tier Isolation – Tenants can have individual databases,
tables, and/or schemas isolated from other tenants. Alternatively,
databases, tables, and/or schemas can be designed to be shared
by tenants.


61
Multitenant Technology

A multitenant application 62
 Multitenancy vs. Virtualization

The differences lie in what is multiplied within a physical server acting

as a host:

 With virtualization: Multiple virtual copies of the server

environment can be hosted by a single physical server. Each copy can
be provided to different users, can be configured independently, and
can contain its own operating systems and applications.

 With multitenancy: A physical or virtual server hosting an

application is designed to allow usage by multiple different users.
Each user feels as though they have exclusive usage of the
application.

63