Parallel Sysplex Overview
Parallel Sysplex Overview
OS/390
This edition applies to Parallel Sysplex environment function that includes System/390 data sharing and parallelism. The Parallel
Sysplex uses the MVS/ESA SP Version 5 or the OS/390 operating system.
Order publications through your IBM representative or the IBM branch office serving your locality. Publications are not stocked at the
address below.
IBM welcomes your comments. A form for readers' comments may be provided at the back of this publication, or you may address
your comments to the following address:
International Business Machines Corporation
Department 55JA, Mail Station P384
522 South Road
Poughkeepsie, NY 12601-5400
United States of America
If you would like a reply, be sure to include your name, address, telephone number, or FAX number.
When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes
appropriate without incurring any obligation to you.
Copyright International Business Machines Corporation 1994, 1998. All rights reserved.
Note to U.S. Government Users — Documentation related to restricted rights — Use, duplication or disclosure is subject to
restrictions set forth in GSA ADP Schedule Contract with IBM Corp.
Contents
Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Introduction to Sysplex . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
What is a Sysplex? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Sysplex Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Sysplex Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Why Sysplex? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
An Evolutionary Approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Single System Uniprocessor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Tightly Coupled Multiprocessors . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Loosely Coupled Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
Base Sysplex . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Parallel Sysplex . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Products in a Sysplex . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Coupling Facility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Coupling Facility Channels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
System/390 Processors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Sysplex Timer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Enterprise Systems Connection (ESCON) . . . . . . . . . . . . . . . . . . . . 32
ESCON Control Units and I/O Devices . . . . . . . . . . . . . . . . . . . . . . 33
System Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
MVS/ESA or OS/390 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
JES2 or JES3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
DFSMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Networking Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Virtual Telecommunications Access Method (VTAM) . . . . . . . . . . . . . 34
Data Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Information Management System Database Manager (IMS DB:) . . . . . . . 34
DATABASE 2 (DB2) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Virtual Storage Access Method (VSAM) - component of DFSMS . . . . . . . 34
Transaction Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Customer Information Control System (CICS/ESA and CICS Transaction
Server) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Information Management System Transaction Manager (IMS TM) . . . . . . 35
Systems Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Accounting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
System Management Facilities (SMF) - component of MVS . . . . . . . . 35
Workload . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
CICSPlex System Manager/ESA (CICSPlex SM) . . . . . . . . . . . . . . 35
Operations Planning and Control (OPC/ESA) . . . . . . . . . . . . . . . . 35
Workload Manager (WLM) - component of MVS . . . . . . . . . . . . . . 35
Operations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
System Automated for OS/390 . . . . . . . . . . . . . . . . . . . . . . . . . 35
Hardware Management Console . . . . . . . . . . . . . . . . . . . . . . . . 36
System Display and Search Facility (SDSF) . . . . . . . . . . . . . . . . . 36
Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Resource Measurement Facility (RMF) . . . . . . . . . . . . . . . . . . . . 36
Enterprise Performance Data Manager/MVS (EPDM) . . . . . . . . . . . . 36
Service Level Reporter (SLR) . . . . . . . . . . . . . . . . . . . . . . . . . 36
Security . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Resource Access Control Facility (RACF) or the Security Server . . . . . 36
Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
System Automation for OS/390 . . . . . . . . . . . . . . . . . . . . . . . . 37
Hardware Configuration Definition (HCD) . . . . . . . . . . . . . . . . . . . 37
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Contents v
vi OS/390 V2R5.0 Parallel Sysplex Overview
Figures
1. Parallel Sysplex Library Books . . . . . . . . . . . . . . . . . . . . . . . . . xv
2. Sysplex Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
3. A Uniprocessor with One MVS Image . . . . . . . . . . . . . . . . . . . . . 5
4. A Tightly Coupled Multiprocessor . . . . . . . . . . . . . . . . . . . . . . . . 6
5. A Loosely Coupled Configuration . . . . . . . . . . . . . . . . . . . . . . . . 7
6. A Base Sysplex . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
7. A Parallel Sysplex . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
8. Data Sharing with a Single Data Server . . . . . . . . . . . . . . . . . . . 13
9. Data Sharing with Partitioned Data . . . . . . . . . . . . . . . . . . . . . . 14
10. Data Sharing Between Two Systems . . . . . . . . . . . . . . . . . . . . 15
11. Sysplex Data Sharing Using the Coupling Facility . . . . . . . . . . . . . . 16
12. Multiprocessing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
13. Workload that Exceeds Processing Capability . . . . . . . . . . . . . . . . 21
14. Increasing Throughput for a Workload . . . . . . . . . . . . . . . . . . . . 21
15. Processing a Lengthy Application . . . . . . . . . . . . . . . . . . . . . . . 22
16. Decreasing the Processing Time of a Lengthy Application . . . . . . . . . 23
17. Parallel OLTP Applications in a Single System . . . . . . . . . . . . . . . 25
18. Parallel OLTP Applications in a Sysplex Parallel Environment . . . . . . 26
19. Products in a Sysplex . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
20. Large Systems Sysplex Configuration . . . . . . . . . . . . . . . . . . . . 40
21. Sysplex in a S/390 Microprocessor Cluster Configuration . . . . . . . . . 41
22. Mixed Processor Sysplex Configuration . . . . . . . . . . . . . . . . . . . 42
IBM may have patents or pending patent applications covering subject matter in
this document. The furnishing of this document does not give you any license to
these patents. You can send license inquiries in writing to:
Licensees of this program who wish to have information about it for the purpose
enabling: (i) the exchange of information between independently created programs
and other programs (including this one) and (ii) the mutual use of the information
which has been exchanged, should contact:
IBM Corporation
Mail Station P300
522 South Road
Poughkeepsie, NY 12601-5400
U.S.A.
Attention: Information Request
It introduces high-level concepts and information useful for anyone who will plan
for, exploit, implement, or operate a sysplex that shares data and processes work
in parallel.
MVS system. An MVS image together with its associated hardware, which
collectively are often referred to simply as a system, or MVS system.
MVS image. A single occurrence of the operating system that has the ability
to process work.
| Getting Started
| This topic describes planning and implementing tasks for the Parallel Sysplex. Each
| task refers to books that you can select to obtain task specific information. If you
| are using the OS/390 CD Collection Kit (SK2T-6700-11 or later), select the book,
| and BookManager places you in the Table of Contents for that book. Under each
| book in the task list, you can also find the appropriate topic within the book that
| helps you locate specific details for the task.
| Planning Capacity
| OS/390 Parallel Sysplex Capacity Planning
| – "Capacity Planning in a Parallel Sysplex"
| Planning Performance
| Analyzing and Improving Performance - Overview
| S/390 Parallel Sysplex Performance
| – "Overview of Parallel Sysplex Performance"
| Defining SYS1.PARMLIB
| OS/390 MVS Setting Up a Sysplex
| – "Planning Parmlib Members for a Sysplex"
| DB2 Installation Guide
| – "Installation Step 1: Define DB2 to MVS: DSNTIJMV"
| Defining Signalling
| OS/390 MVS Setting Up a Sysplex
| – "Planning Signalling Services in a Sysplex"
| Defining JES2
| OS/390 JES2 Initialization and Tuning Guide
| – "JES2 Initialization"
| Defining JES3
| OS/390 JES3 Initialization and Tuning Guide
| – "Initializing JES3"
| Managing Consoles
| Parallel Sysplex Configuration, Volume 2: Cookbook
| – "Consoles and Parallel Sysplex"
| OS/390 MVS Planning: Operations
| – "Defining Your Console Configuration"
| Planning Recovery
| Performing Problem Determination
| OS/390 Parallel Sysplex Systems Management
| – "Planning for Problem Management"
| ITSO Publications
| Automation for S/390 Parallel Sysplex
| CICS and VSAM Record Level Sharing: Implementation Guide
| Getting the Most Out of a Parallel Sysplex
| IMS/ESA Sysplex Data Sharing: An Implementation Case Study
| OS/390 Parallel Sysplex Capacity Planning
| OS/390 MVS Parallel Sysplex Configuration, Volume 1: Overview
| Parallel Sysplex Configuration, Volume 2: Cookbook
| Parallel Sysplex Configuration, Volume 3: Connectivity
| OS/390 Parallel Sysplex Application Considerations Presentation Guide
| S/390 Parallel Sysplex Migration Paths
| S/390 Parallel Sysplex Performance
| VTAM in a Parallel Sysplex Environment
| Hardware Publications
| PR/SM Planning Guide
| DB2 Publications
| DB2 Administration Guide
| DB2 Data Sharing: Planning and Administration
| DB2 Installation Guide
| IMS/ESA Publications
| IMS/ESA Common Queue Server (CQS) Guide and Reference
| IMS/ESA Installation Volume 2: System Definition and Tailoring
| IMS/ESA Operations Guide
| IMS/ESA Release Planning Guide
| OS/390 Publications
| OS/390 JES2 Initialization and Tuning Guide
| OS/390 JES3 Initialization and Tuning Guide
| OS/390 MVS Planning: Global Resource Serialization
| OS/390 MVS Planning: Operations
| OS/390 MVS Planning: Workload Management
| OS/390 MVS Setting Up a Sysplex
| OS/390 Security Server (RACF) Security Administrator's Guide
| RMF Performance Management Guide
| RMF Report Analysis
Acknowledgements
The IBM Sysplex Information Development team would like to express its
appreciation to all the people who helped make this publication possible.
| The following changes appear only in the online version of this publication. A
| vertical line ( | ) in the left margin indicates changes to the text and illustrations.
| This revision includes a task roadmap for Parallel Sysplex information. The task
| roadmap can guide you through information for the Parallel Sysplex, including
| program product information for CICS Transaction Server (CICS TS), IMS/ESA, and
| DB2. See “Task Roadmap” on page xvi.
Summary of Changes
for GC28-1860-02
OS/390 Release 2 Release 4
Summary of Changes
for GC28-1860-01
OS/390 Release 2
Summary of Changes
for GC28-1860-00
as Updated June, 1996
online only for SK2T-6700-01
Summary of Changes
for GC28-1860-00
OS/390 Release 1
What's new is what a sysplex can now do for you. It's more than a platform. It has
become the large system computing environment that offers you improved
price/performance through cost effective processor technology and enhanced
software. This technology builds on existing data processing skills and will run
existing applications—an additional cost saver. A sysplex can also increase system
availability, and at the same time, it increases your potential for doing more work.
In case you're not sure what a sysplex is, this chapter starts with a definition of a
sysplex, and then describes the new capabilities of a sysplex and why you might be
interested in it.
What is a Sysplex?
A sysplex is a collection of MVS systems that cooperate, using certain hardware
and software products, to process work. A conventional large computer system also
uses hardware and software products that cooperate to process work. A major
difference between a sysplex and a conventional large computer system is the
improved growth potential and level of availability in a sysplex. The sysplex
increases the number of processing units and MVS operating systems that can
cooperate, which in turn increases the amount of work that can be processed. To
facilitate this cooperation, new products were created and old products were
enhanced.
The following diagram shows the visible parts of a sysplex, namely the hardware.
The software, which helps to enable the interaction and cooperation among the
systems, is described later.
ESCON Control Units and I/O Devices: ESCON control units and I/O devices in a
sysplex provide the increased connectivity necessary among a greater number of
systems.
Sysplex Software
The following software works with the hardware to enable interaction and
cooperation among systems in a sysplex.
Data Management Software: The data managers that support data sharing in a
sysplex are Information Management System Database Manager (IMS DB),
DATABASE 2 (DB2), and Virtual Storage Access Method (VSAM).
More information about the specific hardware and software products is available in
“Products in a Sysplex” on page 31.
Introduction to Sysplex 3
Why Sysplex?
Now that you've been introduced to the pieces that make up a sysplex, you might
be wondering what a sysplex could do for you. If your data center is responsible for
even one of the following types of work, you could benefit from a sysplex.
Large business problems—ones that involve hundreds of end users, or deal
with a very large volume of work that can be counted in the millions of
transactions per day.
Work that consists of small work units, such as online transactions, or large
work units that can be subdivided into smaller work units, such as queries.
Concurrent applications on different systems that need to directly access and
update a single database without jeopardizing data integrity and security.
A sysplex shares the processing of work across MVS/ESA systems, and as a result
offers benefits, such as:
Reduced cost through:
– Cost effective processor technology
– Continued use of large system data processing skills without re-education
– Protection of MVS/390 application investments
– The ability to manage a large number of systems more easily than other
comparably performing multisystem environments
Platform for continuous availability so that applications can be available 24
hours a day, 7 days a week, 365 days a year (or close to it)
Ability to do more work
– Greater capacity
– Improved ability to manage response time
– Platform for further capacity and response time advances
Greater flexibility
– Ability to mix levels of hardware and software
– Ability to dynamically add systems
– An easy path for incremental growth
– Varied platforms for applications, including parallel, open, and client/server
Depending on your data center's goals and needs, some of these benefits might be
more attractive to you than others. Your IBM marketing representative will be able
to discuss, in more detail, how a benefit can specifically apply to your situation.
An Evolutionary Approach
A sysplex is the most recent development in the evolution of IBM large systems.
Large system configurations have evolved from a single system uniprocessor
through tightly coupled multiprocessors, to a loosely coupled configuration, to the
sysplex.
The System/390 architecture defines that a single CP process one and only one
instruction from a program at a time. The MVS operating system manages the
instructions to be processed and the resources required to process them. When a
single copy of the MVS operating system (MVS image) manages the processing of
a CPC that has a single CP, the system configuration is called a uniprocessor.
Summary
Capacity Equal to the size of the largest single CP
Availability Contains single points of failure; disruptive change
Systems Management Easy to manage work
A tightly coupled multiprocessor has more than one CP and a single MVS image
sharing central storage. The CPs are managed by the single MVS image, which
assigns work to them.
Introduction to Sysplex 5
Figure 4. A Tightly Coupled Multiprocessor
Summary
Capacity Increased over that of a uniprocessor but limited by the
maximum number of CPs in the CPC
Availability Increased over that of a uniprocessor but limited by
some characteristics, including one system image, that
may represent single points of failure and disruptive
change
Systems Management Easy to manage work
Systems outside a sysplex can coordinate more than one MVS image with the MVS
job entry subsystem components (JES2 and JES3) and global resource
serialization. These components establish a means of sharing a work input queue
across a number of systems to allow shared data sets, printers, and consoles. This
type of system configuration is called loosely coupled.
A loosely coupled configuration has more than one CPC, possibly tightly coupled
multiprocessors, sharing DASD but not central storage. The CPCs can connect by
channel-to-channel communications and are managed by more than one MVS
image. Work is distributed from a shared job queue to each MVS.
Products and applications that need to communicate and are running on separate
systems have to create their own communication mechanism. These varied
communication mechanisms add to the difficulty of managing a loosely coupled
configuration.
Summary
Capacity Increased system capacity over tightly coupled
multiprocessors and a uniprocessor
Availability Increased system availability over tightly coupled
multiprocessors and a uniprocessor
Systems Management Requires additional systems management—separate
MVS images communicate to share data sets, printers,
and consoles
Base Sysplex
To help solve the difficulties of managing many MVS systems, IBM introduced the
MVS systems com plex or sysplex in September of 1990. The base sysplex lays
the groundwork for simplified multisystem management through the cross-system
coupling facility (XCF) component of MVS/ESA. XCF services allow authorized
applications on one system to communicate with applications on the same system
or on other systems. In a base sysplex, CPCs connect by channel-to-channel
communications and a shared dataset to support the communication. When more
than one CPC is involved, a Sysplex Timer synchronizes the time on all systems.
The base sysplex is similar to a loosely coupled configuration in that more than one
CPC (possibly a tightly coupled multiprocessor) shares DASD and is managed by
more than one MVS image. A sysplex is different from a loosely coupled
configuration because through XCF, there is a standard communication mechanism
for MVS system applications.
Introduction to Sysplex 7
Figure 6. A Base Sysplex
Summary
Capacity The same system capacity as loosely coupled
Availability The same system availability as loosely coupled
Systems Management Better and simpler systems management than loosely
coupled
Greater degree of communication and cooperation
among systems
Introduction of XCF as a common communication
mechanism that provides high availability
A more unified system image—single MVS console
to manage all components
Parallel Sysplex
Since the introduction of the sysplex, IBM has developed technologies that enhance
sysplex capabilities. The Parallel Sysplex supports a greater number of systems
and significantly improves communication and data sharing among those systems.
High performance communication and data sharing among a large number of MVS
systems could be technically difficult. But with the Parallel Sysplex, high
performance data sharing through a new coupling technology (coupling Facility)
gives high performance multisystem data sharing capability to authorized
applications, such as MVS subsystems. Use of the Coupling Facility by
subsystems, such as Information Management System (IMS), ensures the integrity
and consistency of data throughout the entire sysplex.
The capability of linking together many systems and providing multisystem data
sharing makes the sysplex platform ideal for parallel processing, particularly for
online transaction processing (OLTP) and decision support. More discussion about
parallel processing follows in “Parallel Processing in a Sysplex” on page 19.
In short, a Parallel Sysplex builds on the base sysplex capability, and allows you to
increase the number of CPCs and MVS images that can directly share work. The
Coupling Facility enables high performance, multisystem data sharing across all the
Summary
Capacity Increased system capacity over loosely coupled and
base sysplex
Ability to add incremental capacity to match workload
growth
Availability Increased system availability over loosely coupled and
base sysplex
Systems Management Better systems management than with the base sysplex
Multisystem data sharing capability
Multisystem workload balancing
Enhanced single-system image
Summary
The unique characteristics of a Parallel Sysplex can allow you to reduce your total
cost of computing over prior offerings of comparable function and performance.
Sysplex design characteristics mean that you can run your business continuously,
even when it is growing or changing. You can dynamically add and change
systems in a sysplex and configure them for no single points of failure. If your
revenue depends on continuously available systems, a sysplex can protect your
revenue. If you need to grow beyond the limits imposed by today's technology, a
sysplex lets you go beyond those limits, and helps you avoid the complex and
expensive splitting and rejoining of data centers.
The innate robustness and reliability of the MVS operating system and System/390
processors are the foundation of a sysplex. That robustness and reliability are
extended to all systems in a sysplex through cross system workload balancing and
data sharing using the coupling technologies. Therefore applications on multiple
systems can be continuously available to end users, yet the applications are
shielded behind a single-system view.
Introduction to Sysplex 9
The applications that run in a sysplex are the same applications you run today.
Reuse of applications and data processing skills reduce the costs of application
development, re-engineering, and retraining.
Therefore, the sysplex can reduce your overall cost of compu now and can
position your data processing center for continued savings in the future.
As You Read On...:
In this introductory chapter, you have seen how large systems have evolved
into a sysplex. The sysplex itself is evolving, and the roll-out of sysplex
support across software products will occur over time. For information about
availability of sysplex software support, consult your IBM marketing
representative.
The rest of this publication will not differentiate between the base sysplex
capability and the Parallel Sysplex capability. When you see the term
sysplex, understand it to mean the Parallel Sysplex with its enhanced
capability.
A sysplex significantly changes the way MVS systems can share data. As the
number of systems increase, it is essential to have an efficient way to share data
across systems. The Coupling Facility enables centrally accessible, high
performance data sharing for authorized applications, such as subsystems and
MVS components, that are running in a sysplex. These subsystems and
components then transparently extend the benefits of data sharing to their
applications.
Data Sharing
Data sharing is not new. Different applications within a system often need to access
the same information, sometimes to read it and other times to update it. Sometimes
several copies of the data exist and with that comes the requirement of keeping all
the copies identical. If the system fails, you need a way to preserve the data with
the most recent changes.
When two or more MVS systems share data, each system has its own copy of a
data management system. Communication between the data management systems
is essential.
Data Validity
When many applications share data, within the same MVS system or among
several MVS systems, they need mechanisms to guarantee data validity. Two such
mechanisms are serialization and data consistency (buffer invalidation).
Serialization is a mechanism that allows control over the access and update of
data. Through serialization, only one application can access and change a given
These three options are contrasted with accessing shared data using the Coupling
Facility.
When the data server reaches its capacity, there may be no way to expand, other
than to install a larger capacity system or to go to another data sharing option.
Summary
Response Time Limited by the capability of the single server
Throughput Limited by the capability of the single server
Continuous Availability Limited by the availability of the single server
Growth Requires upgrade of server or change to a different
option
Data Management Managed as a single data management system
To allow for changes in demand for data, you need to configure the size of each
system to handle the peak demand for that data, which requires extra capacity.
Without that extra capacity, dynamic swings in demand for a particular partition of
data could make performance erratic.
If a system fails, its portion of data cannot be accessed unless there is an alternate
path to the data from another system. The other system must then have enough
spare capacity to assume the additional work.
When capacity is reached and you need to add another system, the data must be
re-partitioned.
Summary
Response Time Depends on how appropriately the data is partitioned
Throughput Depends on the demand for data
Continuous Availability Depends on the back-up alternate routing provisions
and the capacity of the alternate system
Growth Requires re-partitioning of the data
Data Management Requires carefully partitioned data for adequate
performance
If you increase the number of IMS DB systems sharing the database to more than
two, the number of messages from one sharing IMS system to the others would
slow all the systems down.
Summary
Response Time Acceptable
Throughput Limited by the two IMS DB systems
Continuous Availability Limited by the two IMS DB systems
Growth Limited by the two MVS systems
Data Management Managed as a single data management system
Summary
Response Time Relieves poor response time due to system overload
Throughput Increases throughput far beyond the current limits
Continuous Availability Extends availability far beyond the current limits
Growth Incremental expansion is not disruptive to existing
systems
Data Management Managed as a single data management system
A Coupling Facility is a microprocessor unit. High bandwidth fiber optic links called
coupling facility channels, provide high speed connectivity between the Coupling
Facility and systems directly connected to it.
Some IBM data management systems that are using the Coupling Facility include
database managers and a data access method.
IMS database managers on different MVS systems can access data at the same
time. By using the Coupling Facility in a sysplex, IMS DB can efficiently provide
data sharing for more than two MVS systems and thereby extends the benefits of
IMS DB data sharing. IMS DB uses the Coupling Facility to centrally keep track of
when shared data is changed. IRLM is still used to manage data locking, but does
not notify each IMS DB of every change. IMS DB does not need to know about
changed data until it is ready to use that data.
DB2 data sharing support allows multiple DB2 subsystems within a sysplex to
concurrently access and update shared databases. DB2 data sharing uses the
Coupling Facility to efficiently lock, to ensure consistency, and to buffer shared
data. Similar to IMS, DB2 serializes data access across the sysplex through
locking. DB2 uses Coupling Facility cache structures to manage the consistency of
the shared data. DB2 cache structures are also used to buffer shared data within a
sysplex for improved sysplex efficiency.
DFSMS supports a new VSAM data set accessing mode called record level sharing
(RLS). RLS uses the Coupling Facility to provide sysplex-wide data sharing for
CICS and the other applications that use the new accessing mode. By controlling
access to data at the record level, VSAM enables CICS application programs
running in different CICS address spaces, called CICS regions, and in different
MVS images, to share VSAM data with complete integrity. The Coupling Facility
The sysplex brings together parallel capability on many levels—in the applications,
the supporting sysplex software, and the hardware. Applications can be replicated
to run in parallel on a single tightly coupled multiprocessing system. When you run
parallel applications in a sysplex with subsystems that support enhanced
communication across systems, you have a greater degree of parallelism. And
when you add hardware to that greater degree of parallelism, hardware with the
capability for modular, incremental growth—you have the broad based parallelism
that is available in a sysplex.
Similarly, if there are more online transactions than one CP can handle, adding
more CPs allows the online transactions to run in parallel.
By adding processors and running transactions in parallel, you can reduce end-user
response time by increasing throughput. The following graphic shows how adding
processing capability increases throughput.
When the lengthy application is divided into smaller units of work and there are
many parallel processors, the smaller units of work can run simultaneously and in
parallel. The following graphic shows how a lengthy application can be processed
in parallel by dividing it among many parallel processors.
You can use this same approach in a sysplex to speed up the processing of a
long-running application, such as a complex query.
Some common MVS applications that deal with large business problems and can
be made to run in parallel are batch, query, and online transaction processing
(OLTP).
A batch workload consists of multiple job streams, which can be unrelated and can
therefore run in parallel. A single job stream, however, runs in sequence and
Queries are a diverse type of workload and usually rely on partitioned data when
running in parallel. To help you process queries in parallel, IBM is offering a parallel
query server. The parallel query server is a self-contained system made up of
hardware, software, and database services. The system is fully installed,
customized, and serviced by IBM. The parallel query server is used to process
large queries in a shared relational database. For more information about the
parallel query server, see your IBM marketing representative.
OLTP applications are a common MVS application type that can take advantage of
parallelism. They are the focus of the following topics, because there is extensive
software support for OLTP processing in a sysplex, and the number of OLTP
applications are on the increase.
Transaction Managers
From the time the transaction manager obtains the transaction from the network
until it returns the completed transaction to the network, it is responsible for:
Sending the transaction to the appropriate application
Converting transaction data to a form that can be used
Reconverting results to a form that can be displayed on an output device
Two MVS transaction managers, which have provided parallel support in a single
system, provide an additional degree of parallel support in a sysplex. The two
transaction managers are Customer Information Control System (CICS) and
Information Management System Transaction Manager (IMS TM).
Using CICS multi-region operation, you can separate function into individual
regions—namely terminal-owning regions (TORs), application-owning regions
(AORs), and file-owning regions (FORs). These individual resource-owning regions
can then be linked together and managed in what is called a CICSplex.
IMS TM can also take advantage of the sysplex. Several IMS TMs can coordinate
work among themselves by using IMS's Multiple Systems Coupling (MSC) support.
Through MSC, transactions entered from one IMS can be routed to another IMS for
processing and the results returned to the original IMS. To the end user, the
transfer of information from one IMS to another is transparent.
Transaction message traffic workloads can be balanced using MSC. IMS will
continue to enhance and unify management of IMS systems and present a
single-system view of IMS in a sysplex.
If the data management system takes advantage of the Coupling Facility, the OLTP
applications can avoid shipping data back and forth between systems. By using the
Coupling Facility for data sharing and for queuing and status control, data
management systems and transaction managers can perform their duties more
quickly and therefore manage more systems efficiently. This increase in the number
of systems that can be managed, increases the degree of parallelism even further.
The data management systems that take advantage of the Coupling Facility are
IMS DB, DB2, and VSAM. These data management systems were described in
Exploiters of the Coupling Facility topicref 17.
This type of workload management is different from the way workloads were
previously managed. The new emphasis is on defining performance goals for work,
and having MVS and the subsystems adapt to meet the goals.
The scope of a service policy is the sysplex. Each service policy has a name, and
can be activated by the ISPF application, an operator command, or an automation
package. Only one policy can be active at a time. When it is activated, all systems
in the sysplex process towards the goals defined in the policy.
Reporting
Resource Measurement Facility (RMF) combines MVS system management
facilities (SMF) data for the sysplex, and reports how well the sysplex is doing to
achieve the goals defined in the service policy. In addition, execution delay
information is available in SMF records that show where delays are occurring. If
there is a problem, you can use this information to help adjust the performance
goals, focus on specific subsystems having a problem, or make work scheduling
adjustments.
Coupling Facility
The Coupling Facility is a microprocessor unit that allows high performance
multisystem data sharing among certain S/390 processors and within a cluster of
S/390 microprocessor complex.
System/390 Processors
Note: All ES/9000 processors can participate in a base sysplex, but only the
following processors can link to the Coupling Facility.
9021 711-based models
The 9021 711-based models are water-cooled CPCs, which were announced in
February, 1993.
9121 511-based models
The 9121 511-based models are air-cooled CPCs, which were announced in
February, 1993.
Microprocessor cluster
A microprocessor cluster comes with an integrated Coupling Facility and flexible
packaging options, and it runs as a parallel transaction server. In addition, an
easy-to-use console provides cross system management capability. For a
description of the console, see “Hardware Management Console” on page 36.
Sysplex Timer
The Sysplex Timer is a unit that synchronizes the time-of-day (TOD) clocks in
multiple CPCs in a sysplex. The time stamp from the Sysplex Timer is a way to
monitor and sequence events within the sysplex.
System Software
System software for the Parallel Sysplex includes the following.
MVS/ESA or OS/390
The MVS/ESA or OS/390 operating system for S/390 is known for its ability to
handle thousands of concurrent interactive users and for its sophisticated data
management, reliability, security, and auditing features in a commercial
environment.
MVS enables the new coupling technology, extends system support beyond the
previous limit of 8 MVS systems, and increases the number of I/O devices allowed
per MVS system beyond the previous limit of 4096. It is the platform for simplified
systems management of a sysplex, including configuration management, availability
management, workload management, and single-image operations. Further
enhancements include problem determination and recovery in a sysplex.
For information about OS/390, see OS/390 Introduction and Release Guide.
JES2 or JES3
These two job entry subsystem products control job queues and dispatch work in a
sysplex. JES2 expands its 7-member multi-access spool (MAS) capability to a
32-member MAS. Additionally, JES2 uses the Coupling Facility to enhance its
performance. JES3 can support a maximum of 32 members in a JES3 complex and
supports ESCON CTCs or the coupling facility.
DFSMS
DFSMS enables the automatic placement, migration, backup, recall, recovery, and
deletion of data for MVS. An SMS configuration can contain 32 names, but the
names can be a combination of system names and system group names. DFSMS
also supports the increased number of I/O devices beyond the previous limit of
4096.
Products in a Sysplex 33
Networking Software
Networking software for the Parallel Sysplex includes the following.
Data Management
Data management for the Parallel Sysplex includes the following.
DATABASE 2 (DB2)
DB2 is a database manager of relational data. DB2 provides data sharing support
that uses the Coupling Facility for read/write sharing of DB2 databases within a
sysplex.
Transaction Management
Transaction management for the Parallel Sysplex includes the following.
Systems Management
Systems management software includes the following.
Accounting
Workload
Operations
Products in a Sysplex 35
System Automation for OS/390 also eases the task of propagating automation
policy to multiple systems. System Automation for OS/390 consolidates access to
other products (for example, SDSF and RMF) from a single workstation.
System Automation for OS/390 also extends the control, monitoring, and
automation capabilities of the NetView program to provide consolidated
management for hardware (system) and software (operator) consoles in
heterogeneous System/390 environments. System Automation for OS/390 supports
both automated and manual operations on a sysplex.
Performance
Security
Products in a Sysplex 37
38 OS/390 V2R5.0 Parallel Sysplex Overview
Introduction to Sample Sysplex Configurations
In a sysplex, you can think of MVS systems and system hardware components as
building blocks that you can select for specific purposes and replicate or combine in
different configurations.
Benefits: This configuration combines the inherent strengths of large systems with
multisystem data sharing provided by the Coupling Facility. It can be used for both:
An easy migration path for initiating and testing data sharing using the Coupling
Facility.
A reliable production environment
ACDS. Active control data set. CBPDO. Custom Built Product Delivery Offering.
ANO/MVS. Automated Network Operations. CEC. Synonym for central processor complex (CPC).
AOC/MVS. Automated Operations Control. The central processor (CP). The part of the computer that
licensed program System Automation for OS/390 contains the sequencing and processing facilities for
includes all of the function previosuly provided by instruction execution, initial program load, and other
AOC/MVS. machine operations.
CICSplex. A group of connected CICS regions. DB2 data sharing group. A collection of one or more
concurrent DB2 subsystems that directly access and
CICSPlex SM. CICSPlex System Manager change the same data while maintaining data integrity.
CP. Central processor. ETR. External Time Reference. See also Sysplex
Timer.
CPC. Central processor complex.
D G
DAE. Dump analysis and elimination.
global resource serialization. A function that
DASD. Direct access storage device. provides an MVS serialization mechanism for resources
(typically data sets) across multiple MVS images.
data sharing. The ability of concurrent subsystems
(such as DB2 or IMS DB) or application programs to global resource serialization complex. One or more
directly access and change the same data while MVS systems that use global resource serialization to
maintaining data integrity. serialize access to shared resources (such as data sets
on shared DASD volumes).
DBCTL. IMS Database Control.
GSAM. Generalized Sequential Access Method.
DBRC. Database Recovery Control.
GTF. Generalized trace facility.
IMS TM. Information Management System Transaction lock structure. A coupling facility structure that
Manager. enables applications in a sysplex to implement
customized locking protocols for serialization of
in-doubt period. The period during which a unit of application-defined resources. The lock structure
work is pending during commit processing that involves supports shared, exclusive, and application-defined lock
two or more subsystems. See also in-doubt work unit. states, as well as generalized contention management
and recovery protocols.
in-doubt work unit. In CICS/ESA and IMS/ESA, a
piece of work that is pending during commit processing; lock structure services. MVS services that enable
if commit processing fails between the polling of applications in a sysplex to perform operations such as
subsystems and the decision to execute the commit, the following on a coupling facility lock structure:
recovery processing must resolve the status of any Request ownership of a lock
work unit that is in doubt. Change the type of ownership for a lock
Release ownership of a lock
integrated operations workstation. A programmable
Manage contention for a lock
workstation (PWS) from which an individual can access
Recover a lock held by a failed application.
multiple products to perform a set of tasks, in some
cases without knowing which particular product logical partition (LP). A subset of the processor
performs a specific task. hardware that is defined to support an operating
system. See also logically partitioned (LPAR) mode.
IOCDS. Input/output configuration data set.
logically partitioned (LPAR) mode. A central
IOCP. Input/output configuration program.
processor complex (CPC) power-on reset mode that
enables use of the PR/SM feature and allows an
IODF. Input/output definition file.
operator to allocate CPC hardware resources (including
IRLM. Internal resource lock manager. central processors, central storage, expanded storage,
Glossary 45
and channel paths) among logical partitions. Contrast multisystem environment. An environment in which
with basic mode. two or more MVS images reside in one or more
processors, and programs on one image can
loosely coupled. A multisystem structure that requires communicate with programs on the other images.
a low degree of interaction and cooperation between
multiple MVS images to process a workload. See also multisystem sysplex. A sysplex in which two or more
tightly coupled. MVS images are allowed to be initialized as part of the
sysplex. See also single-system sysplex.
LP. Logical partition.
MVS image. A single occurrence of the MVS/ESA
LPAR. Logically partitioned (mode). operating system that has the ability to process work.
Glossary 47
sysplex couple data set. A couple data set that
contains sysplex-wide data about systems, groups, and U
members that use XCF services. All MVS systems in a
uniprocessor (UP). A CPC that contains one CP and
sysplex must have connectivity to the sysplex couple
is not partitionable.
data set. See also couple data set.
UP. Uniprocessor.
Sysplex Timer. An IBM unit that synchronizes the
time-of-day (TOD) clocks in multiple processors or
processor sides. External Time Reference (ETR) is the
MVS generic name for the IBM Sysplex Timer (9037).
V
VM. Virtual Machine.
system control element (SCE). Hardware that
handles the transfer of data and control information VSAM. Virtual Storage Access Method.
associated with storage requests between the elements
of the processor. VTAM. Virtual Telecommunications Access Method.
T
X
tightly coupled. Multiple CPs that share storage and
are controlled by a single copy of MVS. See also XCF. Cross-system coupling facility.
loosely coupled, tightly coupled multiprocessor.
XCF PR/SM policy. In a multisystem sysplex on
tightly coupled multiprocessor. Any CPC with PR/SM, the actions that XCF takes when one MVS
multiple CPs. system in the sysplex fails. This policy provides high
availability for multisystem applications in the sysplex.
TOR. Terminal-owning region.
XCF-local mode. The state of a system in which XCF
TSCF. Target System Control Facility. The licensed provides limited services on one system and does not
program System Automation for OS/390 includes all of provide signalling services between MVS systems. See
the function previosuly provided by TSCF. also single-system sysplex.
C E
CICS (Customer Information Control System) 34
as transaction manager for parallel OLTP 27 Enterprise Performance Data Manager 36
CICSPlex SM (CICSPlex System Manager/ESA) 35 See also EPDM (IBM SystemView Enterprise
CICSPlex System Manager/ESA 35 Performance Data Manager/MVS)
See also CICSPlex SM (CICSPlex System Enterprise Systems Connection 32
Manager/ESA) See also ESCON (Enterprise Systems Connection)
configuration EPDM (IBM SystemView Enterprise Performance
large systems data sharing 39 Data Manager/MVS) 36
sysplex sample 39 ES/9000 processors
using a S/390 microprocessor cluster 40 9021 511-based models 32
using mixed processors 41 9021 711-based models 32
consistency of data 12 ESCD (ESCON Director) 32
Coupling Facility ESCM (ESCON Manager) 37
description 16 ESCON (Enterprise Systems Connection) 32
exploiters 17 ESCON control units
multisystem data sharing 15 3990 Storage Control Model 6 33
structures 16 9343 Storage Controller 33
technology 16 9345 Direct Access Storage Device 33
cross-system coupling facility 7 ESCON Director 32
See also XCF (cross-system coupling facility) See also ESCD (ESCON Director)
Customer Information Control System 34 ESCON I/O devices
See also CICS (Customer Information Control 3172 33
System) 3174 33
3490E 33
3745 33
D 3746 33
Data Facility Storage Management Subsystem 33 ESCON Manager 37
See also DFSMS See also ESCM (ESCON Manager)
data management system evolution of sysplex 4
for OLTP parallelism 27
data sharing
comparison to multisystem data sharing 12
data access
sharing data between two systems 14
Index 51
transaction (continued)
running in parallel 24
transaction manager
CICS 27
IMS TM 27
support for OLTP parallelism 24
U
uniprocessor
definition 5
work potential 5
V
Virtual Storage Access Method 34
See also VSAM (Virtual Storage Access Method)
Virtual Telecommunications Access Method 34
See also VTAM (Virtual Telecommunications Access
Method)
VSAM (Virtual Storage Access Method) 34
exploitation of Coupling Facility 17
VTAM (Virtual Telecommunications Access
Method) 34
W
WLM (MVS workload manager) 28, 35
defining performance goals 28
work potential
of a base sysplex 8
of a loosely coupled configuration 7
of a tightly coupled multiprocessor 6
of a uniprocessor 5
of an Parallel Sysplex 9
workload management 28
workload management
dynamic resource balancing 28
in a sysplex 28
reporting 28
X
XCF (cross-system coupling facility) 7
Overall, how satisfied are you with the information in this book?
Very Very
Satisfied Satisfied Neutral Dissatisfied Dissatisfied
Overall satisfaction Ø Ø Ø Ø Ø
How satisfied are you that the information in this book is:
Very Very
Satisfied Satisfied Neutral Dissatisfied Dissatisfied
Accurate Ø Ø Ø Ø Ø
Complete Ø Ø Ø Ø Ø
Easy to find Ø Ø Ø Ø Ø
Easy to understand Ø Ø Ø Ø Ø
Well organized Ø Ø Ø Ø Ø
Applicable to your tasks Ø Ø Ø Ø Ø
When you send comments to IBM, you grant IBM a nonexclusive right to use or distribute your comments
in any way it believes appropriate without incurring any obligation to you.
Name Address
Company or Organization
Phone No.
Cut or Fold
Readers' Comments — We'd Like to Hear from You
IBM
Along Line
GC28-1860-03
NO POSTAGE
NECESSARY
IF MAILED IN THE
UNITED STATES
IBM Corporation
Department 55JA, Mail Station P384
522 South Road
Poughkeepsie, NY 12601-5400
Cut or Fold
GC28-1860-03 Along Line
IBM
Printed in U.S.A.
GC28-186ð-ð3