AWS Data Provider For SAP: Installation and Operations Guide
AWS Data Provider For SAP: Installation and Operations Guide
December 2016
Amazon Web Services – AWS Data Provider for SAP September 2016
© 2016, 2017 Amazon Web Services, Inc. or its affiliates. All rights reserved.
Notices
This document is provided for informational purposes only. It represents AWS’s
current product offerings and practices as of the date of issue of this document,
which are subject to change without notice. Customers are responsible for
making their own independent assessment of the information in this document
and any use of AWS’s products or services, each of which is provided “as is”
without warranty of any kind, whether express or implied. This document does
not create any warranties, representations, contractual commitments, conditions
or assurances from AWS, its affiliates, suppliers or licensors. The responsibilities
and liabilities of AWS to its customers are controlled by AWS agreements, and
this document is not part of, nor does it modify, any agreement between AWS
and its customers.
The software included with this paper is licensed under the Apache License,
Version 2.0 (the "License"). You may not use this file except in compliance with
the License. A copy of the License is located at http://aws.amazon.com/apache2.0/ or
in the "license" file accompanying this file. This code is distributed on an "AS IS"
BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied. See the License for the specific language governing
permissions and limitations under the License.
Contents
Abstract 4
Introduction 4
Upgrading from Previous Versions 6
Versions 1.3 and 1.3.1 6
Technical Requirements 6
Internet Access 6
IAM Roles 8
Installing the AWS Data Provider for SAP 13
Installing on Linux 14
Installing on Windows 19
Updating the AWS Data Provider for SAP 24
Uninstalling the Linux Version 24
Uninstalling the Windows Version 25
Troubleshooting 25
Troubleshooting on Linux 25
Troubleshooting on Windows 30
Appendix A: Customizing the AWS Data Provider 35
Syntax Rules for Configuration Files 35
User-Configurable EC2 Instance Types 36
User-Configurable Support Status 37
Appendix B: Verification of AWS Data Provider in SAP System Monitoring 39
Checking Metrics with the SAP OS Collector (SAPOSCOL) 39
Checking Metrics with the SAP CCMS Transactions 41
Appendix C: Changes and Bug Fixes by Product Version 44
Release 1.2 (Sept. 16, 2014) 44
Abstract
The Amazon Web Services (AWS) Data Provider for SAP is a tool that collects
performance-related data from AWS services, and makes this data available to
SAP applications, to help monitor and improve the performance of business
transactions. The AWS Data Provider uses operating system, network, and
storage data that is most relevant to the operation of the SAP infrastructure. Its
data sources include Amazon Elastic Compute Cloud (Amazon EC2) and Amazon
CloudWatch. This guide provides installation, configuration, and troubleshooting
information for the AWS Data Provider.
Introduction
Many SAP organizations of all sizes are choosing to host their key SAP systems on
the Amazon Web Services (AWS) platform. This platform can rapidly speed up
the time it takes to provision SAP environments, and the elastic nature of the
platform makes it easy to scale computing resources up and down as needed.
This leaves more resources (both people and funds) to focus on innovation that
can really benefit the business immediately.
AWS and SAP recognize that many SAP systems are used to operate daily
business transactions and are critical to their customers’ business functions.
Therefore, SAP customers need the ability to track and troubleshoot the
performance of these transactions. To that end, SAP has built extensive
monitoring transactions within SAP applications to surface relevant performance
information in a logical and consistent format across the many operating system
and database platforms that SAP supports. These transactions rely on metrics
from the operating system and database layers, which, in a virtual environment,
might just be a portion of the relevant performance metrics.
To provide these metrics, AWS has created an AWS Data Provider for SAP, which
collects key performance-related data and surfaces it to SAP applications for use
in the monitoring transactions built by SAP. This performance data is collected
from a variety of sources, including the Amazon Elastic Compute Cloud (Amazon
EC2) API, EC2 instance metadata, and Amazon CloudWatch, to ensure that
performance analysis can be performed on all aspects of the operating
environment. This approach includes metrics from the operating system,
network, and storage that are most relevant to the operation of the SAP
infrastructure.The SAP Operating System Collector (SAPOSCOL) and the SAP
CIM Provider are the SAP components that will read data from the AWS Data
Provider for SAP. Figure 1 provides a high-level illustration of the AWS Data
Provider for SAP, its data sources, and its outputs.
Figure 1: Data Sources for the AWS Data Provider for SAP
If you have older versions of the AWS Data Provider, we recommend that you
uninstall them before installing this version for the best installation experience.
Technical Requirements
Internet Access
The AWS Data Provider for SAP requires an active route to the Internet. This is in
part due to the fact that the tool pulls key performance metrics from the AWS
CloudWatch service and the Amazon EC2 API. Automatic updates to the AWS
Data Provider for SAP also necessitate network access to the Amazon Simple
Storage Service (Amazon S3).
SAP systems that receive information from the AWS Data Provider are required
to be deployed within an Amazon Virtual Private Cloud (Amazon VPC). You can
use one of the following network topologies to enable the routing necessary to
reach the Internet-based endpoints:
• The first topology configures an Internet gateway within the Amazon VPC
(virtual private network), which allows for routing directly to the Internet.
Figure 2 illustrates the topology where the Amazon VPC is directly
connected to the Internet. For more information about Internet gateways,
see the AWS documentation.1
Customers Datacenter
IAM Roles
Because the AWS Data Provider needs the APIs for Amazon CloudWatch and
Amazon EC2, you will have to grant the AWS Data Provider read-only access to
those services. This can be accomplished by using the AWS Identity and Access
Management (IAM) service and by adding a feature known as an IAM role to
your instance.
1. Sign in to the AWS Management Console, and open the IAM console at
https://console.aws.amazon.com/iam/.
2. In the navigation pane, choose Policies, and then choose Create Policy.
3. Choose Create Your Own Policy.
4. On the next screen, enter a policy name and description, and copy the
following policy into the Policy Document box:
{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Action": [
"EC2:DescribeInstances",
"EC2:DescribeVolumes"
],
"Resource": "*"
},
{
"Effect": "Allow",
"Action": "cloudwatch:GetMetricStatistics",
"Resource": "*"
}
]
}
5. Choose Create Policy. The IAM console will confirm the new policy with
a message similar to the following.
6. To set this policy, sign in to the AWS Management Console, and open the
IAM console at https://console. aws.amazon.com/iam/.
7. In the navigation pane, choose Roles, and then choose Create New Role
to begin the process of creating your IAM role.
8. Now you can select Amazon EC2 as the role type, as shown in Figure 8.
9. The next step is to force the console to show the Customer Managed
Policies. This is shown in Figure 9.
You will then attach the DataCollectorAccess role to the EC2 instances that
will be monitored on startup .
The other option is to add the policy to a role, which gets assigned to a new EC2
instance.
For example, if the EC2 instance does not have an IAM role associated with it
that grants explicit access to the Amazon CloudWatch GetMetricStatistics API,
the CloudWatch provider will be unable to access metrics on the EC2 instance
and will return blank values.
AWS provides customers with a rapidly evolving platform, and the AWS Data
Provider was designed to automatically update itself so it can always provide the
most current metrics to SAP customers. When the Data Provider starts up, a
built-in update service pulls down the latest versions of its components and
metric definitions. In order to take advantage of this capability, you must provide
Internet access at startup. If the Data Provider cannot access the update service,
it will continue to run but will not be able to obtain updates.
To install the AWS Data Provider on SUSE Linux Enterprise Server (SLES) 11 or
12, on Red Hat or Oracle Linux, with an IAM role assigned with the appropriate
authorizations to access CloudWatch and the Amazon EC2 API, follow these
steps:
If you don’t have transparent HTTP/HTTPS access to the Internet, start the
script with the required information about the HTTP/HTTPS proxies,
using the following syntax:
where:
• proxy-host specifies the address of the HTTP proxy server (for
example, 10.0.10.2)
• proxy-port specifies the port number of the HTTP proxy server (for
example, 8080)
• proxy-user-name, proxy-user-password, and domain specify the
credentials for the HTTP proxy server, if it requires authentication
(these arguments are optional)
You should see the script pulling down all the required files it needs:
At the very end you will see the agent start as a daemon:
You can also call the AWS Data Provider directly to view the metrics. Calling
wget http://localhost:8888/vhostmd returns a file of metrics. You can look
inside the file to see the metrics that were returned, as shown in Figure 17.
The AWS Data Provider will now automatically start each time the operating
system starts, and you can also manually stop and restart the AWS Data Provider
with the following command:
You will receive the following message when the installation process is
complete.
¾ When the script has completed, the software will be installed in the
C:\Program Files\Amazon\DataProvider directory.
¾ The installation also creates and starts a Windows service called AWS
Data Provider for SAP.
¾ You can open a web browser and type
http://localhost:8888/vhostmd to ensure that the service is
running. If it is, it will return pages of metrics from the Data Provider.
The service performs an update of the agent when it starts, and then works
in standard mode.
5. Verify that the service is running by calling netstat –ant from a
command window or from a Windows PowerShell script to determine if the
listener is running on localhost port 8888:
6. You should then go to the Windows event log and look at the application
log for startup events from the Data Provider. In particular, you should
look at the diagnostics.
You can also call the AWS Data Provider directly from your web browser to view
metrics, as shown in Figure 23:
The AWS Data Provider will now automatically start each time the operating
system starts, and you can also manually stop and restart the AWS Data Provider
just as you would stop and restart any other Windows service.
rm –rf /usr/local/ec2/aws-agent
rm /etc/rc.d/aws-agent
C:\Program Files\AmazonA\DataProvider\uninstall.exe
Troubleshooting
Troubleshooting on Linux
Problem: The installation failed, and I’m not sure if my files are in a
consistent state.
Check the /usr/local/ec2/aws-agent directory for the presence of a versions.mf
file. If this file is not present in the directory, rerun the installation script to
reload the entire set of files for the AWS Data Provider from the update service.
If the versions.mf file is present, delete it, and then rerun the installation script to
reload the Data Provider files.
If reinstalling the Data Provider doesn’t solve the problem, you can gather debug
information about the Data Provider by going to the /etc/rc.d/ directory and
editing the aws-agent file.
and then remove the last part of the line that suppresses console output
(> /dev/null 2>&1). You can comment out the original line so you can put it
back later.
Now if you run service aws-agent-start you will get a lot of debugging output
that may be of value in diagnosing the root cause of the problem.
rm –rf /usr/local/ec2/aws-agent
rm /etc/rc.d/aws-agent
You can then get the latest version of the installation script from
https://s3.amazonaws.com/aws-data-provider/bin/aws-agent_install.sh and
rerun it. This will download all prerequisites from scratch, and will install the
latest software distribution.
Failing all diagnostics indicates that there's a problem with your outbound
connection to the Internet. You can confirm this by pinging a well-known
Internet location like www.amazon.com. The most common cause of routing
issues will be in the VPC network configuration, which needs to have either an
Internet gateway in place, or a VPN connection to your data center with a route to
the Internet. For details, see the Internet Access section.
This is a clear indicator that you have an authorization issue when trying to
access CloudWatch and the Amazon EC2 API. The common cause for this
problem is not having an IAM role associated with your instance that contains
the IAM policy, as specified in the IAM Roles section of this guide. You can
quickly diagnose this issue by looking at the EC2 instance in question in the
Amazon EC2 console and verifying the IAM role.
If the IAM role does not exist, you will have to launch a new instance from an
AMI and assign it an IAM role. IAM roles cannot currently be assigned to an
instance that has already been launched.
If you do have an IAM role assigned to the instance, go to the IAM console, select
the IAM role name, and then choose Show. Verify that you have the required
policy that is specified in the IAM Roles section of this guide.
If reinstalling the Data Provider doesn’t solve the problem, you can gather
debugging information about the Data Provider by going to the C:\Program
Files\Amazon\DataProvider directory.
This directory contains several log files, including an installation log, a log of the
service installation, and the output of the AWS Data Provider itself.
Failing all diagnostics indicates that there’s a problem with your outbound
connection to the Internet. You can confirm this by pinging a well-known
Internet location like www.amazon.com. The most common cause of routing
issues will be in the VPC network configuration, which needs to have either an
Internet gateway in place, or a VPN connection to the customer’s data center with
a route to the Internet.
This is a clear indicator that you have an authorization issue when trying to
access CloudWatch and the Amazon EC2 API. The common cause for this
problem is not having an IAM role associated with your instance that contains
the IAM policy, as specified in the IAM Roles section of this guide. You can
quickly diagnose this issue by looking at the EC2 instance in question in the
Amazon EC2 console and verifying the IAM role.
If the IAM role does not exist, you will have to launch a new instance from an
AMI and assign it an IAM role. IAM roles cannot currently be assigned to an
instance that has already been launched.
If you do have an IAM role assigned to the instance, go to the IAM console, select
the IAM role name, and then choose Show. Verify that you have the required
policy that is specified in the IAM Roles section of this guide.
ec2type,i-type,cpu,core,threads,t-ecu,ecu,hthread,l-map,w-map,speed,p-ecu,
For example:
ec2type,r3.8xlarge,2,16,2,32,1,thread,eth0,lan2,10000,true,
where:
support,production,
where:
This section explains which metrics get exposed to the SAP system, and how they
can be accessed for SAP system monitoring.
1. Open a Windows command shell and direct the shell to the directory
C:\Program Files\SAP\hostctrl\exe. Start saposcol.exe with the -d
option.
2. SAPOSCOL is now in interactive mode. Type dump ccm and press Enter to
list all values gathered. SAPOSCOL will display a lengthy list of metrics:
Note that you will need the appropriate authorizations to look up this
information.
On this screen, you can verify core AWS information such as:
• Cloud provider
• Instance type
To view enhanced AWS statistics, choose the Standard View button in the
upper-left corner. It will change to Expert View and display the enhanced AWS
statistics. The list shown will be fairly comprehensive. It shows the processor
details:
It also shows details about the memory subsystem (main memory and disks) and
network interfaces:
Note: The screen illustrations in Figures 40-42 were taken from SAP NetWeaver
7.4 SP08. This version shows the enhanced AWS metrics in the Memory
Virtualization section. This problem has been fixed by SAP in later versions of
NetWeaver.
• Windows bug fix: AWS Data Provider now reports the correct disk
mapping for Windows EBS volumes with the following names: xvd[a-z][a-
z].
• New: Support for C4, D2, M4 instance types. Users who migrate instances
with installed 1.3 agents will automatically receive support for the new
instance types through an updated configuration database on the web.
Contributors
The following individuals contributed to this document:
• Stefan Schneider, solutions architect, Amazon Web Services
Notes
1
http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPC_Internet_G
ateway.html
2 http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPC_VPN.html
3 http://service.sap.com/sap/support/notes/1656250
4
https://help.sap.com/saphelp_nw70/helpdata/en/c4/3a6bff505211d18955000
0e829fbbd/frameset.htm