User Guide | PUBLIC

Document Version: PROD – 2024-01-16

Smart Data Integration (SDI)

© 2023 SAP SE or an SAP affiliate company. All rights reserved.

THE BEST RUN

Content

1 SAP Smart Data Integration (SDI) for SAP SuccessFactors Incentive Management. . . . . . . . . . 3

2 Quick Start Guide. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4

2.1 Data Integration in SAP SuccessFactors Incentive Management Using SAP Smart Data Integration
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4
2.2 Getting Started Checklist. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2.3 SAP SuccessFactors Incentive Management - SAP Smart Data Integration Architecture. . . . . . . . . . . 7
2.4 Glossary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

3 Setup and Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10

3.1 Data Provisioning (DP) Agent Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Troubleshooting Connectivity Issues. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3.2 Web IDE DB Explorer > EXT Schema Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

4 Inbound and Outbound Transfers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

4.1 Perform an Inbound File Transfer (Example: Load Transaction). . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
4.2 Perform an Outbound File Transfer (Example: Generate Payfile). . . . . . . . . . . . . . . . . . . . . . . . . . . 23
4.3 View Progress, Status Messages, and Logs in Web IDE. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
4.4 Monitor Tasks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26

5 Deploying Projects. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
5.1 Export Projects. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
5.2 Import Projects. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30

6 References. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

Smart Data Integration (SDI)

2 PUBLIC Content
1 SAP Smart Data Integration (SDI)
for SAP SuccessFactors Incentive
Management

Quick Start Guide

• SAP Smart Data Integration (SDI) for SAP SuccessFactors Incentive Management [page 3]
• SAP SuccessFactors Incentive Management - SAP Smart Data Integration Architecture [page 7]
• Getting Started Checklist [page 5]
• Inbound and Outbound Transfers [page 16]

Implementation

• Set up and Configure [page 10]

• Perform an Inbound Transfer [page 19]
• Perform an Outbound Transfer [page 23]
• Review File Transfer Details, Status, and Logs [page 3]

Smart Data Integration (SDI)

SAP Smart Data Integration (SDI) for SAP SuccessFactors Incentive Management PUBLIC 3
2 Quick Start Guide

Quick Links

• Data Integration in SAP SuccessFactors Incentive Management Using SAP Smart Data Integration [page
4]
• Getting Started Checklist [page 5]
• Glossary [page 8]

2.1 Data Integration in SAP SuccessFactors Incentive

Management Using SAP Smart Data Integration

SAP Smart Data Integration

SAP Smart Data Integration (SDI) is a component of the HANA platform that facilitates receiving, transforming,
and loading data to and from the HANA database. Capabilities include high-volume data loads, real-time and
batch data movement, high-speed data provisioning, and data transformation.

 Note

It is recommended NOT to store any Personal Identifying Information (PII) in Sales Transactions Generic
Attributes/Generic Numbers. If PII data is sent in transaction data, the PII attributes can be removed by
specifying the retention period in Preferences > System Preference > Data Protection Policy.

Make sure that transaction PII attributes are not used in Rules and Formulas because once these PII
attributes are purged (after the specified retention date), reprocessing pipelines for prior periods might not
yield accurate results.

Data Integration on SAP SuccessFactors Incentive Management using SAP

Smart Data Integration

SAP Smart Data Integration (SDI) is packaged as part of SAP SuccessFactors Incentive Management and can
be used to integrate your on-premise systems with SAP SuccessFactors Incentive Management on HANA.

Smart Data Integration (SDI) allows you to securely transfer critical business data to and from SAP
SuccessFactors Incentive Management, enabling you to easily synchronize and share data within your
organization.

Smart Data Integration (SDI)

4 PUBLIC Quick Start Guide
Using Smart Data Integration (SDI), you can transfer data pertaining to the business objects that are defined in
the system. You can transfer data to and from the following workspaces in Incentive Management:

• Orders and Transactions workspace for Results

• Participants, Positions, and Titles workspace for Organization

• Categories, Products, Customers, and Postal Codes workspace for Classification

Prerequisite

Understanding of data integration concepts, knowledge of SDI, Web IDE, HANA SQL and procedures is a
prerequisite for implementing SAP Smart Data Integration with SAP SuccessFactors Incentive Management on
HANA.

Related Topics

• Getting Started Checklist [page 5]

• SAP SuccessFactors Incentive Management - SAP Smart Data Integration Architecture [page 7]

2.2 Getting Started Checklist

 Note

Understanding of data integration concepts, knowledge of Smart Data Integration (SDI), Web IDE,
HANA SQL and procedures is a prerequisite for implementing SDI with SAP SuccessFactors Incentive
Management (HANA).

Use this checklist to get started with the setup and configuration process. Make sure you have all the
information handy before you proceed:

Item URL Notes

S-User ID -
Required to download DP
Agent

Link to Download DP Agent https://support.sap.com/en/my-sup-

port/software-downloads.html
or https://tools.hana.onde-
mand.com/#cloudintegration

Smart Data Integration (SDI)

Quick Start Guide PUBLIC 5
Item URL Notes

Tenant DB Name -
Provided in provisioning
email

Required to connect to
Tenant DB from WebIDE

HANA HTTPs URL (SQL connectivity) -

Provided in provisioning
email

Required to create the

data provisioning agent

Web IDE URL - Provided in provisioning email

Web IDE credentials -

Provided in provisioning
email

Required to import/export
projects and create
flowgraphs

HANA DB credentials -
Provided in provisioning
email

Required to access EXT

Schema

Data Provisioning Task Monitor https://

Required to monitor
<<servername>>/sap/
information about
hana/im/dp/monitor/
replication tasks and
index.html?
transformation tasks
view=IMTaskMonitor

Smart Data Integration (SDI)

6 PUBLIC Quick Start Guide
Related Articles

• Setup and Configuration [page 10]

2.3 SAP SuccessFactors Incentive Management - SAP

Smart Data Integration Architecture
Using SAP Smart Data Integration (SDI), data is loaded, in batches or real-time, into SAP SuccessFactors
Incentive Management (HANA) from flat files using pre-built and custom adapters. Data Provisioning Agents
are used to house adapters and connect to the source system with the Data Provisioning server which is
provisioned by the HANA system.

The following image illustrates the integration architecture.

SAP Smart Data Integration (SDI) is packaged as part of HANA Enterprise which comprises the following
components:

• HANA Server (SDI Data Provisioning Server) hosted by SAP/Callidus Datacenter

• Data Provisioning Agent hosted on-premise by customers

The Data Provisioning agent is installed in the customer’s premise and is set up to connect with SAP Smart
Data Integration (SDI) and the HANA DB Server. The DP Agent connects to the data source systems (Hadoop,

Smart Data Integration (SDI)

Quick Start Guide PUBLIC 7
Files, RDBMS, or others) and passes information between the source systems and the HANA Server using
built-in adapters that are packaged with the DP Agent. Data is transmitted over HTTPS to and from the HANA
Server.

Every SAP SuccessFactors Incentive Management solution is provisioned with a separate HANA tenant
database. Web IDE facilitates access to the HANA database and Smart Data Integration (SDI) components.
A development space is provisioned in Web IDE XSA (Extended Application Service) to enable application
developers to manage content integration development. The Web IDE DB Explorer plugin allows users to
connect to the tenant database and access the schemas.

Related Topics

• Getting Started Checklist [page 5]

• Glossary [page 8]

2.4 Glossary

Commonly used terms in SAP SuccessFactors Incentive Management - SAP Smart Data Integration (SDI)
integration are described below:

Term Definition

Adapter SAP Smart Data Integration (SDI) component that allows

connectivity to external sources.

Incentive Management Stage Tables Temporary data storage area in Incentive Management
where data from Smart Data Integration (SDI) is placed dur-
ing export. Data is validated in the staging area before trans-
ferring into the Incentive Management tables and executing
the pipeline.

DP Agent The Data Provisioning Agent hosts all Smart Data Integration
(SDI) Adapters and acts as the communication interface
between Hana and the Adapter.

Flat File Flat file allows you to specify data attributes, such as col-
umns and data types table by table, and stores the data in
plain text format.

Flow Graph A graphical user interface to develop data integration map-

ping and transformations.

Smart Data Integration (SDI)

8 PUBLIC Quick Start Guide
 Term Definition

EXT Schema EXT Schema in HANA database is a temporary database

that facilitates data validation, transformation, aggregation,
and cleaning for large volumes of data. It allows creating
custom tables and stored procedures to process bulk data.

HANA Database SAP HANA database that is used by SAP SuccessFactors

Incentive Management for data storage and processing.

Pipeline Pipeline is a compensation computation process initiated

from the Pipeline workspace in the Job Queue view or from
the command-line utility. The pipeline produces compensa-
tion and pays results for payees assigned to variable com-
pensation plans.

Incentive Management Workspace Designated area in Incentive Management where related

compensation objects are grouped together so that a user
can perform related tasks from the same place.

ODATA Protocol for building and consuming REST APIs.

Virtual Table A HANA component, which allows read and write of data
from external sources.

Web IDE
SAP Web IDE is a browser-based integrated development
environment (IDE), comprised of web-based UIs, business
logic, and extensive SAP HANA data models, that are lever-
aged by Smart Data Integration (SDI).

Web IDE facilitates access to HANA database and Smart

Data Integration (SDI) components. It is also a Web-based
development environment for SAP Fiori, SAPUI5, and full-
stack business apps.

Smart Data Integration (SDI)

Quick Start Guide PUBLIC 9
3 Setup and Configuration

The following components need to be set up and configured to implement Smart Data Integration with SAP
SuccessFactors Incentive Management for data integration:

• Data Provisioning (DP) Agent Installation [page 10]

• Web IDE DB Explorer > EXT Schema Connectivity [page 12]

 Note

Use of GitHub is currently not supported in SDI.

Related Topics

• Getting Started Checklist [page 5]

• Inbound and Outbound Transfers [page 16]

3.1 Data Provisioning (DP) Agent Installation

The Data Provisioning Agent is a lightweight component that hosts data provisioning adapters, enabling data
federation, replication, and transformation scenarios for deployments. It provides secure connectivity between
the SAP HANA database and your on-premise adapter-based sources.

 Note

For best performance, we recommend that you install the Data Provisioning Agent on a separate machine
or in a virtual machine as close to the source database as possible.

Perform the following steps:

1. Download DP Agent. You can download the DP Agent and SAPCAR file from the SAP Support portal .

 Note

You can also install DP Agent from the HANA Tools site.

2. Install DP Agent.For detailed information on installing the DP Agent, see:

• HANA Academy Video: https://www.youtube.com/watch?v=3GzU2NKc4Bs
• SAP Documentation: https://help.sap.com/viewer/
7952ef28a6914997abc01745fef1b607/2.0_SPS03/en-US/44cedf222fa045d8a056175cf21054b7.html
3. Configure DP Agent. Launch the DP Agent configuration tool.
1. To start the DP Agent, click Start Agent.

Smart Data Integration (SDI)

10 PUBLIC Setup and Configuration
 2. Click Connect to HANA.

3. Select the HANA on Cloud and Use HTTPS checkboxes.

4. Provide the following information you received from SAP Support:

• HANA Hostname
• HANA Port
• HANA Agent Admin Name
• HANA Agent Admin Password
• HANA XS Agent User
• HANA XS Agent Password

Smart Data Integration (SDI)

Setup and Configuration PUBLIC 11
 5. Click Connect.

For detailed information on configuring the DP Agent, see: https://help.sap.com/viewer/

7952ef28a6914997abc01745fef1b607/2.0_SPS03/en-US/76e13fc3ed064821841fe8049e23aa59.html

Related Topics

• Getting Started Checklist [page 5]

3.1.1 Troubleshooting Connectivity Issues

For connectivity issues, check the Data Provisioning Agent Logs (available at DP Agent Operating System level)
to resolve the problem.

To resolve connectivity issues:

1. Log in to the DP Agent server ssh session.

2. Stop and restart the DP Agent service.
3. Connect to the DP Agent service again.

If the issue persists, make sure the DP Agent server is able to access HANA over the internet and there are no
Firewalls blocking the connection. If everything looks okay, and the connectivity is still not established, raise an
incident with SAP support in support.sap.com using your “S” user account.

Related Topics

• Data Provisioning (DP) Agent Installation [page 10]

• Getting Started Checklist [page 5]

3.2 Web IDE DB Explorer > EXT Schema Connectivity

• Logging in to Web IDE [page 13]

• Web IDE DB Explorer > EXT Schema Connectivity [page 13]

Smart Data Integration (SDI)

12 PUBLIC Setup and Configuration
Logging in to Web IDE

Web IDE facilitates access to HANA database and SDI components. To connect to Web IDE, you need the
following details:

• Web IDE URL

• Web IDE Username and Password

Launch the Web IDE URL and provide the username and password.

You will be prompted to change your initial password after the first login.

Web IDE DB Explorer > EXT Schema Connectivity

EXT Schema is the Incentive Management HANA database schema which allows creating custom HANA tables
and procedures. In Web IDE, launch DB Explorer to connect to EXT Schema.

1. Launch DB Explorer from Web IDE. After logging in to Web IDE, click the DB Explorer icon on the left panel.
The DB Explorer interface is displayed.

Smart Data Integration (SDI)

Setup and Configuration PUBLIC 13
2. Add Database to DB Explorer (if logging in for the first time). To add the database to DB Explorer, you need
the following details:
• HANA Database Host URL
• Port
• Tenant Database Name
• User and Password

 Note

Do not select the Save user and password (stored in the SAP HANA secure store) option at this point
because you will be prompted to change this initial password when you first log in.

3. Navigate and work with EXT Schema.

Smart Data Integration (SDI)

14 PUBLIC Setup and Configuration
Related Topics

• Getting Started Checklist [page 5]

• SAP SuccessFactors Incentive Management - SAP Smart Data Integration Architecture [page 7]

Smart Data Integration (SDI)

Setup and Configuration PUBLIC 15
4 Inbound and Outbound Transfers

Overview

A typical Extract, Load and Transform pattern would involve 4 primary stages as illustrated below. Data is first
loaded into the EXT Schema typically where it is transformed, cleansed, and validated before being loaded
into the Incentive Management Staging tables. After data is loaded into the staging tables, a flowgraph calls
the ODATA API (using ODATA adapter) to execute the Incentive Management Pipeline to import data from the
Staging tables to the main Incentive Management tables. Users can use monitors to track agents and execution
of tasks.

Stage 1: Data Federation

In the first stage, data is federated in the virtual table in DB Explorer from the remote data source.

Pre-requisite: Create a remote source in the HANA tenant database via Web IDE DB Explorer to be able to
create virtual tables.

 Note

A remote source owner can create or grant privileges for creating virtual tables on a remote source.
Alternatively, remote source creation can be done as PS_ <user>.

Ensure the following steps are performed:

1. Set up SDI DP Agent connection to the SDI DP Server.

2. Turn the adapter on.
3. Create a remote data source in the HANA DB via Web IDE DB Explorer. The remote source is required to
create a virtual table.
4. Create a virtual table.

Smart Data Integration (SDI)

16 PUBLIC Inbound and Outbound Transfers
Stage 2: Load Data

In this stage, data is loaded into the EXT schema table from the virtual table. Typically, users create the same
table structure in EXT schema as in the source table and then load data. This step is executed using flowgraphs
that are built in Web IDE.

Transformations are possible in this stage but are not performed since this is mainly an Extract and Load step.

Stage 3: Transform Data

In this stage, data is transformed and moved from the EXT schema table to the TCMP schema table. This step
is executed using flowgraphs that are built in Web IDE.

Stage 4: Run the OData API

In the final stage, data is moved to the main Incentive Management table from the TCMP table.

To achieve this, the Incentive Management pipeline is triggered. Once the Incentive Management pipeline is
executed, data is moved from the TCMP stage table to TCMP main table.

The Incentive Management pipeline can be triggered using:

• Option 1: Calling the Incentive Management OData API.

• Option 2: Creating a flowgraph using the Web IDE that uses the OData remote source.

Smart Data Integration (SDI)

Inbound and Outbound Transfers PUBLIC 17
Important: WEB IDE Project (Use, Function, Access)

Web IDE project uses the HDI (HANA Deployment Infrastructure) service layer to deploy HANA database
artifacts. HDI also introduces HDI container for database. HDI container is essentially a database schema.
It abstracts the actual physical schema and provides schema-less development to the Web IDE project. The
physical schema is abstracted by the HDI container. Only local object (HDI container schema) access is allowed
from the Web IDE application. Two technical users (Object Owner and Schema Owner) are also created.
Technical users have access to only the local objects. Any foreign object (such as tables in EXT and TCMP
schema) must be accessed via Synonyms and must be granted access by the foreign technical user (tenant
database user).

Development Steps:

1. Create Web IDE project

2. Create SAP HANA Service to connect with SAP SuccessFactors Incentive Management HANA database
3. Create Synonym for virtual table and EXT schema table
4. Build the project and grant access to virtual and physical tables to Object Owner as shown in the below
example:

• GRANT SELECT, INSERT, UPDATE, DELETE ON "SCHEMA"."VIRTUAL_TABLE" to TECHNICAL_USER_1#OO

with grant option;
• GRANT SELECT, INSERT, UPDATE, DELETE ON "SCHEMA"."PHYSICAL_TABLE" to
TECHNICAL_USER_1#OO with grant option;
Grants should be handled by users with their PS_<tenantdbname> account.

 Note

<TECHNICAL_USER>#OO should have privileges granted with grant option for all EXT objects which
users use in that specific project (and on all objects they have created synonyms for). Alternatively,
to manage the required permissions on the tables, users can create a .hdbgrants file to handle the
table permissions.

 Note

If you choose to use the History Preserving Flowgraph component with HANA SPS 05, it is highly
recommended to have a logical key defined in the component’s target table. It is also recommended
that the columns for the logical key are picked as follows:

Smart Data Integration (SDI)

18 PUBLIC Inbound and Outbound Transfers
 • The columns that anyway define the primary key of the target table, plus
• The columns that are used for joining with the source table

For more information, see the following documentation:

• SAP Note 3026693

• SAP HANA Smart Data Integration for SP05
• Modeling Guide for SAP HANA Web-based Development Workbench

Related Articles

• Perform an Inbound File Transfer (Example: Load Transaction) [page 19]

• Perform an Outbound File Transfer (Example: Generate Payfile) [page 23]

4.1 Perform an Inbound File Transfer (Example: Load

Transaction)

In an inbound transfer, data will be copied from the source system/flat files and loaded into the Incentive
Management tables.

 Note

Data can be loaded from various data sources. As an example, the procedure to transfer data from flat files
is illustrated in this documentation. Any Smart Data Integration (SDI) compatible template can be used to
create flat files.

Steps

The following image illustrates the steps involved in an Inbound File Transfer.

Smart Data Integration (SDI)

Inbound and Outbound Transfers PUBLIC 19
To perform an inbound transfer:

1. Copy file for Transfer.

1. Log in to the DP Server Agent.
2. Copy file for transfer. (Example: Transaction)
2. Create Remote Source (if it does not exist).
1. Log in to WEB IDE and create a Remote Source (Inbound File) for File Adapter.
3. Create Virtual Table.
1. Create a virtual table for the file copied in step 1 (Transaction) using the remote source Inbound File.
2. Open DB Explorer and login to EXT schema.
4. Create a Custom EXT Table.
1. Create a custom table in EXT for the file copied in step 1. (Example: Transaction)
5. Create FlowGraph #1 (Database folder):
1. Create a Synonym for the respective table from EXT. (Example: Transaction)
2. Create a FlowGraph and define Virtual table as the Source and the Synonym created as the Target.
3. In between the source and target, introduce a Procedure as a Transformation (develop this procedure
in EXT schema).
4. Build the FlowGraph and Execute.

Smart Data Integration (SDI)

20 PUBLIC Inbound and Outbound Transfers
6. Create FlowGraph #2(Database folder):
1. Create a Synonym for the respective table from TCMP. (Example: CS_STAGESALESTRANSACTION)
2. Create a FlowGraph and define Synonym for EXT.table as source and Synonym for TCMP table as
target. (Example: EXT.Transaction as source and CS_STAGESALESTRANSACTION as target)
3. Include Transformations.
4. Build the FlowGraph and Execute.
7. Execute the Incentive Management pipeline by calling the Incentive Management API service with the
respective payload using Google Postman or any REST API Client tools.

ODATA API Details

URL: https://<commissionshostname>:447/TrueComp-SaaS/CommissionsService.svc/PipelineRuns

Method Type: POST

Basic Authorization: Commission Admin Username and Password

Sample Payload Validate and Transfer

"StartDateScheduled": "2019-06-06T14:57:00Z",

"TraceLevel": null,

"SkipAnalyzeSchema": null,

"SqlLogging": null,

"DebugContext": null,

"Command": "Import",

"StageType": "ValidateAndTransfer",

"CalendarName": "Main Monthly Calendar",

"Period": {

"Calendar": {

"Name": "Main Monthly Calendar"

},

"Name": "April 2019"

},

"BatchName": "BATCH1",

"RunMode": "all",

Smart Data Integration (SDI)

Inbound and Outbound Transfers PUBLIC 21
"Module": "OrganizationData"

CalendarName String Calendar name

StageType String Stage Type name

Revalidate String ReValidate the relevant stage records.

Valid values are : all, onlyError

TraceLeveloptional String Options to trace(log) the pipeline proc-

ess. Available options are 'profile'-Per-
formance Statistics,'internal'-Verbose
Logging. You can pass multiple option
as comma separated string.

- String Default value: status

SqlLoggingoptional Boolean Allow sql logging for Pipeline process.

- Boolean Default value: false

StartDateScheduledoptional String Date when pipeline job starts. Only

passed to submit job for future date.

UserIdoptional String User who submitted the pipeline job.

BatchName String Reset only specific data which are im-

ported with this batchName.

Module String Reset only specific data which are from

module specified by Module name.
Valid values are: TransactionalData,
OrganizationData , ClassificationData,
PlanRelatedData or PlanRelatedData

RunMode String Run mode of the import job. i.e. all

To monitor load status and logs, see Monitor Tasks [page 26].

 Note

Calling the ODATA adapter to execute the Incentive Management pipeline can be part of a flowgraph and
scheduled in a task chain.

Related Articles

• Setup and Configuration [page 10]

Smart Data Integration (SDI)

22 PUBLIC Inbound and Outbound Transfers
• Inbound and Outbound Transfers [page 16]
• Getting Started Checklist [page 5]

4.2 Perform an Outbound File Transfer (Example: Generate

Payfile)

In outbound transfer, data is copied from EXT Schema which has read access Incentive Management tables
(TCMP) and loaded into the target.

 Note

Data can be extracted into various data systems. As an example, the procedure to transfer data to flat files
is illustrated in this documentation.

Steps

The following image illustrates the steps involved for an Outbound File Transfer.

Smart Data Integration (SDI)

Inbound and Outbound Transfers PUBLIC 23
To perform an inbound transfer:

1. Create Custom EXT Table.

1. Open DB Explorer and log in to EXT schema.
2. Create a custom table in EXT for the respective source (Example: Payroll_Data)
2. Create a Custom Stored Procedure.
1. Open DB Explorer and log in to EXT schema.
2. Create a custom procedure in EXT to transfer data from TCMP to EXT (Ex: Payroll_Data_Proc)
3. In this procedure write SQL statements to extract payment data from Incentive Management and load
into the respective custom table (Example: Payroll_Data)
3. Create FlowGraph#1:
1. Create a FlowGraph and define Virtual table (Example: Payroll) as your target and Synonym as a
source.

Smart Data Integration (SDI)

24 PUBLIC Inbound and Outbound Transfers
 2. Build FlowGraph and Execute.

Optionally, you can create additional flowgraphs to meet your requirements and chain flowgraphs.

To monitor data transfer status and logs, see Monitor Tasks. [page 26]

Related Articles

• Setup and Configuration [page 10]

• Inbound and Outbound Transfers [page 16]
• Getting Started Checklist [page 5]

4.3 View Progress, Status Messages, and Logs in Web IDE

When developing Flowgraphs, check the Console in Web IDE to view data transfer progress, status messages,
and logs.

See also Monitor Agents and Tasks [page 26].

Smart Data Integration (SDI)

Inbound and Outbound Transfers PUBLIC 25
Related Articles

• Monitor Tasks [page 26]

• Inbound and Outbound Transfers [page 16]

4.4 Monitor Tasks

Data Provisioning Monitor is a browser-based interface that lets you monitor information about tasks.

DP Monitor URL Purpose Intended for (Persona/User

Types)

Data Provisioning Task Moni- https://<<server>>/sap/ Monitor information about Operations Team
tor hana/im/dp/monitor/in- replication tasks and trans-
dex.html?view=IMTaskMoni- formation tasks. Details in-
tor clude duration of a task,
number of records processed
etc.)

Providing DP Agent Task Monitor Users Access to Execute or Schedule

WebIDE Flowgraphs

When WebIDE project with HANA module is deployed, the system creates an additional schema:

“<ProjectName>”_HDI_”<HDIModuleName>”_1#OO.

This schema contains a procedure named “GRANT_CONTAINER_SCHEMA_PRIVILEGES” which needs to be

executed with proper authorization parameters to provide DP Task Monitor users authority to execute or
schedule WebIDE flowgraphs. Perform the following steps to provide authorization:

1. Log on to Webide/DBExplorer and launch SQL Console (Admin) in the respective container.

Smart Data Integration (SDI)

26 PUBLIC Inbound and Outbound Transfers
2. Insert the following SQL into the console and modify JUNEDEMO_HDI_JUNEMOD_1#DI with
the Schema name similar to the Container name of your WebIDE project. Example:
“<ProjectName>”_HDI_”<HDIModuleName>”_1#OO
set schema JUNEDEMO_HDI_JUNEMOD_1#DI;
create local temporary column table "#PRIVILEGES" like
"_SYS_DI"."TT_SCHEMA_PRIVILEGES";
insert into "#PRIVILEGES" ("PRIVILEGE_NAME", "PRINCIPAL_SCHEMA_NAME",
"PRINCIPAL_NAME") values ('SELECT', '', 'DPCONN');
insert into "#PRIVILEGES" ("PRIVILEGE_NAME", "PRINCIPAL_SCHEMA_NAME",
"PRINCIPAL_NAME") values ('INSERT', '', 'DPCONN');
insert into "#PRIVILEGES" ("PRIVILEGE_NAME", "PRINCIPAL_SCHEMA_NAME",
"PRINCIPAL_NAME") values ('UPDATE', '', 'DPCONN');
insert into "#PRIVILEGES" ("PRIVILEGE_NAME", "PRINCIPAL_SCHEMA_NAME",
"PRINCIPAL_NAME") values ('DELETE', '', 'DPCONN');
insert into "#PRIVILEGES" ("PRIVILEGE_NAME", "PRINCIPAL_SCHEMA_NAME",
"PRINCIPAL_NAME") values ('EXECUTE', '', 'DPCONN');
call
"JUNEDEMO_HDI_JUNEMOD_1#DI"."GRANT_CONTAINER_SCHEMA_PRIVILEGES"("#PRIVILEGES",
"_SYS_DI"."T_NO_PARAMETERS", ?, ?, ?);
drop table "#PRIVILEGES";

Smart Data Integration (SDI)

Inbound and Outbound Transfers PUBLIC 27
 You can get the Schema name from the DBexplorer under JuneDemo (example):

3. Log on to DPAgent Task Monitor and check that every flowgraph in the given HANA
module (such as JUNEMOD and HDBPARTICIPANT as shown in the above example) is
available and authorized for execution and scheduling to the DP Agent Task Monitoring users.

 Note

To schedule custom stored procedures, use XSJS Jobschedule. See Incentive Management - SDI Job
Scheduler XSJS for more details.

Also, see Making HDI containers accessible to a classic database user for additional information on HDI
containers.

Related Articles

• View Progress, Status Messages, and Logs in WEB IDE [page 25]
• Inbound and Outbound Transfers [page 16]

Smart Data Integration (SDI)

28 PUBLIC Inbound and Outbound Transfers
5 Deploying Projects

You can migrate the entire Web IDE XSA Project to another environment. You can also import projects from
other environments.

Related Articles

• Export Projects [page 29]

• Import Projects [page 30]

5.1 Export Projects

Quick Links

• Standard Option [page 29]

Standard Option

Perform the following steps to export a project using the standard option:

1. Log in to WebIDE of the source environment to export the Project.

2. Right click on the respective Project and select the Export option.

Smart Data Integration (SDI)

Deploying Projects PUBLIC 29
3. Select file location to save the exported project (.zip).

4. Click Save. Export is completed on clicking Save.

Related Articles

• Deploying Projects [page 29]

• Import Projects [page 30]

5.2 Import Projects

Quick Links

• Standard Option [page 30]

• MTAR Option [page 32]

Standard Option

1. Log in to WebIDE and select the workspace and click Import.

Smart Data Integration (SDI)

30 PUBLIC Deploying Projects
 2. Select the project that needs to be imported into the workspace.

 Note

: This will overwrite any content if a similar project already exists.

The project is available in the workspace after a successful import.

Smart Data Integration (SDI)

Deploying Projects PUBLIC 31
MTAR Option

1. Log in to WebIDE and select the workspace and click Import.

Smart Data Integration (SDI)

32 PUBLIC Deploying Projects
 2. Select the MTAR file that is obtained from export.
3. To deploy, select Deploy to XS Advanced.

Smart Data Integration (SDI)

Deploying Projects PUBLIC 33
Troubleshooting

The following message is displayed during deployment if the underlying connection configurations are not
correct.

To resolve this issue, ensure that the connection configurations are set correctly, and retry. If the problem
persists, contact Customer Support.

Related Articles

• Deploying Projects [page 29]

• Export Projects [page 29]

Smart Data Integration (SDI)

34 PUBLIC Deploying Projects
6 References

The table below provides links to detailed information on the following topics:

Topic Link

SDI Product Availability Matrix

https://support.sap.com/content/dam/
launchpad/en_us/pam/pam-essentials/TIP/
PAM_HANA_SDI_1_0.pdf

https://support.sap.com/content/dam/
launchpad/en_us/pam/pam-essentials/TIP/
PAM_HANA_SDI_2_0.pdf

SDI Product Support https://support.sap.com/en/product/support-by-prod-

uct/73554900100800000033/default-editorial.html

HANA Academy Videos https://www.youtube.com/playlist?

list=PLkzo92owKnVwQ_preA3cxlQjn_v3W0Eh5

SDI Documentation
https://help.sap.com/viewer/p/HANA_SMART_DATA_INTE-
GRATION

https://training.sap.com/course/ha350-sap-hana-data-pro-
visioning-classroom-013-us-en/

https://jam4.sapjam.com/groups/
aJfzfCQIIJ2SUHVzjwlg3P/forums?
folder_id=2c1CnFbSGkKWMm2tLSszh7

Related Articles

• Getting Started Checklist [page 5]

• Setup and Configuration [page 10]

Smart Data Integration (SDI)

References PUBLIC 35
Important Disclaimers and Legal Information

Hyperlinks
Some links are classified by an icon and/or a mouseover text. These links provide additional information.
About the icons:

• Links with the icon : You are entering a Web site that is not hosted by SAP. By using such links, you agree (unless expressly stated otherwise in your
agreements with SAP) to this:

• The content of the linked-to site is not SAP documentation. You may not infer any product claims against SAP based on this information.

• SAP does not agree or disagree with the content on the linked-to site, nor does SAP warrant the availability and correctness. SAP shall not be liable for any
damages caused by the use of such content unless damages have been caused by SAP's gross negligence or willful misconduct.

• Links with the icon : You are leaving the documentation for that particular SAP product or service and are entering an SAP-hosted Web site. By using
such links, you agree that (unless expressly stated otherwise in your agreements with SAP) you may not infer any product claims against SAP based on this
information.

Videos Hosted on External Platforms

Some videos may point to third-party video hosting platforms. SAP cannot guarantee the future availability of videos stored on these platforms. Furthermore, any
advertisements or other content hosted on these platforms (for example, suggested videos or by navigating to other videos hosted on the same site), are not within
the control or responsibility of SAP.

Beta and Other Experimental Features

Experimental features are not part of the officially delivered scope that SAP guarantees for future releases. This means that experimental features may be changed by
SAP at any time for any reason without notice. Experimental features are not for productive use. You may not demonstrate, test, examine, evaluate or otherwise use
the experimental features in a live operating environment or with data that has not been sufficiently backed up.
The purpose of experimental features is to get feedback early on, allowing customers and partners to influence the future product accordingly. By providing your
feedback (e.g. in the SAP Community), you accept that intellectual property rights of the contributions or derivative works shall remain the exclusive property of SAP.

Example Code
Any software coding and/or code snippets are examples. They are not for productive use. The example code is only intended to better explain and visualize the syntax
and phrasing rules. SAP does not warrant the correctness and completeness of the example code. SAP shall not be liable for errors or damages caused by the use of
example code unless damages have been caused by SAP's gross negligence or willful misconduct.

Bias-Free Language
SAP supports a culture of diversity and inclusion. Whenever possible, we use unbiased language in our documentation to refer to people of all cultures, ethnicities,
genders, and abilities.

Smart Data Integration (SDI)

36 PUBLIC Important Disclaimers and Legal Information
Smart Data Integration (SDI)
Important Disclaimers and Legal Information PUBLIC 37
www.sap.com/contactsap

© 2023 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form

or for any purpose without the express permission of SAP SE or an SAP
affiliate company. The information contained herein may be changed
without prior notice.

Some software products marketed by SAP SE and its distributors

contain proprietary software components of other software vendors.
National product specifications may vary.

These materials are provided by SAP SE or an SAP affiliate company for

informational purposes only, without representation or warranty of any
kind, and SAP or its affiliated companies shall not be liable for errors or
omissions with respect to the materials. The only warranties for SAP or
SAP affiliate company products and services are those that are set forth
in the express warranty statements accompanying such products and
services, if any. Nothing herein should be construed as constituting an
additional warranty.

SAP and other SAP products and services mentioned herein as well as
their respective logos are trademarks or registered trademarks of SAP
SE (or an SAP affiliate company) in Germany and other countries. All
other product and service names mentioned are the trademarks of their
respective companies.

Please see https://www.sap.com/about/legal/trademark.html for

additional trademark information and notices.

THE BEST RUN