Looping in Datastage | InfoSphere DataStage - IBM https://datastage4u.wordpress.

com/2011/12/14/looping-in-datastage/

InfoSphere DataStage – IBM

Uma Katru – IBM Certified Solution Developer – InfoSphere DataStage v8.0 & WebSphere IIS DataStage
Enterprise Edition V7.5

Home
Uma Maheswara Rao Katru

Home > Sequence Activities > Looping in Datastage

Looping in Datastage
December 14, 2011 ukatru Leave a comment Go to comments

In this article i will explain how to use datastage looping acitvities in sequencer.

I have a requirement where i need to pass file id as parameter reading from a file.In Future
file id’s will increase so that i don’t have to add job or change sequencer if I take
advantage of datastage looping.

Contents in the File:

1|200

2|300

3|400

I need to read the above file and pass second field as parameter to the job.I have created
one parallel job with pFileID as parameter.

Step:1 Count the number of lines in the file so that we can set the upper limit in the
datastage start loop activity.

sample routine to count lines in a file:

Argument : FileName(Including path)

Deffun DSRMessage(A1, A2, A3) Calling “*DataStage*DSR_MESSAGE”

Equate RoutineName To “CountLines”

Command = “wc -l”:” “:FileName:”| awk ‘{print $1}'”

Call DSLogInfo(“Executing Command To Get the Record Count “,Command)

* call support routine that executes a Shell command.
CallPrivacy
DSExecute(“UNIX”,
& Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
Close and accept
To find out more, including how to control cookies, see here: Cookie Policy
* Log any and all output as an Information type log message,

1 of 7 18-11-2018, 09:40:06
Looping in Datastage | InfoSphere DataStage - IBM https://datastage4u.wordpress.com/2011/12/14/looping-in-datastage/

* unless system’s return code indicated that an error occurred,

* when we log a slightly different Warning type message.
vOutput=convert(char(254),””,Output)
If (SystemReturnCode = 0) And (Num(vOutput)=1) Then
Call DSLogInfo(“Command Executed Successfully “,Command)
Output=convert(char(254),””,Output)
Call DSLogInfo(“Here is the Record Count In “:FileName:” = “:Output,Output)
Ans = Output
*GoTo NormalExit
End Else
Call DSLogInfo(“Error when executing command “,Command)
Call DSLogFatal(Output, RoutineName)
Ans = 1

End

Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
Close and accept
To find out more, including how to control cookies, see here: Cookie Policy

2 of 7 18-11-2018, 09:40:06
Looping in Datastage | InfoSphere DataStage - IBM https://datastage4u.wordpress.com/2011/12/14/looping-in-datastage/

Now we use startLoop.$Counter variable to get the file id by using combination of grep
and awk command.

for each iteration it will get file id.

Finally the seq job looks like below.

I hope every one likes this post.

Thanks
Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
Close and accept
UmaTo find out more, including how to control cookies, see here: Cookie Policy

3 of 7 18-11-2018, 09:40:06
Looping in Datastage | InfoSphere DataStage - IBM https://datastage4u.wordpress.com/2011/12/14/looping-in-datastage/

Share this:

Be the first to like this.

Related

Use of the tunable parameters Reading File using Sequential Important Technotes -- IBM
in the UVCONFIG file File Stage Infosphere Information Server
8.5/8.7

Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
Categories: Close and accept
To find out(0)
Comments more, including how to control cookies, see here: Cookie Policy

4 of 7 18-11-2018, 09:40:06
Looping in Datastage | InfoSphere DataStage - IBM https://datastage4u.wordpress.com/2011/12/14/looping-in-datastage/

1. No comments yet.

1. No trackbacks yet.

Leave a Reply

Infosphere Information Server 8.7–Monitoring Datastage Jobs Operations console

Connector Migration Tool — IBM InfoSphere Information Server, Version 8.5
RSS feed

Recent Posts

Use of the tunable parameters in the

UVCONFIG file
InfoSphere DataStage parallel jobs:
Understanding the content of the
APT_DUMP_SCORE report
Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
Close and accept
To find out more, including how to control cookies, see here: Cookie Policy
dsadmin Command for

5 of 7 18-11-2018, 09:40:06
Looping in Datastage | InfoSphere DataStage - IBM https://datastage4u.wordpress.com/2011/12/14/looping-in-datastage/

administering Projects
DSXImportService.sh — Infosphere
Information Server 8.x
JR42922: PROBLEMS WITH
TRANSFORMER NULL TESTING
EXPRESSIONS WHEN RUNNING
WITH
APT_TRANSFORM_COMPILE_OLD_NULL_HANDLING
is set
Issues with NULL values in input columns
in Parallel Engine Transformer stage
Important Technotes — IBM Infosphere
Information Server 8.5/8.7
Environment Variables and using
Parameter Sets — Infosphere information
Server 8.5
Vertica database Installation steps on two
node cluster(Redhat 5.8x86_64)

Categories

Command Line Interface

Datastage Common Errors-Warnings
Datastage-Best Practices
Datastage-Connector Stages
Datastage-Stages
Datastage-Unix Scripts
Datastage8.5-New features
InfosphereDatastage-Installation
Sequence Activities
vertica

Blogroll

Discuss
Get Inspired
Get Polling
Get Support
Learn WordPress.com
WordPress Planet
WordPress.com News

Archives

October 2012
September 2012
July 2012
May 2012
Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
Close and accept
To find out more, including how to control cookies, see here: Cookie Policy

6 of 7 18-11-2018, 09:40:06
Looping in Datastage | InfoSphere DataStage - IBM https://datastage4u.wordpress.com/2011/12/14/looping-in-datastage/

December 2011
November 2011
August 2011
June 2011
May 2011
April 2011

Meta

Register
Log in

Top
Blog at WordPress.com.

Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
Close and accept
To find out more, including how to control cookies, see here: Cookie Policy

7 of 7 18-11-2018, 09:40:06