Scribd
Upload
94 views

Metadata Management and Usage Analysis

Datastage Meta Data Management

Uploaded by

Vamsi Karthik
Copyright
© Attribution Non-Commercial (BY-NC)
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
94 views

Metadata Management and Usage Analysis

Datastage Meta Data Management

Uploaded by

Vamsi Karthik
Copyright
© Attribution Non-Commercial (BY-NC)
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 13

Metadata Management and Usage Analysis

Agenda
What is Metadata Metadata Management Different Types of Metadata Supported in Datastage Metadata Management Tools Usage Analysis Dos and Donts

2002. Infosys Technologies Ltd.

What is Metadata
Metadata is data about data Ex Table Definitions, File Layouts, XML Schema, Datasets.

2002. Infosys Technologies Ltd.

Metadata Management
Single repository of Metadata Keep track of Metadata Impact Analysis Change at one place.

2002. Infosys Technologies Ltd.

Different Types of Metadata Supported in Datastage.

Metadata Management Tools


MetaStage

2002. Infosys Technologies Ltd.

Usage Analysis
Highlight the table for which you want to do usage analysis . Then go to tools > Usage analysis or click on usage analysis icon on tool bar Usage analysis window will appear

2002. Infosys Technologies Ltd.

Usage Analysis
In a name column you can find the jobname.stagename.linkname and columns associated with it. For usage analysis compare above columns with actual columns in stage on which you have loaded metadata. Say if You have loaded metadata (say column P and Q) of table A on stage X. Then when you do the usage analysis of table A under the name column section you will get entry JobName.X.Linkname.(P,Q) Compare above columns with actual column loaded on stage X in job. Number and name of columns present in actual stage and in usage analysis window should be same.

2002. Infosys Technologies Ltd.

Usage Analysis
If Passive stage on which you are loading metadata is followed by active stage then in usage analysis window metadata will show up on active stage jobname.stagename.linkname and columns associated with it. Here stagename will be active stage name. In following job passive stage (dataset) is followed by active stage

2002. Infosys Technologies Ltd.

Usage Analysis
Metadata showing on active stage.

2002. Infosys Technologies Ltd.

Usage Analysis
Following details can be monitor through Monitor window There are common errors which impact metadata management. Say you have loaded metadata of table A (Column P,Q,R ) on stage X and then you have changed name of column Q to T manually in job then when you do usage analysis of table A. you will get Job Name.X.linkname(P,Q,R) while on stage column will be P,T,R. In such scenario if metadata management tolls runs on job it will give error for column Q. We should avoid such scenario.

2002. Infosys Technologies Ltd.

10

Usage Analysis
Before submitting the job for metadata management do following steps. Remove the all metadata links for job. Load the metadata on passive stages. If you have build-op stage load metadata on input as well as output. Perform usage analysis to find any discrepancies.

2002. Infosys Technologies Ltd.

11

Dos
Load metadata for all passive stages using Load or Drag and Drop After loading the metadata into all the passive stages, map the records by dragging the necessary columns from the Input link to the Output link.

When copying an existing job, re-load the metadata for the passive links in the copied job. Choose to overwrite all metadata columns that are the same when prompted by Datastage.

2002. Infosys Technologies Ltd.

12

Donts

Do not move tables to different categories after tables have been added to jobs

Do not bring metadata from the Table Definitions into a link going from an active stage to another active stage

Do not use a rejected link from a Look-up Stage for data that needs to be loaded to a table, since rejected links from a Look-up Stage do not have metadata.

Do not change table structures directly on the links Do not manually change the structure of tables in the Datastage table definition categories, if the tables are modeled in Erwin Cheat Sheet

2002. Infosys Technologies Ltd.

13

You might also like