Administrator Guide

Informatica PowerCenter
(Version 8.1.1)

Informatica PowerCenter Administrator Guide Version 8.1.1 September 2006 Copyright (c) 19982006 Informatica Corporation. All rights reserved. Printed in the USA. This software and documentation contain proprietary information of Informatica Corporation and are provided under a license agreement containing restrictions on use and disclosure and are also protected by copyright law. Reverse engineering of the software is prohibited. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying, recording or otherwise) without prior consent of Informatica Corporation. Use, duplication, or disclosure of the Software by the U.S. Government is subject to the restrictions set forth in the applicable software license agreement and as provided in DFARS 227.7202-1(a) and 227.7702-3(a) (1995), DFARS 252.227-7013(c)(1)(ii) (OCT 1988), FAR 12.212(a) (1995), FAR 52.227-19, or FAR 52.227-14 (ALT III), as applicable. The information in this document is subject to change without notice. If you find any problems in the documentation, please report them to us in writing. Informatica Corporation does not warrant that this documentation is error free. Informatica, PowerCenter, PowerCenterRT, PowerCenter Connect, PowerCenter Data Analyzer, PowerMart, SuperGlue, Metadata Manager, Informatica Data Quality and Informatica Data Explorer are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners. Portions of this software and/or documentation are subject to copyright held by third parties, including without limitation: Copyright DataDirect Technologies, 1999-2002. All rights reserved. Copyright Sun Microsystems. All Rights Reserved. Copyright RSA Security Inc. All Rights Reserved. Copyright Ordinal Technology Corp. All Rights Reserved. Informatica PowerCenter products contain ACE (TM) software copyrighted by Douglas C. Schmidt and his research group at Washington University and University of California, Irvine, Copyright (c) 1993-2002, all rights reserved. Portions of this software contain copyrighted material from The JBoss Group, LLC. Your right to use such materials is set forth in the GNU Lesser General Public License Agreement, which may be found at http://www.opensource.org/licenses/lgpl-license.php. The JBoss materials are provided free of charge by Informatica, as-is, without warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability and fitness for a particular purpose. Portions of this software contain copyrighted material from Meta Integration Technology, Inc. Meta Integration is a registered trademark of Meta Integration Technology, Inc. This product includes software developed by the Apache Software Foundation (http://www.apache.org/). The Apache Software is Copyright (c) 1999-2005 The Apache Software Foundation. All rights reserved. This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit and redistribution of this software is subject to terms available at http://www.openssl.org. Copyright 1998-2003 The OpenSSL Project. All Rights Reserved. The zlib library included with this software is Copyright (c) 1995-2003 Jean-loup Gailly and Mark Adler. The Curl license provided with this Software is Copyright 1996-2004, Daniel Stenberg, <[email protected]>. All Rights Reserved. The PCRE library included with this software is Copyright (c) 1997-2001 University of Cambridge Regular expression support is provided by the PCRE library package, which is open source software, written by Philip Hazel. The source for this library may be found at ftp://ftp.csx.cam.ac.uk/pub/software/programming/ pcre. InstallAnywhere is Copyright 2005 Zero G Software, Inc. All Rights Reserved. Portions of the Software are Copyright (c) 1998-2005 The OpenLDAP Foundation. All rights reserved. Redistribution and use in source and binary forms, with or without modification, are permitted only as authorized by the OpenLDAP Public License, available at http://www.openldap.org/software/release/license.html. This Software is protected by U.S. Patent Numbers 6,208,990; 6,044,374; 6,014,670; 6,032,158; 5,794,246; 6,339,775 and other U.S. Patents Pending. DISCLAIMER: Informatica Corporation provides this documentation as is without warranty of any kind, either express or implied, including, but not limited to, the implied warranties of non-infringement, merchantability, or use for a particular purpose. The information provided in this documentation may include technical inaccuracies or typographical errors. Informatica could make improvements and/or changes in the products described in this documentation at any time without notice.

Table of Contents
List of Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv List of Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvii Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xix
About This Book . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xx Document Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xx Other Informatica Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .xxi Visiting Informatica Customer Portal . . . . . . . . . . . . . . . . . . . . . . . . . .xxi Visiting the Informatica Web Site . . . . . . . . . . . . . . . . . . . . . . . . . . . .xxi Visiting the Informatica Developer Network . . . . . . . . . . . . . . . . . . . . .xxi Visiting the Informatica Knowledge Base . . . . . . . . . . . . . . . . . . . . . . .xxi Obtaining Technical Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .xxi

Chapter 1: Understanding Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 Nodes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Gateway Nodes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Worker Nodes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Service Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 Application Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 Integration Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 Repository Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 SAP BW Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Web Services Hub . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 High Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

Chapter 2: Using the Administration Console . . . . . . . . . . . . . . . . . . 11

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 Logging In . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 Administration Console Tabs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 Domain Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Logs Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Administration Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
iii

Upgrade Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Manage Account Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Using the Navigator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 Domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Folders . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 Application Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 Integration Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 Repository Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 SAP BW Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Web Services Hub . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Nodes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Grids . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30

Chapter 3: Managing the Domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 Managing Alerts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 Configuring SMTP Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 Subscribing to Alerts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 Viewing Alerts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 Managing Folders . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36 Creating a Folder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 Moving Objects to a Folder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 Removing a Folder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 Managing Application Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39 Enabling and Disabling Services and Service Processes . . . . . . . . . . . . . . 39 Configuring Restart for Service Processes . . . . . . . . . . . . . . . . . . . . . . . 41 Removing Application Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 Managing Nodes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43 Defining and Adding Nodes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 Configuring Node Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Viewing Processes on the Node . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48 Shutting Down and Restarting the Node . . . . . . . . . . . . . . . . . . . . . . . . 49 Removing a Node . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 Managing the Gateway . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Shutting Down a Domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54 Managing the Domain Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55

iv

Table of Contents

Domain Configuration Database . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 Backing Up the Domain Configuration . . . . . . . . . . . . . . . . . . . . . . . . 56 Restoring the Domain Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . 56 Migrating the Domain Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . 57 Updating the Domain Configuration Database Connection . . . . . . . . . . 60 Custom Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Working with Multiple Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61

Chapter 4: Managing Users and User Accounts . . . . . . . . . . . . . . . . 65

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 Users and User Accounts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 Domain Administrator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 Root Administrators and Domain Users . . . . . . . . . . . . . . . . . . . . . . . . 67 Managing Users . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69 Managing Permissions and Privileges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72 Managing Permissions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72 Managing User Privileges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Managing Your Account . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Monitoring User Activity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78

Chapter 5: Managing High Availability . . . . . . . . . . . . . . . . . . . . . . . . 81

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82 Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82 Resilience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83 Restart and Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84 Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85 High Availability in the Base Product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86 Internal PowerCenter Resilience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86 Repository Service Resilience to Repository Database . . . . . . . . . . . . . . 86 Informatica Services Restart . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86 Manual Workflow and Session Recovery . . . . . . . . . . . . . . . . . . . . . . . . 87 Achieving High Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88 Configuring PowerCenter Internal Components for High Availability . . 88 Using Highly Available External Systems . . . . . . . . . . . . . . . . . . . . . . . 90 Rules and Guidelines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90 Managing Resilience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92 Configuring Service Resilience for the Domain . . . . . . . . . . . . . . . . . . . 92

Table of Contents

Configuring Application Service Resilience . . . . . . . . . . . . . . . . . . . . . . 93 Understanding PowerCenter Client Resilience . . . . . . . . . . . . . . . . . . . . 93 Configuring Command Line Program Resilience . . . . . . . . . . . . . . . . . . 93 Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94 Managing High Availability for the Repository Service . . . . . . . . . . . . . . . . . 96 Resilience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96 Restart and Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 Managing High Availability for the Integration Service . . . . . . . . . . . . . . . . 98 Resilience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98 Restart and Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99 Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102 Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104

Chapter 6: Creating and Configuring the Repository Service . . . . . 105

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106 Creating a Database for the Repository . . . . . . . . . . . . . . . . . . . . . . . . . . . 107 Creating the Repository Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108 Before You Begin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108 Creating a Repository Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108 Database Connect Strings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111 Configuring Repository Service Properties . . . . . . . . . . . . . . . . . . . . . . . . . 112 Node Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113 General Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114 Database Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114 Advanced Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116 Custom Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118 Configuring Repository Service Process Properties . . . . . . . . . . . . . . . . . . . 119 Custom Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119 Environment Variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120

Chapter 7: Managing the Repository . . . . . . . . . . . . . . . . . . . . . . . . 121

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122 Permissions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122 Enabling and Disabling the Repository Service . . . . . . . . . . . . . . . . . . . . . 123 Enabling and Disabling a Repository Service . . . . . . . . . . . . . . . . . . . . 123 Enabling and Disabling Service Processes . . . . . . . . . . . . . . . . . . . . . . 124
vi Table of Contents

Running in Exclusive Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126 Creating and Deleting Repository Content . . . . . . . . . . . . . . . . . . . . . . . . 128 Creating Repository Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128 Deleting Repository Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128 Enabling Version Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131 Managing a Repository Domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132 Prerequisites for a Repository Domain . . . . . . . . . . . . . . . . . . . . . . . . 132 Steps for Building a Repository Domain . . . . . . . . . . . . . . . . . . . . . . . 132 Promoting a Local Repository to a Global Repository . . . . . . . . . . . . . 133 Registering a Local Repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 134 Viewing Registered Local and Global Repositories . . . . . . . . . . . . . . . 135 Moving Local and Global Repositories . . . . . . . . . . . . . . . . . . . . . . . . 136 Managing Repository User Connections and Locks . . . . . . . . . . . . . . . . . . 137 Viewing Locks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137 Viewing User Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 138 Closing User Connections and Releasing Locks . . . . . . . . . . . . . . . . . . 139 Sending Repository Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141 Backing Up and Restoring the Repository . . . . . . . . . . . . . . . . . . . . . . . . . 142 Backing Up a Repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 142 Viewing a List of Backup Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143 Restoring a Repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143 Copying Content from Another Repository . . . . . . . . . . . . . . . . . . . . . . . 146 Registering and Unregistering Repository Plug-ins . . . . . . . . . . . . . . . . . . 148 Registering a Repository Plug-in . . . . . . . . . . . . . . . . . . . . . . . . . . . . 148 Unregistering a Repository Plug-in . . . . . . . . . . . . . . . . . . . . . . . . . . . 149 Setting Up LDAP Authentication for Repositories . . . . . . . . . . . . . . . . . . . 151 Configuring the LDAP Authentication Module for the Domain . . . . . . 151 Registering an LDAP Security Module with a Repository . . . . . . . . . . . 154 Unregistering an LDAP Security Module . . . . . . . . . . . . . . . . . . . . . . 156 Switching Between Repository and LDAP Authentication . . . . . . . . . . 157 Sample Authentication File . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158 Creating an Audit Trail . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159 Tuning Repository Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160 Updating Repository Statistics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160 Increasing Repository Copy, Backup, and Restore Performance . . . . . . 160

Table of Contents

vii

Chapter 8: Creating and Configuring the Integration Service . . . . . 161

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 162 Creating an Integration Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163 Enabling and Disabling the Integration Service . . . . . . . . . . . . . . . . . . . . . 167 Enabling and Disabling an Integration Service Process . . . . . . . . . . . . . 167 Enabling and Disabling the Integration Service . . . . . . . . . . . . . . . . . . 168 Running in Normal and Safe Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170 Changing the Operating Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170 Running the Integration Service in Safe Mode . . . . . . . . . . . . . . . . . . . 171 Steps to Configure the Operating Mode . . . . . . . . . . . . . . . . . . . . . . . 173 Configuring the Integration Service Properties . . . . . . . . . . . . . . . . . . . . . 176 Grid and Node Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 176 General Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 178 Advanced Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 180 Compatibility and Database Properties . . . . . . . . . . . . . . . . . . . . . . . . 183 Configuration Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 186 HTTP Proxy Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188 Configuring the Associated Repository . . . . . . . . . . . . . . . . . . . . . . . . . . . 190 Configuring the Integration Service Processes . . . . . . . . . . . . . . . . . . . . . . 192 Code Pages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192 Directories for Integration Service Files . . . . . . . . . . . . . . . . . . . . . . . 192 Directories for Java Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193 Configuring Properties for a Service Process . . . . . . . . . . . . . . . . . . . . 194

Chapter 9: Integration Service Architecture . . . . . . . . . . . . . . . . . . 197

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 198 Integration Service Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 200 Integration Service Process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201 Managing Workflow Scheduling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201 Locking and Reading the Workflow . . . . . . . . . . . . . . . . . . . . . . . . . . 201 Reading the Parameter File . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202 Creating the Workflow Log . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202 Running Workflow Tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202 Running Workflows Across the Nodes in a Grid . . . . . . . . . . . . . . . . . 202 Starting the DTM Process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202 Writing Historical Information to the Repository . . . . . . . . . . . . . . . . 203 Sending Post-Session Email . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203
viii Table of Contents

Load Balancer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204 Dispatch Process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204 Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205 Resource Provision Thresholds . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206 Dispatch Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206 Service Levels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 207 Data Transformation Manager (DTM) Process . . . . . . . . . . . . . . . . . . . . . 208 Reading the Session Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . 208 Performing Pushdown Optimization . . . . . . . . . . . . . . . . . . . . . . . . . 208 Creating Dynamic Partitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 208 Forming Partition Groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209 Expanding Variables and Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . 209 Creating the Session Log . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209 Validating Code Pages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209 Verifying Connection Object Permissions . . . . . . . . . . . . . . . . . . . . . . 209 Starting Worker DTM Processes . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209 Running Pre-Session Operations . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210 Running the Processing Threads . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210 Running Post-Session Operations . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210 Sending Post-Session Email . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210 Processing Threads . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211 Thread Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212 Pipeline Partitioning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 213 DTM Processing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215 Reading Source Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215 Blocking Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 216 Block Processing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 216 Grids . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 217 Running a Workflow on a Grid . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 217 Running a Session on a Grid . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 218 System Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220 CPU Usage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220 DTM Buffer Memory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220 Cache Memory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221 Code Pages and Data Movement Modes . . . . . . . . . . . . . . . . . . . . . . . . . . 222 ASCII Data Movement Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222 Unicode Data Movement Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222 Output Files and Caches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 223
Table of Contents ix

Workflow Log . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 223 Session Log . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224 Session Details . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224 Performance Detail File . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224 Reject Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225 Row Error Logs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225 Recovery Tables Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225 Control File . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225 Email . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 226 Indicator File . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 226 Output File . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 226 Cache Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 226

Chapter 10: Managing the Grid . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 229

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 230 Configuring the Grid . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231 Configuring the Integration Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 232 Configuring the Integration Service to Run on a Grid . . . . . . . . . . . . . 232 Configuring the Service Processes . . . . . . . . . . . . . . . . . . . . . . . . . . . . 232 Configuring Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 234 Viewing Resources in a Domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 236 Assigning Connection Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . 236 Defining Custom and File/Directory Resources . . . . . . . . . . . . . . . . . . 237

Chapter 11: Configuring the Load Balancer . . . . . . . . . . . . . . . . . . . 239

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 240 Configuring the Dispatch Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241 Round-Robin Dispatch Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242 Metric-Based Dispatch Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242 Adaptive Dispatch Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 243 Creating Service Levels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 244 Configuring Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247 Calculating the CPU Profile . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 248 Defining Resource Provision Thresholds . . . . . . . . . . . . . . . . . . . . . . . . . . 249

Chapter 12: Creating and Configuring the SAP BW Service . . . . . . 251

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
x Table of Contents

Load Balancing for the BW System and the SAP BW Service . . . . . . . . 252 Creating the SAP BW Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 253 Enabling and Disabling the SAP BW Service . . . . . . . . . . . . . . . . . . . . . . . 255 Configuring the SAP BW Service Properties . . . . . . . . . . . . . . . . . . . . . . . 257 Configuring the Associated Integration Service . . . . . . . . . . . . . . . . . . . . . 258 Configuring the SAP BW Service Processes . . . . . . . . . . . . . . . . . . . . . . . . 259 Viewing Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 260

Chapter 13: Creating and Configuring the Web Services Hub . . . . 261
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 262 Creating a Web Services Hub . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 263 Enabling and Disabling the Web Services Hub . . . . . . . . . . . . . . . . . . . . . 266 Configuring the Web Services Hub Properties . . . . . . . . . . . . . . . . . . . . . . 267 Node Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268 General Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268 Advanced Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 269 Custom Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270 Configuring the Associated Repository . . . . . . . . . . . . . . . . . . . . . . . . . . . 271 Adding an Associated Repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271 Editing an Associated Repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . 273

Chapter 14: Managing Licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276 License Validation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276 Licensing Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277 License Management Tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277 Types of License Keys . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 279 Original Keys . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 279 Incremental Keys . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 279 Creating a License Object . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 280 Assigning a License to a Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282 Rules and Guidelines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282 Unassigning a License from a Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . 284 Updating a License . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285 Removing a License . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 286 Viewing License Details . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 287 General Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 287

Table of Contents

xi

Supported Platforms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 289 Repositories . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 290 PowerCenter Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 290 Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 291 Metadata Exchange Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 291

Chapter 15: Monitoring License Usage . . . . . . . . . . . . . . . . . . . . . . 293

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 294 Running the Domain Activity Monitoring Report . . . . . . . . . . . . . . . . . . . 295 CPU Usage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 296 CPU Usage Analysis Chart . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 297 CPU Usage Per Day Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 297 Repository Service Usage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 300 Repository Service Usage Analysis Chart . . . . . . . . . . . . . . . . . . . . . . . 300 Repository Service Usage Analysis Table . . . . . . . . . . . . . . . . . . . . . . . 301

Chapter 16: Managing Logs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 303

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 304 Log Manager Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 306 Log Manager Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 307 Troubleshooting the Log Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . 307 Configuring the Log Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 309 Configuring Log Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 310 Purging Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 310 Exporting Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 311 Configuring the Time Zone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 314 Steps to Configure Log Management Properties . . . . . . . . . . . . . . . . . . 314 Using the Log Viewer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 315 Viewing Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 316 Searching Log Event Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 318 Configuring Log Viewer Columns . . . . . . . . . . . . . . . . . . . . . . . . . . . 319 Saving Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 320 Viewing Administration Console Log Errors . . . . . . . . . . . . . . . . . . . . 321 Understanding Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 322 Log Event Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 322 Domain Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 323 Repository Service Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 324
xii Table of Contents

Integration Service Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 324 SAP BW Service Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 324 Web Services Hub Log Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 325

Chapter 17: Understanding Globalization . . . . . . . . . . . . . . . . . . . . 327

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 328 Unicode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 329 Working with a Unicode Repository . . . . . . . . . . . . . . . . . . . . . . . . . . 329 Locales . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331 System Locale . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331 User Locale . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331 Input Locale . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331 Data Movement Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 333 Character Data Movement Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . 333 Changing Data Movement Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . 334 Code Page Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 336 UNIX Code Pages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 336 Windows Code Pages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 337 Choosing a Code Page . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 337 Code Page Compatibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 339 PowerCenter Client Code Page . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 341 Integration Service Process Code Page . . . . . . . . . . . . . . . . . . . . . . . . 341 Repository Code Page . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 342 Source Code Page . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 342 Target Code Page . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 343 Command Line Program Code Pages . . . . . . . . . . . . . . . . . . . . . . . . . 343 Code Page Compatibility Summary . . . . . . . . . . . . . . . . . . . . . . . . . . 344 PowerCenter Code Page Validation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 346 Relaxed Code Page Validation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 348 Configuring the Integration Service . . . . . . . . . . . . . . . . . . . . . . . . . . 349 Selecting Compatible Source and Target Code Pages . . . . . . . . . . . . . . 349 Troubleshooting for Code Page Relaxation . . . . . . . . . . . . . . . . . . . . . 349 PowerCenter Code Page Conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 351 Choosing Characters for Repository Metadata . . . . . . . . . . . . . . . . . . . 351 Case Study: Processing ISO 8859-1 Data . . . . . . . . . . . . . . . . . . . . . . . . . 353 The ISO 8859-1 Environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 353 Configuring the ISO 8859-1 Environment . . . . . . . . . . . . . . . . . . . . . 354

Table of Contents

xiii

Case Study: Processing Unicode UTF-8 Data . . . . . . . . . . . . . . . . . . . . . . 357 The UTF-8 Environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 357 Configuring the UTF-8 Environment . . . . . . . . . . . . . . . . . . . . . . . . . 358 UTF-8 Case Study: Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 360

Appendix A: Code Pages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 361

Supported Code Pages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 362 Code Page Reference . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 365 Code Page Compatibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 369 Supported Code Pages and Related Code Pages . . . . . . . . . . . . . . . . . . 374 Characters Lost in Code Page Conversion . . . . . . . . . . . . . . . . . . . . . . . . . 387 Converting from MS Latin1 to Latin1 . . . . . . . . . . . . . . . . . . . . . . . . 388 Converting from Latin1 to MS Latin1 . . . . . . . . . . . . . . . . . . . . . . . . 388 Converting from MS Latin 2 to ISO-8859-2 . . . . . . . . . . . . . . . . . . . . 389 Converting from IBM EBCDIC US English to Latin 1 . . . . . . . . . . . . 390 Converting from Latin1 to IBM EBCDIC US English . . . . . . . . . . . . . 390 Converting from IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 . . . . . . . . . . . . . . . . . . . . . . . . . 391 Converting from IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 395 Converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 . . . . . . . . . . . . . . . . . . . . . . . . . 399 Converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 410 Converting from MS Shift JIS to JapanEUC . . . . . . . . . . . . . . . . . . . . 420 Converting from JapanEUC to MS Shift JIS . . . . . . . . . . . . . . . . . . . . 423 Converting from IBM EBCDIC Japanese to JapanEUC . . . . . . . . . . . . 428 Converting from JapanEUC to IBM EBCDIC Japanese . . . . . . . . . . . . 429 Converting from IBM EBCDIC Japanese to MS Shift JIS . . . . . . . . . . 434 Converting from MS Shift JIS to IBM EBCDIC Japanese . . . . . . . . . . 435

Appendix B: Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 437

PowerCenter Glossary Terms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 438

Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 453

xiv

Table of Contents

List of Figures
Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure 1-1. Domain Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1-2. Application Services Configured to Run on Nodes Without High Availability . . . . . 7 1-3. Application Services Configured to Run on Nodes with High Availability . . . . . . . . 7 2-1. Administration Console Tabs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 2-2. Domain Tab of the Administration Console . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 2-3. Logs Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 2-4. Administration Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 2-5. Manage Account Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 2-6. Objects in the Navigator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 2-7. Domain Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 2-8. Legend for Overview Grid . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 2-9. Folder Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 2-10. Integration Service Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 2-11. Repository Service Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 2-12. SAP BW Service Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 2-13. Web Services Hub Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 2-14. Node Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 2-15. Grid Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 2-16. License Main Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 3-1. Folder Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36 3-2. Properties Tab for a Node . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 3-3. Manage Domain List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 4-1. Administration Tab of the Administration Console . . . . . . . . . . . . . . . . . . . . . . . 69 4-2. Inherited and Object Permissions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72 4-3. Manage Account Tab of the Administration Console . . . . . . . . . . . . . . . . . . . . . . 76 5-1. High Availability Configuration with Two Gateway Nodes . . . . . . . . . . . . . . . . . 89 5-2. High Availability Configuration with Multiple Nodes . . . . . . . . . . . . . . . . . . . . . 90 5-3. Domain Properties Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92 5-4. Resilience Timeout in a Domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94 6-1. Repository Service Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113 6-2. Advanced Properties for a Repository Service . . . . . . . . . . . . . . . . . . . . . . . . . . . 116 6-3. Process Properties for a Repository Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119 7-1. List of Plug-ins for a Repository Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149 8-1. Node Assignments for an Integration Service . . . . . . . . . . . . . . . . . . . . . . . . . . . 177 8-2. Grid Assignments for an Integration Service . . . . . . . . . . . . . . . . . . . . . . . . . . . 177 8-3. General Properties for an Integration Service . . . . . . . . . . . . . . . . . . . . . . . . . . . 179 8-4. Advanced Properties for an Integration Service . . . . . . . . . . . . . . . . . . . . . . . . . 180 8-5. Compatibility and Database Properties for an Integration Service . . . . . . . . . . . . 183 8-6. Configuration Properties for an Integration Service . . . . . . . . . . . . . . . . . . . . . . 186 8-7. HTTP Proxy Properties for an Integration Service . . . . . . . . . . . . . . . . . . . . . . . 188

List of Figures

xv

Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure Figure

8-8. Associated Repository for an Integration Service . . . . . . . . . . . . . . . . . 8-9. General Properties for an Integration Service Process . . . . . . . . . . . . . . 9-1. Integration Service and Data Movement . . . . . . . . . . . . . . . . . . . . . . . 9-2. Thread Creation for a Simple Mapping . . . . . . . . . . . . . . . . . . . . . . . . 9-3. Thread Creation for a Pass-through Pipeline . . . . . . . . . . . . . . . . . . . . 9-4. Partitioned Mapping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9-5. Target Load Order Groups and Source Pipelines . . . . . . . . . . . . . . . . . 9-6. Service Process Distribution for a Workflow Running on a Grid . . . . . . 9-7. Service Process and DTM Distribution for a Session Running on a Grid 10-1. Configuring an Integration Service to Run on a Grid . . . . . . . . . . . . . 10-2. Node Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11-1. Domain Properties Tab Showing the Dispatch Mode . . . . . . . . . . . . . 11-2. Domain Properties Tab Showing Service Levels . . . . . . . . . . . . . . . . . 11-3. Node Properties Tab Showing CPU Profile . . . . . . . . . . . . . . . . . . . . 16-1. Log Event Processing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16-2. Search Log Events Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17-1. Code Page Compatibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17-2. ISO 8859-1 Case Study Environment . . . . . . . . . . . . . . . . . . . . . . . . 17-3. UTF-8 Case Study Environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17-4. Summary of UTF-8 Case Study . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . .

. . . . .190 . . . . .195 . . . . .198 . . . . .211 . . . . .212 . . . . .214 . . . . .215 . . . . .217 . . . . .218 . . . . .230 . . . . .235 . . . . .241 . . . . .244 . . . . .248 . . . . .307 . . . . .319 . . . . .344 . . . . .353 . . . . .357 . . . . .360

xvi

List of Figures

List of Tables
Table 1-1. Domain Functions Performed by the Service Manager . . . . . . . . . . . . . . . . Table 3-1. Alert Types and Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 3-2. Description of Service Process Statuses . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 5-1. Resilience Timeout in a Domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 5-2. Restart and Failover for an Integration Service Running on a Single Node . . Table 5-3. Restart and Failover Behavior for Integration Service Running on a Primary Node . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 5-4. Restart and Failover for an Integration Service Running on a Grid . . . . . . . Table 6-1. Create New Repository Service Options . . . . . . . . . . . . . . . . . . . . . . . . . . Table 6-2. Native Connect String Syntax . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 6-3. General Properties for a Repository Service . . . . . . . . . . . . . . . . . . . . . . . . Table 6-4. Database Properties for a Repository Service . . . . . . . . . . . . . . . . . . . . . . . Table 6-5. Advanced Properties for a Repository Service . . . . . . . . . . . . . . . . . . . . . . . Table 7-1. LDAP Server Configuration Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 7-2. Sample Microsoft Active Directory Server Configuration . . . . . . . . . . . . . . Table 7-3. Sample SunONE Directory Server Configuration. . . . . . . . . . . . . . . . . . . . Table 7-4. Register Security Module Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 7-5. Unregister Security Module Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 8-1. Create New Integration Service Options . . . . . . . . . . . . . . . . . . . . . . . . . . Table 8-2. Safe Mode Tasks for an Integration Service . . . . . . . . . . . . . . . . . . . . . . . . Table 8-3. Grid/Node Assignments for an Integration Service . . . . . . . . . . . . . . . . . . . Table 8-4. General Properties for an Integration Service . . . . . . . . . . . . . . . . . . . . . . . Table 8-5. Advanced Properties for an Integration Service . . . . . . . . . . . . . . . . . . . . . Table 8-6. Compatibility and Database Properties for an Integration Service . . . . . . . . Table 8-7. Configuration Properties for an Integration Service . . . . . . . . . . . . . . . . . . Table 8-8. HTTP Proxy Properties for an Integration Service . . . . . . . . . . . . . . . . . . . Table 8-9. Associated Repository for an Integration Service . . . . . . . . . . . . . . . . . . . . Table 8-10. Manage List of Domains Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 8-11. General Properties for an Integration Service Process . . . . . . . . . . . . . . . . Table 9-1. Connectivity Requirements for an Integration Service . . . . . . . . . . . . . . . . Table 10-1. Resource Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 11-1. Differences Among Load Balancer Dispatch Modes . . . . . . . . . . . . . . . . . Table 12-1. Create New SAP BW Service Options . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 13-1. Create New Web Services Hub Options . . . . . . . . . . . . . . . . . . . . . . . . . Table 13-2. General Properties for a Web Services Hub . . . . . . . . . . . . . . . . . . . . . . . Table 13-3. Advanced Properties for a Web Services Hub . . . . . . . . . . . . . . . . . . . . . . Table 14-1. General Properties for a License . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 14-2. Supported Platform Properties for a License . . . . . . . . . . . . . . . . . . . . . . Table 16-1. Purge Log Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 16-2. Export Log Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table 16-3. Query Options for Log Viewer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. 4 . 35 . 39 . 94 100 101 102 109 111 114 114 116 152 153 153 155 157 164 172 178 179 181 184 186 189 190 191 195 200 234 242 253 264 268 269 288 289 311 312 317
xvii

List of Tables

Table 17-1. Session and File Cache Handling After Data Movement Mode Change . Table 17-2. Code Page Compatibility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table A-1. Code Page Descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table A-2. Code Pages By Language . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table A-3. Compatible Code Pages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table A-4. Supported Code Pages and Related Code Pages . . . . . . . . . . . . . . . . . . . Table A-5. Characters Lost in Code Page Conversion . . . . . . . . . . . . . . . . . . . . . . . Table A-6. MS Latin1 to Latin1 Character Conversion . . . . . . . . . . . . . . . . . . . . . . Table A-7. Latin1 to MS Latin1 Character Conversion . . . . . . . . . . . . . . . . . . . . . . Table A-8. MS Latin 2 to ISO-8859-2 Character Conversion . . . . . . . . . . . . . . . . . Table A-9. IBM EBCDIC US English to Latin1 Character Conversion . . . . . . . . . . Table A-10. Latin1 to IBM EBCDIC US English Character Conversion . . . . . . . . . Table A-11. IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table A-12. IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) Character Conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Table A-15. MS Shift JIS to JapanEUC Character Conversion . . . . . . . . . . . . . . . . Table A-16. JapanEUC to MS Shift JIS Character Conversion . . . . . . . . . . . . . . . . Table A-17. IBM EBCDIC Japanese to JapanEUC Character Conversion . . . . . . . . Table A-18. JapanEUC to IBM EBCDIC Japanese Character Conversion . . . . . . . . Table A-19. IBM EBCDIC Japanese to MS Shift JIS Character Conversion . . . . . . . Table A-20. MS Shift JIS to IBM EBCDIC Japanese Character Conversion . . . . . . .

. . . . . . . . . . . .

. . . . . . . . . . . .

..... ..... ..... ..... ..... ..... ..... ..... ..... ..... ..... .....

.334 .345 .362 .365 .369 .375 .387 .388 .388 .389 .390 .390

. . . . . . . .391 . . . . . . . .395 . . . . . . . .399 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .410 .420 .423 .428 .429 .434 .435

xviii

List of Tables

Preface

Welcome to PowerCenter, the Informatica software product that delivers an open, scalable data integration solution addressing the complete life cycle for all data integration projects including data warehouses, data migration, data synchronization, and information hubs. PowerCenter combines the latest technology enhancements for reliably managing data repositories and delivering information resources in a timely, usable, and efficient manner. The PowerCenter repository coordinates and drives a variety of core functions, including extracting, transforming, loading, and managing data. The Integration Service can extract large volumes of data from multiple platforms, handle complex transformations on the data, and support high-speed loads. PowerCenter can simplify and accelerate the process of building a comprehensive data warehouse from disparate data sources.

xix

About This Book

The Administrator Guide is written for PowerCenter domain users. It contains information you need to manage the domain and the nodes and services in the domain. The Administrator Guide assumes you have basic working knowledge of PowerCenter. The material in this book is also available online.

Document Conventions
This guide uses the following formatting conventions:
If you see It means The word or set of words are especially emphasized. Emphasized subjects. This is the variable name for a value you enter as part of an operating system command. This is generic text that should be replaced with user-supplied values. The following paragraph provides additional facts. The following paragraph provides suggested uses. The following paragraph notes situations where you can overwrite or corrupt data, unless you follow the specified procedure. This is a code example. This is an operating system command you enter from a prompt to run a task.

italicized text boldfaced text

italicized monospaced text

Note: Tip: Warning:

monospaced text bold monospaced text

xx

Preface

Other Informatica Resources

In addition to the product manuals, Informatica provides these other resources:

Informatica Customer Portal Informatica web site Informatica Developer Network Informatica Knowledge Base Informatica Technical Support

Visiting Informatica Customer Portal

As an Informatica customer, you can access the Informatica Customer Portal site at http://my.informatica.com. The site contains product information, user group information, newsletters, access to the Informatica customer support case management system (ATLAS), the Informatica Knowledge Base, Informatica Documentation Center, and access to the Informatica user community.

Visiting the Informatica Web Site

You can access the Informatica corporate web site at http://www.informatica.com. The site contains information about Informatica, its background, upcoming events, and sales offices. You will also find product and partner information. The services area of the site includes important information about technical support, training and education, and implementation services.

Visiting the Informatica Developer Network

You can access the Informatica Developer Network at http://devnet.informatica.com. The Informatica Developer Network is a web-based forum for third-party software developers. The site contains information about how to create, market, and support customer-oriented add-on solutions based on interoperability interfaces for Informatica products.

Visiting the Informatica Knowledge Base

As an Informatica customer, you can access the Informatica Knowledge Base at http://my.informatica.com. Use the Knowledge Base to search for documented solutions to known technical issues about Informatica products. You can also find answers to frequently asked questions, technical white papers, and technical tips.

Obtaining Technical Support

There are many ways to access Informatica Technical Support. You can contact a Technical Support Center by using the telephone numbers listed the following table, you can send email, or you can use the WebSupport Service.
Preface xxi

Use the following email addresses to contact Informatica Technical Support:

[email protected] for technical inquiries [email protected] for general customer service requests

WebSupport requires a user name and password. You can request a user name and password at http://my.informatica.com.
North America / South America Informatica Corporation Headquarters 100 Cardinal Way Redwood City, California 94063 United States Europe / Middle East / Africa Informatica Software Ltd. 6 Waltham Park Waltham Road, White Waltham Maidenhead, Berkshire SL6 3TN United Kingdom Asia / Australia Informatica Business Solutions Pvt. Ltd. Diamond District Tower B, 3rd Floor 150 Airport Road Bangalore 560 008 India Toll Free Australia: 00 11 800 4632 4357 Singapore: 001 800 4632 4357 Standard Rate India: +91 80 4112 5738

Toll Free 877 463 2435

Toll Free 00 800 4632 4357

Standard Rate United States: 650 385 5800

Standard Rate Belgium: +32 15 281 702 France: +33 1 41 38 92 26 Germany: +49 1805 702 702 Netherlands: +31 306 022 797 United Kingdom: +44 1628 511 445

xxii

Preface

Chapter 1

Understanding Domains

This chapter includes the following topics:

Overview, 2 Nodes, 3 Service Manager, 4 Application Services, 6 High Availability, 9

Overview
PowerCenter has a service-oriented architecture that provides the ability to scale services and share resources across multiple machines. High availability functionality helps minimize service downtime due to unexpected failures or scheduled maintenance in the PowerCenter environment. The PowerCenter domain is the fundamental administrative unit in PowerCenter. The domain supports the administration of the distributed services. A domain is a collection of nodes and services that you can group in folders based on administration ownership. A node is the logical representation of a machine in a domain. One node in the domain acts as a gateway to receive service requests from clients and route them to the appropriate service and node. Services and processes run on nodes in a domain. The availability of a service or process on a node depends on how you configure the service and the node. For more information about nodes, see Nodes on page 3. Services for the domain include the Service Manager and a set of application services:

Service Manager. A service that manages all domain operations. It runs the application services and performs domain functions on each node in the domain. Some domain functions include authentication, authorization, and logging. For more information about the Service Manager, see Service Manager on page 4. Application services. Services that represent PowerCenter server-based functionality, such as the Repository Service and the Integration Service. The application services that runs on a node depend on the way you configure the services. For more information about application services, see Application Services on page 6.

You manage the domain through the PowerCenter Administration Console. The Administration Console consolidates administrative tasks for domain objects such as services, nodes, licenses, and grids. You access the Administration Console through a web browser. For more information about the Administration Console, see Using the Administration Console on page 11. If you have the high availability option, you can scale services and eliminate single points of failure for services. Services can continue running despite temporary network or hardware failures. For more information about high availability, see Managing High Availability on page 81.

Chapter 1: Understanding Domains

Nodes
When you install PowerCenter Services on a machine, you add the machine to the domain as a node. You can add multiple nodes to a domain. Each node in the domain runs a Service Manager that manages domain operations on that node. The operations that the Service Manager performs depend on the type of node. A node can be a gateway node or a worker node. You can subscribe to alerts to receive notification about node events such as node failure or a master gateway election. When you subscribe to alerts, you receive notifications for the domain and all services on the domain. You must have permission on the domain to receive domain level alerts. You receive service level alerts for all services on the domain that you have permission on.

Gateway Nodes
A gateway node is any node you configure to serve as a gateway for the domain. One node acts as the gateway at any given time. That node is called the master gateway. A gateway node can run application services, and it can serve as a master gateway node. The master gateway node is the entry point to the domain. The Service Manager on the master gateway node performs all domain operations on the master gateway node. The Service Manager running on other gateway nodes performs limited domain operations on those nodes. You can configure more than one node to serve as a gateway. If the master gateway node becomes unavailable, the Service Manager on other gateway nodes elect another master gateway node. If you configure one node to serve as the gateway and the node becomes unavailable, the domain cannot accept service requests. For more information about gateways, see Managing the Gateway on page 52.

Worker Nodes
A worker node is any node not configured to serve as a gateway. A worker node can run application services, but it cannot serve as a gateway. The Service Manager performs limited domain operations on a worker node. For more information about the Service Manager, see Service Manager on page 4.

Nodes

Service Manager
The Service Manager is a service that manages all domain operations. It runs within Informatica Services. It runs as a service on Windows and as a daemon on UNIX. When you start Informatica Services, you start the Service Manager. The Service Manager runs on each node. If the Service Manager is not running, the node is not available. The Service Manager runs on all nodes in the domain to support the application services and the domain:

Application service support. The Service Manager on each node starts application services configured to run on that node. It starts and stops services and service processes based on requests from clients. It also directs service requests to application services. The Service Manager uses TCP/IP to communicate with the application services. Domain support. The Service Manager performs functions on each node to support the domain. The functions that the Service Manager performs on a node depend on the type of node. For example, the Service Manager running on the master gateway node performs all domain functions on that node. The Service Manager running on any other node performs some domain functions on that node.

Table 1-1 describes the domain functions that the Service Manager performs:
Table 1-1. Domain Functions Performed by the Service Manager
Function Alerts Description The Service Manager sends alerts to subscribed users. You subscribe to alerts to receive notification for node failure and master gateway election on the domain, and for service process failover for services on the domain. When you subscribe to alerts, you receive notification emails based upon your domain and services permissions. The Service Manager authenticates user requests from the Administration Console and from infacmd. All domain user metadata is stored in the domain configuration database. When you log in to the domain, the Service Manager authenticates your user name and password against the user accounts in the database. If there is no match, you cannot access the domain. Authentication occurs on the master gateway node. The Service Manager authorizes user requests for services. Requests can come from the Administration Console or from infacmd. Authorization occurs on the master gateway node. The Service Manager manages the domain configuration metadata. Domain configuration occurs on the master gateway node. For more information about the domain configuration, see Managing the Domain Configuration on page 55. The Service Manager manages node configuration metadata in the domain. Node configuration occurs on all nodes in the domain. For more information about node configuration, see Managing Nodes on page 43.

Authentication

Authorization Domain Configuration

Node Configuration

Chapter 1: Understanding Domains

Table 1-1. Domain Functions Performed by the Service Manager

Function Licensing Description The Service Manager registers license information and verifies license information when you run application services. Licensing occurs on the master gateway node. For more information about licensing, see Managing Licenses on page 275. The Service Manager provides accumulated log events from each service in the domain and for sessions and workflows. To perform the logging function, the Service Manager runs a Log Manager and a Log Agent. The Log Manager runs on the master gateway node. The Log Agent runs on all nodes where the Integration Service runs. For more information about logging, see Managing Logs on page 303.

Logging

Figure 1-1 shows where the Service Manager performs domain functions:
Figure 1-1. Domain Functions
Node 1 (Master Gateway) Service Manager Alerts Authentication Authorization Domain Configuration Node Configuration Licensing Logging Application Services Node 2 (Gateway) Service Manager Node Configuration Logging Node 3 (Worker) Service Manager Node Configuration Logging

Application Services

Application Services

Domain Functions

Service Manager

Application Services
Application services represent PowerCenter server-based functionality. Application services include the Repository Service, Integration Service, Web Services Hub, and SAP BW Service. When you configure an application service, you designate the node where it runs. You can also create a grid to run on multiple nodes and assign an Integration Service to run on a grid. When you run a workflow on the grid, the Integration Service distributes workflow tasks across nodes of the grid. When you install PowerCenter Services, the installation program installs the following application services:

Repository Service Integration Service SAP BW Service Web Services Hub

When you configure an application service, you designate a node to run the service process. When a service process runs, the Service Manager assigns a port number from the port numbers assigned to the node. The service process is the runtime representation of a service running on a node. The service type determines how many service processes can run at a time. For example, the Integration Service can run multiple service processes at a time when you run it on a grid. If you have the high availability option, you can run a service on multiple nodes. Designate the primary node to run the service. All other nodes are backup nodes for the service. If the primary node is not available, the service runs on a backup node. You can subscribe to alerts to receive notification in the event of a service process failover. When you subscribe to alerts, you receive notifications for all services you have permission on. If you do not have the high availability option, configure a service to run on one node. If you assign multiple nodes, the service will not start.

Chapter 1: Understanding Domains

Figure 1-2 illustrates how you can configure services to run on multiple nodes:
Figure 1-2. Application Services Configured to Run on Nodes Without High Availability
Node 1 (Worker) Service Manager Node 2 (Gateway) Service Manager

Domain Functions Integration Service

Domain Functions Repository Service

Application Services

Figure 1-3 illustrates how you can configure services to run on multiple nodes if you have the high availability option:
Figure 1-3. Application Services Configured to Run on Nodes with High Availability
Node 1 (Gateway) Service Manager Node 2 (Gateway) Service Manager Node 3 (Worker) Service Manager

Domain Functions Integration Service (P)

Domain Functions Integration Service (B) Repository Service (B)

Domain Functions Integration Service (B) Repository Service (B)

Application Service (P) Primary Node Assignment to Run Service (B) Backup Node Assignment to Run Service

Integration Service
The Integration Service runs sessions and workflows. When you configure the Integration Service, you can specify where you want it to run:

On a node. If you do not have the high availability option, you can configure the service to run on one node.

Application Services

On a grid. When you configure the service to run on a grid, it can run on multiple nodes at a time. The Integration Service dispatches tasks to available nodes assigned to the grid. If you do not have the high availability option, the task fails if any service process or node becomes unavailable. If you have the high availability option, failover and recovery is available if a service process or node becomes unavailable. On multiple nodes. If you have the high availability option, you can configure the service to run on multiple nodes. By default, it runs on the primary node. If the primary node is not available, it runs on a backup node. If the service process fails or the node becomes unavailable, the service fails over to another node.

Repository Service
The Repository Service manages the repository. It retrieves, inserts, and updates metadata in the repository database tables. If the service process fails or the node becomes unavailable, the service fails. If you have the high availability option, you can configure the service to run on primary and backup nodes. By default, the service process runs on the primary node. If the service process fails, a new process starts on the same node. If the node becomes unavailable, a service process starts on one of the backup nodes.

SAP BW Service
The SAP BW Service listens for RFC requests from SAP BW and initiates workflows to extract from or load to SAP BW. The SAP BW Service is not highly available. You can configure it to run on one node.

Web Services Hub

The Web Services Hub receives requests from web service clients and exposes PowerCenter workflows as services. The Web Services Hub does not run an associated service process. It runs within the Service Manager.

Chapter 1: Understanding Domains

High Availability
High availability is a PowerCenter option that eliminates a single point of failure in a domain and provides minimal service interruption in the event of failure. High availability consists of the following components:

Resilience. The ability of PowerCenter services to tolerate transient network failures until either the resilience timeout expires or the external system failure is fixed. Failover. The migration of a service or task to another node when the node running the service process becomes unavailable. Recovery. The automatic completion of tasks after a service is interrupted. Automatic recovery is available for Integration Service and Repository Service tasks. You can also manually recover Integration Service workflows and sessions. Manual recovery is not part of high availability.

For more information about high availability, see Managing High Availability on page 81.

High Availability

10

Chapter 1: Understanding Domains

Chapter 2

Using the Administration Console

This chapter includes the following topics:

Overview, 12 Logging In, 13 Administration Console Tabs, 14 Using the Navigator, 19 Domain, 20 Folders, 23 Application Services, 24 Nodes, 28 Grids, 29 Licenses, 30

11

Overview
The PowerCenter Administration Console is the administration tool you use to administer the PowerCenter domain. If you have a user login to the domain, you can access the Administration Console. Use the Administration Console to perform administrative tasks such as managing logs, user accounts, and domain objects. Domain objects include services, nodes, grids, folders, and licenses. This chapter explains how to log in to the Administration Console and describes how to navigate within the browser-based tool.

12

Chapter 2: Using the Administration Console

Logging In
The domain administrator or any user with full privileges and permission on the domain can create a login to the domain. You must have a domain user account to log in to the Administration Console.
To log in to the Administration Console: 1.

Open Microsoft Internet Explorer or Mozilla Firefox. For information about browser configuration, see the Installation and Configuration Guide.

2.

In the Address field, enter the following URL for the Administration Console login page:
http://<host>:<port>/adminconsole

In the URL, <host>:<port> represents the host name and port number of any gateway node. If you are not using the Internet Explorer Enhanced Security Configuration, you can enter the following URL, and the browser is directed to the full URL for the login page:
http://<host>:<port>

The Informatica PowerCenter Administration Console login page appears.

3. 4. 5.

Enter the domain user name and password. Click Login. If this is the first time you log in with the user name and password provided by the domain administrator, change your password to maintain security. For more information about changing your password, see Managing Your Account on page 76.
Warning: If you change the administrator password in the Administration Console, the Service Manager cannot authenticate nodes that are not running. For more information, see Domain Administrator on page 67.

Logging In

13

Administration Console Tabs

The Administration Console has tabs that are accessible at all times when you are logged in. Use these tabs to perform tasks such as viewing log events or configuring service properties. The Administration Console has the following tabs:

Domain. View and edit the properties of the domain and objects within the domain. The Domain tab has a Navigator and a Main window. For more information about the Domain tab, see Domain Tab on page 15. Logs. View log events for the domain and services within the domain. For more information about the Logs tab, see Logs Tab on page 16. Administration. Manage domain users in the Administration tab. This tab appears if you have permission on the domain. For more information about the Administration tab, see Administration Tab on page 17. Upgrade. Upgrade repositories and Integration Services. This tab appears if you have permission on the domain. For more information about the Upgrade tab, see Upgrade Tab on page 17. Manage Account. Manage your domain user profile. On this tab, you can change your domain user password and update your user profile. For more information about the Manage Account tab, see Manage Account Tab on page 17.

Tip: If you use Mozilla Firefox to access the Administration Console, you can press Ctrl-F to search for text on the page.

Figure 2-1 shows the main tabs of the Administration Console:

Figure 2-1. Administration Console Tabs

Administration Console Tabs

14

Chapter 2: Using the Administration Console

Domain Tab
Use the Domain tab to view information about a domain and to manage objects within the domain. The Domain tab appears by default when you log in to the Administration Console. The Domain tab has the following components:

Create menu. Create an object in the domain. You can create folders, grids, licenses, Integration Services, SAP BW Services, and Repository Services. Remove button. Remove an object from the domain. Move button. Move an object to a folder. For more information about managing folders, see Managing Folders on page 36. Navigator. The Navigator appears on the left side of the Domain tab and displays domain objects. For more information about the Navigator, see Using the Navigator on page 19. Main window. The Main window displays properties and options based on the object selected in the Navigator and the tab selected in the Main window.

Figure 2-2 shows the components of the Domain tab:

Figure 2-2. Domain Tab of the Administration Console
Create objects.

Move objects to folder. Remove objects from domain. Navigator

Main Window

Administration Console Tabs

15

Logs Tab
On the Logs tab, you can view domain and application service logs. The Logs tab displays the following components:

Search options. Configure search options for domain or application service logs. Log Viewer. Displays log events based on the search options. Save link. Save the events from the query to file. Customization link. Customize the columns that appear in the Log Viewer. Configuration link. Configure the Log Manager.

Figure 2-3 shows the Logs tab for the Administration Console:
Figure 2-3. Logs Tab
Configure the logs. Customize Log Viewer columns. Search Options Log Viewer Save the displayed logs.

For more information about viewing log events, see Managing Logs on page 303.

16

Chapter 2: Using the Administration Console

Administration Tab
You can manage users and monitor user and domain activity on the Administration tab using the following links:

Manage Users. You can create, view, and modify domain users on the Administration tab. When you view users, you can see the login name and description. Click a login name to view information about the user, such as the email address and phone number. User Activity Monitoring. Generate a user activity report based on user name and time period. Domain Activity Monitoring. Generate a domain activity report for a specific time period.

Figure 2-4 shows the Administration tab for the Administration Console:
Figure 2-4. Administration Tab
Manage users. Monitor user activity. Monitor domain activity.

For more information about managing users, see Managing Users on page 69.

Upgrade Tab
Upgrade to services. When you upgrade from PowerCenter 6.x or 7.x, you must upgrade the PowerCenter Server and Repository Server to services. The PowerCenter Server upgrades to an Integration Service, and the Repository Server upgrades to a Repository Service. The Upgrade tab appears if you set the user preferences to display it. For more information about setting user preferences, see Managing Your Account on page 76. For more information about upgrading to services, see the Installation and Configuration Guide.

Manage Account Tab

The Manage Account tab displays information for your login. The Manage Account tab displays the following information:

Change password. Change your password to the Administration Console.

Administration Console Tabs 17

Personal profile. View or modify your personal profile. User preferences. Set user preferences to display access to the Upgrade tab, custom properties, and refresh time.

Figure 2-5 shows the Manage Account tab for the Administration Console:
Figure 2-5. Manage Account Tab
Change your password.

View or modify your profile.

Set user preferences.

For more information about managing your account information, see Managing Your Account on page 76.

18

Chapter 2: Using the Administration Console

Using the Navigator

When you select the Domain tab, the Navigator appears on the left side of the Administration Console. When you select an object in the Navigator, the Main window displays tabs that you can select to view properties and other information about the object. The Navigator displays the following types of objects:

Domain. You can view one domain in the Administration Console. It is the highest object in the Navigator hierarchy. For more information about this link, see Domain on page 20. Folder. Use folders to organize domain objects in the Navigator. Select a folder to view information about the folder and the objects in the folder. For more information about this link, see Folders on page 23. Application service. Application services represent server-based functionality. Application services include the Integration Service, Repository Service, and SAP BW Service. Select an application service to view information the service and service processes. For more information about this link, see Application Services on page 24. Node. A node represents a machine in the domain. You assign resources to nodes and configure service processes to run on nodes. For more information about this link, see Nodes on page 28. Grid. Create a grid to run the Integration Service on multiple nodes. Select a grid to view nodes assigned to the grid. For more information about this link, see Grids on page 29. License. You create a license in the Administration Console based on a license key file provided by Informatica. Select a license to view services assigned to the license. For more information about this link, see Licenses on page 30.

Figure 2-6 shows the objects in the Navigator:

Figure 2-6. Objects in the Navigator
Domain

Objects in a Folder

License

Folder Node Grid

Using the Navigator

19

Domain
You can view one domain in the Administration Console. It is the highest object in the Navigator hierarchy. When you select the domain in the Navigator, the Main window displays the following information:

Overview tab. Displays an overview grid with a list of all services and the status of the related service processes in the domain. Click a service or service process to see more information about the service. Click a node to see more information about the node. Properties tab. View or modify domain resilience properties or the LDAP authentication module configuration. For more information about domain resilience, see Configuring Service Resilience for the Domain on page 92. For more information about LDAP authentication, see Setting Up LDAP Authentication for Repositories on page 151. Resources tab. View available resources for each node in the domain. For information about configuring resources for a node, see Configuring Resources on page 234. Permissions tab. View or modify user permission on the domain. For more information about permissions, see Managing Permissions and Privileges on page 72. Log Management. Purge and export service logs. For more information about Log Manager, see Managing Logs on page 303. Shutdown. Shut down the domain to perform administrative tasks on the domain. For more information about shutting down a domain, see Shutting Down a Domain on page 54. Legend link. Click the Legend link to view information about icons used in the overview grid.

20

Chapter 2: Using the Administration Console

Figure 2-7 shows the Main window and the overview grid for the domain:
Figure 2-7. Domain Main Window
View or modify domain properties. View resources for nodes in the domain. View or modify user permissions. Configure and manage logs.

Shut down a domain.

Domain

21

Figure 2-8 shows the legend for the overview grid:

Figure 2-8. Legend for Overview Grid

For more information about the status of service processes, see Enabling and Disabling Services and Service Processes on page 39.

22

Chapter 2: Using the Administration Console

Folders
You can use folders in the domain to organize objects and to manage security. Folders can contain nodes, services, grids, licenses, and other folders. When you select a folder in the Navigator, the Navigator opens to display the objects in the folder. The Main window displays the following information:

Overview tab. Displays services in the folder and the nodes where the service processes run. Properties tab. Displays the name and description of the folder. Permissions tab. View or modify user permission on the folder. For more information about permissions, see Managing Permissions and Privileges on page 72.

Figure 2-9 shows the Main window for a folder:

Figure 2-9. Folder Main Window

For more information about managing folders, see Managing Folders on page 36.

Folders

23

Application Services
Application services are a group of services that represent PowerCenter server-based functionality. You can access properties for Integration Services, Repository Services, SAP BW Services, and the Web Services Hub in the Administration Console.

Integration Service
The Integration Service is an application service that runs data integration sessions and workflows. Select an Integration Service in the Navigator to access information about the service. When you select an Integration Service in the Navigator, the Main window displays the following information:

Service and service processes status. View the status of the service and the service process for each node. Properties tab. View or modify Integration Service properties. Associated Repository tab. View the Repository Service associated with the Integration Service. Processes tab. View or modify the service process properties on each assigned node. Permissions tab. View or modify user permission on the Integration Service. For more information about permissions, see Managing Permissions and Privileges on page 72. Logs tab. View log events for the service. When you click the Integration Service Logs tab, the Log Viewer displays Integration Service log events for the last hour. For more information about logs, see Managing Logs on page 303.

Figure 2-10 shows the Main window for an Integration Service:

Figure 2-10. Integration Service Main Window

24

Chapter 2: Using the Administration Console

For more information about the Integration Service and Integration Service processes, see Creating and Configuring the Integration Service on page 161.

Repository Service
The Repository Service is an application service that manages the repository. It retrieves, inserts, and updates metadata in the repository database tables. Select a Repository Service in the Navigator to access information about the service. When you select a Repository Service in the Navigator, the Main window displays the following information:

Service and service process status. View the status of the service and the service process for each node. The service status also displays the operating mode for the Repository Service. The Main window also provides a message if the repository has no content or requires upgrade. Actions list. Manage the contents of the repository and perform other administrative tasks. Properties tab. Manage general and advanced properties, node assignments, and database properties. Processes tab. View and edit service process properties on each assigned node. Connections tab. View and terminate repository connections repository. Locks tab. View the object locks in the repository. Plug-ins tab. View and manage registered plug-ins. Permissions tab. View or modify user permission on the Repository Service. For more information about permissions, see Managing Permissions and Privileges on page 72. Logs tab. View log events for the service. When you click the Repository Service Logs tab, the Log Viewer displays Repository Service log events for the last hour. For more information about logs, see Managing Logs on page 303.

Figure 2-11 shows the Main window for a Repository Service:

Figure 2-11. Repository Service Main Window

Application Services

25

For more information about creating and configuring the Repository Service, see Creating and Configuring the Repository Service on page 105. For more information about managing Repository Service processes, user connections and locks, and plug-ins, see Managing the Repository on page 121.

SAP BW Service
The SAP BW Service is an application service that listens for RFC requests from SAP BW and initiates workflows to extract from or load to SAP BW. Select an SAP BW Service in the Navigator to access properties and other information about the service. When you select an SAP BW Service in the Navigator, the Main window displays the following information:

Service and service process status. View the status of the service and the service process. Properties tab. Manage general properties and node assignments. Associated Integration Service tab. View or modify the Integration Service associated with the SAP BW Service. Processes tab. View or modify the directory of the BWParam parameter file. Permissions tab. View or modify user permission on the SAP BW Service. For more information about permissions, see Managing Permissions and Privileges on page 72. Logs tab. View log events for the service. When you click the SAP BW Service Logs tab, the Log Viewer displays SAP BW Service log events for the last hour. For more information about logs, see Managing Logs on page 303.

Figure 2-12 shows the Main window for an SAP BW Service:

Figure 2-12. SAP BW Service Main Window

For more information about the SAP BW Service, see the PowerCenter Connect for SAP NetWeaver User and Administrator Guide.

Web Services Hub

The Web Services Hub is a web service gateway for external clients. It processes SOAP requests from web service clients that want to access PowerCenter functionality through web

26

Chapter 2: Using the Administration Console

services. Web service clients access the Integration Service and Repository Service through the Web Services Hub. When you select a Web Services Hub in the Navigator, the Main window displays the following information:

Properties tab. View or modify Web Services Hub properties. Associated Repository tab. View the Repository Services associated with the Web Services Hub. Permissions tab. View or modify user permission on the Web Services Hub. For more information about permissions, see Managing Permissions and Privileges on page 72. Logs tab. View log events for the service. When you click the Web Services Hub Logs tab, the Log Viewer displays Integration Service log events for the last hour. For more information about logs, see Managing Logs on page 303.

Figure 2-13 shows the Main window for a Web Services Hub:
Figure 2-13. Web Services Hub Main Window

For more information about the Web Services Hub, see Creating and Configuring the Web Services Hub on page 261.

Application Services

27

Nodes
A node is a logical representation of a physical machine in the domain. You assign resources to nodes and configure service processes to run on nodes. When you select a node in the Navigator, the Main window displays the following information:

Node status. View the status of the node. Properties tab. View or modify node properties, such as the repository backup directory or range of port numbers for the processes that run on the node. Processes tab. View the status of processes configured to run on the node. Resources tab. View or modify resources assigned to the node. For more information about resources, see Configuring Resources on page 234. Permissions tab. View or modify user permission on the node. For more information about permissions, see Managing Permissions and Privileges on page 72.

Figure 2-14 shows the Main window for a node:

Figure 2-14. Node Main Window

For more information about managing nodes, see Managing Nodes on page 43.

28

Chapter 2: Using the Administration Console

Grids
A grid is an alias assigned to a group of nodes that run sessions and workflows. When you run a workflow or session on a grid, you distribute the processing across multiple nodes in the grid. In the Administration Console, you assign nodes to the grid. When you select a grid in the Navigator, the Main window displays the following information:

Properties tab. View or modify node assignments to a grid. Permissions tab. View or modify user permission on the grid. For more information about permissions, see Managing Permissions and Privileges on page 72.

Figure 2-15 shows the Main window for a grid:

Figure 2-15. Grid Main Window

For more information about managing grids, see Managing the Grid on page 229.

Grids

29

Licenses
You create a license object in the Administration Console based on a license key file provided by Informatica. After you create the license, you can assign services to the license. When you select a license in the Navigator, the Main windows displays the following information:

Properties tab. View license properties, such as supported platforms, repositories, and PowerCenter licensed options. You can also edit the license description. Assigned Services tab. View or modify the services assigned to the license. Permissions tab. View or modify user permission on the license. For more information about permissions, see Managing Permissions and Privileges on page 72.

Figure 2-16 shows the Main window for a license:

Figure 2-16. License Main Window

For more information about managing licenses, see Managing Licenses on page 275.

30

Chapter 2: Using the Administration Console

Chapter 3

Managing the Domain

This chapter includes the following topics:

Overview, 32 Managing Alerts, 33 Managing Folders, 36 Managing Application Services, 39 Managing Nodes, 43 Managing the Gateway, 52 Shutting Down a Domain, 54 Managing the Domain Configuration, 55 Working with Multiple Domains, 61

31

Overview
A PowerCenter domain is a collection of nodes and services that define the PowerCenter environment. To manage the domain, you manage the nodes and services within the domain. Use the Administration Console to perform the following tasks:

Manage users and user accounts. Use the Administration console to manage the accounts of the domain administrator, root administrators, and domain users. You can also create user accounts and assign users permission and privileges on objects in the domain. For more information, see Managing Users and User Accounts on page 65. Manage alerts. Configure, enable, and disable domain and service alerts for users. For more information, see Managing Alerts on page 33. Manage folders. Create folders to organize domain objects and manage security by setting permission on folders. For more information, see Managing Folders on page 36. Manage application services. Enable, disable, and remove application services. Enable, disable, and restart service processes. For more information, see Managing Application Services on page 39. Manage nodes. Configure node properties, such as the backup directory and resources, and shut down nodes. For more information, see Managing Nodes on page 43. Configure gateway nodes. Configure nodes to serve as a gateway. For more information, see Managing the Gateway on page 52. Shut down the domain. Shut down the domain to perform administrative tasks on the domain. For more information, see Shutting Down a Domain on page 54. Manage domain configuration. Back up the domain configuration on a regular basis. You may need to restore the domain configuration from a backup to migrate the configuration to another database user account. You may also need to reset the database information for the domain configuration if it changes. For more information, see Managing the Domain Configuration on page 55. Share metadata between domains. The Administration Console window displays a single PowerCenter domain at a time. You share metadata between domains by using the Manage Domains window. For more information, see Working with Multiple Domains on page 61.

For more information about managing individual services, refer to those chapters in this guide.

32

Chapter 3: Managing the Domain

Managing Alerts
Alerts provide users with domain and service alerts. Domain alerts provide notification about node failure and master gateway election. Service alerts provide notification about service process failover. To use the alerts, complete the following tasks:

Configure the SMTP settings for the outgoing email server. Subscribe to alerts.

After you configure the SMTP settings, users can subscribe to domain and service alerts.

Configuring SMTP Settings

You configure the SMTP settings for the outgoing mail server to enable alerts. Configure SMTP settings on the domain Properties tab.
To configure SMTP settings for the domain: 1.

On the Domain tab, click Properties. The Properties tab appears.

2.

In the SMTP Configuration area, click Edit.

Managing Alerts

33

3.

Enter the following settings:

Option Server Host Name Port User Name Password Sender Email Address Required/ Optional Required Required Conditional Conditional Optional Description SMTP outbound mail server host name. For example, enter the Microsoft Exchange Server for Microsoft Outlook. Port used by the outgoing mail server. Enter any valid port number up to 65535. Default is 25. User name for authentication upon sending, if required by the outbound mail server. User password for authentication upon sending, if required by the outbound mail server. Email address the Service Manager uses in the From field when sending notification emails. If you leave this field blank, the Service Manager uses the default Administrator@<host> as the sender.

4.

Click OK.

Subscribing to Alerts
After you complete the SMTP configuration, you can subscribe to alerts.
To subscribe to alerts: 1.

On the Manage Account tab, click Edit in the Personal Profile area.

2.

Enter your email address. If you enter an invalid email address in the user Preferences or the SMTP configuration is invalid, the Service Manager cannot deliver the alert notification.

3. 4. 5. 34

Click OK. Click Edit in the User Preferences area. Select Subscribe for Alerts.

Chapter 3: Managing the Domain

6.

Click OK.

The Service Manager sends alert notification emails based on your permissions for the domain and services. Table 3-1 shows the alert types and events for notification emails:
Table 3-1. Alert Types and Events Alert Type Domain Service Event Node Failure Master Gateway Election Service Process Failover

Viewing Alerts
When you subscribe to alerts, you can receive domain and service notification emails for certain events. You receive domain alerts for domains you have permission on. You receive service alerts for services you have permission on. When a domain or service event occurs that triggers a notification, you can track the alert status in the following ways:

The Service Manager sends an alert notification email to all subscribers with permission on the domain or service. The Log Manager logs alert notification delivery success or failure in the domain or service log.

For example, the Service Manager sends the following notification email to all alerts subscribers with permission on the service that failed:
From: Administrator@<database host> To: Jon Smith Subject: Alert message of type [Service] for object [HR_811]. The service process on node [node01] for service [HR_811] terminated unexpectedly.

In addition, the Log Manager writes the following message to the service log:
ALERT_10009 Alert message [service process failover] of type [service] for object [HR_811] was successfully sent.

You can review the domain or service logs for undeliverable alerts notification emails. In the domain log, filter by Alerts as the category. In the service logs, search on the message code ALERT. When the Service Manager cannot send an alert notification email, the following message appears in the related domain or service log:
ALERT_10004: Unable to send alert of type [alert type] for object [object name], alert message [alert message], with error [error].

Managing Alerts

35

Managing Folders
Use folders in the domain to organize objects and to manage security. Folders can contain nodes, services, grids, licenses, and other folders. You might want to use folders to group services by type. For example, you can create a folder called IntegrationServices and move all Integration Services to the folder. Or, you might want to create folders to group all services for a functional area, such as Sales or Finance. When you assign a user permission on the folder, the user inherits permission on all objects in the folder. You can perform the following tasks with folders:

View services and nodes. View all services in the folder and the nodes where they run. Click a node or service name to access the properties for that node or service. Create folders. Create folders to group objects in the domain. For more information about creating folders, see Creating a Folder on page 37. Move objects to folders. When you move an object to a folder, folder users inherit permission on the object in the folder. When you move a folder to another folder, the other folder becomes a parent of the moved folder. For more information about moving objects to folders, see Moving Objects to a Folder on page 37. Remove folders. When you remove a folder, you can delete the objects in the folder or move them to the parent folder. For more information about removing folders from a domain, see Removing a Folder on page 37.

Figure 3-1 shows the properties of a folder in the Administration Console:

Figure 3-1. Folder Properties

Folder Tabs Edit folder properties.

Move an object to a folder. Create a folder. Remove a folder or other domain object.

36

Chapter 3: Managing the Domain

Creating a Folder
When you create a folder, the Administration Console adds the folder in the domain or folder selected in the Navigator. Folder names must be unique with a folder or the domain, and they can use any alphanumeric character or the underscore (_) character. Folder names cannot contain spaces or exceed 79 characters in length.
To create a folder: 1. 2. 3. 4.

In the Navigator, select the domain or folder in which you want to create a folder. Click Create > Folder. Enter the name and description for the folder, and verify the location where you want to create the folder. Click OK.

Moving Objects to a Folder

When you move an object to a folder, folder users inherit permission on the object. When you move a folder to another folder, the moved folder becomes a child object of the folder where it resides.
Note: The domain serves as a folder when you move objects in and out of folders.
To move an object to a folder: 1. 2. 3.

Select the object in the Navigator. Click the Move to Folder button. In the Move to Folder window, select a folder, and click OK.

Removing a Folder
When you remove a folder, you can delete the objects in the folder or move them to the parent folder. To remove a folder, you must have permission on the folder.

Managing Folders

37

To remove a folder: 1. 2.

Select the folder in the Navigator. Click the Remove button.

3. 4. 5.

In the Remove Folder window, choose whether to move the folder contents to the parent folder or delete the contents. Choose to wait until all processes complete or to abort all processes. Click OK.

38

Chapter 3: Managing the Domain

Managing Application Services

You can perform the following common administration tasks for application services:

Enable and disable services and service processes. Configure the domain to restart service processes. Remove an application service.

To perform these tasks, you must have full privileges and permission on the service.

Enabling and Disabling Services and Service Processes

You can enable and disable application services and service processes in the Administration Console. You enable services and service processes to run the service. When you enable a service, the service starts running. The status of the associated service processes depends on the service configuration and whether the processes are enabled. For example, you enable a service configured to run on multiple nodes. The service starts the service process on the primary node if it is enabled. All other enabled nodes are on standby. Disabled nodes are stopped. You can disable a service to prevent it from running or to perform a management task, such as changing the data movement mode for an Integration Service. You might want to disable the service process on a node if you need to shut down the node for maintenance. When you disable a service, all associated service processes stop, but they remain enabled. When you disable a service or service process, you can also choose the disable mode:

Complete. Allows all processes to complete before disabling. Abort. Aborts all processes before disabling. Stop. Stops all running workflows. Available for the Integration Service.

Table 3-2 describes the different statuses of a service process:

Table 3-2. Description of Service Process Statuses
Service Process Status Running Standby Process Enabled/ Disabled Enabled Enabled Service Enabled/ Disabled Enabled Enabled Description The service process is running on the node. The service process is enabled but is not running because another service process is running. It is on standby to run if the other service process becomes unavailable. Note: Service processes cannot have a standby status when the Integration Service runs on a grid. If you run the Integration Service on a grid, all service processes can be running at once. The service process is starting on the node. This status appears after you enable a service or service process, and the process is starting up.

Starting

Enabled

Enabled

Managing Application Services

39

Table 3-2. Description of Service Process Statuses

Service Process Status Stopped Enabled Disabled Stopping Enabled Disabled Failed Enabled Disabled Enabled Enabled Disabled Enabled Process Enabled/ Disabled Service Enabled/ Disabled Description The service process is stopped and is not running on the node in the following cases: - The service process is enabled, and you disable the service. - The service is enabled, and you disable the service process. The service process is stopping in the following cases: - The service process is enabled, and you disable the service. - The service is enabled, and you disable the service process. The service and service process are enabled, but the node is not available for the service process, or the service process is not configured properly.

You can view the status of a service process when you select a service in the Navigator. You can view the status of all service processes when you click the domain in the Navigator.
To view the status of a service process: 1. 2.

Select a service in the Navigator. Click the Processes tab. The Main window displays the status of the processes and service.
The Repository Service is enabled and running.

The process on sapphire is running. The process on garnet is on standby.

Processes for nodes sapphire and garnet are enabled.

40

Chapter 3: Managing the Domain

For more information about enabling and disabling Repository Services, see Enabling and Disabling the Repository Service on page 123. For more information about enabling and disabling Integration Services, see Enabling and Disabling the Integration Service on page 167. For more information about enabling and disabling the SAP BW Service, see Enabling and Disabling the SAP BW Service on page 255. For more information about enabling and disabling the Web Services Hub, see Enabling and Disabling the Web Services Hub on page 266.

Configuring Restart for Service Processes

If you have high availability and an application service process becomes unavailable while a node is running, the domain tries to restart the process based on the restart options configured in the domain properties.
To configure restart properties: 1. 2.

Select the domain in the Navigator. Click the Properties tab.

Managing Application Services

41

3.

Configure the following restart properties:

Domain Property Maximum Restart Attempts Required/ Optional Required Description Number of times within a specified period that the domain attempts to restart an application service process when it fails. The value must be greater than or equal to 1. Default is 3. Maximum period of time that the domain spends attempting to restart an application service process when it fails. If a service fails to start after the specified number of attempts within this period of time, the service does not restart. Default is 900.

Within Restart Period (sec)

Required

Removing Application Services

You can remove an application service using the Administration Console. Before removing an application service, you must disable it.
To remove an application service: 1. 2. 3. 4.

In the Navigator, select the application service. In the warning message that appears, click Yes to stop other services that depend on the application service. Click the Remove button. Choose to wait until all processes complete or abort all processes, and the click OK.

42

Chapter 3: Managing the Domain

Managing Nodes
A node is a logical representation of a physical machine in the domain. When you install PowerCenter, you define at least one node that serves as the gateway for the domain. You can define other nodes using the installation program or infasetup command line program. After you define a node, you must add the node to the domain. When you add a node to the domain, the node appears in the Navigator, and you can edit its properties. Use the Domain tab of the Administration Console to manage nodes, including configuring node properties and removing nodes from a domain. You perform the following tasks to manage a node:

Define the node and add it to the domain. Adds the node to the domain and enables the domain to communicate with the node. After you add a node to a domain, you can start the node. For more information, see Defining and Adding Nodes on page 44. Configure properties. Configure node properties, such as the repository backup directory and ports used to run processes. For more information, see Configuring Node Properties on page 46. View processes. View the processes configured to run on the node and their status. Before you remove or shut down a node, verify that all running processes are stopped. For more information, see Viewing Processes on the Node on page 48. Shut down the node. Shut down the node if you need to perform maintenance on the machine or to ensure that domain configuration changes take effect. For more information, see Shutting Down and Restarting the Node on page 49. Remove a node. Remove a node from the domain if you no longer need the node. For more information, see Removing a Node on page 51. Define resources. When the Integration Service runs on a grid, you can configure it to check the resources available on each node. Assign connection resources and define custom and file/directory resources on a node. For more information about defining resources, see Configuring Resources on page 234. Edit users and permissions. View inherited permissions for the node and manage the object permissions for the node. For more information about managing users and permissions, see Managing Users and User Accounts on page 65.

Managing Nodes

43

Figure 3-2 shows node properties in the Administration Console:

Figure 3-2. Properties Tab for a Node
Shut down node. Edit users and permissions. Define resources. View processes. Remove host name and port number from node. Configure properties.

Node

Defining and Adding Nodes

You must define a node and add it to the domain so that you can start the node. When you install PowerCenter, you define at least one node that serves as the gateway for the domain. You can define other nodes. The other nodes can be gateway nodes or worker nodes. A master gateway node receives service requests from clients and routes them to the appropriate service and node. You can define one or more gateway nodes. For more information about gateway nodes, see Managing the Gateway on page 52. A worker node can run application services but cannot serve as a gateway. When you define a node, you specify the host name and port number for the machine that hosts the node. You also specify the node name. The Administration Console uses the node name to identify the node. Use either of the following programs to define a node:

The PowerCenter installation program. Run the installation program on each machine you want to define as a node. For more information about defining nodes using the installation program, see Installation and Configuration Steps in the Installation and Configuration Guide. infasetup command line program. Run the infasetup DefineGatewayNode or DefineWorkerNode command on each machine you want to serve as a gateway or worker

44

Chapter 3: Managing the Domain

node. For more information about these commands, see infasetup Command Reference in the Command Line Reference. When you define a node, the installation program or infasetup creates the nodemeta.xml file, which is the node configuration file for the node. A gateway node uses information in the nodemeta.xml file to connect to the domain configuration database. A worker node uses the information in nodemeta.xml to connect to the domain. The nodemeta.xml file is stored in the \server\config directory on each node. After you define a node, you must add it to the domain. When you add a node to the domain, the node appears in the Navigator. You can add a node to the domain using the Administration Console or the infacmd AddDomainNode command. For more information about the AddDomainNode command, see infacmd Command Reference in the Command Line Reference.
To add a node to the domain: 1. 2. 3.

Select the Domain tab in the Administration Console. In the Navigator, select the folder where you want to add the node. If you do not want the node to appear in a folder, select the domain. Select Create > Node. The Create Node dialog box appears.

4. 5. 6.

Enter the node name. This must be the same node name you specified when you defined the node. If you want to change the folder for the node, click Select Folder and choose a new folder or the domain. Click Create. If you add a node to the domain before you define the node using the installation program or infasetup, the Administration Console displays a message saying that you need to run the installation program to associate the node with a physical host name and port number.

Managing Nodes

45

Configuring Node Properties

You configure node properties on the Properties tab for the node. You can configure properties such as the error severity level, minimum and maximum port numbers, and the maximum number of Session and Command tasks that can run on an Integration Service process. You can also remove the host name and port number for a node. When you do this, the node remains in the domain, but it is not associated with a host machine. To associate a different host machine with the node, you must run the installation program or infasetup DefineGatewayNode or DefineWorkerNode command on the new host machine, and then restart the node on the new host machine.
To configure node properties: 1.

Select a node in the Navigator. The Main window displays the node Properties tab.

2.

Click Edit on the Properties tab.

3.

To remove the host name and port number from the node, click Remove host name/port. If you remove the host name and port number, you must run the installation program or the infasetup DefineGatewayNode or DefineWorkerNode command to associate the node with a different host.

46

Chapter 3: Managing the Domain

4.

Edit the following properties:

Node Property Name Required/ Optional Required Description Name of the node. The name is not case sensitive and must be unique within the domain. The name cannot have spaces, include carriage returns or tabs, exceed 79 characters, or contain the following characters: /*?<>"| Host name of the machine represented by the node. Port number used by the node. Removes the host name and port number for the node. If you remove the host name and port number, you must associate the node with a different host. Indicates whether the node can serve as a gateway. If this property is set to No, then the node is a worker node. For more information about configuring the node to serve as a gateway, see Managing the Gateway on page 52. Directory to store repository backup files. The directory must be accessible by the node. Ranking of the CPU performance of the node compared to a baseline system. For example, if the CPU is running 1.5 times as fast as the baseline machine, the value of this property is 1.5. Default is 1.0. Minimum is 0.001. Maximum is 1,000,000. Used in adaptive dispatch mode. Ignored in round-robin and metricbased dispatch modes. For more information about the dispatch mode, see Configuring the Dispatch Mode on page 241. For more information about the baseline system configuration, see Calculating the CPU Profile on page 248. Recalculates the CPU profile for the node. To get the most accurate value, recalculate the CPU profile when the node is idle. Note: This calculation takes approximately five minutes and uses 100% of one CPU on the machine. Level of error logging for the node. These messages are written to the Log Manager application service and Service Manager log files. Set one of the following message levels: - Error. Writes ERROR code messages to the log. - Warning. Writes WARNING and ERROR code messages to the log. - Info. Writes INFO, WARNING, and ERROR code messages to the log. - Tracing. Writes TRACE, INFO, WARNING, and ERROR code messages to the log. - Debug. Writes DEBUG, TRACE, INFO, WARNING, and ERROR code messages to the log. Default is INFO. Minimum port number used by service processes on the node. To apply changes to this property, restart Informatica Services. The default value is the value entered when the node was defined.

Host Name Port Remove Host Name/ Port Serves as Gateway

Required Required Optional

n/a

Backup Directory CPU Profile

Required n/a

Recalculate CPU Profile

Optional

Error Severity Level

Required

Minimum

Required

Managing Nodes

47

Node Property Maximum

Required/ Optional Required

Description Maximum port number used by service processes on the node. To apply changes to this property, restart Informatica Services. The default value is the value entered when the node was defined. Maximum number of runnable threads waiting for CPU resources on the node. Set this threshold to a low number to preserve computing resources for other applications. Set this threshold to a high value, such as 200, to cause the Load Balancer to ignore it. Default is 10. Minimum is 0. Maximum is 1,000,000,000. Used in metric-based and adaptive dispatch modes. Ignored in roundrobin dispatch mode. For more information about the dispatch mode, see Configuring the Dispatch Mode on page 241. Maximum percentage of virtual memory allocated on the node relative to the total physical memory size. Set this threshold to a value greater than 100% to allow the allocation of virtual memory to exceed the physical memory size when dispatching tasks. Set this threshold to a high value, such as 1,000, if you want the Load Balancer to ignore it. Default is 150. Minimum is 0. Maximum is 1,000,000,000. Used in metric-based and adaptive dispatch modes. Ignored in roundrobin dispatch mode. For more information about the dispatch mode, see Configuring the Dispatch Mode on page 241. Maximum number of running Session and Command tasks allowed for each Integration Service process on the node. For example, if you set this threshold to 10 and there are two Integration Service processes running on the node, then the maximum number of running Session and Command tasks allowed for the node is 20. Set this threshold to a high number, such as 200, to cause the Load Balancer to ignore it. To prevent the Load Balancer from dispatching tasks to this node, set this threshold to 0. Default is 10. Minimum is 0. Maximum is 1,000,000,000. Used in all dispatch modes. For more information about the dispatch mode, see Configuring the Dispatch Mode on page 241.

Maximum CPU Run Queue Length

n/a

Maximum Memory %

n/a

Maximum Processes

Required

5.

Click OK.

Viewing Processes on the Node

You can view the status of all processes configured to run on a node. Before you shut down or remove a node, you can view the status of each process to determine which processes you need to disable.
To view processes on a node: 1. 2.

Select a node in the Navigator. Click the Processes tab.

48

Chapter 3: Managing the Domain

The Main window displays the status of each process configured to run on the node.

Shutting Down and Restarting the Node

Some administrative tasks may require you to shut down a node. For example, you might need to perform maintenance or benchmarking on a machine. You might also need to shut down and restart a node for some configuration changes to take effect. For example, if you change the shared directory for the Log Manager or domain, you must shut down the node and restart it to update the configuration files. You can shut down a node from the Administration Console or from the operating system. When you shut down a node, you stop Informatica Services and abort all processes running on the node. To restart a node, start Informatica Services on the node.
Note: To avoid loss of data or metadata when you shut down a node, disable all running

processes in complete mode.

To shut down a node from the Administration Console: 1. 2.

Select the node in the Navigator. Click Shutdown in the Main window.

Managing Nodes

49

The Administration Console displays the list of service processes running on that node.

3.

Click Yes to stop all processes. -orClick No to cancel the operation.

To start or stop the node on Windows: 1. 2.

From the Start Menu, click Administrative Tools > Services. Double-click Informatica Services.

3.

If the Service Manager service is running, click Stop. -orIf the Service Manager service is stopped, click Start.

50

Chapter 3: Managing the Domain

To start or stop the node on UNIX: 1.

At the command prompt, switch to the directory where the infaservice executable is located. By default, infaservice resides in the server/tomcat/bin directory in the PowerCenter Services installation directory.

2.

At the command prompt, type the following command to start or stop the Service Manager:
infaservice [startup | shutdown]

Note: If you use a softlink to specify the location of infaservice, you must set the

INFA_HOME environment variable to the location of the PowerCenter Services installation directory.

Removing a Node
When you remove a node from a domain, it is no longer visible in the Navigator. If the node is running when you remove it, the node shuts down and all service processes are aborted.
Note: To avoid loss of data or metadata when you remove a node, disable all running processes in complete mode.
To remove a node: 1. 2. 3.

Select the node in the Navigator. Click the Remove button. In the warning message that appears, click OK.

Managing Nodes

51

Managing the Gateway

One gateway node in the domain serves as the master gateway node for the domain. The Service Manager on the master gateway node accepts service requests and manages the domain and services in the domain. When you install PowerCenter, you create one gateway node. After installation, you can create additional gateway nodes. You might want to create additional gateway nodes as backups. If you have one gateway node and it becomes unavailable, the domain cannot accept service requests. If you have multiple gateway nodes and the master gateway node becomes unavailable, the Service Managers on the other gateway nodes elect a new master gateway node. The new master gateway node accepts service requests. Only one gateway node can be the master gateway node at any given time. You must have at least one node configured as a gateway node at all times. Otherwise, the domain is inoperable. You can configure a worker node to serve as a gateway node. The worker node must be running when you configure it to serve as a gateway node. You must have full privileges and permission on the domain to configure a worker node to serve as a gateway node.
Note: You can also run the infasetup DefineGatewayNode command to create a gateway node. For more information about the infasetup DefineGatewayNode command, see infasetup Command Reference in the Command Line Reference.

If you configure a worker node to serve as a gateway node, you must specify the log directory. If you have multiple gateway nodes, configure all gateway nodes to write log files to the same directory on a shared disk. For more information about configuring the log directory, see Configuring the Log Location on page 309. After you configure the gateway node, the Service Manager on the master gateway node writes the domain configuration database connection to the nodemeta.xml file of the new gateway node. If you configure a master gateway node to serve as a worker node, you must restart the node to make the Service Managers elect a new master gateway node. If you do not restart the node, the node continues as the master gateway node until you restart the node or the node becomes unavailable.
To configure a gateway node: 1. 2.

In the Navigator, select the domain. Select the Properties tab.

52

Chapter 3: Managing the Domain

3.

Click Edit in the Log and Gateway Configuration section.

Select to configure node to serve as a gateway. 4.

Select the check box next to the worker node that you want to configure to serve as a gateway node. You can select multiple nodes to serve as gateway nodes.

5.

Configure the directory path for the log files. If you have multiple gateway nodes, configure all gateway nodes to point to the same location for log files.

6.

Click OK.

Managing the Gateway

53

Shutting Down a Domain

You may need to shut down a domain to perform administrative tasks on the domain. For example, you need to shut down a domain to back up and restore a domain configuration. When you shut down a domain, the Service Manager on the master gateway node stops all application services and Informatica Services in the domain. After you shut down the domain, restart Informatica Services on each node in the domain. When you shut down a domain, any processes running on nodes in the domain are aborted. Before you shut down a domain, verify that all processes, including workflows, have completed and no users are logged in to repositories in the domain. For more information about shutting down and restarting Informatica Services on an individual node, see Shutting Down and Restarting the Node on page 49.
Note: To avoid a possible loss of data or metadata and allow the currently running processes to

complete, you can shut down each node from the Administration Console or from the operating system.
To shut down and restart a domain: 1. 2.

In the Navigator, select the domain. Click Shutdown in the Main window. The Shutdown dialog box lists the running processes on the nodes in the domain.

3.

Click Yes. The Shutdown dialog box shows a warning message.

4.

Click Yes. The Service Manager on the master gateway node shuts down the application services and Informatica Services on each node in the domain.

5.

Restart Informatica Services on the gateway and worker nodes in the domain to restart the domain.

54

Chapter 3: Managing the Domain

Managing the Domain Configuration

The Service Manager on the master gateway node manages the domain configuration. The domain configuration is a set of metadata tables stored in a relational database that is accessible by all gateway nodes in the domain. Each time you make a change to the domain, the Service Manager writes the change to the domain configuration. For example, when you add a node to the domain, the Service Manager adds the node information to the domain configuration. The gateway nodes use a JDBC connection to access the domain configuration database. You can perform the following domain configuration management tasks:

Back up the domain configuration. Back up the domain configuration on a regular basis. You may need to restore the domain configuration from a backup if the domain configuration in the database becomes corrupt. For more information, see Backing Up the Domain Configuration on page 56. Restore the domain configuration. You may need to restore the domain configuration if you migrate the domain configuration to another database user account. Or, you may need to restore the backup domain configuration to a database user account. For more information, see Restoring the Domain Configuration on page 56. Migrate the domain configuration. You may need to migrate the domain configuration to another database user account. For more information, see Migrating the Domain Configuration on page 57. Configure the connection to the domain configuration database. Each gateway node must have access to the domain configuration database. You configure the database connection when you create a domain. If you change the database connection information or migrate the domain configuration to a new database, you must update the database connection information for each gateway node. For more information, see Updating the Domain Configuration Database Connection on page 60. Custom properties. Configure domain properties that are unique to your PowerCenter environment or that apply in special cases. Use custom properties only if Informatica Technical Support instructs you to do so. For more information, see Custom Properties on page 60.

Domain Configuration Database

The domain configuration database consists of the following tables:

PCSF_CPU_USAGE_SUMMARY. Stores the number of CPUs used by each application service each day. Run the Domain Activity Monitoring report to analyze CPU usage information stored in this table. For more information about the Domain Activity Monitoring report, see Monitoring License Usage on page 293. PCSF_DOMAIN. Stores the domain metadata, such as names, host names, and port numbers of nodes in the domain. The Service Manager on the master gateway node determines nodes that are eligible to exist in the domain based on the list of nodes that it

Managing the Domain Configuration

55

tracks in this table. The Service Manager looks up host names and port numbers of worker nodes in this table to assign tasks to the worker nodes in the domain.

PCSF_MASTER_ELECTION. Stores information that allows the Service Managers on the other gateway nodes to elect the master gateway node. PCSF_MASTER_ELECT_LOCK. Stores the lock information about the master gateway node. Ensures that only one master gateway node exists at any time. PCSF_REPO_USAGE_SUMMARY. Stores the number of Repository Services running in the domain each day. Run the Domain Activity Monitoring report to analyze Repository Service usage information stored in this table. For more information about the Domain Activity Monitoring report, see Monitoring License Usage on page 293. PCSF_RUN_LOG. Stores the location of workflow and session log binary files. The Log Manager retrieves the location of the files from this table. The Workflow Monitor and infacmd commands request the location of the workflow and session log binary files from the Log Manager.

Backing Up the Domain Configuration

Back up the domain configuration on a regular basis. You may need to restore the domain configuration from a backup file if the domain configuration in the database becomes corrupt. Run the infasetup BackupDomain command to back up the domain configuration to an XML file. For more information about the BackupDomain command, see infasetup Command Reference in the Command Line Reference.

Restoring the Domain Configuration

You can restore domain configuration from a backup file. You may need to restore the domain configuration if the domain configuration in the database becomes inconsistent or if you want to migrate the domain configuration to another database. For more information about migrating domain configuration, see Migrating the Domain Configuration on page 57. You can restore the domain configuration to the same or a different database user account. If you restore the domain configuration to a database user account with existing domain configuration, you must configure the command to overwrite the existing domain configuration. If you do not configure the command to overwrite the existing domain configuration, the command fails. Each node in a domain has a host name and port number. When you restore the domain configuration, you can disassociate the host names and port numbers for all nodes in the domain. You might do this if you want to run the nodes on different machines. After you restore the domain configuration, you can assign new host names and port numbers to the nodes. Run the infasetup DefineGatewayNode or DefineWorkerNode command to assign a new host name and port number to a node. For more information about the infasetup DefineGatewayNode and DefineWorkerNode commands, see infasetup Command Reference in the Command Line Reference.

56

Chapter 3: Managing the Domain

If you restore the domain configuration to another database, you must reset the database connections for all gateway nodes. For more information, see Updating the Domain Configuration Database Connection on page 60.
Warning: You lose all data in the PCSF_CPU_USAGE_SUMMARY, PCSF_REPO_USAGE_SUMMARY, and PCSF_RUN_LOG tables when you restore the domain configuration. For more information about what is stored in each of these tables, see Domain Configuration Database on page 55.

Complete the following tasks to restore the domain: 1. Disable the application services. Disable the application services in complete mode to ensure that you do not abort any running service process. You must disable the application services to ensure that no service process is running when you shut down the domain. Shut down the domain. You must shut down the domain to ensure that no change to the domain occurs while you are restoring the domain. Run the infasetup RestoreDomain command to restore the domain configuration to a database. The RestoreDomain command restores the domain configuration in the backup XML file to the specified database user account. For more information about the RestoreDomain command, see infasetup Command Reference in the Command Line Reference. Assign new host names and port numbers to the nodes in the domain if you disassociated the previous host names and port numbers when you restored the domain configuration. Run the infasetup DefineGatewayNode or DefineWorkerNode command to assign a new host name and port number to a node. For more information about the DefineGatewayNode and DefineWorkerNode commands, see infasetup Command Reference in the Command Line Reference. Reset the database connections for all gateway nodes if you restored the domain configuration to another database. All gateway nodes must have a valid connection to the domain configuration database.

2. 3.

4.

5.

Migrating the Domain Configuration

You can migrate the domain configuration to another database user account. You may need to migrate the domain configuration if you no longer support the existing database user account. For example, if your company requires all departments to migrate to a new database type, you must migrate the domain configuration. Complete the following steps to migrate the domain configuration: 1. 2. 3. 4. Shut down all application services in the domain. Shut down the domain. Back up the domain configuration. Create the database user account where you want to restore the domain configuration.

Managing the Domain Configuration

57

5. 6. 7. 8.

Restore the domain configuration backup to the database user account. Update the database connection for each gateway node. Start all nodes in the domain. Enable all application services in the domain.

Warning: You lose all data in the PCSF_CPU_USAGE_SUMMARY, PCSF_REPO_USAGE_SUMMARY, and PCSF_RUN_LOG tables when you restore the domain configuration. For more information about what is stored in each of these tables, see Domain Configuration Database on page 55.

Step 1. Shut Down All Application Services

You must disable all application services to disable all service processes. If you do not disable an application service and a user starts running a service process while you are backing up and restoring the domain, the service process changes may be lost and data may become corrupt.
Tip: Shut down the application services in complete mode to ensure that you do not abort any running service processes.

Shut down the application services in the following order: 1. 2. 3. 4. Web Services Hub SAP BW Services Integration Services Repository Services

For more information about shutting down an application service, see Enabling and Disabling Services and Service Processes on page 39.

Step 2. Shut Down the Domain

You must shut down the domain to ensure that users do not modify the domain while you are migrating the domain configuration. For example, if the domain is running when you are backing up the domain configuration, users can create new services and objects. Also, if you do not shut down the domain and you restore the domain configuration to a different database, the domain becomes inoperative. The connections between the gateway nodes and the domain configuration database become invalid. The gateway nodes shut down because they cannot connect to the domain configuration database. A domain is inoperative if it has no running gateway node. For more information about shutting down the domain, see Shutting Down a Domain on page 54.

Step 3. Back Up the Domain Configuration

Run the infasetup BackupDomain command to back up the domain configuration to an XML file.

58

Chapter 3: Managing the Domain

For more information about the infasetup BackupDomain command, see infasetup Command Reference in the Command Line Reference.

Step 4. Create a Database User Account

Create a database user account if you want to restore the domain configuration to a new database user account. For information about the database requirements for the domain configuration database, see the Installation and Configuration Guide.

Step 5. Restore the Domain Configuration

Run the infasetup RestoreDomain command to restore the domain configuration to a database. The RestoreDomain command restores the domain configuration in the backup XML file to the specified database user account. For more information about the domain configuration restoration process, see Restoring the Domain Configuration on page 56. For more information about the RestoreDomain command, see infasetup Command Reference in the Command Line Reference.

Step 6. Update the Database Connection

If you restore the domain configuration to a different database user account, you must update the database connection information for each gateway node in the domain. Gateway nodes must have a connection to the domain configuration database to retrieve and update domain configuration. For more information about updating the connection to the domain configuration database, see Updating the Domain Configuration Database Connection on page 60.

Step 7. Start All Nodes in the Domain

Start all nodes in the domain. You must start the nodes to enable services to run. For more information about starting a node, see Shutting Down and Restarting the Node on page 49.
To update the database connection: 1. 2.

Shut down the gateway node that you want to update. Run the infasetup UpdateGatewayNode command to update the gateway node. For more information about the infasetup UpdateGatewayNode command, see infasetup Command Reference the Command Line Reference.

3.

Start the gateway node. For information about starting a node, see Shutting Down and Restarting the Node on page 49.

4.

Repeat this process for each gateway node.

Managing the Domain Configuration

59

Step 8. Enable All Application Services

Enable all application services that you previously shut down. Application services must be enabled to run service processes.

Updating the Domain Configuration Database Connection

All gateway nodes must have a connection to the domain configuration database to retrieve and update domain configuration. When you create a gateway node or configure a node to serve as a gateway, you specify the database connection, including the database user name and password. If you migrate the domain configuration to a different database or change the database user name or password, you must update the database connection for each gateway node. For example, as part of a security policy, your company may require you to change the password for the domain configuration database every three months. Run the infasetup UpdateGatewayNode command to update a gateway node with the new database connection information. You must shut down the gateway node before you run the UpdateGatewayNode command on the node. For more information about shutting down a node, see Shutting Down and Restarting the Node on page 49. If you change the host name, port number, node user, or password while a node is shut down, you must redefine the node. Run the infasetup UpdateGatewayNode command to update the gateway node. For more information about defining and adding nodes, see Defining and Adding Nodes on page 44. For more information about the UpdateGatewayNode command, see infasetup Command Reference in the Command Line Reference.

Custom Properties
Custom properties include properties that are unique to your PowerCenter environment or that apply in special cases. A domain has no custom properties when you initially create it. Use custom properties only if Infomatica Technical Support instructs you to.

60

Chapter 3: Managing the Domain

Working with Multiple Domains

All nodes and services that need to be managed through a single interface must be in the same domain. You cannot access two PowerCenter domains in the same PowerCenter Administration Console window. You may need to share metadata among multiple PowerCenter domains. For example, if two organizations merge and each has established its own PowerCenter domain, the combined organization may want to maintain separate PowerCenter domains. Similarly, network configuration and geographic considerations may require an organization to use multiple domains. To exchange metadata between domains, you can link the domain you access when you start the Administration Console (the local PowerCenter domain) with another domain. Link domains to perform the following types of tasks:

Copy the content of a repository in the local PowerCenter domain to a repository in another PowerCenter domain. Register or unregister a local repository in the local PowerCenter domain with a global repository in another PowerCenter domain. Associate an Integration Service in the local PowerCenter domain with a Repository Service in another PowerCenter domain. Associate an SAP BW Service in the local PowerCenter domain with an Integration Service in another PowerCenter domain.

When you perform an operation that allows you to choose a service in another domain, you can select the domain from a list of linked domains. If the domain is not in the list, you can add it. When you add a domain to the list, you establish a link between the local PowerCenter domain and the other domain. After you link the domains, you can access the Repository Services or Integration Services in the linked domain.
To add a domain to the domain list: 1. 2.

Select an application service in the Navigator of the Administration Console. Perform any task that allows you to choose the domain.

Working with Multiple Domains

61

Figure 3-3 shows the list of domains and the Manage Domain List button to add linked domains:
Figure 3-3. Manage Domain List

List of Available Domains 3.

Add domains to the list.

On the page where you select an Integration Service or Repository Service in another domain, click Manage Domain List. The Manage List of Domains window appears.

Linked Domain

62

Chapter 3: Managing the Domain

4.

Enter the following information:

Field Domain Name Host Name Required/ Optional Required Required Description Name of a PowerCenter domain that you want to link to. Machine running the master gateway for the linked domain. The machine running the master gateway for the local PowerCenter domain must have a network connection to this machine. Gateway port number for the linked domain.

Host Port 5. 6. 7. 8. 9.

Required

Click Add if you want to add more than one domain to the list, and repeat step 4 for each domain. To edit the connection information for a linked domain, go to the section for the domain you want to update and click Edit. To remove a linked domain from the list, go to the section for the domain you want to remove and click Delete. To refresh the list of domains, click Refresh Domains. Click Done to save the list.

Working with Multiple Domains

63

64

Chapter 3: Managing the Domain

Chapter 4

Managing Users and User Accounts

This chapter includes the following topics:

Overview, 66 Users and User Accounts, 67 Managing Users, 69 Managing Permissions and Privileges, 72 Managing Your Account, 76 Monitoring User Activity, 78

65

Overview
User accounts enable access to the Administration Console. Depending on your user account type, you may or may not be able to perform all tasks on the Administration Console. Use the Administration Console to perform the following tasks:

Manage users. Create, edit, and remove user accounts on the Administration tab. For more information, see Managing Users on page 69. Manage permissions and privileges. All users must have permissions and privileges on objects in the domain. You must have permission on an object to access the object. Your privilege designates read-only or full access to objects you have permission on. For more information, see Managing Permissions and Privileges on page 72. Manage your account. Update your password, profile, and preferences. For example, you can subscribe to alerts and verify your email address to receive notifications. For more information, see Managing Your Account on page 76. Monitor user activity. Run user activity reports to view user activity in a domain. For example, you can run an activity report against a user to find out when the user shut down a node. For more information, see Monitoring User Activity on page 78.

66

Chapter 4: Managing Users and User Accounts

Users and User Accounts

To log in to the Administration Console, you must have a user account. The Administration Console has the following types of users:

Domain administrator. The administrator created when you install PowerCenter services and create a domain. You cannot delete the domain administrator. Root administrator. An Administration Console user who can modify all objects in the domain and manage users. Domain user. An Administration Console user who can view objects in the domain. Domain users may be allowed to modify the objects that they can view.

Domain Administrator
When you install PowerCenter services and create a domain, you create an administrator for the domain. The domain administrator has full privileges and permission on all objects in the domain, such as services, licenses, and folders. The administrator can create and remove domain users and grant permission on objects in the domain. You must use the domain administrator user name and password to perform the following tasks:

Join a domain through the installation program. Log in to the Administration Console for the first time.

You cannot remove the domain administrator from the domain or change the domain administrator user name, privileges, or permissions. You can change the domain administrator profile and password. To keep the PowerCenter domain secure, use the domain administrator account to create one or more root administrators. Use the root administrator accounts to manage the domain and other users.

Root Administrators and Domain Users

Root administrators can manage the domain, view and modify all objects in the domain, and manage users. Domain users can view objects they have permission on. If domain users have full privileges, they can also modify the objects they have permission on. Use the Administration tab to add root administrators and domain users. You must have permission on the domain to view the Administration tab. To create a root administrator, add a new user and assign the following permissions and privileges:

Full privileges Permission on the domain

To create a domain user, add a new user and assign the appropriate permissions and privileges.

Users and User Accounts

67

For more information about permissions and privileges, see Managing Permissions and Privileges on page 72. For more information about adding users, see Managing Users on page 69.

68

Chapter 4: Managing Users and User Accounts

Managing Users
If you have full privileges in the Administration Console and permission on the domain, you can manage users in the domain. You can add, edit, and remove users on the Administration tab. Figure 4-1 shows the Administration tab where you manage users:
Figure 4-1. Administration Tab of the Administration Console

Add user. Click login name to edit user. Remove user. Edit permissions.

To add a user: 1. 2.

In the Administration Console, click the Administration tab. Click Add.

Managing Users

69

The Add User page appears.

Add user account information.

Assign permissions.

Assign privileges.

3. 4. 5.

Enter the login name, password, password confirmation, and full name. Optionally, enter the description, email address, and phone number. Select an object to give the user permission. If you select the domain, the user has permission on all objects in the domain. If you select a folder, the user has permission on all objects in the folder, including objects in subfolders.

6. 7. 8.

Click Add. Repeat steps 5 to 6 to assign more permissions. To assign the user read-only privilege, enable Provide this user Read-only access to all objects for which permission is granted. To assign the user full privileges, disable this option. For more information about privileges, see Managing User Privileges on page 74. Click Add User.

9.

70

Chapter 4: Managing Users and User Accounts

To edit user information: 1. 2.

In the Administration Console, click the Administration tab. Click a user name. The Edit User page appears.

3.

Update the user information. If the user has full privileges and permission on the domain, a message at the bottom of the window indicates that the user can manage other users. For more information about editing user permissions and privileges, see Managing Permissions and Privileges on page 72.

4.

Click OK.

To remove a user: 1. 2. 3.

In the Administration Console, click the Administration tab. Click the Remove button for the user. In the confirmation window, click OK.

Managing Users

71

Managing Permissions and Privileges

Security in the Administration Console is managed with permissions and privileges. Permissions allow the user to access objects on the domain. You have the option to assign permissions at either the object or user level. Privileges are assigned to users and designate the access (full or read-only) to objects which permissions have been granted.

Managing Permissions
If you have full privileges and permission on an object in the domain, you can grant permission on that object to other users in the domain. Objects include the domain, folders, nodes, grids, licenses, and application services. You can perform administrative tasks on an object in the domain if you have full privileges and permission on that object. You can have the following types of permissions in a domain:

Object permissions. When you have permission on an object, you can perform administration tasks on that object. Inherited permissions. When you have permission on a domain or a folder, you inherit permission on all objects in the domain or the folder.

For example, a domain has a folder named Integration_Services, which contains multiple Integration Services. If you have object permission on one Integration Service in the folder, you can access that Integration Service. If you have object permission on the folder, you inherit permission on all Integration Services in the folder. Figure 4-2 shows inherited and object permissions for the Integration_Services folder:
Figure 4-2. Inherited and Object Permissions

User has object permission and inherits permission on the folder and all objects in the folder. Users have object permission on the domain. They inherit permission on everything in the domain, including the folder.

If you do not have permission on an object that you select in the Navigator, the Main window displays a message indicating that you lack permission on the object. If you have full privileges and permission on the domain, you cannot edit the permission of others with the same access.

72

Chapter 4: Managing Users and User Accounts

Steps to Assign Permissions

There are two ways to assign permission on the Administration Console:

Assign permission on a selected object to multiple users. Assign multiple objects permissions to one user.

To grant or revoke permissions by object: 1. 2. 3.

Select an object in the Navigator. Click the Permissions tab. Click Edit. The page displays the following object permission options:

4.

Select a user in the All Users list, and click Grant Permission. -orSelect a user in the Users with Permissions list, and click Revoke Permission. If you revoke domain permission for a root administrator, the root administrator becomes a domain user.

5.

Click OK.

To grant or revoke permissions by user: 1. 2.

In the Administration Console, click the Administration tab. Click the Set Permissions button for the user.

Managing Permissions and Privileges

73

The Edit User Permissions page appears:

3.

Select an object in the All objects in Domain list, and click Add. -orSelect an object in the Permissions granted to list, and click Remove.

4. 5.

Repeat step 3 to edit the permission for multiple objects. To assign the user read-only privilege, enable Provide this user Read-only access to all objects for which permission is granted. To assign the user full privileges, disable this option. For more information about privileges, see Managing User Privileges on page 74. Click OK.

6.

Managing User Privileges

In the Administration Console, privileges determine whether you can view or modify the objects that you have permission on. You can have one of the following types of privileges:

Full. When you have full privileges, you can view and modify the objects you have permission on. Read-only. When you have read-only privilege, you can view the objects that you have permission on, but you cannot modify them.

You assign read-only privilege to a user when you want the user to monitor but not modify the domain. A user with read-only privilege cannot perform the following operations:

Create, remove, or move any objects in a domain. Edit the properties, assigned services, or permissions for any object in a domain. Modify the associated repositories or service processes for any service.

74

Chapter 4: Managing Users and User Accounts

Enable or disable services. Create, restore, or copy repository contents. Enable, disable, create, or delete resources available to a node. Add, remove, or edit user accounts. Purge, export, or modify autopurge configuration for log events. Run the upgrade wizard. Upgrade, delete, and backup a repository. Register and unregister Local Database Repositories, Global Database Repositories, plugins, and LDAP Security Modules. Notify users. Modify their own user information, but cannot change their privileges.

A user with read-only privilege can perform the following operations:

You assign privileges to Administration Console users when you add or edit permissions. For more information about adding and editing users, see Managing Users on page 69.

Managing Permissions and Privileges

75

Managing Your Account

Use the Manage Account tab to change your password, manage your own user profile, and set user preferences. The Manage Account tab includes the following areas:

Change password. Change your domain password. If someone else created your domain user account, change your password the first time you log in to the Administration Console. Click Apply after entering the old and new passwords and confirming the new password. Personal profile. View or modify your personal profile. Update personal information such as your email address or telephone number. Email address and telephone number must have valid formats. You must enter an email address here to subscribe to domain and service alerts. The phone number field accepts numeric values and hyphens. User preferences. Set user preferences to display access to upgrade option or custom properties.

Warning: The user password associated with a node is used by the Service Manager to authenticate that node in the domain. If you change a user password in the Administration Console that is associated with a node, the Service Manager updates the nodes associated with that user. Nodes that are not running cannot be updated. You must run the infasetup UpdateGatewayNode or UpdateWorkerNode command to change the password for the nonrunning nodes. For more information about these commands, see infasetup Command Reference in the Command Line Reference.

Figure 4-3 shows the Manage Account tab:

Figure 4-3. Manage Account Tab of the Administration Console

76

Chapter 4: Managing Users and User Accounts

In the User Preferences area, update the following Administration Console settings:
Option Subscribe for Alerts Required/ Optional Required Description Subscribes you to domain and service alerts for domains and services you have permission on. You must have a valid email address configured in your Personal Profile to subscribe to alerts. Default is No. For more information about alerts, see Managing Alerts on page 33. Displays custom properties in the Main window when you click an object in the Navigator. You use custom properties to configure PowerCenter behavior for special cases or to improve performance. Hide the custom properties to avoid inadvertently changing the values. Use custom properties only if Informatica Technical Support instructs you to. Displays the Upgrade tab that appears next to the Manage Account tab the Administration Console. Show the Upgrade tab to upgrade a PowerCenter Server to an Integration Service or to upgrade a Repository Agent to a Repository Service. Displays tooltips in the Overview and Properties tabs of the Administration Console. Controls the interval at which the overview grid refreshes when you select the Overview tab for a domain or folder. Default is 30 seconds.

Show Custom Properties

Required

Show Upgrade Options

Required

Show Tooltips in the Overview Dashboards and Properties Overview Grid Refresh Time

Required

Required

Managing Your Account

77

Monitoring User Activity

You can monitor user activity in the domain. You might monitor user activity to determine who created, updated, or removed services and nodes. For example, if a PowerCenter repository user cannot log in to a PowerCenter repository, you can review the user activity for the Repository Service. You find that the Repository Service is shut down. You view the User Activity Monitoring report to determine who shut down the Repository Service. You can then follow up with the person who shut down the Repository Service to find out why the service was shut down. The Service Manager logs events whenever the domain needs to authorize an action. The domain logs an event each time a user performs one of the following actions:

Adds, updates, or removes a user. Starts, stops, enables, or disables a service. Adds, updates, removes, or shuts down a node. Modifies the domain properties. Moves a folder in the domain. Adds, updates, or removes an application service. Enables or disables a service process.

You must have permission on the domain to view the User Activity Monitoring report.
To monitor user activity: 1.

On the Administration tab, click the User Activity Monitoring link. The User Activity Monitoring page appears.

Go Button

2.

Specify the time period and the user to view user activity. When you specify a time period, you can choose the following options:

Last. View the most recent log events. You must specify the number of days or months for which you want to view log events. From Date. View log events that occurred between two specified dates. You must specify the start and end dates for this option. Use the yyyy-mm-dd format when you enter a date.

78

Chapter 4: Managing Users and User Accounts

3.

Click the Go button to run the report. The User Activity Monitoring report appears.

Monitoring User Activity

79

80

Chapter 4: Managing Users and User Accounts

Chapter 5

Managing High Availability

This chapter includes the following topics:

Overview, 82 High Availability in the Base Product, 86 Achieving High Availability, 88 Managing Resilience, 92 Managing High Availability for the Repository Service, 96 Managing High Availability for the Integration Service, 98 Troubleshooting, 104

81

Overview
The term high availability refers to the uninterrupted availability of computer system resources. In PowerCenter, high availability eliminates a single point of failure in a domain and provides minimal service interruption in the event of failure. When you configure high availability for a domain, the domain can continue running despite temporary network, hardware, or service failures. The following high availability components make services highly available in a PowerCenter domain:

Resilience. The ability of a PowerCenter domain to tolerate temporary connection failures until either the resilience timeout expires or the failure is fixed. For more information, see Resilience on page 83. Restart and failover. The restart of a service or task or the migration to a backup node after the service becomes unavailable on the primary node. For more information, see Restart and Failover on page 84. Recovery. The completion of operations after a service is interrupted. After a service process restarts or fails over, it restores the service state and recovers operations. For more information, see Recovery on page 85.

When you plan a highly available PowerCenter environment, consider the differences between internal PowerCenter components and systems that are external to PowerCenter. Internal PowerCenter components include Service Manager, application services, the PowerCenter Client, and command line programs. External systems include the network, hardware, database management systems, FTP servers, message queues, and shared storage. If you have the high availability option, you can achieve full high availability of internal components. You can achieve high availability with external components based on the availability of those components. If you do not have the high availability option, you can achieve some high availability of internal components. For more information about high availability in the base product, see High Availability in the Base Product on page 86.

Example
While you are fetching a mapping into the Designer workspace, the Repository Service becomes unavailable, and the request fails. The Repository Service fails over to another node because it cannot restart on the same node. The Designer is resilient to temporary failures and tries to establish a connection to the Repository Service. The Repository Service starts within the resilience timeout period, and the Designer reestablishes the connection. After the Designer reestablishes the connection, the Repository Service recovers from the failed operation and fetches the mapping into the Designer workspace.

82

Chapter 5: Managing High Availability

Resilience
Resilience is the ability of PowerCenter service clients to tolerate temporary network failures until the timeout period expires or the system failure is resolved. Clients that are resilient to a temporary failure can maintain connection to a service for the duration of the timeout. All clients within PowerCenter are resilient to service failures. A client of a service can be any PowerCenter Client tool or PowerCenter service that depends on the service. For example, the Integration Service is a client of the Repository Service. If the Repository Service becomes unavailable, the Integration Service tries to reestablish the connection. If the Repository Service becomes available within the timeout period, the Integration Service is able to connect. If the Repository Service is not available within the timeout period, the request fails. PowerCenter services may also be resilient to temporary failures of external systems, such as database systems, FTP servers, and message queue sources. For this type of resilience to work, the external systems must be highly available. You need the high availability option to configure resilience to external system failures.

Internal Resilience
Internal resilience occurs within the PowerCenter environment among PowerCenter services, the PowerCenter Client tools, and other client applications such as pmrep and pmcmd. You can configure internal resilience at the following levels:

Domain. You configure service connection resilience at the domain level in the general properties for the domain. The domain resilience timeout determines how long services attempt to connect as clients to application services or the Service Manager. The domain resilience properties are the default values for all services in the domain. Service. You can also configure service connection resilience in the advanced properties for an application service. When you configure connection resilience for an application service, you override the resilience values from the domain settings. Gateway. The master gateway node maintains a connection to the domain configuration database. If the domain configuration database becomes unavailable, the master gateway node tries to reconnect. The resilience timeout period depends on user activity and the number of gateway nodes:

Single gateway node. If the domain has one gateway node, the gateway node tries to reconnect until a user or service tries to perform a domain operation. When a user tries to perform a domain operation, the master gateway node shuts down. Multiple gateway nodes. If the domain has multiple gateway nodes and the master gateway node cannot reconnect, then the master gateway node shuts down. If a user tries to perform a domain operation while the master gateway node is trying to connect, the master gateway node shuts down. If another gateway node is available, the domain elects a new master gateway node. The domain tries to connect to the domain configuration database with each gateway node. If none of the gateway nodes can connect, the domain shuts down and all domain operations fail.

Overview

83

External Resilience
Services in the domain can also be resilient to the temporary unavailability of systems that are external to PowerCenter, such as FTP servers and database management systems. You can configure the following types of external resilience for application services:

Database connection resilience for Integration Service. The Integration Service depends on external database systems to run sessions and workflows. If a database is temporarily unavailable, the Integration Service attempts to connect for a specified amount of time. The Integration Service is resilient when connecting to a database when a session starts, when the Integration Services fetches data from a relational source or uncached lookup, or it writes data to a relational target. The Integration Service is resilient if the database supports resilience. You configure the connection retry period in the relational connection object for a database.

Database connection resilience for Repository Service. The Repository Service can be resilient to temporary unavailability of the repository database system. A client request to the Repository Service does not necessarily fail if the database system becomes temporarily unavailable. The Repository Service tries to reestablish connections to the database system and complete the interrupted request. You configure the repository database resilience timeout in the database properties of a Repository Service. Database connection resilience for master gateway node. The master gateway node can be resilient to temporary unavailability of the domain configuration database. The master gateway node maintains a connection to the domain configuration database. If the domain configuration database becomes unavailable, the master gateway node tries to reconnect. The timeout period depends on whether the domain has one or multiple gateway nodes. FTP connection resilience. If a connection is lost while the Integration Service is transferring files to or from an FTP server, the Integration Service tries to reconnect for the amount of time configured in the FTP connection object. The Integration Service is resilient to interruptions if the FTP server supports resilience. Client connection resilience. You can configure connection resilience for Integration Service clients that are external applications using C/Java LMAPI. You configure this type of resilience in the Application connection object.

For more information about configuring the resilience, see Working with Multiple Domains on page 61.

Restart and Failover

If a service process becomes unavailable, the Service Manager can restart the process or fail it over to a backup node based on the availability of the node. When a service process restarts or fails over, the service restores the state of operation and begins recovery from the point of interruption. You can configure backup nodes for services if you have the high availability option. If you configure an application service to run on primary and backup nodes, one service process can run at a time. The following situations describe restart and failover for an application service:

84

Chapter 5: Managing High Availability

If the primary node running the service process becomes unavailable, the service fails over to a backup node. The primary node might be unavailable if it shuts down or if the connection to the node becomes unavailable. If the primary node running the service process is available, the domain tries to restart the process based on the restart options configured in the domain properties. If the process does not restart, the Service Manager may mark the process as failed. The service then fails over to a backup node and starts another process. If the Service Manager marks the process as failed, the administrator must enable the process after addressing any configuration problem.

If a service process fails over to a backup node, it does not fail back to the primary node when the node becomes available. You can disable the service process on the backup node to cause it to fail back to the primary node.

Recovery
Recovery is the completion of operations after an interrupted service is restored. When a service recovers, it restores the state of operation and continues processing the job from the point of interruption. The state of operation for a service contains information about the service process. The PowerCenter services include the following states of operation:

Service Manager. The Service Manager for each node in the domain maintains the state of service processes running on that node. If the master gateway shuts down, the newly elected master gateway collects the state information from each node to restore the state of the domain. Repository Service. The Repository Service maintains the state of operation in the repository. This includes information about repository locks, requests in progress, and connected clients. Integration Service. The Integration Service maintains the state of operation in the shared storage configured for the service. This includes information about scheduled, running, and completed tasks for the service. The Integration Service maintains session and workflow state of operation based on the recovery strategy you configure for the session and workflow.

Overview

85

High Availability in the Base Product

PowerCenter provides some high availability functionality that does not require the high availability option. The base product provides the following high availability functionality:

Internal PowerCenter resilience. The Service Manager, application services, PowerCenter Client, and command line programs are resilient to temporary unavailability of other PowerCenter internal components. Repository database resilience. The Repository Service is resilient to temporary unavailability of the repository database. Informatica Services restart. You can configure Informatica Services to restart after a failure. Manual recovery of workflows and sessions. You can manually recover workflows and sessions. Multiple gateway nodes. You can configure multiple nodes as gateway.

Note: You must have the high availability option for failover and automatic recovery.

Internal PowerCenter Resilience

Internal PowerCenter components are resilient to temporary unavailability of other PowerCenter components. PowerCenter components include the Service Manager, application services, the PowerCenter Client, and command line programs. You can configure the resilience timeout and the limit on resilience timeout for the domain, application services, and command line programs. The PowerCenter Client is resilient to temporary unavailability of the application services. For example, temporary network failure can cause the Integration Service to be unavailable to the PowerCenter Client. The PowerCenter Client tries to reconnect to the Integration Service during the resilience timeout period. For more information, see Managing Resilience on page 92.

Repository Service Resilience to Repository Database

The Repository Service is resilient to temporary unavailability of the repository database. If the repository database becomes unavailable, the Repository Service tries to reconnect within the database connection timeout period. If the database becomes available and the Repository Service reconnects, the Repository Service can continue processing repository requests. You configure the database connection timeout in the Repository Service database properties. For more information, see Managing Resilience on page 92.

Informatica Services Restart

Informatica Services run as a service on Windows and as a daemon on UNIX. When you start Informatica Services, you start the Service Manager. The Service Manager manages all domain

86

Chapter 5: Managing High Availability

operations. The Service Manager runs within Informatica Services and starts the application services and supports the domain. You can configure Informatica Services to restart on failure. If the node shuts down, Informatica Services restarts automatically so services on the node can receive new requests. Services cannot recover failed operations. For more information, see Configuring PowerCenter in the Installation and Configuration Guide.

Manual Workflow and Session Recovery

You can manually recover a workflow and all tasks in the workflow without the high availability option. To recover a workflow, you must configure the workflow for recovery. When you configure a workflow for recovery, the Integration Service stores the state of operation that it uses to begin processing from the point of interruption. You can manually recover a session without the high availability option. To recover a session, you must configure the recovery strategy for the session. If you have the high availability option, the Integration Service can automatically recover workflows. For more information about recovery, see Recovering Workflows in the Workflow Administration Guide.

High Availability in the Base Product

87

Achieving High Availability

You can achieve different degrees of availability depending on factors that are internal and external to the PowerCenter environment. For example, you can achieve a greater degree of availability when you configure more than one node to serve as a gateway and when you configure backup nodes for application services. Consider internal components and external systems when you are designing a highly available PowerCenter environment:

Internal components. Configure nodes and services for high availability. For more information, see Configuring PowerCenter Internal Components for High Availability on page 88. External systems. Use highly available external systems for hardware, shared storage, database systems, networks, message queues, and FTP servers. For more information, see Using Highly Available External Systems on page 90.

Note: Web Services Hub and SAP BW Service are not highly available.

Configuring PowerCenter Internal Components for High Availability

PowerCenter internal components include the Server Manager, nodes, and all services within the PowerCenter environment. You can configure nodes and services to enhance availability:

Configure more than one gateway. You can configure multiple nodes in a domain to serve as the gateway. Only one node serves as the gateway at any given time. That node is called the master gateway. If the master gateway becomes unavailable, the Service Manager elects another master gateway node. If you configure only one gateway node, the gateway is a single point of failure. If the gateway node becomes unavailable, the Service Manager cannot accept service requests. Configure application services to run on multiple nodes. You can configure the application services to run on multiple nodes in a domain. A service is available if at least one designated node is available. Configure access to shared storage. You need to configure access to shared storage when you configure multiple gateway nodes and multiple backup nodes for the Integration Service. When you configure more than one gateway node, each gateway node must have access to the domain configuration database. When you configure the Integration Service to run on more than one node, each node must have access to the run-time files used to process a session or workflow.

When you design a highly available PowerCenter environment, you can configure the nodes and services to minimize failover or to optimize performance.

Minimize service failover. Configure two nodes as gateway. Configure different primary nodes for each application service. Optimize performance. Configure gateway nodes on machines that are dedicated to serve as a gateway. Configure backup nodes for the Integration Service and the Repository Service.

88

Chapter 5: Managing High Availability

Minimizing Service Failover

To minimize service failover in a domain with two nodes, configure the Integration Service and Repository Service to run on opposite primary nodes. Configure one node as the primary node for the Integration Service, and configure the other node as the primary node for the Repository Service. Figure 5-1 shows a configuration in which both nodes are gateways and the Integration Service and Repository Service are configured to run on opposite primary nodes:
Figure 5-1. High Availability Configuration with Two Gateway Nodes
Node 1 (Gateway) Service Manager Integration Service (P) Repository Service (B) Node 2 (Gateway) Service Manager

Integration Service (B) Repository Service (P)

Application Service (P) Primary Node Assignment to Run Service (B) Backup Node Assignment to Run Service

Optimizing Performance
To optimize performance in a domain, configure gateway operations and applications services to run on separate nodes. Configure the Integration Service and the Repository Service to run on multiple worker nodes. When you separate the gateway operations from the application services, the application services do not interfere with gateway operations when they consume a high level of CPUs.

Achieving High Availability

89

Figure 5-2 shows a configuration with two gateway nodes and multiple backup nodes for the Integration Service and Repository Service:
Figure 5-2. High Availability Configuration with Multiple Nodes
Node 1 (Gateway) Service Manager Node 3 (Worker) Service Manager Node n (Worker) Service Manager

Node 2 (Gateway) Service Manager

Integration Service (P)

Integration Service (B) Repository Service (P)

Repository Service (B)

Application Service (P) Primary Node Assignment to Run Service (B) Backup Node Assignment to Run Service

Using Highly Available External Systems

PowerCenter depends on external systems such as file systems and databases for repositories, sources, and targets. To optimize PowerCenter availability, ensure that external systems are also highly available. Use the following rules and guidelines to configure external systems:

Use a highly available database management system for the repository and domain configuration database. Follow the guidelines of the database system when you plan redundant components and backup and restore policies. Use highly available versions of other external systems, such as source and target database systems, message queues, and FTP servers. Use a highly available file system for the shared storage used by services in the domain. You can use different disks or file systems for the shared files used by the Integration Service. For more information about shared storage, see Directories for Integration Service Files on page 192. Make the network highly available by configuring redundant components such as routers, cables, and network adapter cards.

Rules and Guidelines

Use the following rules and guidelines when you set up high availability for the PowerCenter environment:

Install and configure PowerCenter services on multiple nodes. For each node, configure Informatica Services to restart if it terminates unexpectedly.

90

Chapter 5: Managing High Availability

In the Administration Console, configure at least two nodes to serve as gateway nodes. Configure the Repository Services to run on at least two nodes. Configure the Integration Services to run on multiple nodes. Configure primary and backup nodes or a grid. If you configure the Integration Services to run on a grid, make resources available to more than one node. Use highly available database management systems for the repository databases associated with Repository Services and the domain configuration database.

Achieving High Availability

91

Managing Resilience
Resilience is the ability of PowerCenter Service clients to tolerate temporary network failures until the resilience timeout period expires or the external system failure is fixed. A client of a service can be any PowerCenter Client or PowerCenter service that depends on the service. Clients that are resilient to a temporary failure can try to reconnect to a service for the duration of the timeout. For example, the Integration Service is a client of the Repository Service. If the Repository Service becomes unavailable, the Integration Service tries to reestablish the connection. If the Repository Service becomes available within the timeout period, the Integration Service is able to connect. If the Repository Service is not available within the timeout period, the request fails. You can configure the following resilience properties for the domain, application services, and command line programs:

Resilience timeout. The amount of time a client attempts to connect or reconnect to a service. A limit on resilience timeouts can override the timeout. Limit on resilience timeout. The amount of time a service waits for a client to connect or reconnect to the service. This limit can override the client resilience timeouts configured for a connecting client. This is available for the domain and application services.

Configuring Service Resilience for the Domain

The domain resilience timeout determines how long services attempt to connect as clients to other services. The domain resilience timeout is the default timeout for all services in the domain. The default value is 30 seconds. The limit on resilience timeout is the maximum amount of time that a service allows another service to connect as a client. This limit overrides the resilience timeout for the connecting service if the resilience timeout is a greater value. The default value is 180 seconds. You can configure resilience properties for each application service if you do not want to use the domain values. Figure 5-3 shows the domain Properties tab where you configure resilience for the domain:
Figure 5-3. Domain Properties Tab

92

Chapter 5: Managing High Availability

Configuring Application Service Resilience

When an application service connects to another service in the domain, the connecting service is a client of the other service. When an application service connects to another application service, the resilience timeout is determined by one of the following values:

Configured value. You can configure the resilience timeout for the service in the service properties. To disable resilience for a service, set the resilience timeout to 0. The default is blank, and the service uses the domain resilience timeout. Domain resilience timeout. If you do not configure the service resilience timeout, the service uses the resilience timeout configured for the domain. Limit on timeout. If the limit on resilience timeout for the service is smaller than the resilience timeout for the connecting client, the client uses the limit as the resilience timeout.

By default, an application service uses the values for the domain resilience timeout and limit on resilience timeout. You can override the properties for each service. You configure the resilience timeout and resilience timeout limits for the Integration Service and the Repository Service in the advanced properties for the service. You configure the resilience timeout for the SAP BW Service in the general properties for the service. The property for the SAP BW Service is called the retry period.
Note: A client cannot be resilient to service interruptions if you disable the service in the

Administration Console. If you disable the service process, the client is resilient to the interruption in service.

Understanding PowerCenter Client Resilience

PowerCenter Client resilience timeout determines the amount of time the PowerCenter Client tries to connect or reconnect to the Repository Service or the Integration Service. The PowerCenter Client resilience timeout is 180 seconds and is not configurable. This resilience timeout is bound by the service limit on resilience timeout. If you perform a PowerCenter Client action that requires connection to the repository while the PowerCenter Client is trying to reestablish the connection, the PowerCenter Client prompts you to try the operation again after the PowerCenter Client reestablishes the connection. If the PowerCenter Client is unable to reestablish the connection during the resilience timeout period, the PowerCenter Client prompts you to reconnect to the repository manually.

Configuring Command Line Program Resilience

When you use a command line program to connect to the domain or an application service, the resilience timeout is determined by one of the following values:

Command line option. You can determine the resilience timeout for command line programs by using a command line option, -timeout or -t, each time you run a command.

Managing Resilience

93

Environment variable. If you do not use the timeout option in the command line syntax, the command line program uses the value of the environment variable INFA_CLIENT_RESILIENCE_TIMEOUT that is configured on the client machine. Default value. If you do not use the command line option or the environment variable, the command line program uses the default resilience timeout of 180 seconds. Limit on timeout. If the limit on resilience timeout for the service is smaller than the command line resilience timeout, the command line program uses the limit as the resilience timeout.

Note: PowerCenter does not provide resilience for a repository client when the Repository

Service is running in exclusive mode.

Example
Figure 5-4 shows some sample connections and resilience configurations in a domain:
Figure 5-4. Resilience Timeout in a Domain
DOMAIN Timeout = 30 Limit = 180 default settings NODE A NODE B

INTEGRATION SERVICE Timeout = <blank> Limit = <blank> uses domain settings B pmcmd Timeout = 200 from environment variable

REPOSITORY SERVICE Timeout = 60 Limit = 60 overrides domain settings

C POWERCENTER CLIENT Timeout = 180 not configurable

Table 5-1 describes the resilience timeout and the limits shown in Figure 5-4:
Table 5-1. Resilience Timeout in a Domain
Connect From A Integration Service Connect To Repository Service Description The Integration Service can spend up to 30 seconds to connect to the Repository Service, based on the domain resilience timeout. It is not bound by the Repository Service limit on resilience timeout of 60 seconds. pmcmd is bound by the Integration Service limit on resilience timeout of 180 seconds, and it cannot use the 200 second resilience timeout configured in INFA_CLIENT_RESILIENCE_TIMEOUT.

pmcmd

Integration Service

94

Chapter 5: Managing High Availability

Table 5-1. Resilience Timeout in a Domain

Connect From C PowerCenter Client Connect To Repository Service Description The PowerCenter Client is bound by the Repository Service limit on resilience timeout of 60 seconds. It cannot use the default resilience timeout of 180 seconds. Node A can spend up to 30 seconds to connect to Node B. The Service Manager on Node A uses the domain configuration for resilience timeout. The Service Manager on Node B uses the domain configuration for limit on resilience timeout.

Node A

Node B

Managing Resilience

95

Managing High Availability for the Repository Service

High availability for the Repository Service includes the following behavior:

Resilience. The Repository Service is resilient to temporary unavailability of other services and the repository database. Repository Service clients are resilient to connections with the Repository Service. For more information, see Resilience on page 96. Restart and failover. If the Repository Service fails, the Service Manager can restart the service or fail it over to another node, based on node availability. For more information, see Restart and Failover on page 97. Recovery. After restart or failover, the Repository Service can recover operations from the point of interruption. For more information, see Recovery on page 97.

Resilience
The Repository Service is resilient to temporary unavailability of other services. Services can be unavailable because of network failure or because a service process fails. The Repository Service is also resilient to temporary unavailability of the repository database. This can occur because of network failure or because the repository database system becomes unavailable. Repository Service clients are resilient to temporary unavailability of the Repository Service. A Repository Service client is any PowerCenter Client or PowerCenter service that depends on the Repository Service. For example, the Integration Service is a Repository Service client because it depends on the Repository Service for a connection to the repository.
Tip: You can configure the Repository Service to be resilient to temporary unavailability of the repository database. The repository database may become unavailable because of network failure or because the repository database system becomes unavailable. If the repository database becomes unavailable, the Repository Service tries to reconnect to the repository database within the period specified by the database connection timeout configured in the Repository Service properties. If the repository database system has high availability features, set the database connection timeout to allow the repository database system enough time to become available before the Repository Service tries to reconnect to it. Test the database system features that you plan to use to determine the optimum database connection timeout.

You can configure some Repository Service clients to be resilient to connections with the Repository Service. You configure the resilience timeout and the limit on resilience timeout for the Integration Service in the advanced properties when you create the Integration Service. PowerCenter Client resilience timeout is 180 seconds and is not configurable. For more information about configuring Repository Service resilience, see Managing Resilience on page 92.

96

Chapter 5: Managing High Availability

Restart and Failover

If the Repository Service process fails, the Service Manager can restart the process on the same node. If the node is not available, the Repository Service process fails over to the backup node. The Repository Service process fails over to a backup node in the following situations:

The Repository Service process fails and the primary node is not available. The Repository Service process is running on a node that fails. You disable the Repository Service process.

After failover, Repository Service clients synchronize and connect to the Repository Service process without loss of service. You may want to disable a Repository Service process to shut down a node for maintenance. If you disable a Repository Service process in complete or abort mode, the Repository Service process fails over to another node.

Recovery
The Repository Service maintains the state of operation in the repository. This includes information about repository locks, requests in progress, and connected clients. After a Repository Service restarts or fails over, it restores the state of operation from the repository and recovers operations from the point of interruption. The Repository Service performs the following tasks to recover operations:

Obtains locks on repository objects, such as mappings and sessions Reconnects to clients, such as the Designer and the Integration Service Completes requests in progress, such as saving a mapping Sends outstanding notifications about metadata changes, such as workflow schedule changes

Managing High Availability for the Repository Service

97

Managing High Availability for the Integration Service

High availability for the Integration Service includes the following behavior:

Resilience. An Integration Service process is resilient to connections with Integration Service clients and with external components. For more information, see Resilience on page 98. Restart and failover. If the Integration Service process becomes unavailable, the Service Manager can restart the process or fail it over to another node. For more information, see Restart and Failover on page 99. Recovery. When the Integration Service restarts or fails over a service process, it can automatically recover interrupted workflows that are configured for recovery. For more information, see Recovery on page 102.

Resilience
The Integration Service is resilient to temporary unavailability of other services, Integration Service clients, and external components such databases and FTP servers. If the Integration Service loses connectivity to other services and Integration Service clients within the Integration Service resilience timeout period. The Integration Service tries to reconnect to external components within the resilience timeout for the database or FTP connection object.
Note: You must have the high availability option for resilience when the Integration Service

loses connection to an external component. All other Integration Service resilience is part of the base product.

Service and Client Resilience

Integration Service clients are resilient to temporary unavailability of the Integration Service. This can occur because of network failure or because an Integration Service process fails. Integration Service clients include the PowerCenter Client, the Service Manager, the Web Services Hub, and pmcmd. Integration Service clients also include applications developed using LMAPI. You configure the resilience timeout and the limit on resilience timeout in the Integration Service advanced properties. If you do not configure the resilience timeout and the limit on the resilience timeout in the Integration Service advanced properties, the domain resilience properties provide the default values. For more information, see Advanced Properties on page 180.

External Component Resilience

An Integration Service process is resilient to temporary unavailability of external components. External components can be temporarily unavailable because of network failure or the component experiences a failure. If the Integration Service process loses connection to an external component, it tries to reconnect to the component within the retry period for the connection object.

98

Chapter 5: Managing High Availability

If the Integration Service loses the connection when it transfers files to or from an FTP server, the Integration Service tries to reconnect for the amount of time configured in the FTP connection object. The Integration Service is resilient to interruptions if the FTP server supports resilience. If the Integration Service loses the connection when it connects or retrieves data from a database for sources or Lookup transformations, it attempts to reconnect for the amount of time configured in the database connection object. If a connection is lost when the Integration Service writes data to a target database, it attempts to reconnect for the amount of time configured in the database connection object. For example, you configure a retry period of 180 for a database connection object. If Integration Service connectivity to a database fails during the initial connection to the database, or connectivity fails when the Integration Service reads data from the database, it attempts to reconnect for 180 seconds. If it cannot reconnect to the database and you configure the workflow for automatic recovery, the Integration Service recovers the session. Otherwise, the session fails. You can configure the retry period when you create or edit the database or FTP server connection object. For more information about configuring connection objects, see Managing Connection Objects in the Workflow Administration Guide.

Restart and Failover

If an Integration Service process becomes unavailable, the Service Manager tries to restart it or fails it over to another node based on the shutdown mode, the service configuration, and the operating mode for the service. Restart and failover behavior is different for services that run on a single node, primary and backup nodes, or on a grid. For more information about Integration Service behavior in normal and safe modes, see Running in Normal and Safe Mode on page 170.

Managing High Availability for the Integration Service

99

Running on a Single Node

Table 5-2 describes the failover behavior for an Integration Service if only one service process is running:
Table 5-2. Restart and Failover for an Integration Service Running on a Single Node
Source of Shutdown Service Process Restart and Failover Behavior If the service process shuts down unexpectedly, the Service Manager tries to restart the service process. If it cannot restart the process, the process stops or fails. When you restart the process, the Integration Service restores the state of operation for the service and restores workflow schedules, service requests, and workflows. The failover and recovery behavior of the Integration Service after a service process fails depends on the operating mode: - Normal. When you restart the process, the workflow fails over on the same node. The Integration Service can recover the workflow based on the workflow state and recovery strategy. If the workflow is configured for recovery, the Integration Service restores the state of operation for the workflow and recovers the workflow from the point of interruption. The Integration Service performs failover and recovers the schedules, requests, and workflows. - Safe. When you restart the process, the workflow does not fail over and the Integration Service does not recover the workflow. It performs failover and recovers the schedules, requests, and workflows when you enable the service in normal mode. Service When the Integration Service becomes unavailable, you must enable the service and start the service processes. You can manually recover workflows and sessions based on the state and the configured recovery strategy. The workflows that run after you start the service processes depend on the operating mode: - Normal. Workflows configured to run continuously or on initialization will start. You must reschedule all other workflows. - Safe. Scheduled workflows do not start. You must enable the service in normal mode for the scheduled workflows to run. Node When the node becomes unavailable, the restart and failover behavior is the same as restart and failover for the service process, based on the operating mode.

100

Chapter 5: Managing High Availability

Running on a Primary Node

Table 5-3 describes the failover behavior for an Integration Service configured to run on primary and backup nodes:
Table 5-3. Restart and Failover Behavior for Integration Service Running on a Primary Node
Source of Shutdown Service Process Restart and Failover Behavior When you disable the service process on a primary node, the service process fails over to a backup node. When the service process on a primary node shuts down unexpectedly, the Service Manager tries to restart the service process before failing it over to a backup node. After the service process fails over to a backup node, the Integration Service restores the state of operation for the service and restores workflow schedules, service requests, and workflows. The failover and recovery behavior of the Integration Service after a service process fails depends on the operating mode: - Normal. The Integration Service can recover the workflow based on the workflow state and recovery strategy. If the workflow was configured for recovery, the Integration Service restores the state of operation for the workflow and recovers the workflow from the point of interruption. The Integration Service performs failover and recovers the schedules, requests, and workflows. - Safe. The Integration Service does not run scheduled workflows and it disables schedule failover, automatic workflow recovery, workflow failover, and client request recovery. It performs failover and recovers the schedules, requests, and workflows when you enable the service in normal mode. Service When the Integration Service becomes unavailable, you must enable the service and start the service processes. You can manually recover workflows and sessions based on the state and the configured recovery strategy. Workflows configured to run continuously or on initialization will start. You must reschedule all other workflows. The workflows that run after you start the service processes depend on the operating mode: - Normal. Workflows configured to run continuously or on initialization will start. You must reschedule all other workflows. - Safe. Scheduled workflows do not start. You must enable the service in normal mode to run the scheduled workflows. Node When the node becomes unavailable, the failover behavior is the same as the failover for the service process, based on the operating mode.

Managing High Availability for the Integration Service

101

Running on a Grid
Table 5-4 describes the failover behavior for an Integration Service configured to run on a grid:
Table 5-4. Restart and Failover for an Integration Service Running on a Grid
Source of Shutdown Master Service Process Restart and Failover Behavior If you disable the master service process, the Service Manager elects another node to run the master service process. If the master service process shuts down unexpectedly, the Service Manager tries to restart the process before electing another node to run the master service process. The master service process then reconfigures the grid to run on one less node. The Integration Service restores the state of operation, and the workflow fails over to the newly elected master service process. The Integration Service can recover the workflow based on the workflow state and recovery strategy. If the workflow was configured for recovery, the Integration Service restores the state of operation for the workflow and recovers the workflow from the point of interruption. When the Integration Service restores the state of operation for the service, it restores workflow schedules, service requests, and workflows. The Integration Service performs failover and recovers the schedules, requests, and workflows. Worker Service Process If you disable a worker service process, the master service process reconfigures the grid to run on one less node. If the worker service process shuts down unexpectedly, the Service Manager tries to restart the process before the master service process reconfigures the grid. After the master service process reconfigures the grid, it can recover tasks based on task state and recovery strategy. Since workflows do not run on the worker service process, workflow failover is not applicable. Service When the Integration Service becomes unavailable, you must enable the service and start the service processes. You can manually recover workflows and sessions based on the state and the configured recovery strategy. Workflows configured to run continuously or on initialization will start. You must reschedule all other workflows. When the node running the master service process becomes unavailable, the failover behavior is the same as the failover for the master service process. When the node running the worker service process becomes unavailable, the failover behavior is the same as the failover for the worker service process.

Node

Note: You cannot configure an Integration Service to fail over in safe mode when it runs on a grid.

Recovery
When you have the high availability option, the Integration Service can automatically recover workflows and tasks based on the recovery strategy, the state of the workflows and tasks, and the Integration Service operating mode:

Stopped, aborted, or terminated workflows. In normal mode, the Integration Service can recover stopped, aborted, or terminated workflows from the point of interruption. In safe mode, automatic recovery is disabled until you enable the service in normal mode. After you enable normal mode, the Integration Service automatically recovers the workflow.

102

Chapter 5: Managing High Availability

Running workflows. In normal and safe mode, the Integration Service can recover terminated tasks while the workflow is running. Suspended workflows. The Integration Service can restore the workflow state after the workflow fails over to another node if you enable recovery in the workflow properties.

For more information about recovery strategies for workflows and tasks, see Recovering Workflows in the Workflow Administration Guide. For more information about normal and safe mode, see Running in Normal and Safe Mode on page 170.

Stopped, Aborted, or Terminated Workflows

When the Integration Service restarts or fails over a service process, it can automatically recover interrupted workflows that are configured for recovery, based on the operating mode. When you run a workflow configured for recovery, the Integration Service stores the state of operation in the $PMStorageDir directory. When the Integration Service recovers a workflow, it restores the state of operation and begins recovery from the point of interruption. The Integration Service can recover a workflow with a stopped, aborted, or terminated status. In normal mode, the Integration Service can automatically recover the workflow. In safe mode, the Integration Service does not recover the workflow until you enable the service in normal mode When the Integration Service recovers a workflow that failed over, it begins recovery at the point of interruption. The Integration Service can recover a task with a stopped, aborted, or terminated status according to the recovery strategy for the task. The Integration Service behavior for task recovery does not depend on the operating mode.
Note: The Integration Service does not automatically recover a workflow or task that you stop or abort through the Workflow Monitor or pmcmd.

Running Workflows
You can configure automatic task recovery in the workflow properties. When you configure automatic task recovery, the Integration Service can recover terminated tasks while the workflow is running. You can also configure the number of times for the Integration Service to attempt recovery. If the Integration Service cannot recover the task in the configured number of times for recovery, the task and the workflow are terminated. The Integration Service behavior for task recovery does not depend on the operating mode.

Suspended Workflows
If a service process shuts down while a workflow is suspended, the Integration Service marks the workflow as terminated. It fails the workflow over to another node, and changes the workflow state to terminated. The Integration Service does not recover any workflow task. You can fix the errors that caused the workflow to suspend, and recover the workflow.

Managing High Availability for the Integration Service

103

Troubleshooting
The solutions to the following situations might help you with high availability. In the Designer, I tried using various resilience timeouts for connecting to the repository, but I cannot make my repository resilient on a Sybase database. The Sybase database may have leftover locks that prevent resilience. The locks from a previously terminated connection are held for a period of time up to the limit set in an operating system parameter called the TCP KeepAlive timeout. These locks must be released to achieve database resilience. To correct the problem, use a lower TCP KeepAlive timeout on the machine hosting the Sybase database. I am not sure where to look for status information regarding client connections to the repository. In PowerCenter Client applications such as the Designer and the Workflow Manager, an error message appears if the connection cannot be established during the timeout period. Detailed information about the connection failure appears in the Output window. If you are using pmrep, the connection error information appears at the command line. If the Integration Service cannot establish a connection to the repository, the error appears in the Integration Service log, the workflow log, and the session log. I entered the wrong connection string for an Oracle database. Now I cannot enable the Repository Service even though I edited the Repository Service properties to use the right connection string. You need to wait for the database resilience timeout to expire before you can enable the Repository Service with the updated connection string. I have the high availability option, but my FTP server is not resilient when the network connection fails. The FTP server is an external system. To achieve high availability for FTP transmissions, you must use a highly available FTP server. For example, Microsoft IIS 6.0 does not natively support the restart of file uploads or file downloads. File restarts must be managed by the client connecting to the IIS server. If the transfer of a file to or from the IIS 6.0 server is interrupted and then reestablished within the client resilience timeout period, the transfer does not necessarily continue as expected. If the write process is more than half complete, the target file may be rejected. I have the high availability option, but the PowerCenter domain is not resilient when machines are connected through a network switch. If you are using a network switch to connect machines in the domain, use the auto-select option for the switch.

104

Chapter 5: Managing High Availability

Chapter 6

Creating and Configuring the Repository Service

This chapter includes the following topics:

Overview, 106 Creating a Database for the Repository, 107 Creating the Repository Service, 108 Configuring Repository Service Properties, 112 Configuring Repository Service Process Properties, 119

105

Overview
A PowerCenter repository is a collection of database tables containing metadata. A Repository Service manages the repository. It performs all metadata transactions between the repository database and repository client applications. Create a Repository Service to manage the metadata in repository database tables. Each Repository Service manages a single repository. You need to create a unique Repository Service for each repository in a PowerCenter domain. Creating and configuring a Repository Service involves the following tasks:

Create a database for the repository tables. Before you can create the repository tables, you need to create a database to store the tables. If you create a Repository Service for an existing repository, you do not need to create a new database. You can use the existing database, as long as it meets the minimum requirements for a repository database. For more information, see Creating a Database for the Repository on page 107. Create the Repository Service. Create the Repository Service to manage the repository. When you create a Repository Service, you can choose to create the repository tables. If you do not create the repository tables, you can create them later or you can associate the Repository Service with an existing repository. For more information, see Creating the Repository Service on page 108. Configure the Repository Service. After you create a Repository Service, you can configure its properties. You can configure properties such as the error severity level or maximum user connections. For more information, see Configuring Repository Service Properties on page 112.

To create a Repository Service, you must have full privileges in the Administration Console and permission on the domain or folder where you want to create the service. You must also have permission on any nodes where you want the service to run.

106

Chapter 6: Creating and Configuring the Repository Service

Creating a Database for the Repository

Before you can manage a repository with a Repository Service, you need a database to hold the repository database tables. You can create the repository on any supported database system. For information about minimum system requirements, see the Installation and Configuration Guide. Use the database management system client to create the database. The repository database name must be unique. If you create a repository in a database with an existing repository, the create operation fails. You must delete the existing repository in the target database before creating the new repository.
Note: When you create, restore, or upgrade a Sybase repository, set allow nulls by default to

TRUE at the database level. Setting this option changes the default null type of the column to null in compliance with the SQL standard. To protect the repository and improve performance, do not create the repository on an overloaded machine. The machine running the repository database system must have a network connection to the node that runs the Repository Service.
Tip: You can optimize repository performance on IBM DB2 EEE databases when you store a

PowerCenter repository in a single-node tablespace. When setting up an IBM DB2 EEE database, the database administrator must define the database on a single node.

Creating a Database for the Repository

107

Creating the Repository Service

Use the PowerCenter Administration Console to create a Repository Service.

Before You Begin

Before you create a Repository Service, complete the following tasks:

Determine repository requirements. Determine whether the repository needs to be version-enabled and whether it is a local, global, or standalone repository. For more information about versioned repositories, see Enabling Version Control on page 131. For more information about local and global repositories, see Managing a Repository Domain on page 132. Verify license. Verify that you have a valid license to run application services. Although you can create a Repository Service without a license, you need a license to run the service. In addition, you need a license to configure some options related to version control and high availability. For more information about licenses, see Managing Licenses on page 275. Determine code page. Determine the code page to use for the repository. The Repository Service uses the character set encoded in the repository code page when writing data to the repository. The repository code page must be compatible with the code pages for the PowerCenter Client and Integration Services. For more information about code pages, see Understanding Globalization on page 327.

Tip: To change the repository code page after you create the repository, back up the repository

and restore it. When you restore the repository, you can specify a compatible code page.

Creating a Repository Service

After you complete the tasks in the Before You Begin section, create the Repository Service.
To create a Repository Service: 1.

In the Navigator of the Administration Console, select the folder where you want to create the Repository Service.
Note: If you do not select a folder, you can move the Repository Service into a folder after you create it.

2.

Click Create > Repository Service.

108

Chapter 6: Creating and Configuring the Repository Service

The Create New Repository Service window appears.

3.

Enter values for the following Repository Service options:

Table 6-1. Create New Repository Service Options
Property Service Name Required/ Optional Required Description Name of the Repository Service. The name is not case sensitive and must be unique within the domain. The characters must be compatible with the code page of the repository. The name cannot have leading or trailing spaces, include carriage returns or tabs, exceed 79 characters, or contain the following characters: \/ * :? < > " | The Repository Service and the repository have the same name. Domain and folder where the service is created. Click Select Folder to choose a different folder. You can also move the Repository Service to a different folder after you create it.

Location

n/a

Creating the Repository Service

109

Table 6-1. Create New Repository Service Options

Property License Required/ Optional Required Description License that allows use of the service. If you do not select a license when you create the service, you can assign a license later. The options included in the license determine the selections you can make for the repository. For example, you must have the team-based development option to create a versioned repository. Also, you need the high availability option to run the Repository Service on more than one node. To apply changes to this property, restart the Repository Service. Node on which the service process runs. Required if you do not select a license with the high availability option. If you select a license with the high availability option, this property does not appear. Node on which the service process runs by default. Required if you select a license with the high availability option. This property appears if you select a license with the high availability option. Nodes on which the service process can run if the primary node is unavailable. Optional if you select a license with the high availability option. This property appears if you select a license with the high availability option. Type of database storing the repository. To apply changes to this property, restart the Repository Service. Repository code page. The Repository Service uses the character set encoded in the repository code page when writing data to the repository. For more information about code pages, see Understanding Globalization on page 327. Native connection string the Repository Service uses to access the repository database. For example, use servername@dbname for Microsoft SQL Server and dbname.world for Oracle. For more information, see Database Connect Strings on page 111. To apply changes to this property, restart the Repository Service. Account for the repository database. Set up this account using the appropriate database client tools. To apply changes to this property, restart the Repository Service. Repository database password corresponding to the database user. Must be in 7-bit ASCII. To apply changes to this property, restart the Repository Service. Tablespace name for IBM DB2 repositories. When you specify the tablespace name, the Repository Service creates all repository tables in the same tablespace. You cannot use spaces in the tablespace name. To improve repository performance on IBM DB2 EEE repositories, specify a tablespace name with one node. For more information about using the tablespace names, see the Installation and Configuration Guide. To apply changes to this property, restart the Repository Service.

Node

Conditional

Primary Node

Conditional

Backup Nodes

Optional

DatabaseType CodePage

Required Required

ConnectString

Required

DBUser

Required

DBPassword

Required

TablespaceName

Optional

110

Chapter 6: Creating and Configuring the Repository Service

Table 6-1. Create New Repository Service Options

Property Creation Mode Required/ Optional Required Description Creates or omits new repository content. Select one of the following options: - Create new repository content. Select if no content exists in the database. Optionally, choose to create a global repository, enable version control, or both. If you do not select these options during service creation, you can select them later. However, if you select the options during service creation, you cannot later convert the repository to a local repository or to a non-versioned repository. The option to enable version control appears if you select a license with the high availability option. - Do not create repository content. Select if content exists in the database or if you plan to create the repository content later. For more information about creating the content after you create the service, see Creating and Deleting Repository Content on page 128. Enables the service. When you select this option, the service starts running when it is created. Otherwise, you need to click the Enable button to run the service. You need a valid license to run a Repository Service.

Enable the Repository Service

Optional

4.

Click OK.

For information about how to remove application services, see Removing Application Services on page 42.

Database Connect Strings

When you create a database connection, specify a connect string for that connection. The Repository Service uses native connectivity to communicate with the repository database. Table 6-2 lists the native connect string syntax for each supported database:
Table 6-2. Native Connect String Syntax
Database IBM DB2 Microsoft SQL Server Oracle Sybase Connect String Syntax dbname servername@dbname dbname.world (same as TNSNAMES entry) servername@dbname Example mydatabase sqlserver@mydatabase oracle.world sambrown@mydatabase

Creating the Repository Service

111

Configuring Repository Service Properties

After you create a Repository Service, you can configure it. Use the Administration Console to configure the following types of Repository Service properties:

General properties. Configure general properties, such as the operating mode. For more information, see General Properties on page 114. Node assignments. If you have the high availability option, configure the primary and backup nodes to run the service. For more information, see Node Assignments on page 113. Database properties. Configure repository database properties, such as the code page and connection string. For more information, see Database Properties on page 114. Advanced properties. Configure advanced repository properties, such as the maximum connections and locks on the repository. For more information, see Advanced Properties on page 116. Custom properties. Configure repository properties that are unique to your PowerCenter environment or that apply in special cases. Use custom properties only if Informatica Technical Support instructs you to do so. For more information, see Custom Properties on page 118.

To view and update properties, select the Repository Service in the Navigator. The Properties tab for the service appears.

112

Chapter 6: Creating and Configuring the Repository Service

Figure 6-1 shows the Properties tab of a Repository Service:

Figure 6-1. Repository Service Properties

Node Assignments
If you have the high availability option, you can designate primary and backup nodes to run the service. By default, the service runs on the primary node. If the node becomes unavailable, the service fails over to a backup node. For more information, see Restart and Failover on page 97.

Configuring Repository Service Properties

113

General Properties
You can configure some of the general properties when you create the service. Table 6-3 describes the general properties:
Table 6-3. General Properties for a Repository Service
Property OperatingMode Required/ Optional Required Description Mode in which the Repository Service is running. Values are Normal and Exclusive. You need to run the Repository Service in exclusive mode to perform some administrative tasks, such as promoting a local repository to a global repository or enabling version control. When changing this property from Normal to Exclusive, restart the Repository Service to apply your change. Tracks changes made to users, groups, privileges, and permissions. The Log Manager tracks the changes. For more information, see Creating an Audit Trail on page 159. Creates a global repository. If the repository is a global repository, you cannot revert back to a local repository. To promote a local repository to a global repository, the Repository Service must be running in exclusive mode. Creates a versioned repository. After you enable a repository for version control, you cannot disable the version control. To enable a repository for version control, you must run the Repository Service in exclusive mode. This property appears if you have the team-based development option. License that allows you to run the Repository Service. For more information about licenses, see Managing Licenses on page 275.

SecurityAuditTrail

Required

GlobalRepository

Optional

EnableVersionControl

Optional

License

Optional

Database Properties
Database properties provide information about the database that stores the repository metadata. You specify the database properties when you create the Repository Service. After you create a repository, you may need to modify some of these properties. For example, you might need to change the database user name and password, or you might want to adjust the database connection timeout. Table 6-4 describes the database properties:
Table 6-4. Database Properties for a Repository Service
Property DatabaseType CodePage Required/ Optional Required Required Description Type of database storing the repository. To apply changes to this property, restart the Repository Service. Repository code page. The Repository Service uses the character set encoded in the repository code page when writing data to the repository. For more information about code pages, see Understanding Globalization on page 327.

114

Chapter 6: Creating and Configuring the Repository Service

Table 6-4. Database Properties for a Repository Service

Property ConnectString Required/ Optional Required Description Native connection string the Repository Service uses to access the database containing the repository. For example, use servername@dbname for Microsoft SQL Server and dbname.world for Oracle. For more information, see Database Connect Strings on page 111. To apply changes to this property, restart the Repository Service. Tablespace name for IBM DB2 repositories. When you specify the tablespace name, the Repository Service creates all repository tables in the same tablespace. You cannot use spaces in the tablespace name. You cannot change the tablespace name in the repository database properties after you create the service. If you create a Repository Service with the wrong tablespace name, delete the Repository Service and create a new one with the correct tablespace name. To improve repository performance on IBM DB2 EEE repositories, specify a tablespace name with one node. For more information about using the tablespace names, see the Installation and Configuration Guide. To apply changes to this property, restart the Repository Service. Account for the database containing the repository. Set up this account using the appropriate database client tools. To apply changes to this property, restart the Repository Service. Repository database password corresponding to the database user. Must be in 7-bit ASCII. To apply changes to this property, restart the Repository Service. Period of time that the Repository Service attempts to establish or reestablish a connection to the database system. Default is 180 seconds. Number of rows to fetch each time an array database operation is issued, such as insert or fetch. Default is 100. To apply changes to this property, restart the Repository Service. Maximum number of connections to the repository database that the Repository Service can establish. If the Repository Service tries to establish more connections than specified for DatabasePoolSize, it times out the connection attempt after the number of seconds specified for DatabaseConnectionTimeout. Default is 500. Minimum is 20. Name of the owner of the repository tables for a DB2 repository. Note: You can use this option for DB2 databases only.

TablespaceName

Optional

DBUser

Required

DBPassword

Required

DatabaseConnectionTimeout

Optional

DatabaseArrayOperationSize

Optional

DatabasePoolSize

Required

Table Owner Name

Optional

Configuring Repository Service Properties

115

Advanced Properties
Advanced properties control the performance of the Repository Service and the repository database. Figure 6-2 shows the advanced properties:
Figure 6-2. Advanced Properties for a Repository Service

Table 6-5 describes the advanced properties:

Table 6-5. Advanced Properties for a Repository Service
Property TrustedConnection Required/ Optional Optional Description Uses Windows authentication to access the Microsoft SQL Server database. The user name that starts the Repository Service must be a valid Windows user with access to the Microsoft SQL Server database. To apply changes to this property, restart the Repository Service. Requires users to add comments when checking in repository objects. To apply changes to this property, restart the Repository Service. Level of error messages written to the Repository Service log. Specify one of the following message levels: - Fatal - Error - Warning - Info - Trace - Debug When you specify a severity level, the log includes all errors at that level and above. For example, if the severity level is Warning, fatal, error, and warning messages are logged. Use Trace or Debug if Informatica Technical Support instructs you to use that logging level for troubleshooting purposes. Default is INFO.

CommentsRequiredFor Checkin Error Severity Level

Optional

Required

116

Chapter 6: Creating and Configuring the Repository Service

Table 6-5. Advanced Properties for a Repository Service

Property Limit on Resilience Timeouts Required/ Optional Optional Description Maximum amount of time that the service holds on to resources to accommodate resilience timeouts. This property limits the resilience timeouts for client applications connecting to the service. If a resilience timeout exceeds the limit, the limit takes precedence. If blank, the service uses the domain limit on resilience timeouts. Default is blank. To apply changes to this property, restart the Repository Service. Period of time that the service tries to establish or reestablish a connection to another service. If blank, the service uses the domain resilience timeout. Default is blank. Enables repository agent caching. Repository agent caching provides optimal performance of the repository when you run workflows. When you enable repository agent caching, the Repository Service process caches metadata requested by the Integration Service. Default is Yes. Number of objects that the cache can contain when repository agent caching is enabled. You can increase the number of objects if there is available memory on the machine running the Repository Service process. The value must be between 100 and 10,000,000,000. Default is 10,000. Allows you to modify metadata in the repository when repository agent caching is enabled. When you allow writes, the Repository Service process flushes the cache each time you save metadata through the PowerCenter Client tools. You might want to disable writes to improve performance in a production environment where the Integration Service makes all changes to repository metadata. Default is Yes. Interval at which the Repository Service verifies its connections with clients of the service. Default is 60 seconds. Maximum number of connections the repository accepts from repository client applications. Default is 200. Maximum number of locks the repository places on metadata objects. Default is 50,000. Minimum number of idle database connections allowed by the Repository Service. For example, if there are 20 idle connections, and you set this threshold to 5, the Repository Service closes no more than 15 connections. Minimum is 3. Default is 5.

Resilience Timeout

Optional

EnableRepAgentCaching

Optional

RACacheCapacity

Required

AllowWritesWithRACaching

Optional

HeartBeatInterval MaximumConnections MaximumLocks Database Pool Expiry Threshold

Optional Required Required Optional

Configuring Repository Service Properties

117

Table 6-5. Advanced Properties for a Repository Service

Property Database Pool Expiry Timeout Required/ Optional Optional Description Interval, in seconds, at which the Repository Service checks for idle database connections. If a connection is idle for a period of time greater than this value, the Repository Service can close the connection. Minimum is 300. Maximum is 2,592,000 (30 days). Default is 3,600 (1 hour). Preserves MX data for old versions of mappings. When disabled, the Repository Service deletes MX data for old versions of mappings when you check in a new version. Default is disabled.

Preserve MX Data

Optional

Custom Properties
Custom properties include properties that are unique to your PowerCenter environment or that apply in special cases. A Repository Service does not have custom properties when you initially create it. Use custom properties only if Informatica Technical Support instructs you to.

118

Chapter 6: Creating and Configuring the Repository Service

Configuring Repository Service Process Properties

Use the Administration Console to configure the following types of Repository Service process properties:

Custom properties. Configure Repository Service process properties that are unique to your PowerCenter environment or that apply in special cases. For more information, see Custom Properties on page 119. Environment variables. Specify environment variables for each Repository Service process. For more information, see Environment Variables on page 120.

To view and update properties, select a Repository Service in the Navigator and click the Processes tab. Figure 6-3 shows the Processes tab for a Repository Service.
Figure 6-3. Process Properties for a Repository Service

Custom Properties
Custom properties include properties that are unique to your PowerCenter environment or that apply in special cases. A Repository Service process does not have custom properties when you initially create it. Use custom properties only if Informatica Technical Support instructs you to.

Configuring Repository Service Process Properties

119

Environment Variables
You can set or alter environment variables for a Repository Service process on a particular node. You might want to specify environment variables for a Repository Service process if you need to use different environment variables for application services that run on a node. For example, if the Integration Service process on a node uses a particular database client code page and the Repository Service process on the same node needs to use a different database client code page, you can use an environment variable to configure the database client code page for the Repository Service process. For a repository on an Oracle database, you use the following name/value pair to set the code page to UTF-8:

Name: NLS_LANG Value: american_america.AL32UTF8

For more information about code page compatibility, see Understanding Globalization on page 327.

120

Chapter 6: Creating and Configuring the Repository Service

Chapter 7

Managing the Repository

This chapter includes the following topics:

Overview, 122 Enabling and Disabling the Repository Service, 123 Running in Exclusive Mode, 126 Creating and Deleting Repository Content, 128 Enabling Version Control, 131 Managing a Repository Domain, 132 Managing Repository User Connections and Locks, 137 Sending Repository Notifications, 141 Backing Up and Restoring the Repository, 142 Copying Content from Another Repository, 146 Registering and Unregistering Repository Plug-ins, 148 Setting Up LDAP Authentication for Repositories, 151 Creating an Audit Trail, 159 Tuning Repository Performance, 160

121

Overview
You use the Administration Console to manage Repository Services and repository content. A Repository Service manages a single repository. You can use the Administration Console to complete the following repository-related tasks:

Enable and disable a Repository Service or service process. Change the operating mode of a Repository Service. Create and delete repository content. Back up, copy, restore, and delete a repository. Promote a local repository to a global repository. Register and unregister a local repository. Manage user connections and locks. Send repository notification messages. Manage repository plug-ins. Upgrade a repository and upgrade a Repository Server to a Repository Service.

For more information about upgrades, see Upgrading PowerCenter in the Installation and Configuration Guide. For more information about repository architecture and connectivity, see Understanding the Repository in the Repository Guide.

Permissions
You can grant permission on objects to users in a PowerCenter domain. Objects include the PowerCenter domain object, folders, nodes, grids, licenses, and application services. To access a Repository Service, you must have permission on the service in the domain.

122

Chapter 7: Managing the Repository

Enabling and Disabling the Repository Service

When you enable a Repository Service, a service process starts on a node designated to run the service. The service is available to perform repository transactions. If you have the high availability option, the service can fail over to another node if the current node becomes unavailable. If you disable the Repository Service, the service cannot run on any node until you reenable the service. When you enable a service process, the service process is available to run, but it may not start. For example, if you have the high availability option and you configure a Repository Service to run on a primary node and two backup nodes, you enable Repository Service processes on all three nodes. A single process runs at any given time, and the other processes maintain standby status. If you disable a Repository Service process, the Repository Service cannot run on the particular node of the service process. The Repository Service continues to run on another node that is designated to run the service, as long as the node is available.

Enabling and Disabling a Repository Service

You can enable the Repository Service when you initially create it, or you can enable it after you create it. You need to enable the Repository Service to perform the following tasks in the Administration Console:

Create or delete content Back up or restore content Upgrade content Copy content from another repository Register or unregister a local repository with a global repository Promote a local repository to a global repository Register plug-ins and security modules Manage user connections and locks Send repository notifications

You must disable the Repository Service to run it in it exclusive mode. For more information, see Running in Exclusive Mode on page 126.
Note: Before you disable a Repository Service, verify that all users are disconnected from the

repository. You can send a repository notification to inform users that you are disabling the service. For more information about notifications, see Sending Repository Notifications on page 141.
To enable a Repository Service: 1.

Select the Repository Service in the Navigator. The properties for the Repository Service appear in the Main window.

2.

Click Enable.
Enabling and Disabling the Repository Service 123

The status indicator at the top of the Main window indicates when the service starts running.
To disable a Repository Service: 1.

Select the Repository Service in the Navigator. The properties for the Repository Service appear in the Main window.

2.

Click Disable. The Disable Repository Service window appears.

3. 4.

Select to abort all service processes immediately or to allow services processes to complete. Click OK.

Enabling and Disabling Service Processes

A service process is the physical representation of a service running on a node. The process for a Repository Service is the pmrepagent process. At any given time, only one service process is running for the service in the domain. When you create a Repository Service, service processes are enabled by default on the designated nodes, even if you do not enable the service. You disable and reenable service processes on the Processes tab. You may want to disable a service process to perform maintenance on the node or to tune performance. If you have the high availability option, you can configure the service to run on multiple nodes. At any given time, a single process is running for the Repository Service. The service continues to be available as long as one of the designated nodes for the service is available. With the high availability option, disabling a service process does not disable the service if the service is configured to run on multiple nodes. Disabling a service process that is running causes the service to fail over to another node.

124

Chapter 7: Managing the Repository

To enable a Repository Service process: 1. 2.

In the Navigator, select the Repository Service associated with the service process you want to enable. Click the Processes tab.

Node 3.

Enable the service process.

Click Enable for a node to enable the service process on the node.

To disable a Repository Service process: 1. 2. 3. 4. 5.

In the Navigator, select the Repository Service associated with the service process you want to disable. Click the Processes tab. Click Disable for the service process. In the window that appears, select to abort service processes immediately or allow service processes to complete. Click OK.

Enabling and Disabling the Repository Service

125

Running in Exclusive Mode

You can run the Repository Service in normal or exclusive operating mode. When you run the Repository Service in normal mode, you allow multiple users to access the repository to update content. When you run the Repository Service in exclusive mode, you allow only one user to access the repository. Set the operating mode to exclusive to perform administrative tasks that require a single user to access the repository and update the configuration. When the Repository Service runs in exclusive mode it accepts connection requests from the Administration Console and pmrep. Run a Repository Service in exclusive mode to perform the following administrative tasks:

Delete repository content. Delete the repository database tables for the repository. For more information, see Deleting Repository Content on page 128. Enable version control. If you have the team-based development option, you can enable version control for the repository. A versioned repository can store multiple versions of an object. For more information, see Enabling Version Control on page 131. Promote a repository. Promote a local repository to a global repository to build a repository domain. For more information, see Promoting a Local Repository to a Global Repository on page 133. Register a plug-in or security module. Register or unregister a plug-in or security module, such as the LDAP authentication security module. For more information, see Registering and Unregistering Repository Plug-ins on page 148. Upgrade the repository. Upgrade a Repository Agent configuration file to a Repository Service, or upgrade the repository metadata. For more information about upgrades, see Upgrading PowerCenter in the Installation and Configuration Guide.

You must have full privileges and permission on a Repository Service to run it in exclusive mode. Before running a Repository Service in exclusive mode, verify that all users are disconnected from the repository. You must stop and restart the Repository Service to change the operating mode.
Note: When you run the Repository Service in exclusive mode, you disable repository agent

caching. For more information about repository agent caching, see Configuring Repository Service Properties on page 112.
To run a Repository Service in exclusive mode: 1. 2.

In the Navigator, select the Repository Service. On the Properties tab, click Edit in the general properties.

126

Chapter 7: Managing the Repository

3. 4.

Select Exclusive as the operating mode. Click OK. The Restart Repository Service window appears.

5.

Verify that you have notified users to disconnect from the repository, and click Yes if you want to log out users who are still connected. The following warning message appears.

6.

Choose to allow processes to complete or abort all processes, and then click OK. The Repository Service stops and then restarts. The service status at the top of the Main window indicates when the service has restarted. The Disable button for the service appears when the service is enabled and running.

Note: PowerCenter does not provide resilience for a repository client when the Repository

Service is running in exclusive mode.

To return the operating mode to normal: 1. 2. 3. 4.

In the Navigator, select the Repository Service. On the Properties tab, click Edit in the general properties. Select Normal as the operating mode. Click OK.

Note: You can also use the infacmd UpdateRepositoryService command to change the

operating mode. For more information about using the infacmd program, see the Command Line Reference.

Running in Exclusive Mode

127

Creating and Deleting Repository Content

Repository content are repository tables in the database. You can create or delete repository content for a Repository Service.

Creating Repository Content

You can create repository content for a Repository Service if you did not create content when you created the service or if you deleted the repository content. You cannot create content for a Repository Service that already includes content.
To create content after creating a Repository Service: 1. 2.

In the Navigator, select a Repository Service that has no content associated with it. In the Actions list, select Create Contents. The page displays the options to create content.

3.

Optionally, choose to create a global repository. Select this option if you are certain you want to create a global repository. You can promote a local repository to a global repository at any time, but you cannot convert a global repository to a local repository. For more information, see Promoting a Local Repository to a Global Repository on page 133.

4.

Optionally, enable version control. You must have the team-based development option to enable version control. Enable version control if you are certain you want to use a versioned repository. You can convert a non-versioned repository to a versioned repository at any time, but you cannot convert a versioned repository to a non-versioned repository. For more information, see Enabling Version Control on page 131.

5.

Click OK.

Deleting Repository Content

Delete repository content when you want to delete all metadata and repository database tables from the repository. You might delete the repository content if the metadata is obsolete. Deleting repository content is an irreversible action. If the repository contains information that you might need later, back up the repository before you delete it. For more information, see Backing Up and Restoring the Repository on page 142.
128 Chapter 7: Managing the Repository

To delete a global repository, you must unregister all local repositories. Also, you must run the Repository Service in exclusive mode to delete repository content. For more information about running a Repository Service in exclusive mode, see Running in Exclusive Mode on page 126.
Note: You can also use the pmrep Delete command to delete repository content. For more

information, see pmrep Command Reference in the Command Line Reference.

To delete repository content: 1. 2.

In the Navigator, select the repository from which you want to delete the content. Change the operating mode of the Repository Service to exclusive. For more information, see Running in Exclusive Mode on page 126.

3.

In the Actions list, select Delete Contents.

4.

Enter a repository user name and password. The repository user must have the Admin Repository privilege to delete repository content.

5.

If the repository is a global repository, choose to unregister local repositories when you delete the content. The delete operation does not proceed if it cannot unregister the local repositories. For example, if a Repository Service for one of the local repositories is running in exclusive mode, you may need to unregister that repository before you attempt to delete the global repository.

6.

Click OK.

Creating and Deleting Repository Content

129

The activity log displays the results of the delete operation.

130

Chapter 7: Managing the Repository

Enabling Version Control

If you have the team-based development option, you can enable version control for a new or existing repository. A versioned repository can store multiple versions of objects. If you enable version control, you can maintain multiple versions of an object, control development of the object, and track changes. You can also use labels and deployment groups to associate groups of objects and copy them from one repository to another. After you enable version control for a repository, you cannot disable it. When you enable version control for a repository, the repository assigns all versioned objects version number 1, and each object has an active status. For more information about working with versioned objects and versioned object properties, see Working with Versioned Objects in the Repository Guide. You must run the Repository Service in exclusive mode to enable version control for the repository.
To enable version control for a repository: 1. 2. 3. 4. 5. 6.

Ensure that all users disconnect from the repository. In the Administration Console, change the operating mode of the Repository Service to exclusive. For more information, see Running in Exclusive Mode on page 126. Enable the Repository Service. Select the Repository Service in the Navigator. In the general properties, click Edit. Select EnableVersionControl. The Repository Authentication window appears.

7.

Enter the user name and password for a repository user who has the necessary administrative privileges. The user must be the Administrator user or have the Super User privilege.

8.

Change the operating mode of the Repository Service to normal.

The repository is now versioned. For more information about versioned repositories, see Working with Versioned Objects in the Repository Guide.

Enabling Version Control

131

Managing a Repository Domain

A repository domain is a group of linked repositories that consists of one global repository and one or more local repositories. You connect repositories in a repository domain to share data and metadata between repositories. When working in a repository domain, you can complete the following tasks:

Navigate from local to global repositories without connecting to each repository separately. Promote metadata from a local repository to a global repository, making it accessible to all local repositories in the repository domain. Copy objects from or create shortcuts to metadata in the global repository. Copy objects from the local repository to the global repository.

For more information about repository domains, see Understanding the Repository in the Repository Guide.
Note: A repository domain is distinct from a PowerCenter domain, which is the primary unit

of administration in the PowerCenter environment. For more information about PowerCenter domains, see Understanding Domains on page 1.

Prerequisites for a Repository Domain

Before building a repository domain, verify that you have the following required elements:

A licensed copy of PowerCenter to create the global repository. A license for each local repository you want to create. A database created and configured for each repository. A Repository Service created and configured to manage each repository. A Repository Service accesses the repository faster if the Repository Service process runs on the machine where the repository database resides.

Network connections between the Repository Services and Integration Services. Compatible repository code pages. To register a local repository, the code page of the global repository must be a subset of each local repository code page in the repository domain. To copy objects from the local repository to the global repository, the code pages of the local and global repository must be compatible.

Steps for Building a Repository Domain

Use the following steps as a guideline to connect separate repositories into a repository domain: 1. Create a repository and configure it as a global repository. You can specify that a repository is the global repository when you create the Repository Service. Alternatively, you can promote an existing local repository to a global repository.
132 Chapter 7: Managing the Repository

For more information about creating and configuring a repository, see Creating and Configuring the Repository Service on page 105. For more information about promoting a local repository, see Promoting a Local Repository to a Global Repository on page 133. 2. Register local repositories with the global repository. After a local repository is registered, you can connect to the global repository from the local repository and you can connect to the local repository from the global repository. For more information about registering repositories, see Registering a Local Repository on page 134. 3. Create user profiles for users performing cross-repository work. A user who needs to connect to multiple repositories must have an identical repository user name and password in each repository. Although the user name and password must remain the same, the user can be a member of different user groups and can have a different set of privileges in each repository. For more information about creating users and configuring repository security, see Managing Users and Groups in the Repository Guide.

Promoting a Local Repository to a Global Repository

You can promote an existing repository to a global repository. After you promote a repository to a global repository, you cannot change it to a local or standalone repository. After you promote a repository, you can register local repositories to create a repository domain. When registering local repositories with a global repository, the global and local repository code pages must be compatible. Before promoting a repository to a global repository, make sure the repository code page is compatible with each local repository you plan to register. To promote a repository to a global repository, you need to change the operating mode of the Repository Service to exclusive. If users are connected to the repository, have them disconnect before you run the repository in exclusive mode.
To promote a repository: 1. 2. 3. 4. 5.

In the Administration Console, select the Repository Service for the repository you want to promote. If the Repository Service is running in normal mode, change the operating mode to exclusive. For more information, see Running in Exclusive Mode on page 126. If the Repository Service is not enabled, click Enable. In the general properties for the service, click Edit. Select GlobalRepository, and click OK.

Managing a Repository Domain

133

The Repository Authentication window appears.

6. 7.

Enter the repository user name and password of a repository user. The user must be the Administrator or have the Super User privilege. Click OK.

After you promote a local repository, the value of the GlobalRepository property is true in the general properties for the Repository Service.

Registering a Local Repository

You can register local repositories with a global repository to create a repository domain.When you register a local repository, the code pages of the local and global repositories must be compatible. You can copy objects from the local repository to the global repository and create shortcuts. You can also copy objects from the global repository to the local repository. If you unregister a repository from the global repository and register it again, the Repository Service reestablishes global shortcuts. For example, if you create a copy of the global repository and delete the original, you can register all local repositories with the copy of the global repository. The Repository Service reestablishes all global shortcuts unless you delete objects from the copied repository. A separate Repository Service manages each repository. For example, if a repository domain has three local repositories and one global repository, it must have four Repository Services. The Repository Services and repository databases do not need to run on the same machine. However, you improve performance for repository transactions if the Repository Service process runs on the same machine where the repository database resides. You can move a registered local or global repository to a different Repository Service in the repository domain or to a different PowerCenter domain. For more information about moving repositories, see Moving Local and Global Repositories on page 136.

134

Chapter 7: Managing the Repository

To register or unregister a local repository: 1. 2.

In the Navigator, select the Repository Service associated with the local repository. In the Actions list, select Register Local Repository or select Unregister Local Repository.

3.

Select the PowerCenter domain of the Repository Service for the global repository. If the Repository Service resides in a different PowerCenter domain and the PowerCenter domain name does not appear in the list of PowerCenter domains, click Manage Domain List to update the list. For more information about updating the list of PowerCenter domains, see Working with Multiple Domains on page 61.

4. 5. 6. 7.

Select the Repository Service. Enter the repository user name and password in the authentication fields for the global Repository Service. Enter the repository user name and password in the authentication fields for the local Repository Service. Click OK.

Viewing Registered Local and Global Repositories

For a global repository, you can view a list of all the registered local repositories. Likewise, if a local repository is registered with a global repository, you can view the name of the global repository and the PowerCenter domain where it resides.
Note: A Repository Service manages a single repository. The name of a repository is the same

as the name of the Repository Service that manages it.

Managing a Repository Domain

135

To view registered local and global repositories: 1. 2.

In the Navigator, select the Repository Service that manages the local or global repository. In the Actions list, select View Registered Repositories. For a global repository, a list of local repositories appears.

For a local repository, the name of the global repository appears.

Note: The Administration Console displays a message if a local repository is not registered

with a global repository or if a global repository has no registered local repositories.

Moving Local and Global Repositories

If you need to move a local or global repository to another PowerCenter domain, complete the following steps: 1. Unregister the local repositories. For each local repository, follow the procedure to unregister a local repository from a global repository. To move a global repository to another PowerCenter domain, unregister all local repositories associated with the global repository. Create the Repository Services without content. Create the new Repository Services without content in the target PowerCenter domain. If you are creating a global repository, select the global repository option when you create the service. Alternatively, you can promote a local repository to a global repository. Copy the content from the source domain. For each new Repository Service in the target PowerCenter domain, use the Copy Contents From command to copy the repository database tables from the corresponding Repository Service in the source PowerCenter domain. Register the local repositories. For each local repository in the target PowerCenter domain, follow the procedure to register a local repository with a global repository.

2.

3.

4.

136

Chapter 7: Managing the Repository

Managing Repository User Connections and Locks

You can use the Administration Console and the Repository Manager to manage repository user connections and locks. In the Administration Console, you can perform the following tasks:

View locks. View object locks and lock type. For more information, see Viewing Locks on page 137. View repository user connections. View all user connections in the repository. For more information, see Viewing User Connections on page 138. Close connections and release locks. Terminate residual connections and locks. When you close a connection, you release all locks associated with that connection. For more information, see Closing User Connections and Releasing Locks on page 139.

For more information about using the Repository Manager to manage user connections and locks, see Using the Repository Manager in the Repository Guide.

Viewing Locks
You can view locks and identify residual locks in the Repository Manager or in the Administration Console.
To show all repository locks in the Administration Console: 1. 2.

In the Navigator, select the Repository Service with the locks you want to view. Click the Locks tab.

Managing Repository User Connections and Locks

137

The following table describes the object lock information in both the Repository Manager and the Administration Console:
Column Name User Connection ID Folder Object Type Object Name Lock Type Lock Time Host Name Application Description User name locking the object. Identification number assigned to the repository connection. Folder in which the locked object is saved. Type of object, such as folder, version, mapping, or source. Name of the locked object. Type of lock: in-use, write-intent, or execute. Time the lock was created. Name of the machine locking the object. Application locking the object: Designer, Workflow Manager, or Repository Manager.

Viewing User Connections

You can view repository user connection details in the Administration Console. You might want to view user connections to verify all users are disconnected before you disable the Repository Service.
To view user connections in the Administration Console: 1. 2.

In the Navigator, select the Repository Service with the user connections you want to view. Click the Connections tab.

138

Chapter 7: Managing the Repository

The following table describes the repository user connection information:

Property User Connection ID Application Host Name Host Address Host Port Login Time Last Active Time Description User name associated with the connection. Identification number assigned to the repository connection. Repository client application associated with the connection. Name of the machine running the application. TCP/IP address of the machine associated with the connection. Port number the machine hosting the repository client application uses to communicate with the repository. Time when the user connected to the repository. Time of the last metadata transaction between the repository client application and the repository.

Closing User Connections and Releasing Locks

Sometimes, the Repository Service does not immediately disconnect a user from the repository. The repository has a residual connection when the repository client application or machine is shut down but the connection remains in the repository. This can happen in the following situations:

Network problems occur. A PowerCenter Client, Integration Service, Repository Service, or database machine shuts down improperly.

A residual repository connection also retains all repository locks associated with the connection. If an object or folder is locked when one of these events occurs, the repository does not release the lock. This is called a residual lock. If a system or network problem causes a repository client application to lose connectivity to the repository, the Repository Service detects and closes the residual connection. When the Repository Service closes the connection, it also releases all repository locks associated with the connection. An Integration Service may have multiple connections open to the repository. If you close one Integration Service connection to the repository, you close all connections for that service.
Warning: Closing an active connection may cause repository inconsistencies. Close residual connections only.
To close a connection and release locks: 1.

In the Navigator, select the Repository Service with the connection you want to close.
Note: To terminate a connection associated with a residual lock, first view the repository

object locks to identify the connection ID number associated with the residual lock. Make a note of the connection ID number. You use this number to determine which user
Managing Repository User Connections and Locks 139

connection to close. Then, verify the user is not connected to the repository. For more information about viewing repository object locks, see Viewing Locks on page 137.
2.

Click the Connections tab.

Close a connection. 3.

Click the Remove button for the user connection you want to close, or click the End All User Connections button to close all connections. The Repository Authentication window appears.

4.

Enter a repository user name and password. You can enter the user name and password associated with a particular connection, or you can enter the login information for a user with the Manage Connection or Super User privilege.

The Repository Service closes connections and releases all locks associated with the connections.

140

Chapter 7: Managing the Repository

Sending Repository Notifications

If you have permission on the Repository Service, you can create repository user notifications in the Administration Console. You create and send notification messages to all users connected to a repository. You might want to send a message to notify users of scheduled repository maintenance or other tasks that require you to disable a Repository Service or run it in exclusive mode. For example, you might send a notification message to ask users to disconnect before you promote a local repository to a global repository.
To send a repository notification message: 1. 2.

Select the Repository Service in the Navigator. In the Actions list, select Notify Users. The Notify Users for <Repository> window appears.

3. 4.

Enter the message text. Click OK. The Repository Service sends the notification message to the PowerCenter Client users. A message box informs users that the notification was received. The message text appears on the Notifications tab of the PowerCenter Client Output window.

Sending Repository Notifications

141

Backing Up and Restoring the Repository

Regularly back up repositories to prevent data loss due to hardware or software problems. When you back up a repository, the Repository Service saves the repository in a binary file, including the repository objects, connection information, and code page information. If you need to recover the repository, you can restore the content of the repository from this binary file.

Backing Up a Repository
When you back up a repository, the Repository Service stores the file in the backup location you specify for the node. You specify the backup location when you set up the node. View the general properties of the node to determine the path of the backup directory. For more information, see Configuring Node Properties on page 46. The Repository Service uses the extension .rep for all repository backup files.
To back up a repository: 1. 2.

In the Navigator, select the Repository Service for the repository you want to back up. In the Actions list, select Back Up Contents.

3.

Enter a repository user name and password. The repository user must have the Admin Repository or Super User privilege to perform backups.

4.

Enter a file name and description for the repository backup file. Use an easily distinguishable name for the file. For example, if the name of the repository is DEVELOPMENT, and the backup occurs on May 7, you might name the file

142

Chapter 7: Managing the Repository

DEVELOPMENTMay07.rep. If you do not include the .rep extension, the Repository Service appends that extension to the file name.
5.

If you use the same file name that you used for a previous backup file, select whether or not to replace the existing file with the new backup file. To overwrite an existing repository backup file, select Replace Existing File. If you specify a file name that already exists in the repository backup directory and you do not choose to replace the existing file, the Repository Service does not back up the repository.

6.

Choose to skip or back up workflow and session logs, deployment group history, and MX data. You might want to skip these operations to increase performance when you restore the repository. For more information, see Increasing Repository Copy, Backup, and Restore Performance on page 160. Click OK. The results of the backup operation appear in the activity log.

7.

Viewing a List of Backup Files

You can view the backup files you create for a repository in the backup directory where they are saved. You can also view a list of existing backup files in the Administration Console.
To view the list of backup files: 1. 2.

In the Navigator, select the Repository Service for a repository that has been backed up. In the Actions list, select View Backup Files. A list of the backup files appears.

Restoring a Repository
You can restore metadata from a repository binary backup file. When you restore a repository, you must have a database available for the repository. You can restore the repository in a database that has a compatible code page with the original database. If a repository exists at the target database location, you must delete it before you restore a repository backup file. PowerCenter restores repositories from the current version. If you have a backup file from an earlier version of PowerCenter or PowerMart, you must use the earlier version to restore the repository. Verify that the repository license includes the license keys necessary to restore the repository backup file. For example, you must have the team-based development option to restore a versioned repository. For more information about licenses, see Managing Licenses on page 275.
Backing Up and Restoring the Repository 143

Note: If you want to create, restore, or upgrade a Sybase ASE repository, set allow nulls by default to TRUE at the database level. Setting this option changes the default null type of the column to null in compliance with the SQL standard.
To restore a repository: 1. 2.

In the Navigator, select the Repository Service that manages the repository content you want to restore. In the Actions list, select Restore Contents. The Restore Contents options appear.

3.

Select a backup file to restore. If the repository backup file is associated with a security module, the restore security options appear.

144

Chapter 7: Managing the Repository

4.

If the restore security options appear, you must choose whether to restore the repository with the external module or unregister the security module when you restore. If you choose to keep the external module, you must specify the repository administrator user name and password. Use the external module login that corresponds to the Administrator user for the repository. If you choose to unregister the security module, the Administrator account password becomes Administrator. The other user names are disabled. You must register the security module again to activate the user names.

5.

Select whether or not to restore the repository as new. When you restore a repository as new, the Repository Service creates internal folder IDs for the folders in the restored repository. This enables you to copy folders and deployment groups between the original repository and the restored repository. If you do not restore the repository as new, you cannot copy folders and deployment groups between the original and restored repositories.
Note: When you copy repository content, you create the repository as new. The

Repository Service creates internal folder IDs for the repository.

6.

Optionally, choose to skip workflow and session logs, deployment group history, and MX data. Skipping the data improves performance. For more information, see Increasing Repository Copy, Backup, and Restore Performance on page 160. Click OK. The activity log indicates whether the restore operation succeeded or failed.

7.

Note: When you restore a global repository, the repository becomes a standalone repository.

After restoring the repository, you need to promote it to a global repository.

Backing Up and Restoring the Repository

145

Copying Content from Another Repository

Copy content into a repository when no content exists for the repository and you want to use the content from a different repository. Copying repository content provides a quick way to copy the metadata that you want to use as a basis for a new repository. You can copy repository content to preserve the original repository before upgrading. You can also copy repository content when you need to move a repository from development into production. To copy repository content, you must create the Repository Service for the target repository. When you create the Repository Service, set the creation mode to create the Repository Service without content. Also, you must select a code page that is compatible with the original repository. For more information, see Understanding Globalization on page 327. Alternatively, you can delete the content from a Repository Service that already has content associated with it. For more information, see Deleting Repository Content on page 128. If a repository exists in the target database, the copy operation fails. You must back up the existing repository and delete it from the target database before copying the repository content.
Note: If you copy repository content to a Sybase database, set allow nulls by default to TRUE at

the database level. Setting this option changes the default null type of a column to null in compliance with the SQL standard.
To copy content from another repository: 1.

In the Navigator, select the Repository Service to which you want to add copied content. You cannot copy content to a repository that already contains content. If necessary, back up and delete existing repository content before copying in the new content.

2.

In the Actions list, select Copy Contents From. The page displays the options for the Copy Contents From operation.

146

Chapter 7: Managing the Repository

3.

Select the PowerCenter domain for the Repository Service associated with the content you want to copy. If the Repository Service resides in a different PowerCenter domain and the domain name does not appear in the list of domains, click Manage List to update the list of domains. For more information about updating the list of domains, see Working with Multiple Domains on page 61.

4. 5.

Select the name of the Repository Service. Enter a repository user name and password for the repository from which you want to copy content. The repository user must have the Deploy privilege to copy repository content.

6.

To skip workflow and session logs, deployment group history, and MX data, select the check boxes in the advanced options. Skipping this data can increase performance. For more information, see Increasing Repository Copy, Backup, and Restore Performance on page 160. Click OK. The activity log displays the results of the copy operation.

7.

Copying Content from Another Repository

147

Registering and Unregistering Repository Plug-ins

Use the Administration Console to register and remove repository plug-ins. Repository plugins are third-party or other Informatica applications that extend PowerCenter functionality by introducing new repository metadata. For installation issues specific to the plug-in, consult the plug-in documentation. For information about registering and unregistering LDAP security modules, see Setting Up LDAP Authentication for Repositories on page 151.

Registering a Repository Plug-in

Register a repository plug-in to add its functionality to the repository. You can also update an existing repository plug-in.
To register a plug-in: 1.

Run the Repository Service in exclusive mode. For more information about exclusive mode, see Running in Exclusive Mode on page 126.

2. 3.

In the Navigator, select the Repository Service to which you want to add the plug-in. Click the Plug-ins tab.

4. 5. 6.

Click the link to register a Repository Service plug-in. On the Register Plugin for <Repository Service> page, click the Browse button to locate the plug-in file. If the plug-in was registered previously and you want to overwrite the registration, select the check box to update the existing plug-in registration. For example, you might select this option when you upgrade a plug-in to the latest version. Enter your repository user name and password. Click OK. The Repository Service registers the plug-in with the repository. The results of the registration operation appear in the activity log.

7. 8.

148

Chapter 7: Managing the Repository

9.

Run the Repository Service in normal mode.

Unregistering a Repository Plug-in

To unregister a repository plug-in, the Repository Service must be running in exclusive mode. Verify that all users are disconnected from the repository before you unregister a plug-in. The list of registered plug-ins for a Repository Service appears on the Plug-ins tab. Figure 7-1 shows a sample list of registered plug-ins:
Figure 7-1. List of Plug-ins for a Repository Service

Remove Button

If the Repository Service is not running in exclusive mode, the Remove buttons for plug-ins are disabled.
To unregister a plug-in: 1.

Run the Repository Service service for the plug-in in exclusive mode. For more information about exclusive mode, see Running in Exclusive Mode on page 126.

2. 3.

In the Navigator, select the Repository Service from which you want to remove the plug-in. Click the Plug-ins tab. The list of registered plug-ins appears.

Registering and Unregistering Repository Plug-ins

149

4.

Click the Remove button for the plug-in you want to unregister.

5.

Enter a repository user name and password. The user must be the Administrator or have the Super User privilege.

6. 7.

Click OK. Run the Repository Service in normal mode.

150

Chapter 7: Managing the Repository

Setting Up LDAP Authentication for Repositories

If you use LDAP authentication for a repository, the Repository Service passes a user login to the external directory for authentication. The service maintains an association between repository user names and external login names. There must be one unique external login for each repository user name. For more information about LDAP user authentication, see Managing Users and Groups in the Repository Guide. You can use the following LDAP external directory services with PowerCenter:

Microsoft Active Directory Server Sun ONE Directory Server IBM SecureWay

Note: You cannot use SSL-enabled LDAP servers.

To configure one or more repositories in a PowerCenter domain to use LDAP authentication, complete the following steps: 1. 2. Configure the LDAP authentication module for the domain. You must set up the connection from the domain to the LDAP external directory service. Register the LDAP authentication module with each applicable Repository Service. You register the LDAP authentication module for each Repository Service in the domain that will use LDAP authentication. If you do not register the LDAP authentication module with a Repository Service, the Repository Service continues to use the default repository authentication.

You can switch between repository authentication and LDAP authentication. When you switch authentication methods, user accounts may become invalid. For more information about switching between repository and LDAP authentication, see Switching Between Repository and LDAP Authentication on page 157. To switch a repository from LDAP authentication to repository authentication, you must unregister the LDAP security module. For more information about unregistering an LDAP security module, see Unregistering an LDAP Security Module on page 156.

Configuring the LDAP Authentication Module for the Domain

You configure the LDAP authentication module for the domain. After you configure the LDAP authentication module for the domain, you can register the module with one or more repositories in the domain. If you edit the existing LDAP configuration, you must refresh the LDAP plug-in. To refresh the plug-in, unregister the plug-in and reregister the plug-in. If you do not refresh the LDAP plug-in, PowerCenter repository users cannot log in to any repository that uses the LDAP authentication method.

Setting Up LDAP Authentication for Repositories

151

To configure the LDAP authentication module for the domain: 1. 2. 3. 4.

In the Navigator of the Administration Console, select the domain. Select the Properties tab. Click Edit in the LDAP Authentication Module Configuration section. Enter the LDAP server configuration options. Table 7-1 describes the LDAP server configuration options:
Table 7-1. LDAP Server Configuration Options
Option Server name Port Search base Description Name of the machine hosting the LDAP server. LDAP server listening port. This is the port used to configure the LDAP server. Default port is 389. Distinguished name (DN) of the entry that serves as the starting point to search for user names in the LDAP directory tree. LDAP finds an object in the directory according to the path in the distinguished name of the object. For example, in Microsoft Active Directory, the distinguished name of a user object might be cn=UserName,ou=OrganizationalUnit,dc=DomainName, where the series of relative distinguished names denoted by dc=DomainName identifies the DNS domain of the object. Scope of the user search. Choose one of the following options: - Base. Search the entry identified by Search Base. - One level. Search all entries one level beneath the Search Base entry but not including the Search Base entry. - Subtree. Search the entire subtree at all levels beneath the Search Base entry. Distinguished name (DN) for the principal user. The user name often consists of a common name (CN), an organization (O), and a country (C). The Principal User Name is an administrative user with access to the directory and is not the name to authenticate. Specify a user who has permission to read other user entries in the LDAP server. Leave blank for anonymous login. For more information, refer to the LDAP Server documentation. Password for the principal user. Leave blank for anonymous login. Directory attribute that contains login names. An LDAP query string to filter results for user search. The filter can specify attribute types, assertion values, and matching criteria. For example: (objectclass=*) searches all objects. (&(objectClass=user)(!(cn=susan))) searches all user objects except susan. For more information about search filters, see the LDAP server documentation. Do not use this option. PowerCenter does not support an LDAP server that uses SSL. Do not use this option. PowerCenter does not support an LDAP server that uses SSL.

Scope

Name

Password Attribute Used as Login Login Filter

Use SSL Certificate Database Certificate Database

Note: You may need to consult the LDAP administrator to get the information for the

LDAP server configuration options.

152

Chapter 7: Managing the Repository

Examples
The following example shows options for a Microsoft Active Directory server running on server6. When a user connects to the repository, the authentication module binds as the principal user JSmith to the LDAP server server6. The LDAP server searches for users within the search base starting at the organizational unit TestUsers, and searches down the subtree. It checks objects in the person object class. The server searches for an object where sAMAccountName equals the user login name. Table 7-2 shows the configuration options for a Microsoft Active Directory server:
Table 7-2. Sample Microsoft Active Directory Server Configuration
Option Server name Port Search base Scope Name Password Attribute used as login Login filter Use SSL Certificate Database Certificate database Value server6 389 ou=TestUsers, dc=informatica, dc=com subtree CN=JSmith testpassword sAMAccountName (objectclass=person) n/a n/a

The following example shows configuration options for a SunONE directory server running on port 503 on server mars. The principal user and credential options are blank, which indicates that the users access the LDAP server through anonymous login. Table 7-3 shows the configuration options for a SunONE directory server:
Table 7-3. Sample SunONE Directory Server Configuration
Option Server name Port Search base Scope Name Password Attribute used as login Value mars 503 ou=people, dc=informatica, dc=com subtree n/a n/a uid

Setting Up LDAP Authentication for Repositories

153

Table 7-3. Sample SunONE Directory Server Configuration

Option Login filter Use SSL Certificate Database Certificate database Value (objectclass=person) n/a n/a

Registering an LDAP Security Module with a Repository

Use the Administration Console or the pmrep Registerplugin command to register the LDAP authentication module with a repository. For more information about the Registerplugin command, see pmrep Command Reference in the Command Line Reference. When you switch from repository authentication to LDAP authentication, all existing repository user accounts become invalid, except for the one that you map to an external directory service user account. When you register the authentication module for a repository, you specify user accounts for repository authentication and the external directory service. After you register the authentication module, the domain maps the specified repository user account to the specified external directory service user account. This is the only valid LDAP user account. For example, when you register the LDAP authentication module, you specify the following user accounts:

Administrator. This is the administrator user account under repository authentication. JSmith. This is the external directory service user account under LDAP authentication.

After you register the LDAP authentication module, JSmith is the only user account that can log in to the repository. The repository user Administrator cannot be used with LDAP authentication. The repository administrator must log in to the repository with the valid LDAP user account and associate existing repository user names with LDAP login names to grant other users permission to log in to the repository. The repository administrator maintains the user namelogin associations. Each user must have a valid LDAP user account to log in to the repository. There must be one unique LDAP user account for each repository user. For more information about creating a user using an external directory service, see Managing Users and Groups in the Repository Guide.
Note: If you switch to LDAP authentication, you must update environment variables or

pmcmd commands that use the repository administrator user name and password. Replace the repository user name and password with the external directory service user name and password.

154

Chapter 7: Managing the Repository

To register an LDAP security module using the Administration Console: 1. 2.

In the Navigator of the Administration Console, select a Repository Service to associate with the LDAP security module. Make sure the Repository Service is running in exclusive mode. For more information, see Running in Exclusive Mode on page 126.

3. 4.

Select the Plug-ins tab for the Repository Service. Click Register security module. The Register LDAP Security Module page appears.

Table 7-4 describes the options on the Register LDAP Security Module page:
Table 7-4. Register Security Module Options
Option Update Existing Security Module Registration Username Password Login Description Updates an existing security module. Leave blank if this is the first time you are registering this module. Enter the user name of the repository administrator. The user account must have the Admin Repository privilege to register the security module. Enter the password for the repository administrator. Enter a valid login name for the LDAP authentication module. This LDAP login account is mapped to the repository administrator account to allow the repository administrator to log in to the repository. The repository administrator uses this login to access the LDAPauthenticated repository. Enter the password for the specified login name.

Password

Setting Up LDAP Authentication for Repositories

155

5.

Click OK. The following message appears:

Action status for Register security module: Succeeded.

6.

Click Save to save the log. Otherwise, click Close to close the window. The Repository Service registers the plug-in with the repository. The LDAP security module appears in the list of components on the Plugins tab.

7.

Run the Repository Service in normal mode. The Repository Service must be running in normal mode to allow any user to log in to the repository, regardless of the authentication method.

Unregistering an LDAP Security Module

You can unregister the LDAP authentication module by using the Administration Console or by using the pmrep Unregisterplugin command. For information on the Unregisterplugin command, see pmrep Command Reference in the Command Line Reference. If you unregister the external security module, PowerCenter switches to repository authentication mode. It resets all user passwords to the values in the repository instead of the values in the external directory. When you unregister the security module, you lose the mapping between the repository user names and the external security login names unless you select to keep the user name and external login mapping. If you keep the mapping, you can reuse it later if you register a new security module.
Note: Although you can save the associations between external logins and repository user

names, the Repository Manager does not display the external logins while running under repository user authentication. You must specify a new password for the administrator when you unregister the security module. This ensures that you can access the repository after the external security directory is unregistered. To unregister the LDAP authentication module, the Repository Service must be running in exclusive mode. Before running a Repository Service in exclusive mode, verify that all users are disconnected from the repository. You must stop and restart the Repository Service to change the operating mode.
To unregister an LDAP security module: 1. 2.

In the Navigator of the Administration Console, select the Repository Service associated with the LDAP security module. Verify that the Repository Service is running in exclusive mode. For more information, see Running in Exclusive Mode on page 126.

3.

Select the Plug-ins tab. The Repository Service displays the registered plug-ins.

156

Chapter 7: Managing the Repository

4.

Click the Remove button for LDAPAuthenPlugin. The Unregister Security Module page appears.

5.

Enter the following information:

Table 7-5. Unregister Security Module Options
Option Repository Username Password New Administrator Password Confirm Password Keep Username/ External Login Mapping Description The external login name for the repository administrator. The external login password for the repository administrator. The new password for the administrator to use with repository security after unregistering the external security module. Confirms the new password for the administrator. Keeps the mapping between the external user names and the login names in the repository. You can reuse this mapping if you register another external security module.

6.

Click OK. The following message appears:

Action status for Unregister security module: Succeeded.

7. 8.

Click Save to save the log. Otherwise, click Close. Run the Repository Service in normal mode.

Switching Between Repository and LDAP Authentication

If you switch an existing repository from the default repository authentication to LDAP external directory authentication, the existing repository users receive the No Login Assigned or Login Suggested status. You must enable these users by associating their repository user names with valid LDAP external directory login names. The associations between the repository user name and LDAP login are stored in the PowerCenter repository. If you switch from using LDAP authentication to repository authentication, you can retain the associations in the repository, but repository authentication does not use these associations. You do not see the associations in the Repository Manager. Also, the users you add under the external directory service have the Disabled status. When you retain the associations, you can reuse the associations if you register another external directory service for LDAP authentication. If a login is not valid on the new external directory, the status for the associated user name becomes No Login Assigned. For more information about user statuses and associating users between different types of authentication methods, see Managing Users and Groups in the Repository Guide.

Setting Up LDAP Authentication for Repositories

157

Sample Authentication File

When you install PowerCenter, the installation program places an LDAP external module library file and an associated XML file in the server\bin\security subdirectory of the Informatica root directory. For example, the installation might create the following files:
C:\Informatica\PowerCenter8.1\server\bin\security\pmldapauth.dll C:\Informatica\PowerCenter8.1\server\bin\security\ldap_authen.xml

The NAME attribute in the LIBRARY element specifies the library file that implements the authentication. The OSTYPE attribute specifies the operating system running the library file. The TYPE should be REPAGENT.
Note: If you back up and restore a repository to a machine with a different operating system, the restore process might unregister the external security module if it cannot find the security library on the new platform.

The XML file specifies the security module. The following code is an example of an LDAP XML file:
<?xml version="1.0" encoding="us-ascii"?> <!DOCTYPE POWERMART SYSTEM "plugin.dtd"> <POWERMART> <REPOSITORY CODEPAGE ="us-ascii"> <PLUGIN ID ="3014" NAME ="LDAPAuthenPlugin" VERSION ="8.0.0" VENDORID ="1" VENDORNAME ="Informatica" DESCRIPTION ="LDAP Authentication Security module"> <TEMPLATE ID="400100" NAME="LDAP Authentication Module" TYPE="AUTHENTICATIONMODULE" DESCRIPTION="Authentication module implemented using LDAP" COMPONENTVERSION="1.0.0"> <LIBRARY NAME="pmldapauth.dll" OSTYPE="NT" TYPE="REPAGENT"/> <LIBRARY NAME="libpmldapauth.so" OSTYPE="SOLARIS" TYPE="REPAGENT"/> <LIBRARY NAME="libpmldapauth.sl" OSTYPE="HPUX" TYPE="REPAGENT"/> <LIBRARY NAME="libpmldapauth.a" OSTYPE="AIX" TYPE="REPAGENT"/> <LIBRARY NAME="libpmldapauth.so" OSTYPE="LINUX" TYPE="REPAGENT"/> </TEMPLATE> </PLUGIN> </REPOSITORY> </POWERMART>

158

Chapter 7: Managing the Repository

Creating an Audit Trail

You can track changes to Repository users, groups, privileges, and permissions by selecting the SecurityAuditTrail configuration option in the Repository Service properties in the PowerCenter Administration Console. When you enable the audit trail, the Repository Service logs security changes to the Repository Service log. The audit trail logs the following operations:

Changing the owner, owners group, or permissions for a folder. Changing the password of another user. Adding or removing a user. Adding or removing a group. Adding or removing users from a group. Changing global object permissions. Adding or removing user and group privileges. Changing your own password. Deleting the owner or owners group for a folder. The delete operation causes a log entry, but after you delete the owner or owners group, the ownership defaults to Administrator owner or the Public group. This change does not create a log entry. Changing permissions of queries. Installing or removing an external security authorization module.

The audit trail does not log the following operations:

Creating an Audit Trail

159

Tuning Repository Performance

PowerCenter includes features that allow you improve the performance of the repository. You can update statistics and skip information when you copy, back up, or restore the repository.

Updating Repository Statistics

The PowerCenter repository has more than 170 tables, and almost all tables use at least one index to speed up queries. Most databases keep and use column distribution statistics to determine which index to use to execute SQL queries optimally. Database servers do not update these statistics continuously. In frequently used repositories, these statistics can quickly become outdated, and SQL query optimizers may not choose the best query plan. In large repositories, choosing a sub-optimal query plan can have a negative impact on performance. Over time, repository operations gradually become slower. PowerCenter identifies and updates the statistics of all repository tables and indexes when you copy, upgrade, and restore repositories. You can also update statistics using the pmrep UpdateStatistics command. For more information about updating statistics, see pmrep Command Reference in the Command Line Reference.

Increasing Repository Copy, Backup, and Restore Performance

Large repositories may contain a lot of log and history information that slows down repository performance. You have the option to skip the information that is not essential to the function of the repository. When you back up, restore, or copy a repository, you can choose to skip the following types of information:

Workflow and session logs Deploy group history MX data

By skipping this information, you reduce the time it takes to copy, back up, or restore a repository. You can also skip this information when you use the pmrep commands. For more information, see pmrep Command Reference in the Command Line Reference.
Note: You can optimize repository performance for repositories on IBM DB2 EEE. For more

information, see Optimizing the PowerCenter Components in the Performance Tuning Guide.

160

Chapter 7: Managing the Repository

Chapter 8

Creating and Configuring the Integration Service

This chapter includes the following topics:

Overview, 162 Creating an Integration Service, 163 Enabling and Disabling the Integration Service, 167 Running in Normal and Safe Mode, 170 Configuring the Integration Service Properties, 176 Configuring the Associated Repository, 190 Configuring the Integration Service Processes, 192

161

Overview
The Integration Service is an application service that runs sessions and workflows. You install the Integration Service when you install PowerCenter Services. After you install the PowerCenter Services, you can use the Administration Console to manage the Integration Service. To access an Integration Service, you must have permission on the service in the domain. You can use the Administration Console to complete the following Integration Service tasks:

Create an Integration Service. You can create an Integration Service to replace an existing Integration Service or to use multiple Integration Services. For more information, see Creating an Integration Service on page 163. Enable or disable the Integration Service. You enable the Integration Service to run sessions and workflows. You might disable the Integration Service to prevent users from running sessions and workflows while performing maintenance on the machine or modifying the repository. For more information, see Enabling and Disabling the Integration Service on page 167. Configure normal or safe mode. Configure the Integration Service to run in normal or safe mode. For more information, see Running in Normal and Safe Mode on page 170. Configure the Integration Service properties. You might need to configure the Integration Service properties to change behavior of the Integration Service. For more information, see Configuring the Integration Service Properties on page 176. Configure the associated repository. You must associate a repository with an Integration Service. The Integration Service uses the mappings in the repository to run sessions and workflows. For more information, see Configuring the Associated Repository on page 190. Configure the Integration Service processes. Configure service process properties for each node, such as the code page and service process variables. For more information, see Configuring the Integration Service Processes on page 192. Configure permissions on the Integration Service. You must have permission on an Integration Service to view it and full privileges to configure it. For more information about permissions, see Managing Permissions and Privileges on page 72. Remove an Integration Service. You may need to remove an Integration Service if it becomes obsolete. Use the Administration Console to remove an Integration Service. For more information about removing services from a domain, see Removing Application Services on page 42.

162

Chapter 8: Creating and Configuring the Integration Service

Creating an Integration Service

You can create an Integration Service when you install PowerCenter. However, you may need to create an additional Integration Service to replace an existing one or create multiple Integration Services. You must assign a repository to the Integration Service. You can assign the repository when you create the Integration Service or after you create the Integration Service. You must assign a repository before you can run the Integration Service. The repository that you assign to the Integration Service is called the associated repository. The Integration Service retrieves metadata, such as workflows and mappings, from the associated repository. After you create an Integration Service, you must assign a code page for each Integration Service process. The code page for each Integration Service process must be a subset of the code page of the associated repository. You must select the associated repository before you can select the code page for an Integration Service process. The Repository Service must be enabled to set up a code page for an Integration Service process. To create an Integration Service, you must have full privileges and permission on the domain or folder where you want to create the service. You must also have permission on the grid or node where the service runs.
Note: If you configure an Integration Service to run on a node that is unavailable, you must

start the node and configure $PMRootDir for the service process before you run workflows with the Integration Service.

Creating an Integration Service

163

To create an Integration Service: 1.

In the Administration Console, click Create > Integration Service. The Create New Integration Service page appears.

2.

Enter values for the following Integration Service options:

Table 8-1. Create New Integration Service Options
Property Service Name Required/ Optional Required Description Name of the Integration Service. The name is not case sensitive and must be unique within the domain. The characters must be compatible with the code page of the associated repository. The name cannot have leading or trailing spaces, include carriage returns or tabs, exceed 79 characters, or contain the following characters: /*?<>"| Domain in which the Integration Service is created. This is a read-only field. License to assign to the Integration Service. If you do not select a license now, you can assign a license to the service later. Required if you want to enable the Integration Service. Configure the Integration Service to run on a grid or nodes. Grid name to which you assign the Integration Service. Required if you assign the Integration Service to a grid.

Location License

n/a Optional

Assign Run the Service on Grid

Required Conditional

164

Chapter 8: Creating and Configuring the Integration Service

Table 8-1. Create New Integration Service Options

Property Primary Node Required/ Optional Conditional Description Primary node to run the Integration Service. Required if you configure the Integration Service to run on nodes. Node used as a backup to the primary node. Option displays if you configure the Integration Service to run on nodes and you have the high availability option. Domain that contains the Repository Service associated with the Integration Service. Required to select an associated Repository Service. To apply changes to this property, restart the Integration Service. Repository Service associated with the Integration Service. If you do not select the associated Repository Service now, you can select it later. You must select the Repository Service before you run the Integration Service. To apply changes to this property, restart the Integration Service. Account used to access the repository database. When you create a repository, the repository user is the database user name. Required when you select an associated Repository Service. To apply changes to this property, restart the Integration Service. Password for the repository user. When you create a repository, the password is the password for the database user. Required when you select an associated Repository Service. To apply changes to this property, restart the Integration Service. Mode that determines how the Integration Service handles character data. Choose ASCII or Unicode. ASCII mode passes 7-bit ASCII or EBCDIC character data. Unicode mode passes 8-bit ASCII and multibyte character data from sources to targets. For more information about data movement modes, see Data Movement Modes on page 333. Default is ASCII. To apply changes to this property, restart the Integration Service.

Backup Nodes

Optional

Domain for Associated Repository Service

Conditional

Associated Repository Service

Optional

Repository User Name

Conditional

Repository Password

Conditional

Data Movement Mode

Required

3.

Click OK. If you do not specify an associated repository, the following message appears:
No Repository Service is associated with this Integration Service. Select an associated Repository Service to view a list of available codepages.

You must specify a Repository Service before you can enable the Integration Service.

Creating an Integration Service

165

If you specify an associated repository, the Create New Integration Service page appears:

You can specify the code page for each Integration Service process node and select the Enable Service option to enable the service. If you do not specify the code page information now, you can specify it later. You cannot enable the Integration Service until you assign the code page for each Integration Service process node.
4.

Click OK.

166

Chapter 8: Creating and Configuring the Integration Service

Enabling and Disabling the Integration Service

You can enable and disable an Integration Service process or the entire Integration Service. If you run the Integration Service on a grid or with the high availability option, you have one Integration Service process configured for each node. For a grid, the Integration Service runs all enabled Integration Service processes. With high availability, the Integration Service runs the Integration Service process on the primary node.

Enabling and Disabling an Integration Service Process

Use the Administration Console to enable and disable a service process running the Integration Service. Each service process runs on one node. You must enable the Integration Service process if you want the node to perform Integration Service tasks. You may want to disable the service process on a node to perform maintenance on that node or to enable safe mode for the Integration Service. When you disable an Integration Service process, you must choose the mode to disable it in. You can choose one of the following options:

Complete. Allows the sessions and workflows to run to completion before disabling the service process. Stop. Stops all sessions and workflows and then disables the service process. Abort. Attempts to stop all sessions and workflows before aborting them and disabling the service process.

To enable or disable an Integration Service process: 1. 2.

In the Navigator of the Administration Console, select the Integration Service. Click the Processes tab. If you configure the Integration Service to run on a grid or on multiple nodes, the Processes tab displays one area for each node.

3. 4.

To enable a service process, click Enable for the applicable node. To disable a service process, click Disable for the applicable node.

Enabling and Disabling the Integration Service

167

The Disable Integration Service window appears.

5.

Choose the disable mode and click OK.

Enabling and Disabling the Integration Service

Use the Administration Console to enable and disable an Integration Service. You may want to disable an Integration Service if you need to perform maintenance or if you want temporarily restrict users from using the service. You can enable a disabled Integration Service to make it available again. If you disable the Integration Service, you disable all service processes enabled to run the Integration Service and shut down the Integration Service. If you are running an Integration Service on a grid, you disable all service processes on the grid. When you disable the Integration Service, you must choose what to do if a process or workflow is running. You must choose one of the following options:

Complete. Allows the sessions and workflows to run to completion before shutting down the service. Stop. Stops all sessions and workflows and then shuts down the service. Abort. Attempts to stop all sessions and workflows before aborting them and shutting down the service.

When you enable the Integration Service, the service starts. The associated Repository Service must be started before you can enable the Integration Service. If you try to enable an Integration Service and the associated Repository Service is not running, the following error displays:
The Service Manager could not start the service due to the following error: [DOM_10076] Unable to enable service [<Integration Service] because of dependent services [<Repository Service>] are not initialized.

If the Integration Service is unable to start, the Service Manager keeps trying to start the service until it reaches the maximum restart attempts defined in the domain properties. For example, if you try to start the Integration Service without specifying the code page for each Integration Service process, the domain tries to start the service. The service does not start

168

Chapter 8: Creating and Configuring the Integration Service

without specifying a valid code page for each Integration Service process. The domain keeps trying to start the service until it reaches the maximum number of attempts. If the service is enabled but fails to start after reaching the maximum number of attempts, the following message appears:
The Integration Service <service name> is enabled. The service did not start. Please check the logs for more information.

To resolve the problem, review the logs for this Integration Service to determine the reason for failure and fix the problem. After you fix the problem, you must disable and re-enable the Integration Service to start it. To enable the Integration Service, select the Integration Service in the Navigator, and then click Enable.
To disable an Integration Service: 1. 2.

In the Navigator of the Administration Console, select the Integration Service. Click Disable. The Disable Integration Service window appears.

3.

Choose the disable mode and click OK.

Enabling and Disabling the Integration Service

169

Running in Normal and Safe Mode

You can run the Integration Service in normal or safe operating mode. Normal mode provides full access to users with permissions and privileges to use an Integration Service. Safe mode limits user access to the Integration Service and workflow activity during environment migration or Integration Service maintenance activities. Run the Integration Service in normal mode during daily Integration Service operations. In normal mode, repository users with workflow privileges can run workflows and get session and workflow information for workflows assigned to the Integration Service. You can configure the Integration Service to run in safe mode or to fail over in safe mode. When you enable the Integration Service to run in safe mode or when the Integration Service fails over in safe mode, it limits access and workflow activity to allow administrators to perform migration or maintenance activities. Run the Integration Service in safe mode to control which workflows an Integration Service runs and which users can run workflows during migration and maintenance activities. Run in safe mode to verify a production environment, manage workflow schedules, or maintain an Integration Service. In safe mode, only repository users with privileges to administer the Integration Service can run workflows and get information about sessions and workflows assigned to the Integration Service.

Changing the Operating Mode

When you the change operating mode, the Integration Service behavior depends on the mode you configure for the Integration Service:

Safe mode Normal mode

Safe Mode
In safe mode, the Integration Service limits access to the Integration Service and limits workflow activity. You can configure the Integration Service to run in safe mode or to fail over in safe mode:

Enable in safe mode. Enable the Integration Service in safe mode to perform migration or maintenance activities. When you enable the Integration Service in safe mode, you limit access to the Integration Service. When you enable an Integration Service in safe mode, you can choose to have the Integration Service complete, abort, or stop running workflows. In addition, the operating mode on failover also changes to safe.

Fail over in safe mode. Configure the Integration Service process to fail over in safe mode during migration or maintenance activities. When the Integration Service process fails over to a backup node, it restarts in safe mode and limits workflow activity and access to the Integration Service. The Integration Service restores the state of operations for any

170

Chapter 8: Creating and Configuring the Integration Service

workflows that were running when the service process failed over, but does not fail over or automatically recover the workflows. You can manually recover the workflow. After the Integration Service fails over in safe mode during normal operations, you can correct the error that caused the Integration Service process to fail over and restart the service in normal mode. The behavior of the Integration Service when it fails over in safe mode is the same as when you enable the Integration Service in safe mode. All scheduled workflows, including workflows scheduled to run continuously or start on service initialization, do not run. The Integration Service does not fail over schedules or workflows, does not automatically recover workflows, and does not recover client requests.

Normal Mode
When you enable an Integration Service to run in normal mode, the Integration Service begins running scheduled workflows. It also completes workflow failover for any workflows that failed while in safe mode, recovers client requests, and recovers any workflows configured for automatic recovery that failed in safe mode. Repository users with workflow privileges can run workflows and get session and workflow information for workflows assigned to the Integration Service. When you change the operating mode from safe to normal, the Integration Service begins running scheduled workflows and completes workflow failover and workflow recovery for any workflows configured for automatic recovery. You can use the Administration Console to view the log events about the scheduled workflows that started, the workflows that failed over, and the workflows recovered by the Integration Service.

Running the Integration Service in Safe Mode

This section describes the specific migration and maintenance activities that you can complete when you run an Integration Service in safe mode, the workflow tasks that you can complete in the Workflow Manager and Workflow Monitor, the behavior of the Integration Service in safe mode, and the permissions and privileges required to run and monitor workflows in safe mode.

Performing Migration or Maintenance

You might want to run an Integration Service in safe mode for the following reasons:

Test a development environment. Run the Integration Service in safe mode to test a development environment before migrating to production. You can run workflows that contain session and command tasks to test the environment. Run the Integration Service in safe mode to limit access to the Integration Service when you run the test sessions and command tasks. Manage workflow schedules. During migration, you can unschedule workflows that only run in a development environment. For example, you may have workflows intended to run only in the development environment. You can enable the Integration Service in safe mode, unschedule the workflow, and then enable the Integration Service in normal mode.
Running in Normal and Safe Mode 171

After you enable the service in normal mode, the workflows that you unscheduled do not run.

Troubleshoot the Integration Service. Configure the Integration Service to fail over in safe mode and troubleshoot errors when you migrate or test a production environment configured for high availability. After the Integration Service fails over in safe mode, you can correct the error that caused the Integration Service to fail over. Perform maintenance on the Integration Service. When you perform maintenance on an Integration Service, you can limit the users who can run workflows using an Integration Service. You can enable the Integration Service in safe mode, change Integration Service properties, and verify the Integration Service functionality before allowing other repository users to run workflows. For example, you can use safe mode to test changes to the paths for Integration Service files for Integration Service processes.

Workflow Tasks
Table 8-2 describes the tasks that you can perform when the Integration Service runs in safe mode:
Table 8-2. Safe Mode Tasks for an Integration Service
Task Run workflows. Unschedule workflows. Monitor Integration Service properties. Monitor workflow and task details. Recover workflows. Task Description Start, stop, abort, and recover workflows. The workflows may contain session or command tasks required to test a development or production environment. Unschedule workflows in the Workflow Manager. Connect to the Integration Service in the Workflow Monitor. Get Integration Service details and monitor information. Connect to the Integration Service in the Workflow Monitor and get task, session, and workflow details. Manually recover failed workflows.

Integration Service Behavior

Safe mode affects Integration Service behavior for the following workflow and high availability functionality:

Workflow schedules. Scheduled workflows remain scheduled, but they do not run if the Integration Service is running in safe mode. This includes workflows scheduled to run continuously and run on service initialization. Workflow schedules do not fail over when an Integration Service fails over in safe mode. For example, you configure an Integration Service to fail over in safe mode. The Integration Service process fails for a workflow scheduled to run five times, and it fails over after it runs the workflow three times. The Integration Service does not complete the remaining workflows when it fails over to the backup node. The Integration Service completes the workflows when you enable the Integration Service in safe mode.

172

Chapter 8: Creating and Configuring the Integration Service

Workflow failover. When an Integration Service process fails over in safe mode, workflows do not fail over. The Integration Service restores the state of operations for the workflow. When you enable the Integration Service in normal mode, the Integration Service fails over the workflow and recovers it based on the recovery strategy for the workflow. Workflow recovery. The Integration Service does not recover workflows when it runs in safe mode or when the operating mode changes from normal to safe. The Integration Service recovers a workflow that failed over in safe mode when you change the operating mode from safe to normal, depending on the recovery strategy for the workflow. For example, you configure a workflow for automatic recovery and you configure the Integration Service to fail over in safe mode. If the Integration Service process fails over, the workflow is not recovered while the Integration Service runs in safe mode. When you enable the Integration Service in normal mode, the workflow fails over and the Integration Service recovers it. You can manually recover the workflow if the workflow fails over in safe mode. You can recover the workflow after the resilience timeout for the Integration Service expires.

Client request recovery. The Integration Service does not recover client requests when it fails over in safe mode. For example, you stop a workflow and the Integration Service process fails over before the workflow stops. The Integration Service process does not recover your request to stop the workflow when the workflow fails over. When you enable the Integration Service in normal mode, it recovers the client requests.

For more information about Integration Service failover and recovery, see Managing High Availability for the Integration Service on page 98.

Permissions and Privileges

You need one of the following sets of permissions and privileges to run and monitor workflows in safe mode:

Admin Integration Service and Use Workflow Manager privilege with read and write permission on the folder Admin Integration Service and Workflow Operator privilege with read folder permissions Super User privilege

Steps to Configure the Operating Mode

You can use the Administration Console to configure the Integration Service to run in safe mode, run in normal mode, or run in safe or normal mode on failover. To configure the operating mode, you must have permissions on the Integration Service in the Administration Console. To configure the operating mode on failover, you must have the high availability option.

Running in Normal and Safe Mode

173

To configure an Integration Service to run in safe mode: 1. 2.

On the Domain tab, select the Integration Service in the Navigator. On the Properties tab, click Edit under Operating Mode Configuration.

3.

Select Safe for the operating mode. The following message appears:
Changing OperatingMode to Safe will also set OperatingModeOnFailover to Safe.

4. 5.

Click OK. Click OK under Operating Mode Configuration. The Restart Integration Service window displays the following message:
Changing the OperatingMode from normal to safe requires the Integration Service to be restarted. Restart service now?

6.

Click Yes. The Restart Integration Service window displays the following message.

7.

Choose to allow processes to complete or choose to stop or abort all processes, and then click OK. The Integration Service stops and then restarts in safe mode. The service status at the top of the Main window indicates when the service has restarted. The Disable button for the service appears when the service is enabled and running.

To configure an Integration Service to run in normal mode: 1. 2.

On the Domain tab, select the Integration Service in the Navigator. On the Properties tab, click Edit under Operating Mode Configuration.

174

Chapter 8: Creating and Configuring the Integration Service

3. 4.

Select Normal as the operating mode. Click OK. The Integration Service operating mode changes to normal.

To configure an Integration Service to run in safe mode on failover: 1. 2.

On the Domain tab, select the Integration Service in the Navigator. On the Properties tab, click Edit under Operating Mode Configuration.

3. 4.

Select Safe as the operating mode on failover. Click OK.

Note: When you change the operating mode on fail over from safe to normal, the change takes

effect immediately.

Running in Normal and Safe Mode

175

Configuring the Integration Service Properties

Use the Administration Console to configure the following Integration Service properties:

Grid and node assignments. Choose to run the Integration Service on a grid or nodes. For more information about grid and node properties, see Grid and Node Assignments on page 176. General properties. Configure general properties, such as the data movement mode. For more information about general properties, see General Properties on page 178. Advanced properties. Configure advanced properties, such as the character set of the Integration Service logs and whether the Integration Service should check resources. For more information about advanced properties, see Advanced Properties on page 180. Operating mode properties. Enable the Integration Service in normal or safe mode and configure the Integration Service to fail over in safe mode. For more information about operating mode properties, see Running in Normal and Safe Mode on page 170. Compatibility and database properties. Configure the source and target database properties, such the maximum number of connections, and configure properties to enable compatibility with previous versions of PowerCenter. For more information about compatibility and database properties, see Compatibility and Database Properties on page 183. Configuration properties. Configure the configuration properties, such as the data display format. For more information about configuration properties, see Configuration Properties on page 186. HTTP proxy properties. Configure the connection to the HTTP proxy server. For more information about HTTP proxy properties, see HTTP Proxy Properties on page 188. Custom properties. Custom properties include properties that are unique to your PowerCenter environment or that apply in special cases. An Integration Service has no custom properties when you initially create it. Use custom properties only if Informatica Technical Support instructs you to.

To view and update properties, select the Integration Service in the Navigator. The Properties tab for the service appears.

Grid and Node Assignments

You can configure an existing Integration Service to run on a grid or on nodes. If you choose to run the Integration Service on a grid, select the grid. You must have the server grid option to run the Integration Service on a grid. You must create the grid before you can select the grid. For more information about creating grids, see Configuring Resources on page 234. If you configure the Integration Service to run on nodes, choose one or more Integration service process nodes. If you have the high availability option, you can run the Integration Service on multiple nodes. To run the service on multiple nodes, choose the primary and backup nodes.

176

Chapter 8: Creating and Configuring the Integration Service

To edit the grid and node assignment properties, select the Integration Service in the Navigator, and then click the Properties tab > Grid and Node Assignment Properties > Edit. Figure 8-1 shows the node assignment properties when you choose to run the Integration Service on nodes:
Figure 8-1. Node Assignments for an Integration Service

Figure 8-2 shows the grid properties when you choose to run the Integration Service on a grid:
Figure 8-2. Grid Assignments for an Integration Service

Configuring the Integration Service Properties

177

Table 8-3 describes the grid and node assignment properties:

Table 8-3. Grid/Node Assignments for an Integration Service
Property Node Primary Node Required/ Optional Conditional Conditional Description Node on which the Integration Service runs. Required if you run the Integration Service on one node. You can select any node in the domain. Primary node on which the Integration Service runs. Required if you run the Integration Service on nodes and you specify at least one backup node. You can select any node in the domain. Backup node(s) that the Integration Service can run on. If the primary node becomes unavailable, the Integration Service runs on a backup node. You can select one or more nodes as backup nodes. Option available if you have the high availability option and you run the Integration Service on nodes. Code page assigned to the node. Required if you run the Integration Service on nodes. Ensure that the code page for the Integration Service process node meets all requirements. For a list of requirements, see Integration Service Process Code Page on page 341. Grid on which the Integration Service runs. Required if you run the Integration Service on a grid. You can select any grid created in the domain.

Backup Node

Optional

Code Page

Conditional

Assigned Grid

Conditional

General Properties
You can configure general properties for the Integration Service. You can override some of these properties at the session level or workflow level. To override these properties, configure the properties for the session or workflow. To edit the general properties, select the Integration Service in the Navigator, and click the Properties tab > General Properties > Edit.

178

Chapter 8: Creating and Configuring the Integration Service

Figure 8-3 shows the general properties:

Figure 8-3. General Properties for an Integration Service

Table 8-4 describes the general properties:

Table 8-4. General Properties for an Integration Service
Property DataMovementMode Required/ Optional Required Description Mode that determines how the Integration Service handles character data. In ASCII mode, the Integration Service recognizes 7-bit ASCII and EBCDIC characters and stores each character in a single byte. Use ASCII mode when all sources and targets are 7-bit ASCII or EBCDIC character sets. In Unicode mode, the Integration Service recognizes multibyte character sets as defined by supported code pages. Use Unicode mode when sources or targets use 8-bit or multibyte character sets and contain character data. Default is ASCII. To apply changes to this property, restart the Integration Service. Service variable that specifies the email address of the user to receive email when a session completes successfully. Use this variable for the Email User Name attribute for success email. The Integration Service does not expand this variable when you use it for any other email type. Service variable that specifies the email address of the user to receive email when a session fails to complete. Use this variable for the Email User Name attribute for failure email. The Integration Service does not expand this variable when you use it for any other email type.

$PMSuccessEmailUser

Optional

$PMFailureEmailUser

Optional

Configuring the Integration Service Properties

179

Table 8-4. General Properties for an Integration Service

Property $PMSessionLogCount Required/ Optional Required Description Service variable that specifies the number of session logs the Integration Service archives for the session. Minimum value is 0. Default is 0. Service variable that specifies the number of workflow logs the Integration Service archives for the workflow. Minimum value is 0. Default is 0. Service variable that specifies the number of non-fatal errors the Integration Service allows before failing the session. Non-fatal errors include reader, writer, and DTM errors. If you want to stop the session on errors, enter the number of non-fatal errors you want to allow before stopping the session. The Integration Service maintains an independent error count for each source, target, and transformation. Use to configure the Stop On option in the session properties. Defaults to 0. If you use the default setting 0, non-fatal errors do not cause the session to stop. License to which the Integration Service is assigned. Read-only field.

$PMWorkflowLogCount

Required

$PMSessionErrorThreshold

Required

License

n/a

Advanced Properties
You can configure advanced properties for the Integration Service. To edit the advanced properties, select the Integration Service in the Navigator, and then click the Properties tab > Advanced Properties > Edit. Figure 8-4 shows the advanced properties:
Figure 8-4. Advanced Properties for an Integration Service

180

Chapter 8: Creating and Configuring the Integration Service

Table 8-5 describes the advanced properties:

Table 8-5. Advanced Properties for an Integration Service
Property Error Severity Level Required/ Optional Required Description Level of error logging for the domain. These messages are written to the Log Manager and log files. Specify one of the following message levels: - Error. Writes ERROR code messages to the log. - Warning. Writes WARNING and ERROR code messages to the log. - Information. Writes INFO, WARNING, and ERROR code messages to the log. - Tracing. Writes TRACE, INFO, WARNING, and ERROR code messages to the log. - Debug. Writes DEBUG, TRACE, INFO, WARNING, and ERROR code messages to the log. Default is INFO. Maximum amount of time (in seconds) that the service holds on to resources for resilience purposes. This property places a restriction on clients that connect to the service. Any resilience timeouts that exceed the limit are cut off at the limit. If the value of this property is blank, the value is derived from the domain-level settings. Valid values are between 0 and 2,592,000, inclusive. Default is blank. Period of time (in seconds) that the service tries to establish or reestablish a connection to another service. If blank, the value is derived from the domain-level settings. Valid values are between 0 and 2,592,000, inclusive. Default is blank. Appends a timestamp to messages written to the workflow log. Default is No. Allows you to use this Integration Service to run debugger sessions from the Designer. Default is Yes. Ignores task resource requirements when distributing tasks across the nodes of a grid. Used when the Integration Service runs on a grid. Ignored when the Integration Service runs on a node. Enable this option to cause the Load Balancer to ignore task resource requirements. It distributes tasks to available nodes whether or not the nodes have the resources required to run the tasks. Disable this option to cause the Load Balancer to match task resource requirements with node resource availability when distributing tasks. It distributes tasks to nodes that have the required resources. Default is Yes.

Limit on Resilience Timeouts

Optional

Resilience Timeout

Optional

Timestamp Workflow Log Messages Allow Debugging IgnoreResourceRequirements

Optional Optional n/a

Configuring the Integration Service Properties

181

Table 8-5. Advanced Properties for an Integration Service

Property LogsInUTF8 Required/ Optional Optional Description Writes to all logs using the UTF-8 character set. Disable this option to write to the logs using the Integration Service code page. This option is available when you configure the Integration Service to run in Unicode mode. When running in Unicode data movement mode, default is Yes. When running in ASCII data movement mode, default is No. Runs sessions that are impacted by dependency updates. By default, the Integration Service does not run impacted sessions. When you modify a dependent object, the parent object can become invalid. The PowerCenter client marks a session with a warning if the session is impacted. At run time, the Integration Service fails the session if it detects errors. Enter the value for TrustStore using the following syntax:
<path>/<filename>

Run sessions impacted by dependency updates

Optional

TrustStore

Optional

For example:
./Certs/trust.keystore

ClientStore

Optional

Enter the value for ClientStore using the following syntax:

<path>/<filename>

For example:
./Certs/client.keystore

JCEProvider

Optional

Enter the JCEProvider class name to support NTLM authentication. For example: com.unix.crypto.provider.UnixJCE.

Persist Run-time Statistics to Repository

Required

Level of run-time information stored in the repository. Specify one of the following levels: - None. Integration Service does not store any session or workflow run-time information in the repository. - Normal. Integration Service stores workflow details, task details, session statistics, and source and target statistics in the repository. Default is Normal. - Verbose. Integration Service stores workflow details, task details, session statistics, source and target statistics, partition details, and performance details in the repository. To store session performance details in the repository, you must also configure the session to collect performance details and write them to the repository. The Workflow Monitor shows run-time statistics stored in the repository. For more information about each type of run-time statistic, see Monitoring Workflows in the Workflow Administration Guide.

182

Chapter 8: Creating and Configuring the Integration Service

Compatibility and Database Properties

You can configure properties to reinstate previous PowerCenter behavior or to configure database behavior. To edit the compatibility and database properties, select the Integration Service in the Navigator, and then click the Properties tab > Compatibility and Database Properties > Edit. Figure 8-5 shows the compatibility and database properties:
Figure 8-5. Compatibility and Database Properties for an Integration Service

Configuring the Integration Service Properties

183

Table 8-6 describes the compatibility and database properties:

Table 8-6. Compatibility and Database Properties for an Integration Service
Property PMServer3XCompatibility Required/ Optional Optional Description Handles Aggregator transformations as it did in version 3.5. The Integration Service treats null values as zeros in aggregate calculations and performs aggregate calculations before flagging records for insert, update, delete, or reject in Update Strategy expressions. Disable this option to treat null values as NULL and perform aggregate calculations based on the Update Strategy transformation. This overrides both Aggregate treat nulls as zero and Aggregate treat rows as insert. Default is No. Processes master and detail pipelines sequentially as it did in versions prior to 7.0. The Integration Service processes all data from the master pipeline before it processes the detail pipeline. When the target load order group contains multiple Joiner transformations, the Integration Service processes the detail pipelines sequentially. The Integration Service fails sessions when the mapping meets any of the following conditions: - The mapping contains a multiple input group transformation, such as the Custom transformation. Multiple input group transformations require the Integration Service to read sources concurrently. - You configure any Joiner transformation with transaction level transformation scope. Disable this option to process the master and detail pipelines concurrently. Default is No. Treats null values as zero in Aggregator transformations. Disable this option to treat null values as NULL in aggregate calculations. Default is No. Performs aggregate calculations before flagging records for insert, update, delete, or reject in Update Strategy expressions. When set to No, the Integration Service performs aggregate calculations based on the Update Strategy transformation. See Update Strategy Transformation in the Transformation Guide. Default is No.

JoinerSourceOrder6xCompatibility

Optional

AggregateTreatNullAsZero

Optional

AggregateTreatRowAsInsert

Optional

184

Chapter 8: Creating and Configuring the Integration Service

Table 8-6. Compatibility and Database Properties for an Integration Service

Property DateHandling40Compatibility Required/ Optional Optional Description Handles dates as in version 4.0. Disable this option to handle dates as defined in the current version of PowerCenter. Date handling significantly improved in version 4.5. Enable this option to revert to version 4.0 behavior. Default is No. If you have PowerCenter Connect for PeopleSoft, use this option for PeopleSoft sources on Oracle. You cannot, however, use it for PeopleSoft lookup tables on Oracle or PeopleSoft sources on Microsoft SQL Server. Maximum number of connections to a lookup or stored procedure database when you start a session. If the number of connections needed exceeds this value, session threads must share connections. This can result in decreased performance. If blank, the Integration Service allows an unlimited number of connections to the lookup or stored procedure database. If the Integration Service allows an unlimited number of connections, but the database user does not have permission for the number of connections required by the session, the session fails. Minimum value is 0. Default is 0. Maximum number of connections to a Sybase ASE database when you start a session. If the number of connections required by the session is greater than this value, the session fails. Minimum value is 100. Maximum value is 2147483647. Default is 100. Maximum number of connections to a Microsoft SQL Server database when you start a session. If the number of connections required by the session is greater than this value, the session fails. Minimum value is 100. Maximum value is 2147483647. Default is 100. Number of times the Integration Service retries a target write on a database deadlock. Minimum value is 0. Maximum value is 2147483647. Default is 10. Number of seconds before the Integration Service retries a target write on database deadlock. If set to 0 seconds, the Integration Service retries the target write immediately. Minimum value is 0. Maximum value is 2147483647. Default is 0.

TreatCHARasCHARonRead

Optional

Max Lookup SP DB Connections

Optional

Max Sybase Connections

Optional

Max MSSQL Connections

Optional

NumOfDeadlockRetries

Optional

DeadlockSleep

Optional

Configuring the Integration Service Properties

185

Configuration Properties
You can configure session and miscellaneous properties, such as whether to enforce code page compatibility. To edit the configuration properties, select the Integration Service in the Navigator, and then click the Properties tab > Configuration Properties > Edit. Figure 8-6 shows the configuration properties:
Figure 8-6. Configuration Properties for an Integration Service

Table 8-7 describes the configuration properties:

Table 8-7. Configuration Properties for an Integration Service
Property XMLWarnDupRows Required/ Optional Optional Description Writes duplicate row warnings and duplicate rows for XML targets to the session log. Default is Yes. Creates indicator files when you run a workflow with a flat file target. Default is No. Writes column headers to flat file targets. The Integration Service writes the target definition port names to the flat file target in the first line, starting with the # symbol. Default is No.

CreateIndicatorFiles

Optional

OutputMetaDataForFF

Optional

186

Chapter 8: Creating and Configuring the Integration Service

Table 8-7. Configuration Properties for an Integration Service

Property TreatDBPartitionAsPassThrough Required/ Optional Optional Description Uses pass-through partitioning for non-DB2 targets when the partition type is Database Partitioning. Enable this option if you specify Database Partitioning for a non-DB2 target. Otherwise, the Integration Service fails the session. Default is No. Name of an external library file to write session log messages. Determines how the Integration Service evaluates null values in comparison operations. Specify one of the following options: - Null. The Integration Service evaluates null values as NULL in comparison expressions. If either operand is NULL, the result is NULL. - High. The Integration Service evaluates null values as greater than non-null values in comparison expressions. If both operands are NULL, the Integration Service evaluates them as equal. When you choose High, comparison expressions never result in NULL. - Low. The Integration Service evaluates null values as less than non-null values in comparison expressions. If both operands are NULL, the Integration Service treats them as equal. When you choose Low, comparison expressions never result in NULL. Default is NULL. In target-based commit mode, the amount of time in seconds the writer remains idle before it issues a commit when the following conditions are true: - The Integration Service has written data to the target. - The Integration Service has not issued a commit. The Integration Service may commit to the target before or after the configured commit interval. Minimum value is 60. Maximum value is 2147483647. Default is 60. If you configure the timeout to be 0 or a negative number, the Integration Service defaults to 60 seconds. Microsoft Exchange profile used by the Service Start Account to send post-session email. The Service Start Account must be set up as a Domain account to use this feature.

ExportSessionLogLibName TreatNullInComparisonOperatorsAs

Optional Required

WriterWaitTimeOut

Optional

MSExchangeProfile

Optional

Configuring the Integration Service Properties

187

Table 8-7. Configuration Properties for an Integration Service

Property DateDisplayFormat Required/ Optional Required Description Date format the Integration Service uses in log entries. The Integration Service validates the date format you enter. If the date display format is invalid, the Integration Service uses the default date display format. Default is DY MON DD HH 24:MI:SS YYYY. Enforces data code page compatibility. Disable this option to lift restrictions for source and target data code page selection, stored procedure and lookup database code page selection, and session sort order selection. The Integration Service performs data code page validation in Unicode data movement mode only. Option available if you run the Integration Service in Unicode data movement mode. Option disabled if you run the Integration Service in ASCII data movement mode. Default is Yes.

ValidateDataCodePages

Required

HTTP Proxy Properties

You can configure properties for the HTTP proxy server for Web Services and the HTTP transformation. To edit the HTTP proxy properties, select the Integration Service in the Navigator, and click the Properties tab > HTTP Proxy Properties > Edit. Figure 8-7 shows the HTTP proxy properties:
Figure 8-7. HTTP Proxy Properties for an Integration Service

188

Chapter 8: Creating and Configuring the Integration Service

Table 8-8 describes the HTTP proxy properties:

Table 8-8. HTTP Proxy Properties for an Integration Service
Property HttpProxyServer HttpProxyPort HttpProxyUser HttpProxyPassword HttpProxyDomain Required/ Optional Required Required Optional Optional Optional Description Name of the HTTP proxy server. Port number of the HTTP proxy server. This must be a number. Authenticated user name for the HTTP proxy server. This is required if the proxy server requires authentication. Password for the authenticated user. This is required if the proxy server requires authentication. Domain for authentication.

Configuring the Integration Service Properties

189

Configuring the Associated Repository

When you create the Integration Service, you specify the repository associated with the Integration Service. However, you may need to change the repository connection information. For example, you need to update the connection information if the repository is moved to a new database. You may need to choose a different repository when you move from a development repository to a production repository. When you update or choose a new repository, you must specify the repository database user name and password, the Repository Service, and the associated domain. The Administration Console lists the Repository Services defined in the selected domain. The Repository Service and Integration Service can be in different domains. If you want to choose a domain that is not listed in the Administration Console, you can add the connection information for the other domain. To select a Repository Service in a different domain, you must select the domain and Repository Service, and then enter the host and port number for the Repository Service. For more information about multiple domains, see Working with Multiple Domains on page 61. To edit the associated repository properties, select the Integration Service in the Domain tab of the Administration Console, and then click the Properties tab > Associated Repository Properties > Edit. Figure 8-8 shows the associated repository information:
Figure 8-8. Associated Repository for an Integration Service

Table 8-9 describes the associated repository properties:

Table 8-9. Associated Repository for an Integration Service
Property Domain for Associated Repository Service Required/ Optional Required Description Domain that contains the Repository Service associated with the Integration Service. Choose Other to enter domain connection information for a domain that does not exist in the list. To apply changes to this property, restart the Integration Service. Repository Service name to which the Integration Service connects. To apply changes to this property, restart the Integration Service.

Associated Repository Service

Required

190

Chapter 8: Creating and Configuring the Integration Service

Table 8-9. Associated Repository for an Integration Service

Property Repository User Name Required/ Optional Required Description Account used to access the repository. When you first create a repository, the repository user is the database user name. You create other repository users in the Repository Manager. To apply changes to this property, restart the Integration Service. Password for the repository user. When you first create a repository, the password is the password for the database user. To apply changes to this property, restart the Integration Service.

Repository Password

Required

If you want to select a repository from a different domain, click Manage Domain List. The Manage List of Domains window appears:

Table 8-10 shows the domain properties:

Table 8-10. Manage List of Domains Properties
Option Domain Name Host Name Host Port Required/ Optional Required Required Required Description Name of the PowerCenter domain that contains the Repository Service. Host name of the master gateway node for the domain of the Repository Service. Gateway port number for the domain of the Repository Service.

For more information about working with multiple domains, see Working with Multiple Domains on page 61.

Configuring the Associated Repository

191

Configuring the Integration Service Processes

The Integration Service runs each Integration Service process on a different node. When you select the Integration Service in the Administration Console, the Integration Service process nodes appear on the Processes tab. You can change the following properties to configure the way that a node runs an Integration Service process:

Code page Directories for Integration Service files Directories for Java components

You configure properties on the Processes tab in the Administration Console. For information about configuring the Integration Service processes for a grid, see Configuring the Integration Service on page 232.

Code Pages
You must specify the code page of each Integration Service process node. Before you can select a code page for an Integration Service process, you must select an associated repository for the Integration Service. The code page for each Integration Service process node must be a subset of the repository code page. For more information about code pages and compatibility, see Understanding Globalization on page 327.

Directories for Integration Service Files

You must specify the paths for Integration Service files for each Integration Service process. Examples of Integration Service files include run-time files, state of operation files, and session log files. Each Integration Service process uses run-time files to process workflows and sessions. If you configure an Integration Service to run on a grid or to run on backup nodes, the run-time files must be stored in a shared location. Each node must have access to the run-time files used to process a session or workflow. This includes files such as parameter files, cache files, input files, and output files. State of operation files must be accessible by all Integration Service processes. When you enable an Integration Service, it creates files to store the state of operations for the service. The state of operations includes information such as the active service requests, scheduled tasks, and completed and running processes. If the service fails, the Integration Service can restore the state and recover operations from the point of interruption. All Integration Service processes associated with an Integration Service must use the same shared location. However, each Integration Service can use a separate location.

192

Chapter 8: Creating and Configuring the Integration Service

By default, the installation program creates a set of Integration Service directories in the server\infa_shared directory. You can set the shared location for these directories by configuring the process variable $PMRootDir to point to the same location for each Integration Service process. You must specify the directory path for each type of file. You specify the following directories using service process variables:
Directory Root directory Session log subdirectory Bad file subdirectory Cache file subdirectory Target file subdirectory Source file subdirectory External procedure file subdirectory Temporary subdirectory Workflow log subdirectory Lookup file subdirectory Storage subdirectory Service Process Variable $PMRootDir $PMSessionLogDir $PMBadFileDir $PMCacheDir $PMTargetFileDir $PMSourceFileDir $PMExtProcDir $PMTempDir $PMWorkflowLogDir $PMLookupFileDir $PMStorageDir Description Root directory for all subdirectories. Stores session logs. Stores reject files. Stores index and data cache files. Stores target files. Stores source files. Stores external procedure files. Stores temporary files. Stores workflow logs. Stores lookup files. Stores run-time files that are used to recover a workflow or session. These files store the state of each workflow and session operation. If the session or workflow fail, the Integration Service uses these files to determine the point of failure to recover the session or workflow. For more information about recovering a session or workflow, see Recovering Workflows in the Workflow Administration Guide.

Directories for Java Components

You must specify the directory containing the Java components. The Integration Service uses the Java components for the following PowerCenter components:

Custom transformation that uses Java coding Java transformation PowerCenter Connect for JMS PowerCenter Connect for Web Services PowerCenter Connect for webMethods

Configuring the Integration Service Processes

193

Configuring Properties for a Service Process

You can configure the following types of properties for an Integration Service process:

General. You can configure properties such as code pages and directories. For more information, see General Properties on page 194. Custom. Configure Integration Service process properties that are unique to your PowerCenter environment or that apply in special cases. For more information, see Custom Properties on page 196. Environment variables. Specify environment variables for each Repository Service process. For more information, see Environment Variables on page 196.

General Properties
You configure a code page for each Integration Service process node. If you are running the Integration Service with high availability or on a grid, you can use a different code page for each Integration Service process node. However, all codes pages for the Integration Service process nodes must be compatible. When you configure the Integration Service process properties, you also specify the paths for the root directory and its subdirectories. You set the root directory in the $PMRootDir service process variable. The syntax for $PMRootDir is different for Windows and UNIX:

Windows. Enter a path beginning with a drive letter, colon, backslash, as follows:
C:\Informatica\PowerCenter8.1\server\infa_shared

UNIX. Enter an absolute path beginning with a slash, as follows:

/Informatica/PowerCenter8.1/server/infa_shared

You set the subdirectories for the other types of files in other service process variables, such as $PMSessionLogDir, $PMBadFileDir, and $PMCacheDir. You can use the $PMRootDir service process variable to define the other service process variable values. For example, you can set the session log directory in the $PMSessionLogDir service process variable as:
$PMRootDir/SessLogs

You can also specify an absolute directory for the service process variables. Make sure all directories specified for service process variables exist before running a workflow. To configure the general properties, in the Navigator of the Administration Console, select the Integration Service, and click the Processes tab > Edit.

194

Chapter 8: Creating and Configuring the Integration Service

Figure 8-9 shows the general properties for an Integration Service process:
Figure 8-9. General Properties for an Integration Service Process

Table 8-11 describes the general properties for an Integration Service process:
Table 8-11. General Properties for an Integration Service Process
Property Codepage Required/ Optional Required Description Code page for the Integration Service process. The node that runs this process uses this code page when it extracts, transforms, or loads data. When you edit this property, the field displays code pages that are a subset of the associated Repository Service code page. Root directory accessible by the node. This is the root directory for other service process variables. Default is C:\Informatica\PowerCenter8.1.0\server\infa_shared Default directory for session logs. Default is $PMRootDir/SessLogs. Default directory for reject files. Default is $PMRootDir/BadFiles. Default directory for index and data cache files. You can increase performance when the cache directory is a drive local to the Integration Service process. Do not use a mapped or mounted drive for cache files. Default is $PMRootDir/Cache. Default directory for target files. Default is $PMRootDir/TgtFiles. Default directory for source files. Default is $PMRootDir/SrcFiles. Default directory for external procedures. Default is $PMRootDir/ ExtProc. Default directory for temporary files. Default is $PMRootDir/Temp. Default directory for workflow logs. Default is $PMRootDir/ WorkflowLogs. Default directory for lookup files. Default is $PMRootDir/LkpFiles.

$PMRootDir

Required

$PMSessionLogDir $PMBadFileDir $PMCacheDir

Required Required Required

$PMTargetFileDir $PMSourceFileDir $PMExtProcDir $PMTempDir $PMWorkflowLogDir $PMLookupFileDir

Required Required Required Required Required Required

Configuring the Integration Service Processes

195

Table 8-11. General Properties for an Integration Service Process

Property $PMStorageDir Required/ Optional Required Description Default directory for run-time files. The Integration Service uses these files for recovery if you have the high availability option. Default is $PMRootDir/Storage. Java SDK classpath. You can set the CLASSPATH to any JAR files you need to run a session that require java components. The Integration Service appends the values you set to the system CLASSPATH. For more information, see Directories for Java Components on page 193. Minimum amount of memory the Java SDK uses during a session. If the session fails due to a lack of memory, you may want to increase this value. Default is 32 MB. Maximum amount of memory the Java SDK uses during a session. If the session fails due to a lack of memory, you may want to increase this value. Default is 64 MB.

Java SDK ClassPath

Optional

Java SDK Minimum Memory

Optional

Java SDK Maximum Memory

Optional

Custom Properties
If required, you can also configure custom properties for each node assigned to the Integration Service. Custom properties include properties that are unique to your PowerCenter environment or that apply in special cases. An Integration Service process has no custom properties when you initially create it. Use custom properties only if Informatica Technical Support instructs you to.

Environment Variables
You can set or alter environment variables for an Integration Service process on a particular node. You might want to specify environment variables for an Integration Service process if you need to use different environment variables for application services that run on a node.

196

Chapter 8: Creating and Configuring the Integration Service

Chapter 9

Integration Service Architecture

This chapter includes the following topics:

Overview, 198 Integration Service Connectivity, 200 Integration Service Process, 201 Load Balancer, 204 Data Transformation Manager (DTM) Process, 208 Processing Threads, 211 DTM Processing, 215 Grids, 217 System Resources, 220 Code Pages and Data Movement Modes, 222 Output Files and Caches, 223

197

Overview
The Integration Service moves data from sources to targets based on workflow and mapping metadata stored in a repository. When a workflow starts, the Integration Service retrieves mapping, workflow, and session metadata from the repository. It extracts data from the mapping sources and stores the data in memory while it applies the transformation rules configured in the mapping. The Integration Service loads the transformed data into one or more targets. Figure 9-1 shows the processing path between the Integration Service, repository, source, and target:
Figure 9-1. Integration Service and Data Movement
Source Source Data Integration Service Transformed Data Target

Instructions from Metadata

Repository

To move data from sources to targets, the Integration Service uses the following components:

Integration Service process. The Integration Service starts one or more Integration Service processes to run and monitor workflows. When you run a workflow, the Integration Service process starts and locks the workflow, runs the workflow tasks, and starts the process to run sessions. For more information about the Integration Service process, see Integration Service Process on page 201. Load Balancer. The Integration Service uses the Load Balancer to dispatch tasks. The Load Balancer dispatches tasks to achieve optimal performance. It may dispatch tasks to a single node or across the nodes in a grid. For more information about the Load Balancer, see Load Balancer on page 204. Data Transformation Manager (DTM) process. The Integration Service starts a DTM process to run each Session and Command task within a workflow. The DTM process performs session validations, creates threads to initialize the session, read, write, and transform data, and handles pre- and post- session operations. For more information about the DTM process, see Data Transformation Manager (DTM) Process on page 208.

The Integration Service can achieve high performance using symmetric multi-processing systems. It can start and run multiple tasks concurrently. It can also concurrently process partitions within a single session. When you create multiple partitions within a session, the Integration Service creates multiple database connections to a single source and extracts a

198

Chapter 9: Integration Service Architecture

separate range of data for each connection. It also transforms and loads the data in parallel. For more information about partitioning, see Processing Threads on page 211. You can create an Integration Service on a Windows or UNIX server machine. For more information about installation requirements, see the Installation and Configuration Guide. You can configure the Integration Service using the Administration Console or the pmcmd command line program. For more information about the Administration Console, see Using the Administration Console on page 11. For more information about pmcmd, see pmcmd Command Reference in the Command Line Reference.

Overview

199

Integration Service Connectivity

The Integration Service connects to the following PowerCenter components:

PowerCenter Client Repository Service Source and target databases

The Integration Service is a repository client application. It connects to the Repository Service to retrieve workflow and mapping metadata from the repository database. When the Integration Service process requests a repository connection, the request is routed through the master gateway, which sends back Repository Service information to the Integration Service process. The Integration Service process connects to the Repository Service. The Repository Service connects to the repository and performs repository metadata transactions for the client application. The Workflow Manager communicates with the Integration Service process over a TCP/IP connection. The Workflow Manager communicates with the Integration Service process each time you schedule or edit a workflow, display workflow details, and request workflow and session logs. Use the connection information defined for the domain to access the Integration Service from the Workflow Manager. The Integration Service process connects to the source or target database using ODBC or native drivers. The Integration Service process maintains a database connection pool for stored procedures or lookup databases in a workflow. The Integration Service process allows an unlimited number of connections to lookup or stored procedure databases. If a database user does not have permission for the number of connections a session requires, the session fails. You can optionally set a parameter to limit the database connections. For a session, the Integration Service process holds the connection as long as it needs to read data from source tables or write data to target tables. Table 9-1 summarizes the software you need to connect the Integration Service to the platform components, source databases, and target databases:
Table 9-1. Connectivity Requirements for an Integration Service
Integration Service Connection PowerCenter Client Other Integration Service Processes Repository Service Source and target databases Connectivity Requirement TCP/IP TCP/IP TCP/IP Native database drivers or ODBC

Note: Both the Windows and UNIX versions of the Integration Service can use ODBC drivers to connect to databases. Use native drivers to improve performance.

200

Chapter 9: Integration Service Architecture

Integration Service Process

The Integration Service starts an Integration Service process to run and monitor workflows. The Integration Service process accepts requests from the PowerCenter Client and from pmcmd. It performs the following tasks:

Manages workflow scheduling. Locks and reads the workflow. Reads the parameter file. Creates the workflow log. Runs workflow tasks and evaluates the conditional links connecting tasks. Starts the DTM process or processes to run the session. Writes historical run information to the repository. Sends post-session email in the event of a DTM failure.

Managing Workflow Scheduling

The Integration Service process manages workflow scheduling in the following situations:

When you start the Integration Service. When you start the Integration Service, it queries the repository for a list of workflows configured to run on it. When you save a workflow. When you save a workflow assigned to an Integration Service to the repository, the Integration Service process adds the workflow to or removes the workflow from the schedule queue.

Locking and Reading the Workflow

When the Integration Service process starts a workflow, it requests an execute lock on the workflow from the repository. The execute lock allows the Integration Service process to run the workflow and prevents you from starting the workflow again until it completes. If the workflow is already locked, the Integration Service process cannot start the workflow. A workflow may be locked if it is already running. The Integration Service process also reads the workflow from the repository at workflow run time. The Integration Service process reads all links and tasks in the workflow except sessions and worklet instances. The Integration Service process reads session instance information from the repository. The DTM retrieves the session and mapping from the repository at session run time. The Integration Service process reads worklets from the repository when the worklet starts. For more information about locking, Managing Repository User Connections and Locks on page 137.

Integration Service Process

201

Reading the Parameter File

When the workflow starts, the Integration Service process checks the workflow properties for use of a parameter file. If the workflow uses a parameter file, the Integration Service process reads the parameter file and expands the variable values for the workflow and any worklets invoked by the workflow. The parameter file can also contain mapping variables, mapping parameters, and session parameters for sessions in the workflow. When starting the DTM, the Integration Service process passes the parameter file name to the DTM. For more information about the parameter file, see Parameter Files in the Workflow Administration Guide.

Creating the Workflow Log

The Integration Service process creates a log for the workflow. The workflow log contains a history of the workflow run, including initialization, workflow task status, and error messages. You can use information in the workflow log in conjunction with the Integration Service log and session log to troubleshoot system, workflow, or session problems. For more information about workflow logs, see Session and Workflow Logs in the Workflow Administration Guide.

Running Workflow Tasks

The Integration Service process runs workflow tasks according to the conditional links connecting the tasks. Links define the order of execution for workflow tasks. When a task in the workflow completes, the Integration Service process evaluates the completed task according to specified conditions, such as success or failure. Based on the result of the evaluation, the Integration Service process runs successive links and tasks. For more information about workflows and workflow tasks, see Working with Workflows in the Workflow Administration Guide.

Running Workflows Across the Nodes in a Grid

When you run an Integration Service on a grid, the service processes run workflow tasks across the nodes of the grid. The domain designates one service process as the master service process. The master service process monitors the worker service processes running on separate nodes. The worker service processes run workflows across the nodes in a grid. For more information about grids, see Grids on page 217.

Starting the DTM Process

When the workflow reaches a session, the Integration Service process starts the DTM process. The Integration Service process provides the DTM process with session and parameter file information that allows the DTM to retrieve the session and mapping metadata from the

202

Chapter 9: Integration Service Architecture

repository. When you run a session on a grid, the worker service process starts multiple DTM processes that run groups of session threads. For more information about the DTM process, see Data Transformation Manager (DTM) Process on page 208. For more information about the DTM processes that run in a grid, see Grids on page 217.

Writing Historical Information to the Repository

The Integration Service process monitors the status of workflow tasks during the workflow run. When workflow tasks start or finish, the Integration Service process writes historical run information to the repository. Historical run information for tasks includes start and completion times and completion status. Historical run information for sessions also includes source read statistics, target load statistics, and number of errors. You can view this information using the Workflow Monitor. For more information about using the Workflow Monitor, see Monitoring Workflows in the Workflow Administration Guide.

Sending Post-Session Email

The Integration Service process sends post-session email if the DTM terminates abnormally. The DTM sends post-session email in all other cases. For more information about postsession email, see Sending Email in the Workflow Administration Guide.

Integration Service Process

203

Load Balancer
The Load Balancer is a component of the Integration Service that dispatches tasks to achieve optimal performance and scalability. When you run a workflow, the Load Balancer dispatches the Session, Command, and predefined Event-Wait tasks within the workflow. The Load Balancer matches task requirements with resource availability to identify the best node to run a task. It dispatches the task to an Integration Service process running on the node. It may dispatch tasks to a single node or across nodes. The Load Balancer dispatches tasks in the order it receives them. When the Load Balancer needs to dispatch more Session and Command tasks than the Integration Service can run, it places the tasks it cannot run in a queue. When nodes become available, the Load Balancer dispatches tasks from the queue in the order determined by the workflow service level. The following concepts describe Load Balancer functionality:

Dispatch process. The Load Balancer performs several steps to dispatch tasks. For more information, see Dispatch Process on page 204. Resources. The Load Balancer can use PowerCenter resources to determine if it can dispatch a task to a node. For more information, see Resources on page 205. Resource provision thresholds. The Load Balancer uses resource provision thresholds to determine whether it can start additional tasks on a node. For more information, see Resource Provision Thresholds on page 206. Dispatch mode. The dispatch mode determines how the Load Balancer selects nodes for dispatch. For more information, see Dispatch Mode on page 206. Service levels. When multiple tasks are waiting in the dispatch queue, the Load Balancer uses service levels to determine the order in which to dispatch tasks from the queue. For more information, see Service Levels on page 207.

Dispatch Process
The Load Balancer uses different criteria to dispatch tasks depending on whether the Integration Service runs on a node or a grid.

204

Chapter 9: Integration Service Architecture

Dispatching Tasks on a Node

When the Integration Service runs on a node, the Load Balancer performs the following steps to dispatch a task: 1. The Load Balancer checks resource provision thresholds on the node. If dispatching the task causes any threshold to be exceeded, the Load Balancer places the task in the dispatch queue, and it dispatches the task later. The Load Balancer checks different thresholds depending on the dispatch mode. For more information about thresholds, see Resource Provision Thresholds on page 206. For more information about the dispatch mode, see Dispatch Mode on page 206. 2. The Load Balancer dispatches all tasks to the node that runs the master Integration Service process.

Dispatching Tasks Across a Grid

When the Integration Service runs on a grid, the Load Balancer performs the following steps to determine on which node to run a task: 1. 2. The Load Balancer verifies which nodes are currently running and enabled. If you configure the Integration Service to check resource requirements, the Load Balancer identifies nodes that have the PowerCenter resources required by the tasks in the workflow. For more information, see Resources on page 205. 3. The Load Balancer verifies that the resource provision thresholds on each candidate node are not exceeded. If dispatching the task causes a threshold to be exceeded, the Load Balancer places the task in the dispatch queue, and it dispatches the task later. The Load Balancer checks thresholds based on the dispatch mode. For more information, see Resource Provision Thresholds on page 206. 4. The Load Balancer selects a node based on the dispatch mode. For more information, see Dispatch Mode on page 206. For more information about grids, see Grids on page 217.

Resources
You can configure the Integration Service to check the resources available on each node and match them with the resources required to run the task. If you configure the Integration Service to run on a grid and to check resources, the Load Balancer dispatches a task to a node where the required PowerCenter resources are available. For example, if a session uses an SAP source, the Load Balancer dispatches the session only to nodes where the SAP client is installed. If no available node has the required resources, the Integration Service fails the task. You configure the Integration Service to check resources in the Administration Console. For more information about configuring the Integration Service to check resource requirements, see Configuring the Integration Service Properties on page 176.
Load Balancer 205

You define resources available to a node in the Administration Console. For information about defining available resources, see Configuring Resources on page 234. You assign resources required by a task in the task properties. For information about assigning required resources, see Working with the Load Balancer in the Workflow Administration Guide. The Integration Service writes resource requirements and availability information in the workflow log.

Resource Provision Thresholds

The Load Balancer uses resource provision thresholds to determine the maximum load acceptable for a node. The Load Balancer can dispatch a task to a node when dispatching the task does not cause the resource provision thresholds to be exceeded. The Load Balancer checks the following thresholds:

Maximum CPU Run Queue Length. The maximum number of runnable threads waiting for CPU resources on the node. The Load Balancer excludes the node if the maximum number of waiting threads is exceeded. The Load Balancer checks this threshold in all dispatch modes. Maximum Memory %. The maximum percentage of virtual memory allocated on the node relative to the total physical memory size. The Load Balancer excludes the node if dispatching the task causes this threshold to be exceeded. The Load Balancer checks this threshold in metric-based and adaptive dispatch modes. Maximum Processes. The maximum number of running Session and Command tasks allowed for each Integration Service process running on the node. The Load Balancer excludes the node if dispatching the task causes this threshold to be exceeded. The Load Balancer checks this threshold in metric-based and adaptive dispatch modes.

If all nodes in the grid have reached the resource provision thresholds before any PowerCenter task has been dispatched, the Load Balancer dispatches tasks one at a time to ensure that PowerCenter tasks are still executed. You define resource provision thresholds in the node properties in the Administration Console. For information about configuring the resource provision thresholds for a node, see Managing Nodes on page 43.

Dispatch Mode
The dispatch mode determines how the Load Balancer selects nodes to distribute workflow tasks. The Load Balancer uses the following dispatch modes:

Round-robin. The Load Balancer dispatches tasks to available nodes in a round-robin fashion. It checks the Maximum Processes threshold on each available node and excludes a node if dispatching a task causes the threshold to be exceeded. This mode is the least compute-intensive and is useful when the load on the grid is even and the tasks to dispatch have similar computing requirements.

206

Chapter 9: Integration Service Architecture

Metric-based. The Load Balancer evaluates nodes in a round-robin fashion. It checks all resource provision thresholds on each available node and excludes a node if dispatching a task causes the thresholds to be exceeded. The Load Balancer continues to evaluate nodes until it finds a node that can accept the task. This mode prevents overloading nodes when tasks have uneven computing requirements. Adaptive. The Load Balancer ranks nodes according to current CPU availability. It checks all resource provision thresholds on each available node and excludes a node if dispatching a task causes the thresholds to be exceeded. This mode prevents overloading nodes and ensures the best performance on a grid that is not heavily loaded.

When the Load Balancer runs in metric-based or adaptive mode, it uses task statistics to determine whether a task can run on a node. The Load Balancer averages statistics from the last three runs of the task to estimate the computing resources required to run the task. If no statistics exist in the repository, the Load Balancer uses default values. For more information, see Metric-Based Dispatch Mode on page 242 and Adaptive Dispatch Mode on page 243. In adaptive dispatch mode, the Load Balancer can use the CPU profile for the node to identify the node with the most computing resources. For more information, see Calculating the CPU Profile on page 248. You configure the dispatch mode in the domain properties in the Administration Console. For more information, see Configuring the Dispatch Mode on page 241.

Service Levels
Service levels establish priority among tasks that are waiting to be dispatched. When the Load Balancer has more Session and Command tasks to dispatch than the Integration Service can run at the time, the Load Balancer places the tasks in the dispatch queue. When nodes become available, the Load Balancer dispatches tasks from the queue. The Load Balancer uses service levels to determine the order in which to dispatch tasks from the queue. Each service level has the following properties:

Name. Name of the service level. Dispatch priority. A number that establishes the task priority in the dispatch queue. The Load Balancer dispatches tasks with high priority before it dispatches tasks with low priority. When multiple tasks in the queue have the same dispatch priority, the Load Balancer dispatches the tasks in the order it receives them. Maximum dispatch wait time. The amount of time a task can wait in the dispatch queue before the Load Balancer changes its dispatch priority to the maximum priority. This ensures that no task waits forever in the dispatch queue.

You create and edit service levels in the domain properties in the Administration Console. For more information, see Creating Service Levels on page 244. You assign service levels to workflows in the workflow properties in the Workflow Manager. For more information, see Working with the Load Balancer in the Workflow Administration Guide.

Load Balancer

207

Data Transformation Manager (DTM) Process

When the workflow reaches a session, the Integration Service process starts the DTM process. The DTM is the process associated with the session task. The DTM process performs the following tasks:

Retrieves and validates session information from the repository. Performs pushdown optimization when the session is configured for pushdown optimization. Adds partitions to the session when the session is configured for dynamic partitioning. Forms partition groups when the session is configured to run on a grid. Expands the service process variables, session parameters, and mapping variables and parameters. Creates the session log. Validates source and target code pages. Verifies connection object permissions. Runs pre-session shell commands, stored procedures, and SQL. Sends a request to start worker DTM processes on other nodes when the session is configured to run on a grid. Creates and runs mapping, reader, writer, and transformation threads to extract, transform, and load data. Runs post-session stored procedures, SQL, and shell commands. Sends post-session email.

Reading the Session Information

The Integration Service process provides the DTM with session instance information when it starts the DTM. The DTM retrieves the mapping and session metadata from the repository and validates it.

Performing Pushdown Optimization

If the session is configured for pushdown optimization, the DTM runs a SQL statement to push transformation logic to the source or target database.

Creating Dynamic Partitions

The DTM adds partitions to the session if you configure the session for dynamic partitioning. The DTM scales the number of session partitions based on factors such as source database partitions or the number of nodes in a grid.

208

Chapter 9: Integration Service Architecture

Forming Partition Groups

If you run a session on a grid, the DTM forms partition groups. A partition group is a group of reader, writer, and transformation threads that runs in a single DTM process. The DTM process forms partition groups and distributes them to worker DTM processes running on nodes in the grid.

Expanding Variables and Parameters

If the workflow uses a parameter file, the Integration Service process sends the parameter file to the DTM when it starts the DTM. The DTM creates and expands session-level, Integration Service-level, and mapping-level variables and parameters. For more information about the parameter file, see Parameter Files in the Workflow Administration Guide.

Creating the Session Log

The DTM creates logs for the session. The session log contains a complete history of the session run, including initialization, transformation, status, and error messages. You can use information in the session log in conjunction with the Integration Service log and the workflow log to troubleshoot system or session problems. For more information about session logs, see Session and Workflow Logs in the Workflow Administration Guide.

Validating Code Pages

The Integration Service processes data internally using the UCS-2 character set. When you disable data code page validation, the Integration Service verifies that the source query, target query, lookup database query, and stored procedure call text convert from the source, target, lookup, or stored procedure data code page to the UCS-2 character set without loss of data in conversion. If the Integration Service encounters an error when converting data, it writes an error message to the session log.

Verifying Connection Object Permissions

After validating the session code pages, the DTM verifies permissions for connection objects used in the session. The DTM verifies that the user who started the Integration Service and the user who started or scheduled the workflow has execute permissions for connection objects associated with the session.

Starting Worker DTM Processes

The DTM sends a request to the Integration Service process to start worker DTM processes on other nodes when the session is configured to run on a grid.

Data Transformation Manager (DTM) Process

209

Running Pre-Session Operations

After verifying connection object permissions, the DTM runs pre-session shell commands. The DTM then runs pre-session stored procedures and SQL commands.

Running the Processing Threads

After initializing the session, the DTM uses reader, transformation, and writer threads to extract, transform, and load data. The number of threads the DTM uses to run the session depends on the number of partitions configured for the session. For more information about reader, transformation, and writer threads, see Processing Threads on page 211.

Running Post-Session Operations

After the DTM runs the processing threads, it runs post-session SQL commands and stored procedures. The DTM then runs post-session shell commands.

Sending Post-Session Email

When the session finishes, the DTM composes and sends email that reports session completion or failure. If the DTM terminates abnormally, the Integration Service process sends post-session email. For more information about post-session email, see Sending Email in the Workflow Administration Guide.

210

Chapter 9: Integration Service Architecture

Processing Threads
The DTM allocates process memory for the session and divides it into buffers. This is also known as buffer memory. The default memory allocation is 12,000,000 bytes. The DTM uses multiple threads to process data in a session. The main DTM thread is called the master thread. The master thread creates and manages other threads. The master thread for a session can create mapping, pre-session, post-session, reader, transformation, and writer threads. For more information, see Thread Types on page 212. For each target load order group in a mapping, the master thread can create several threads. The types of threads depend on the session properties and the transformations in the mapping. The number of threads depends on the partitioning information for each target load order group in the mapping. For more information about target load order groups, see Reading Source Data on page 215. For more information about partitioning, see Pipeline Partitioning on page 213. Figure 9-2 shows the threads the master thread creates for a simple mapping that contains one target load order group:
Figure 9-2. Thread Creation for a Simple Mapping

1 Reader Thread

1 Transformation Thread

1 Writer Thread

The mapping in Figure 9-2 contains a single partition. In this case, the master thread creates one reader, one transformation, and one writer thread to process the data. The reader thread controls how the Integration Service process extracts source data and passes it to the source qualifier, the transformation thread controls how the Integration Service process handles the data, and the writer thread controls how the Integration Service process loads data to the target. When the pipeline contains only a source definition, source qualifier, and a target definition, the data bypasses the transformation threads, proceeding directly from the reader buffers to the writer. This type of pipeline is a pass-through pipeline.

Processing Threads

211

Figure 9-3 shows the threads for a pass-through pipeline with one partition:
Figure 9-3. Thread Creation for a Pass-through Pipeline

1 Reader Thread

Bypassed Transformation Thread

1 Writer Thread

Note: The previous examples assume that each session contains a single partition. For

information on how partitions and partition points affect thread creation, see Pipeline Partitioning on page 213.

Thread Types
The master thread creates different types of threads for a session. The types of threads the master thread creates depend on the pre- and post-session properties, as well as the types of transformations in the mapping. The master thread can create the following types of threads:

Mapping Threads Pre- and Post-Session Threads Reader Threads Transformation Threads Writer Threads

Mapping Threads
The master thread creates one mapping thread for each session. The mapping thread fetches session and mapping information, compiles the mapping, and cleans up after session execution.

Pre- and Post-Session Threads

The master thread creates one pre-session and one post-session thread to perform pre- and post-session operations.

Reader Threads
The master thread creates reader threads to extract source data. The number of reader threads depends on the partitioning information for each pipeline. The number of reader threads equals the number of partitions. Relational sources use relational reader threads, and file sources use file reader threads.
212 Chapter 9: Integration Service Architecture

The Integration Service creates an SQL statement for each reader thread to extract data from a relational source. For file sources, the Integration Service can create multiple threads to read a single source.

Transformation Threads
The master thread creates one or more transformation threads for each partition. Transformation threads process data according to the transformation logic in the mapping. The master thread creates transformation threads to transform data received in buffers by the reader thread, move the data from transformation to transformation, and create memory caches when necessary. The number of transformation threads depends on the partitioning information for each pipeline. Transformation threads store fully-transformed data in a buffer drawn from the memory pool for subsequent access by the writer thread. If the pipeline contains a Rank, Joiner, Aggregator, Sorter, or a cached Lookup transformation, the transformation thread uses cache memory until it reaches the configured cache size limits. If the transformation thread requires more space, it pages to local cache files to hold additional data. When the Integration Service runs in ASCII mode, the transformation threads pass character data in single bytes. When the Integration Service runs in Unicode mode, the transformation threads use double bytes to move character data.

Writer Threads
The master thread creates one writer thread for each partition if a target exists in the source pipeline. Relational targets use relational writer threads, and file targets use file writer threads. The master thread creates writer threads to load target data. The number of writer threads depends on the partitioning information for each pipeline. If the pipeline contains one partition, the master thread creates one writer thread. If it contains multiple partitions, the master thread creates multiple writer threads. Each writer thread creates connections to the target databases to load data. If the target is a file, each writer thread creates a separate file. You can configure the session to merge these files. If the target is relational, the writer thread takes data from buffers and commits it to session targets. When loading targets, the writer commits data based on the commit interval in the session properties. You can configure a session to commit data based on the number of source rows read, the number of rows written to the target, or the number of rows that pass through a transformation that generates transactions, such as a Transaction Control transformation.

Pipeline Partitioning
When running sessions, the Integration Service process can achieve high performance by partitioning the pipeline and performing the extract, transformation, and load for each

Processing Threads

213

partition in parallel. To accomplish this, use the following session and Integration Service configuration:

Configure the session with multiple partitions. Install the Integration Service on a machine with multiple CPUs.

You can configure the partition type at most transformations in the pipeline. The Integration Service can partition data using round-robin, hash, key-range, database partitioning, or passthrough partitioning. You can also configure a session for dynamic partitioning to enable the Integration Service to set partitioning at run time. When you enable dynamic partitioning, the Integration Service scales the number of session partitions based on factors such as the source database partitions or the number of nodes in a grid. For relational sources, the Integration Service creates multiple database connections to a single source and extracts a separate range of data for each connection. The Integration Service transforms the partitions concurrently, it passes data between the partitions as needed to perform operations such as aggregation. When the Integration Service loads relational data, it creates multiple database connections to the target and loads partitions of data concurrently. When the Integration Service loads data to file targets, it creates a separate file for each partition. You can choose to merge the target files. Figure 9-4 shows a mapping that contains two partitions:
Figure 9-4. Partitioned Mapping
Source Transformations Target

For more information about pipeline partitioning, see Understanding Pipeline Partitioning in the Workflow Administration Guide.

214

Chapter 9: Integration Service Architecture

DTM Processing
When you run a session, the DTM process reads source data and passes it to the transformations for processing. To help understand DTM processing, consider the following DTM process actions:

Reading source data. The DTM reads the sources in a mapping at different times depending on how you configure the sources, transformations, and targets in the mapping. For more information about reading data, see Reading Source Data on page 215. Blocking data. The DTM sometimes blocks the flow of data at a transformation in the mapping while it processes a row of data from a different source. For more information about blocking data, see Blocking Data on page 216. Block processing. The DTM reads and processes a block of rows at a time. For more information, see Block Processing on page 216.

Reading Source Data

You create a session based on a mapping. Mappings contain one or more target load order groups. A target load order group is the collection of source qualifiers, transformations, and targets linked together in a mapping. Each target load order group contains one or more source pipelines. A source pipeline consists of a source qualifier and all of the transformations and target instances that receive data from that source qualifier. By default, the DTM reads sources in a target load order group concurrently, and it processes target load order groups sequentially. You can configure the order that the DTM processes target load order groups. For more information about setting the target load order, see Mappings in the Designer Guide. Figure 9-5 shows a mapping that contains two target load order groups and three source pipelines:
Figure 9-5. Target Load Order Groups and Source Pipelines
Sources Transformations Targets Pipeline A

T1 Target Load Order Group 1

T2

Pipeline B C T3 Target Load Order Group 2 Pipeline C

DTM Processing

215

In the mapping shown in Figure 9-5, the DTM processes the target load order groups sequentially. It first processes Target Load Order Group 1 by reading Source A and Source B at the same time. When it finishes processing Target Load Order Group 1, the DTM begins to process Target Load Order Group 2 by reading Source C.

Blocking Data
You can include multiple input group transformations in a mapping. The DTM passes data to the input groups concurrently. However, sometimes the transformation logic of a multiple input group transformation requires that the DTM block data on one input group while it waits for a row from a different input group. Blocking is the suspension of the data flow into an input group of a multiple input group transformation. When the DTM blocks data, it reads data from the source connected to the input group until it fills the reader and transformation buffers. After the DTM fills the buffers, it does not read more source rows until the transformation logic allows the DTM to stop blocking the source. When the DTM stops blocking a source, it processes the data in the buffers and continues to read from the source. The DTM blocks data at one input group when it needs a specific row from a different input group to perform the transformation logic. After the DTM reads and processes the row it needs, it stops blocking the source.

Block Processing
The DTM reads and processes a block of rows at a time. The number of rows in the block depend on the row size and the DTM buffer size. In the following circumstances, the DTM processes one row in a block:

Log row errors. When you log row errors, the DTM processes one row in a block. Connect CURRVAL. When you connect the CURRVAL port in a Sequence Generator transformation, the session processes one row in a block. For optimal performance, connect only the NEXTVAL port in mappings. For more information, see Sequence Generator Transformation in the Transformation Guide. Configure array-based mode for Custom transformation procedure. When you configure the data access mode for a Custom transformation procedure to be row-based, the DTM processes one row in a block. By default, the data access mode is array-based, and the DTM processes multiple rows in a block. For more information, see Custom Transformation Functions in the Transformation Guide.

216

Chapter 9: Integration Service Architecture

Grids
When you run an Integration Service on a grid, a master service process runs on one node and worker service processes run on the remaining nodes in the grid. The master service process runs the workflow and workflow tasks, and it distributes the Session, Command, and predefined Event-Wait tasks to itself and other nodes. A DTM process runs on each node where a session runs. If you run a session on a grid, a worker service process can run multiple DTM processes on different nodes to distribute session threads.

Running a Workflow on a Grid

When you run a workflow on a grid, the Integration Service designates one service process as the master service process, and the service processes on other nodes as worker service processes. The master service process can run on any node in the grid. The master service process receives requests, runs the workflow and workflow tasks including the Scheduler, and communicates with worker service processes on other nodes. Because it runs on the master service process node, the Scheduler uses the date and time for the master service process node to start scheduled workflows. The master service process also runs the Load Balancer, which dispatches tasks to nodes in the grid. Worker service processes running on other nodes act as Load Balancer agents. The worker service process runs predefined Event-Wait tasks within its process. It starts a process to run Command tasks and a DTM process to run Session tasks. The master service process can also act as a worker service process. So the Load Balancer can distribute Session, Command, and predefined Event-Wait tasks to the node that runs the master service process or to other nodes. For example, you have a workflow that contains two Session tasks, a Command task, and a predefined Event-Wait task. Figure 9-6 shows an example of service process distribution when you run the workflow on a grid:
Figure 9-6. Service Process Distribution for a Workflow Running on a Grid
Node 1 Master Service Process (Load Balancer) - Workflow - Workflow tasks Node 2 Worker Service Process (Load Balancer Agent) Command task Node 3 Worker Service Process (Load Balancer Agent) Predefined Event-Wait task

DTM Process - Session task 1

DTM Process - Session task 2

Grids

217

When you run the workflow on a grid, the Integration Service process distributes the tasks in the following way:

On Node 1, the master service process starts the workflow and runs workflow tasks other than the Session, Command, and predefined Event-Wait tasks. The Load Balancer dispatches the Session, Command, and predefined Event-Wait tasks to other nodes. On Node 2, the worker service process starts a process to run a Command task and starts a DTM process to run Session task 1. On Node 3, the worker service process runs a predefined Event-Wait task and starts a DTM process to run Session task 2.

Running a Session on a Grid

When you run a session on a grid, the master service process runs the workflow and workflow tasks, including the Scheduler. Because it runs on the master service process node, the Scheduler uses the date and time for the master service process node to start scheduled workflows. The Load Balancer distributes Command tasks as it does when you run a workflow on a grid. In addition, when the Load Balancer dispatches a Session task, it distributes the session threads to separate DTM processes. The master service process starts a temporary preparer DTM process that fetches the session and prepares it to run. After the preparer DTM process prepares the session, it acts as the master DTM process, which monitors the DTM processes running on other nodes. The worker service processes start the worker DTM processes on other nodes. The worker DTM runs the session. Multiple worker DTM processes running on a node might be running multiple sessions or multiple partition groups from a single session depending on the session configuration. For example, you run a workflow on a grid that contains one Session task and one Command task. You also configure the session to run on the grid. Figure 9-7 shows the service process and DTM distribution when you run a session on a grid:
Figure 9-7. Service Process and DTM Distribution for a Session Running on a Grid
Node 1 Master Service Process (Load Balancer) - Workflow - Workflow tasks Node 2 Worker Service Process (Load Balancer Agent) Command task Worker DTM Process - Session threads Worker DTM Process - Session threads Worker DTM Process - Session threads Worker DTM Process - Session threads Node 3 Worker Service Process (Load Balancer Agent)

Preparer DTM Process becomes Master DTM Process.

218

Chapter 9: Integration Service Architecture

When the Integration Service process runs the session on a grid, it performs the following tasks:

On Node 1, the master service process runs workflow tasks. It also starts a temporary preparer DTM process, which becomes the master DTM process. The Load Balancer dispatches the Command task and session threads to nodes in the grid. On Node 2, the worker service process runs the Command task and starts the worker DTM processes that run the session threads. On Node 3, the worker service process starts the worker DTM processes that run the session threads.

For information about configuring and managing a grid, see Managing the Grid on page 229. For information about how the DTM distributes session threads into partition groups, see Running Workflows and Sessions on a Grid in the Workflow Administration Guide.

Grids

219

System Resources
To allocate system resources for read, transformation, and write processing, you should understand how the Integration Service allocates and uses system resources. The Integration Service uses the following system resources:

CPU usage DTM buffer memory Cache memory

CPU Usage
The Integration Service process performs read, transformation, and write processing for a pipeline in parallel. It can process multiple partitions of a pipeline within a session, and it can process multiple sessions in parallel. If you have a symmetric multi-processing (SMP) platform, you can use multiple CPUs to concurrently process session data or partitions of data. This provides increased performance, as true parallelism is achieved. On a single processor platform, these tasks share the CPU, so there is no parallelism. The Integration Service process can use multiple CPUs to process a session that contains multiple partitions. The number of CPUs used depends on factors such as the number of partitions, the number of threads, the number of available CPUs, and amount or resources required to process the mapping. For more information about partitioning, see Understanding Pipeline Partitioning in the Workflow Administration Guide.

DTM Buffer Memory

The Integration Service process launches the DTM. The DTM allocates buffer memory to the session based on the DTM Buffer Size setting in the session properties. By default, the Integration Service determines the size of the buffer memory. However, you may want to configure the buffer memory and buffer block size manually. The DTM divides the memory into buffer blocks as configured in the Buffer Block Size setting in the session properties. The reader, transformation, and writer threads use buffer blocks to move data from sources to targets. You can sometimes improve session performance by increasing buffer memory when you run a session handling a large volume of character data and the Integration Service runs in Unicode mode. In Unicode mode, the Integration Service uses double bytes to move characters, so increasing buffer memory might improve session performance. If the DTM cannot allocate the configured amount of buffer memory for the session, the session cannot initialize. Informatica recommends you allocate no more than 1 GB for DTM buffer memory.

220

Chapter 9: Integration Service Architecture

For more information about working with DTM buffer memory, see Working with Sessions in the Workflow Administration Guide.

Cache Memory
The DTM process creates in-memory index and data caches to temporarily store data used by the following transformations:

Aggregator transformation (without sorted input) Rank transformation Joiner transformation Lookup transformation (with caching enabled)

You can configure memory size for the index and data cache in the transformation properties. By default, the Integration Service determines the amount of memory to allocate for caches. However, you can manually configure a cache size for the data and index caches. By default, the DTM creates cache files in the directory configured for the $PMCacheDir service process variable. If the DTM requires more space than it allocates, it pages to local index and data files. The DTM process also creates an in-memory cache to store data for Sorter transformations and XML target transformations. You configure the memory size for the cache in the transformation properties. By default, the Integration Service determines the cache size for the Sorter and XML target transformations at run time. The Integration Service allocates a minimum value of 8,388,608 bytes for the Sorter transformation cache and 1,000,000,000 bytes for the XML Target transformation. The DTM creates cache files in the directory configured for the $PMTempDir service process variable. If the DTM requires more cache space than it allocates, it pages to local cache files. When processing large amounts of data, the DTM may create multiple index and data files. The session does not fail if it runs out of cache memory and pages to the cache files. It does fail, however, if the local directory for cache files runs out of disk space. After the session completes, the DTM releases memory used by the index and data caches and deletes any index and data files. However, if the session is configured to perform incremental aggregation or if a Lookup transformation is configured for a persistent lookup cache, the DTM saves all index and data cache information to disk for the next session run. For more information about caching, see Session Caches in the Workflow Administration Guide. For more information about working with automatic cache calculation, see Working with Sessions in the Workflow Administration Guide.

System Resources

221

Code Pages and Data Movement Modes

You can configure PowerCenter to move single byte and multibyte data. The Integration Service can move data in either ASCII or Unicode data movement mode. These modes determine how the Integration Service handles character data. You choose the data movement mode in the Integration Service configuration settings. If you want to move multibyte data, choose Unicode data movement mode. To ensure that characters are not lost during conversion from one code page to another, you must also choose the appropriate code pages for your connections. For more information, see Code Page Overview on page 336.

ASCII Data Movement Mode

Use ASCII data movement mode when all sources and targets are 7-bit ASCII or EBCDIC character sets. In ASCII mode, the Integration Service recognizes 7-bit ASCII and EBCDIC characters and stores each character in a single byte. When the Integration Service runs in ASCII mode, it does not validate session code pages. It reads all character data as ASCII characters and does not perform code page conversions. It also treats all numerics as U.S. Standard and all dates as binary data. You can also use ASCII data movement mode when sources and targets are 8-bit ASCII.

Unicode Data Movement Mode

Use Unicode data movement mode when sources or targets use 8-bit or multibyte character sets and contain character data. In Unicode mode, the Integration Service recognizes multibyte character sets as defined by supported code pages. If you configure the Integration Service to validate data code pages, the Integration Service validates source and target code page compatibility when you run a session. If you configure the Integration Service for relaxed data code page validation, the Integration Service lifts source and target compatibility restrictions. The Integration Service converts data from the source character set to UCS-2 before processing, processes the data, and then converts the UCS-2 data to the target code page character set before loading the data. The Integration Service allots two bytes for each character when moving data through a mapping. It also treats all numerics as U.S. Standard and all dates as binary data. The Integration Service code page must be a subset of the repository code page. For more information about code page compatibility and validation, see Code Page Compatibility on page 339.

222

Chapter 9: Integration Service Architecture

Output Files and Caches

The Integration Service process generates output files when you run workflows and sessions. By default, the Integration Service logs status and error messages to log event files. Log event files are binary files that the Log Manager uses to display log events. However, you can also configure the workflow or session to generate log files to a specified directory. During each session, the Integration Service also creates a reject file. Depending on transformation cache settings and target types, the Integration Service may create additional files as well. The Integration Service creates the following output files:

Workflow log Session log Session details file Performance details file Reject files Row error logs Recovery tables and files Control file Post-session email Output file Cache files

When the Integration Service process on UNIX creates any file other than a recovery file, it sets the file permissions according to the umask of the shell that starts the Integration Service process. For example, when the umask of the shell that starts the Integration Service process is 022, the Integration Service process creates files with rw-r--r-- permissions. To change the file permissions, you must change the umask of the shell that starts the Integration Service process and then restart it. The Integration Service process on UNIX creates recovery files with rw------- permissions. The Integration Service process on Windows creates files with read and write permissions.

Workflow Log
The Integration Service process creates a workflow log for each workflow it runs. It writes information in the workflow log such as initialization of processes, workflow task run information, errors encountered, and workflow run summary. Workflow log error messages are categorized into severity levels. You can configure the Integration Service to suppress writing messages to the workflow log file. You can view workflow logs from the Workflow Monitor. You can also configure the workflow to write events to a log file in a specified directory.

Output Files and Caches

223

As with Integration Service logs and session logs, the Integration Service process enters a code number into the workflow log file message along with message text. You can find information about error messages in the Troubleshooting Guide. For more information about the workflow log, see Session and Workflow Logs in the Workflow Administration Guide.

Session Log
The Integration Service process creates a session log for each session it runs. It writes information in the session log such as initialization of processes, session validation, creation of SQL commands for reader and writer threads, errors encountered, and load summary. The amount of detail in the session log depends on the tracing level that you set. You can view the session log from the Workflow Monitor. You can also configure the session to write the log information to a log file in a specified directory. As with Integration Service logs and workflow logs, the Integration Service process enters a code number along with message text. You can find information about error messages in the Troubleshooting Guide. For more information about the session log, see Session and Workflow Logs in the Workflow Administration Guide.

Session Details
When you run a session, the Workflow Manager creates session details that provide load statistics for each target in the mapping. You can monitor session details during the session or after the session completes. Session details include information such as table name, number of rows written or rejected, and read and write throughput. You can view this information by double-clicking the session in the Workflow Monitor. For more information about session details file, see Monitoring Workflows in the Workflow Administration Guide.

Performance Detail File

The Integration Service process generates performance details for session runs. The Integration Service process writes the performance details to a file. The file stores performance details for the last session run. You can review a performance details file to determine where session performance can be improved. Performance details provide transformation-by-transformation information on the flow of data through the session. You can also view performance details in the Workflow Monitor if you configure the session to collect performance details. For more information about configuring a session to collect performance details, see Working with Sessions in the Workflow Administration Guide. For more information about performance details, see Monitoring Workflows in the Workflow Administration Guide.
224 Chapter 9: Integration Service Architecture

Reject Files
By default, the Integration Service process creates a reject file for each target in the session. The reject file contains rows of data that the writer does not write to targets. The writer may reject a row in the following circumstances:

It is flagged for reject by an Update Strategy or Custom transformation. It violates a database constraint such as primary key constraint. A field in the row was truncated or overflowed, and the target database is configured to reject truncated or overflowed data.

By default, the Integration Service process saves the reject file in the directory entered for the service process variable $PMBadFileDir in the Workflow Manager, and names the reject file target_table_name.bad.
Note: If you enable row error logging, the Integration Service process does not create a reject

file. For more information about the reject file, see Working with Targets in the Workflow Administration Guide.

Row Error Logs

When you configure a session, you can choose to log row errors in a central location. When a row error occurs, the Integration Service process logs error information that allows you to determine the cause and source of the error. The Integration Service process logs information such as source name, row ID, current row data, transformation, timestamp, error code, error message, repository name, folder name, session name, and mapping information. For more information about row error logging, see Row Error Logging in the Workflow Administration Guide.

Recovery Tables Files

The Integration Service process creates recovery tables on the target database system when it runs a session enabled for recovery. When you run a session in recovery mode, the Integration Service process uses information in the recovery tables to complete the session. When the Integration Service process performs recovery, it restores the state of operations to recover the workflow from the point of interruption. The workflow state of operations includes information such as active service requests, completed and running status, workflow variable values, running workflows and sessions, and workflow schedules. For more information about recovery, see Recovering Workflows in the Workflow Administration Guide.

Control File
When you run a session that uses an external loader, the Integration Service process creates a control file and a target flat file. The control file contains information about the target flat file
Output Files and Caches 225

such as data format and loading instructions for the external loader. The control file has an extension of .ctl. You can view the control file and the target flat file in the target file directory (default: $PMTargetFilesDir). For more information about external loading and control files, see External Loading in the Workflow Administration Guide.

Email
You can compose and send email messages by creating an Email task in the Workflow Designer or Task Developer. You can place the Email task in a workflow, or you can associate it with a session. The Email task allows you to automatically communicate information about a workflow or session run to designated recipients. Email tasks in the workflow send email depending on the conditional links connected to the task. For post-session email, you can create two different messages, one to be sent if the session completes successfully, the other if the session fails. You can also use variables to generate information about the session name, status, and total rows loaded. For more information, see Sending Email in the Workflow Administration Guide.

Indicator File
If you use a flat file as a target, you can configure the Integration Service to create an indicator file for target row type information. For each target row, the indicator file contains a number to indicate whether the row was marked for insert, update, delete, or reject. The Integration Service process names this file target_name.ind and stores it in the same directory as the target file. For more information about configuring the Integration Service, see Creating an Integration Service on page 163.

Output File
If the session writes to a target file, the Integration Service process creates the target file based on a file target definition. By default, the Integration Service process names the target file based on the target definition name. If a mapping contains multiple instances of the same target, the Integration Service process names the target files based on the target instance name. The Integration Service process creates this file in the Integration Service variable directory, $PMTargetFileDir, by default. For more information about working with target files, see Working with Targets in the Workflow Administration Guide.

Cache Files
When the Integration Service process creates memory cache, it also creates cache files. The Integration Service process creates cache files for the following mapping objects:
226

Aggregator transformation Joiner transformation

Chapter 9: Integration Service Architecture

Rank transformation Lookup transformation Sorter transformation XML target

By default, the DTM creates the index and data files for Aggregator, Rank, Joiner, and Lookup transformations and XML targets in the directory configured for the $PMCacheDir service process variable. The Integration Service process names the index file PM*.idx, and the data file PM*.dat. The Integration Service process creates the cache file for a Sorter transformation in the $PMTempDir service process variable directory.

Incremental Aggregation Files

If the session performs incremental aggregation, the Integration Service process saves index and data cache information to disk when the session finished. The next time the session runs, the Integration Service process uses this historical information to perform the incremental aggregation. The Integration Service process names these files PMAGG*.dat and PMAGG*.idx and saves them to the cache directory. For more information about incremental aggregation, see Using Incremental Aggregation in the Workflow Administration Guide.

Persistent Lookup Cache

If a session uses a Lookup transformation, you can configure the transformation to use a persistent lookup cache. With this option selected, the Integration Service process saves the lookup cache to disk the first time it runs the session, and then uses this lookup cache during subsequent session runs. These files are saved in the cache directory. If you do not name the files in the transformation properties, these files are named PMLKUP*.idx and PMLKUP*.dat. For more information about lookup caching, see Session Caches in the Workflow Administration Guide and Lookup Transformation in the Transformation Guide.

Output Files and Caches

227

228

Chapter 9: Integration Service Architecture

Chapter 10

Managing the Grid

This chapter includes the following topics:

Overview, 230 Configuring the Grid, 231 Configuring the Integration Service, 232 Configuring Resources, 234

229

Overview
A grid is an alias assigned to a group of nodes that run sessions and workflows. When you run a workflow on a grid, you improve scalability and performance by distributing Session and Command tasks to service processes running on nodes in the grid. When you run a session on a grid, you improve scalability and performance by distributing session threads to multiple DTM processes running on nodes in the grid. To run a workflow or session on a grid, you assign resources to nodes, create and configure the grid, and configure the Integration Service to run on a grid. Figure 10-1 shows an Integration Service configured to run on a grid:
Figure 10-1. Configuring an Integration Service to Run on a Grid
Node 1 Node 2 Node 3 (Resource) Assign resources to nodes. Create a grid and assign nodes to it. Configure the Integration Service to run on a grid. Grid Integration Service

To manage a grid, complete the following tasks:

Create a grid and assign nodes to the grid. You create a grid and assign nodes to the grid. For more information, see Configuring the Grid on page 231. Configure the Integration Service to run on a grid. You configure the Integration Service to run on a grid, and you configure the service processes for the nodes in the grid. For more information, see Configuring the Integration Service on page 232. Assign resources to nodes. You assign resources to a node to allow the Integration Service to match the resources required to run a task or session thread with the resources available on a node. For more information, see Configuring Resources on page 234.

After you configure the grid and Integration Service, you configure a workflow to run on the Integration Service assigned to a grid. For information about running workflows and sessions on a grid, see Running Workflows and Sessions on a Grid in the Workflow Administration Guide.

230

Chapter 10: Managing the Grid

Configuring the Grid

To configure a grid, create the grid and assign nodes to the grid. You can assign a node to more than one grid. To create a grid, you must have full privileges and permission on the domain or folder where you want to create the grid. To assign a node to a grid, you must have full privileges and permission on the grid and the node.
To create a grid: 1.

In the PowerCenter Administration Console, select Create > Grid. The Create Grid window appears.

Enter a name for the grid.

Select nodes to assign to the grid.

2. 3.

Enter a name for the grid. Select nodes to assign to the grid. Ensure that each node in the grid uses the same operating system.

Configuring the Grid

231

Configuring the Integration Service

To configure the Integration Service, you assign the grid to the Integration Service and configure the service process for each node in the grid.

Configuring the Integration Service to Run on a Grid

You configure the Integration Service by assigning the grid to the Integration Service.
To assign the grid to an Integration Service: 1. 2.

In the PowerCenter Administration Console, select the Integration Service Properties tab. Edit the grid/node assignments, and select Grid.

3.

Select the grid you want to assign to the Integration Service.

Configuring the Service Processes

When you run a session or a workflow on a grid, a service process runs on each node in the grid. Each service process running on a node must be compatible or configured the same. It must also have access to the directories and input files used by the Integration Service. To ensure consistent results, complete the following tasks:

Verify the shared storage location. Verify the shared storage location is accessible to each node in the grid. For more information about configuring a shared storage location for the Integration Service processes, see Creating and Configuring the Integration Service on page 161. Configure the service process. Configure the service process for each node in the grid, and point the $PMRootDir to the shared location.

To configure the service processes: 1. 2.

Select the Integration Service in the Navigator. Click the Processes tab.

232

Chapter 10: Managing the Grid

The tab displays the service process for each node assigned to the grid:
The Integration Service displays the nodes in the grid. Edit the service process. Configure the root directory to point to the same location for all process variables.

3. 4.

Configure $PMRootDir to point to the shared location. Configure the following service process settings for each node in the grid:

Code pages. For accurate data movement and transformation, verify that the code pages are compatible for each service process. Use the same code page for each node where possible. Process variables. Configure the process variables the same for each service process. When you run a workflow on a grid, the process variables must be the same for reject files, source and target files, parameter files, and workflow logs. When you run a session on a grid, the process variables must be the same for data and index cache files, session logs, and lookup files. Directories for Java components. Point to the same Java directory to ensure that java components are available to objects that access Java, such as Custom transformations that use Java coding.

For more information about code page compatibility, see Code Page Compatibility on page 339. For information about configuring service processes, see Creating and Configuring the Integration Service on page 161.

Configuring the Integration Service

233

Configuring Resources
PowerCenter resources are the database connections, files, directories, node names, and operating system types required by a task. You can configure the Integration Service to check resources. When you do this, the Load Balancer matches the resources available to nodes in the grid with the resources required by the workflow. It dispatches tasks in the workflow to nodes where the required resources are available. For more information about configuring the Integration Service to check resource requirements, see Advanced Properties on page 180. If the Integration Service is not configured to run on a grid, the Load Balancer ignores resource requirements. For example, if a session uses a parameter file, it must run on a node that has access to the file. You create a resource for the parameter file and make it available to one or more nodes. When you configure the session, you assign the parameter file resource as a required resource. The Load Balancer dispatches the Session task to a node that has the parameter file resource. If no node has the parameter file resource available, the session fails. Resources for a node can be predefined or user-defined. PowerCenter creates predefined resources during installation. Predefined resources include the connections available on a node, node name, and operating system type. When you create a node, all connection resources are available by default. Disable the connection resources that are not available on the node. For example, if the node does not have Oracle client libraries, disable the Oracle Application connections. If the Load Balancer dispatches a task to a node where the required resources are not available, the task fails. You cannot disable or remove node name or operating system type resources. User-defined resources include file/directory and custom resources. Use file/directory resources for parameter files or file server directories. Use custom resources for any other resources available to the node, such as database client version. Table 10-1 lists the types of resources you use in PowerCenter:
Table 10-1. Resource Types
Type Connection Predefined/ User-Defined Predefined Description Any resource installed with PowerCenter, such as a plug-in or a connection object. A connection object may be a relational, application, FTP, external loader, or queue connection. When you create a node, all connection resources are available by default. Disable the connection resources that are not available to the node. Any Session task that reads from or writes to a relational database requires one or more connection resources. The Workflow Manager assigns connection resources to the session by default. A resource for the name of the node. A Session, Command, or predefined Event-Wait task requires a node name resource if it must run on a specific node.

Node Name

Predefined

234

Chapter 10: Managing the Grid

Table 10-1. Resource Types

Type Operating System Type Custom Predefined/ User-Defined Predefined Description A resource for the type of operating system on the node. A Session or Command task requires an operating system type resource if it must run a specific operating system. Any resource for all other resources available to the node, such as a specific database client version. For example, a Session task requires a custom resource if it accesses a Custom transformation shared library or if it requires a specific database client version. Any resource for files or directories, such as a parameter file or a file server directory. For example, a Session task requires a file resource if it accesses a session parameter file.

User-defined

File/Directory

User-defined

You configure resources required by Session, Command, and predefined Event-Wait tasks in the task properties. For more information about configuring task resources, see in the Running Sessions and Workflows on a Grid in the Workflow Administration Guide. You define resources available to a node on the Resources tab of the node in the Administration Console. Figure 10-2 shows where you define node resources:
Figure 10-2. Node Resources

Enable and disable connection resources.

Disabled connection resource.

Enabled connection resource.

Add resources.

Remove the resource.

Configuring Resources

235

Note: When you define a resource for a node, you must verify that the resource is available to the node. If the resource is not available and the Integration Service runs a task that requires the resource, the task fails.

Viewing Resources in a Domain

You can view the resources available to all nodes in a domain on the Resources tab of the domain. The Administration Console uses a column for each node. It displays a check mark when a resource is available for a node and an x when the resource is unavailable. Scroll down to view all resources for each node.

Nodes

Available Resource

Unavailable Resource

Assigning Connection Resources

You can assign the connection resources available to a node in the Administration Console.
To assign connection resources: 1. 2.

In the Administration Console Navigator, click a node. Click the Resources tab.

236

Chapter 10: Managing the Grid

3.

Click Edit in the Main window.

4.

Click More to view all connection resources. The Administration Console shows the relational, FTP, queue, application, and external loader connections you can assign to a node. In the Main window, select the connections that are available to the node, and clear the connections that are not available to the node. Click OK to save the changes.

5. 6.

Defining Custom and File/Directory Resources

You can define custom and file/directory resources available to a node in the Administration Console. When you define a custom or file/directory resource, you assign a resource name. The resource name is a logical name that you create to identify the resource. You assign the resource to a task or mapping object instance using this name. To coordinate resource usage, you may want to use a naming convention for file/directory and custom resources. For more information about naming these resources, see Resource Naming Conventions on page 238.
To define a custom or file/directory resource: 1. 2. 3.

In the Administration Console Navigator, click a node. Click the Resources tab. In the Main window, click Add for either the Custom or File/Directory resources.
Configuring Resources 237

4.

Enter a name for the resource in the Create Custom Resource or Create File/Directory Resource window. The name cannot have spaces, include carriage returns or tabs, exceed 79 characters, or contain the following characters: \ / * ? < > " | $

5.

Click OK.

To remove a custom or file/directory resource, click the Remove button for the resource you want to remove.

Resource Naming Conventions

Using resources with PowerCenter requires coordination and communication between the domain administrator and the workflow developer. The domain administrator defines resources available to nodes. The workflow developer assigns resources required by Session, Command, and predefined Event-Wait tasks. To coordinate resource usage, you can use a naming convention for file/directory and custom resources. Use the following naming convention:
resourcetype_description

For example, multiple nodes in a grid contain a session parameter file called sales1.txt. Create a file resource for it named sessionparamfile_sales1 on each node that contains the file. A workflow developer creates a session that uses the parameter file and assigns the sessionparamfile_sales1 file resource to the session. When the Integration Service runs the workflow on the grid, the Load Balancer distributes the session assigned the sessionparamfile_sales1 resource to nodes that have the resource defined. For more information about how the Load Balancer distributes tasks using resource availability and requirements, see Load Balancer on page 204.

238

Chapter 10: Managing the Grid

Chapter 11

Configuring the Load Balancer

This chapter includes the following topics:

Overview, 240 Configuring the Dispatch Mode, 241 Creating Service Levels, 244 Configuring Resources, 247 Calculating the CPU Profile, 248 Defining Resource Provision Thresholds, 249

239

Overview
The Load Balancer is a component of the Integration Service that dispatches tasks to Integration Service processes running on nodes in a grid. It matches task requirements with resource availability to identify the best Integration Service process to run a task. It can dispatch tasks on a single node or across nodes. You can configure Load Balancer settings for the domain and for nodes in the domain. The settings you configure for the domain apply to all Integration Services in the domain. You configure the following settings for the domain to determine how the Load Balancer dispatches tasks:

Dispatch mode. The dispatch mode determines how the Load Balancer dispatches tasks. You can configure the Load Balancer to dispatch tasks in a simple round-robin fashion, in a round-robin fashion using node load metrics, or to the node with the most available computing resources. For more information about the dispatch mode, see Configuring the Dispatch Mode on page 241. Service level. Service levels establish dispatch priority among tasks that are waiting to be dispatched. You can create different service levels that a workflow developer can assign to workflows. For information about assigning service levels to workflows, see Working with the Load Balancer in the Workflow Administration Guide. For more information about creating service levels, see Creating Service Levels on page 244. Resources. When the Integration Service runs on a grid, the Load Balancer can compare the PowerCenter resources required by a task with the resources available on each node. The Load Balancer dispatches tasks to nodes that have the required resources. You assign required resources in the task properties. For more information about assigning resources to tasks, see Working with the Load Balancer in the Workflow Administration Guide. You configure available resources using the Administration Console or infacmd. For more information, see Configuring Resources on page 247. CPU profile. In adaptive dispatch mode, the Load Balancer uses the CPU profile to rank the computing throughput of each CPU and bus architecture in a grid. It uses this value to ensure that more powerful nodes get precedence for dispatch. For more information, see Calculating the CPU Profile on page 248. Resource provision thresholds. The Load Balancer checks one or more resource provision thresholds to determine if it can dispatch a task. The Load Balancer checks different thresholds depending on the dispatch mode. For more information about the dispatch mode, see Configuring the Dispatch Mode on page 241. For more information about resource provision thresholds, see Defining Resource Provision Thresholds on page 249.

You configure the following Load Balancer settings for each node:

240

Chapter 11: Configuring the Load Balancer

Configuring the Dispatch Mode

The Load Balancer uses the dispatch mode to select a node to run a task. You configure the dispatch mode for the domain. Therefore, all Integration Services in a domain use the same dispatch mode. When you change the dispatch mode for a domain, you must restart each Integration Service in the domain for the change to take effect. The previous dispatch mode remains in effect until you restart the Integration Service. You configure the dispatch mode in the domain properties. Figure 11-1 shows the Properties tab for the domain:
Figure 11-1. Domain Properties Tab Showing the Dispatch Mode

Dispatch Mode

Edit general properties.

The Load Balancer uses the following dispatch modes:

Round-robin. The Load Balancer dispatches tasks to available nodes in a round-robin fashion. It checks the Maximum Processes threshold on each available node and excludes a node if dispatching a task causes the threshold to be exceeded. This mode is the least compute-intensive and is useful when the load on the grid is even and the tasks to dispatch have similar computing requirements. For more information, see Round-Robin Dispatch Mode on page 242. Metric-based. The Load Balancer evaluates nodes in a round-robin fashion. It checks all resource provision thresholds on each available node and excludes a node if dispatching a task causes the thresholds to be exceeded. The Load Balancer continues to evaluate nodes until it finds a node that can accept the task. This mode prevents overloading nodes when tasks have uneven computing requirements. For more information, see Metric-Based Dispatch Mode on page 242. Adaptive. The Load Balancer ranks nodes according to current CPU availability. It checks all resource provision thresholds on each available node and excludes a node if dispatching
Configuring the Dispatch Mode 241

a task causes the thresholds to be exceeded. This mode prevents overloading nodes and ensures the best performance on a grid that is not heavily loaded. For more information, see Adaptive Dispatch Mode on page 243. Table 11-1 compares the differences among dispatch modes:
Table 11-1. Differences Among Load Balancer Dispatch Modes Dispatch Mode Round-Robin Metric-Based Adaptive Checks resource provision thresholds? Checks maximum processes. Checks all thresholds. Checks all thresholds. Uses task statistics? No Yes Yes Uses CPU profile? No No Yes Allows bypass in dispatch queue? No No Yes

To configure the dispatch mode, you must have permission on the domain and full privileges in the Administration Console.

Round-Robin Dispatch Mode

In round-robin dispatch mode, the Load Balancer dispatches tasks to nodes in a round-robin fashion. The Load Balancer checks the Maximum Processes resource provision threshold on the first available node. It dispatches the task to this node if dispatching the task does not cause this threshold to be exceeded. If dispatching the task causes this threshold to be exceeded, the Load Balancer evaluates the next node. It continues to evaluate nodes until it finds a node that can accept the task. For more information about the Maximum Processes threshold, see Defining Resource Provision Thresholds on page 249. The Load Balancer dispatches tasks for execution in the order the Workflow Manager or scheduler submits them. The Load Balancer does not bypass any task in the dispatch queue. Therefore, if a resource-intensive task is first in the dispatch queue, all other tasks with the same service level must wait in the queue until the Load Balancer dispatches the resourceintensive task.

Metric-Based Dispatch Mode

In metric-based dispatch mode, the Load Balancer evaluates nodes in a round-robin fashion until it finds a node that can accept the task. The Load Balancer checks the resource provision thresholds on the first available node. It dispatches the task to this node if dispatching the task causes none of the thresholds to be exceeded. If dispatching the task causes any threshold to be exceeded, or if the node is out of free swap space, the Load Balancer evaluates the next node. It continues to evaluate nodes until it finds a node that can accept the task. To determine whether a task can run on a particular node, the Load Balancer collects and stores statistics from the last three runs of the task. It compares these statistics with the

242

Chapter 11: Configuring the Load Balancer

resource provision thresholds defined for the node. If no statistics exist in the repository, the Load Balancer uses the following default values:

40 MB memory 15% CPU

The Load Balancer dispatches tasks for execution in the order the Workflow Manager or scheduler submits them. The Load Balancer does not bypass any tasks in the dispatch queue. Therefore, if a resource intensive task is first in the dispatch queue, all other tasks with the same service level must wait in the queue until the Load Balancer dispatches the resource intensive task.

Adaptive Dispatch Mode

In adaptive dispatch mode, the Load Balancer evaluates the computing resources on all available nodes. It identifies the node with the most available CPU and checks the resource provision thresholds on the node. It dispatches the task if doing so does not cause any threshold to be exceeded. The Load Balancer does not dispatch a task to a node that is out of free swap space. In adaptive dispatch mode, the Load Balancer can use the CPU profile to rank nodes according to the amount of computing resources on the node. For more information, see Calculating the CPU Profile on page 248. To identify the best node to run a task, the Load Balancer also collects and stores statistics from the last three runs of the task and compares them with node load metrics. If no statistics exist in the repository, the Load Balancer uses the following default values:

40 MB memory 15% CPU

In adaptive dispatch mode, the order in which the Load Balancer dispatches tasks from the dispatch queue depends on the task requirements and dispatch priority. For example, if multiple tasks with the same service level are waiting in the dispatch queue and adequate computing resources are not available to run a resource intensive task, the Load Balancer reserves a node for the resource intensive task and keeps dispatching less intensive tasks to other nodes.

Configuring the Dispatch Mode

243

Creating Service Levels

Service levels establish priorities among tasks that are waiting to be dispatched. When the Load Balancer has more tasks to dispatch than the Integration Service can run at the time, the Load Balancer places those tasks in the dispatch queue. When multiple tasks are waiting in the dispatch queue, the Load Balancer uses service levels to determine the order in which to dispatch tasks from the queue. Service levels are domain properties. Therefore, you can use the same service levels for all repositories in a domain. You create and edit service levels in the domain properties or using infacmd. Figure 11-2 shows the domain properties where you configure service levels:
Figure 11-2. Domain Properties Tab Showing Service Levels

Remove a service level.

Add a service level.

Each service level you create has the following properties:

Name. Name of the service level. Dispatch priority. A number that establishes the priority for dispatch. The Load Balancer dispatches high priority tasks before it dispatches low priority tasks. Dispatch priority 1 is the highest priority. Maximum dispatch wait time. The amount of time the Load Balancer waits before it changes the dispatch priority for a task to the highest priority. This ensures that no task waits forever in the dispatch queue.

When you create a service level, a workflow developer can assign it to a workflow in the Workflow Manager. All tasks in a workflow have the same service level. The Load Balancer uses service levels to dispatch tasks from the dispatch queue. For example, you create two service levels:

Service level Low has dispatch priority 10 and maximum dispatch wait time 7,200 seconds.

244

Chapter 11: Configuring the Load Balancer

Service level High has dispatch priority 2 and maximum dispatch wait time 1,800 seconds.

When multiple tasks are in the dispatch queue, the Load Balancer dispatches tasks with service level High before tasks with service level Low because service level High has a higher dispatch priority. If a task with service level Low waits in the dispatch queue for two hours, the Load Balancer changes its dispatch priority to the maximum priority so that the task does not remain in the dispatch queue indefinitely. The Administration Console provides a default service level, Default, that is set to dispatch priority 5 and maximum dispatch wait time 1,800 seconds. You can update the default service level, but you cannot delete it. When you remove a service level, the Workflow Manager does not update tasks that use the service level. If a workflow service level does not exist in the domain, the Load Balancer dispatches the tasks with the default service level. For information about changing service levels for a workflow, see Working with the Load Balancer in the Workflow Administration Guide. To create, modify, or remove service levels, you must have permission on the domain and full privileges in the Administration Console.
To create a service level: 1. 2. 3. 4. 5.

In the Navigator of the Administration Console, select the domain. Select the domain. Click the Properties tab. In the Service Level Management area, click Add. Enter values for the following service level properties:
Property Service Level Name Required/ Optional Required Description Name of the service level. The name is not case sensitive and must be unique within the domain.The name cannot have leading or trailing spaces, include carriage returns or tabs, exceed 79 characters, or contain the following characters: /*?<>"| The initial priority for dispatch. Smaller numbers have higher priority. Priority 1 is the highest priority. Range is 1 to 10. Default is 5. The amount of time, in seconds, that can elapse before the Load Balancer escalates the dispatch priority for a task to the highest priority. Range is 1 to 86,400. Default is 1,800.

Dispatch Priority

Required

Maximum Dispatch Wait Time

Required

Creating Service Levels

245

6. 7.

Click OK. To remove a service level, click the Remove button for the service level you want to remove.

246

Chapter 11: Configuring the Load Balancer

Configuring Resources
When you configure the Integration Service to run on a grid and to check resource requirements, the Load Balancer dispatches tasks to nodes based on the resources available on each node. You configure the Integration Service to check available resources in the Integration Service properties in the Administration Console. For more information about configuring the Integration Service to check resource requirements, see Advanced Properties on page 180. You assign resources required by a task in the task properties in the Workflow Manager. For information about configuring required resources for a task, see Working with the Load Balancer in the Workflow Administration Guide. You define the resources available to each node in the Administration Console. Define the following types of resources:

Connection. Any resource installed with PowerCenter, such as a plug-in or a connection object. When you create a node, all connection resources are available by default. Disable the connection resources that are not available to the node. File/Directory. A user-defined resource that defines files or directories available to the node, such as parameter files or file server directories. Custom. A user-defined resource that identifies any other resources available to the node. For example, you may use a custom resource to identify a specific database client version.

Enable and disable available resources on the Resources tab for the node in the Administration Console or using infacmd. For more information, see Configuring Resources on page 234 or infacmd Command Reference in the Command Line Reference.

Configuring Resources

247

Calculating the CPU Profile

In adaptive dispatch mode, the Load Balancer uses the CPU profile to rank the computing throughput of each CPU and bus architecture in a grid. This ensures that nodes with higher processing power get precedence for dispatch. This value is not used in round-robin or metric-based dispatch modes. The CPU profile is an index of the processing power of a node compared to a baseline system. The baseline system is a Pentium 2.4 GHz computer running Windows 2000. For example, if a SPARC 480 MHz computer is 0.28 times as fast as the baseline computer, the CPU profile for the SPARC computer should be set to 0.28. You calculate and edit the CPU profile in the node properties or using infacmd. Figure 11-3 shows the node properties where you configure the CPU profile:
Figure 11-3. Node Properties Tab Showing CPU Profile

Calculate CPU profile.

Edit node properties.

By default, the CPU profile is set to 1.0. To calculate the CPU profile for a node, click Recalculate CPU Profile. To get the most accurate value, calculate the CPU profile when the node is idle.
Note: This calculation takes approximately five minutes and uses 100% of one CPU on the

machine. You can also edit the node properties and update the value manually. For more information, see Configuring Node Properties on page 46.

248

Chapter 11: Configuring the Load Balancer

Defining Resource Provision Thresholds

The Load Balancer dispatches tasks to Integration Service processes running on a node. It can continue to dispatch tasks to a node as long as the resource provision thresholds defined for the node are not exceeded. When the Load Balancer has more Session and Command tasks to dispatch than the Integration Service can run at the time, the Load Balancer places the tasks in the dispatch queue. It dispatches tasks from the queue when an Integration Service process becomes available. You can define the following resource provision thresholds for each node in a domain:

Maximum CPU run queue length. The maximum number of runnable threads waiting for CPU resources on the node. The Load Balancer does not count threads that are waiting on disk or network I/Os. If you set this threshold to 2 on a 4-CPU node that has four threads running and two runnable threads waiting, the Load Balancer does not dispatch new tasks to this node. This threshold limits context switching overhead. You can set this threshold to a low value to preserve computing resources for other applications. If you want the Load Balancer to ignore this threshold, set it to a high number such as 200. The default value is 10. The Load Balancer uses this threshold in metric-based and adaptive dispatch modes.

Maximum memory %. The maximum percentage of virtual memory allocated on the node relative to the total physical memory size. If you set this threshold to 120% on a node, and virtual memory usage on the node is above 120%, the Load Balancer does not dispatch new tasks to the node. The default value for this threshold is 150%. Set this threshold to a value greater than 100% to allow the allocation of virtual memory to exceed the physical memory size when dispatching tasks. If you want the Load Balancer to ignore this threshold, set it to a high number such as 1,000. The Load Balancer uses this threshold in metric-based and adaptive dispatch modes.

Maximum processes. The maximum number of running Session and Command tasks allowed for each Integration Service process running on the node. For example, if you set this threshold to 10, and two Integration Service processes are running on the node, the maximum number of Session and Command tasks allowed for the node is 20. The default value for this threshold is 10. Set this threshold to a high number, such as 200, to cause the Load Balancer to ignore it. To prevent the Load Balancer from dispatching tasks to the node, set this threshold to 0. The Load Balancer uses this threshold in all dispatch modes.

You define resource provision thresholds in the node properties. For more information, see Configuring Node Properties on page 46.

Defining Resource Provision Thresholds

249

250

Chapter 11: Configuring the Load Balancer

Chapter 12

Creating and Configuring the SAP BW Service

This chapter includes the following topics:

Overview, 252 Creating the SAP BW Service, 253 Enabling and Disabling the SAP BW Service, 255 Configuring the SAP BW Service Properties, 257 Configuring the Associated Integration Service, 258 Configuring the SAP BW Service Processes, 259 Viewing Log Events, 260

251

Overview
If you are using PowerCenter Connect for SAP NetWeaver BW Option, use the Administration Console to manage the SAP BW Service. The SAP BW Service is an application service that performs the following tasks:

Listens for RFC requests from SAP BW Initiates workflows to extract from or load to SAP BW Sends log events to the PowerCenter Log Manager

To access the SAP BW Service, you must have permission on the service in the domain. For more information about permissions, see Managing Permissions on page 72. Use the Administration Console to complete the following SAP BW Service tasks:

Create the SAP BW Service. For more information, see Creating the SAP BW Service on page 253. Enable and disable the SAP BW Service. For more information, see Enabling and Disabling the SAP BW Service on page 255. Configure the SAP BW Service properties. For more information, see Configuring the SAP BW Service Properties on page 257. Configure the associated Integration Service. For more information, see Configuring the Associated Integration Service on page 258. Configure the SAP BW Service processes. For more information, see Configuring the SAP BW Service Processes on page 259. Configure permissions on the SAP BW Service. You must have permission on the SAP BW Service to view it and full privileges to configure it. For more information about permissions, see Managing Permissions and Privileges on page 72. View log events. View messages that the SAP BW Service sends to the PowerCenter Log Manager. For more information, see Viewing Log Events on page 260.

Load Balancing for the BW System and the SAP BW Service

You can configure the BW system to use load balancing. To support a BW system configured for load balancing, the SAP BW Service records the host name and system number of the BW server requesting data from PowerCenter. It passes this information to the Integration Service. The Integration Service uses this information to load data to the same BW server that made the request. For more information about configuring the BW system to use load balancing, see your BW documentation. You can also configure the SAP BW Service in PowerCenter to use load balancing. If the load on the SAP BW Service becomes too high, you can create multiple instances of the SAP BW Service to balance the load. To run multiple SAP BW Services configured for load balancing, create each service with a unique name but use the same values for all other parameters. The services can run on the same node or on different nodes. The BW server distributes data to the multiple SAP BW Services in a round-robin fashion.
252 Chapter 12: Creating and Configuring the SAP BW Service

Creating the SAP BW Service

Use the Administration Console to create the SAP BW Service. To create the SAP BW Service, you must have full privileges and permission on the domain or folder where you want to create the service. You must also have permission on the node where the service runs.
To create the SAP BW Service: 1.

In the Administration Console, click Create > SAP BW Service. The Create New SAP BW Service window appears.

2.

Configure the SAP BW Service options. Table 12-1 describes the information to enter in the Create New SAP BW Service window:
Table 12-1. Create New SAP BW Service Options
Property Service Name Required/ Optional Required Description Name of the SAP BW Service. The name is not case sensitive and must be unique within the domain. The characters must be compatible with the code page of the associated repository. The name cannot have leading or trailing spaces, include carriage returns or tabs, exceed 79 characters, or contain the following characters: \ / * ? < > " | Name of the domain and folder in which the SAP BW Service is created. The Administration Console creates the SAP BW Service in the domain where you are connected. Click Select Folder to select a new folder in the domain. PowerCenter license. Node on which this service runs.

Location

Required

License Node Setup

Required Required

Creating the SAP BW Service

253

Table 12-1. Create New SAP BW Service Options

Property Domain for Associated Integration Service Required/ Optional Required Description Domain that contains the Integration Service associated with the SAP BW Service. If the PowerCenter environment consists of multiple domains, you can click Manage Domain List to access another domain. You can then associate the SAP BW Service with an Integration Service that exists in another domain. For more information about working with multiple domains, see Working with Multiple Domains on page 61. Integration Service associated with the SAP BW Service.

Associated Integration Service Repository User Name Repository Password SAP Destination R Type

Required

Required Required Required

Account used to access the repository. Password for the repository user. Type R DEST entry in the saprfc.ini file created for the SAP BW Service. For more information about the saprfc.ini file, see Configuring PowerCenter Connect for SAP NetWeaver BW Option in the Installation and Configuration Guide.

3.

Click OK. A message informs you that the SAP BW Service was successfully created.

4.

Click Close. The SAP BW Service properties window appears.

254

Chapter 12: Creating and Configuring the SAP BW Service

Enabling and Disabling the SAP BW Service

Use the Administration Console to enable and disable the SAP BW Service. You might disable the SAP BW Service if you need to perform maintenance on the machine. You can enable the disabled SAP BW Service to make it available again. Before you enable the SAP BW Service, you must define PowerCenter as a logical system in SAP BW. For more information, see Configuring PowerCenter Connect for SAP NetWeaver BW Option in the Installation and Configuration Guide. When you enable the SAP BW Service, the service starts. If the service is unable to start, the domain tries to restart the service based on the restart options configured in the domain properties. For more information about configuring restart properties for service processes, see Managing the Domain on page 31. If the service is enabled but fails to start after reaching the maximum number of attempts, the following message appears:
The SAP BW Service <service name> is enabled. The service did not start. Please check the logs for more information.

You can review the logs for this SAP BW Service to determine the reason for failure and fix the problem. After you fix the problem, you must disable and re-enable the SAP BW Service to start it. When you enable the SAP BW Service, it attempts to connect to the associated Integration Service. If the Integration Service is not enabled and the SAP BW Service cannot connect to it, the SAP BW Service still starts successfully. When the SAP BW Service receives a request from BW to start a PowerCenter workflow, the service attempts to connect to the associated Integration Service again. If it cannot establish a connection, the SAP BW Service returns the following message to the BW system:
The SAP BW Service could not find Integration Service <service name> in domain <domain name>.

To resolve this problem, verify that the Integration Service is enabled and that the domain name and Integration Service name entered in the 3rd Party Selection tab of the BW InfoPackage are valid. Then restart the process chain in the BW system. When you disable the SAP BW Service, you must choose one of the following options:

Complete. Disables the SAP BW Service after all service processes complete. Abort. Aborts all processes immediately, and then disables the SAP BW Service. You might want to choose abort if a service process is hanging.

To enable the SAP BW Service: 1. 2.

In the Navigator of the Administration Console, select the SAP BW Service. Click Enable.

Enabling and Disabling the SAP BW Service

255

To disable the SAP BW Service: 1. 2.

In the Navigator of the Administration Console, select the SAP BW Service. Click Disable. The Disable SAP BW Service window appears.

3.

Choose the disable mode and click OK.

256

Chapter 12: Creating and Configuring the SAP BW Service

Configuring the SAP BW Service Properties

Use the Properties tab in the Administration Console to configure general properties for the SAP BW Service and to configure the node on which the service runs.
To configure the SAP BW Service properties: 1.

Select the SAP BW Service in the Navigator. The SAP BW Service properties window appears.

2. 3. 4. 5. 6.

In the Properties tab, click Edit for the node assignments. Select the node on which the service runs. Click OK. Click Edit for the general properties. Edit the following general properties:
Property SAP Destination R Type Required/ Optional Required Description Type R DEST entry in the saprfc.ini file created for the SAP BW Service. Edit this property if you have created a different type R DEST entry in sapfrc.ini for the SAP BW Service. For more information about the saprfc.ini file, see Configuring PowerCenter Connect for SAP NetWeaver BW Option in the Installation and Configuration Guide. Number of seconds the SAP BW Service waits before trying to connect to the BW system if a previous connection attempt failed. The SAP BW Service attempts to connect five times. Between connection attempts, it waits the number of seconds you specify. After five unsuccessful attempts, the SAP BW Service shuts down. Default is 5.

RetryPeriod

Required

7.

Click OK.

Configuring the SAP BW Service Properties

257

Configuring the Associated Integration Service

Use the Associated Integration Service tab in the Administration Console to configure connection information for the repository database and Integration Service.
To configure the associated Integration Service: 1.

Select the SAP BW Service in the Navigator. The SAP BW Service properties window appears.

2.

Click Associated Integration Service.

3. 4.

Click Edit. Edit the following properties:

Property Domain for Associated Integration Service Required/ Optional Required Description Domain that contains the Integration Service associated with the SAP BW Service. If the PowerCenter environment consists of multiple domains, you can click Manage Domain List to access another domain. You can then associate the SAP BW Service with an Integration Service that exists in another domain. For more information about working with multiple domains, see Working with Multiple Domains on page 61. Integration Service name to which the SAP BW Service connects. Account used to access the repository. Password for the repository user.

Associated Integration Service Repository User Name Repository Password 5.

Required Required Required

Click OK.

258

Chapter 12: Creating and Configuring the SAP BW Service

Configuring the SAP BW Service Processes

Use the Processes tab in the Administration Console to configure the temporary parameter file directory that the SAP BW Service uses when you filter data to load into BW.
To configure the SAP BW Service processes: 1.

Select the SAP BW Service in the Navigator. The SAP BW Service properties window appears.

2.

Click Processes.

3. 4.

Click Edit. Edit the following property:

Property ParamFileDir Required/ Optional Required Description Temporary parameter file directory. The SAP BW Service stores BW data selection entries in the parameter file when you filter data to load into BW. The directory must exist on the node running the SAP BW Service. Verify that the directory you specify has read and write permissions enabled. For more information about filtering data to load into BW, see Building PowerCenter Objects to Load Data into BW in the PowerCenter Connect for SAP NetWeaver User and Administrator Guide. Default is $PMRootDir\BWParam. You define $PMRootDir for the associated Integration Service. For more information about $PMRootDir, see Directories for Integration Service Files on page 192.

Configuring the SAP BW Service Processes

259

Viewing Log Events

The SAP BW Service sends log events to the PowerCenter Log Manager. The SAP BW Service captures log events that track interactions between PowerCenter and SAP BW. You can view SAP BW Service log events in the following locations:

PowerCenter Administration Console. On the Log tab, enter search criteria to find log events that the SAP BW Service captures when extracting from or loading into SAP BW. For more information, see Managing Logs on page 303. BW Monitor. In the Monitor - Administrator Workbench window, you can view log events that the SAP BW Service captures for an InfoPackage included in a process chain that loads data into BW. BW pulls the messages from the SAP BW Service and displays them in the monitor. The SAP BW Service must be running to view the messages in the BW Monitor. For more information, see Loading Data into BW in the PowerCenter Connect for SAP NetWeaver User and Administrator Guide.

To view log events about how the Integration Service processes a BW workflow, view the session or workflow log. For more information, see Session and Workflow Logs in the Workflow Administration Guide.

260

Chapter 12: Creating and Configuring the SAP BW Service

Chapter 13

Creating and Configuring the Web Services Hub

This chapter includes the following topics:

Overview, 262 Creating a Web Services Hub, 263 Enabling and Disabling the Web Services Hub, 266 Configuring the Web Services Hub Properties, 267 Configuring the Associated Repository, 271

261

Overview
The Web Services Hub is a gateway that exposes PowerCenter functionality to external clients. It receives requests from web service clients and passes them to the Integration Service or Repository Service. The Integration Service or Repository Service processes the requests and sends a response to the web service client through the Web Services Hub. To create or configure a Web Services Hub, you must have permission on the service in the domain. You can use the Administration Console to complete the following tasks related to the Web Services Hub:

Create a Web Services Hub. You can create multiple Web Services Hubs in a domain. For more information, see Creating a Web Services Hub on page 263. Enable or disable the Web Services Hub. You must enable the Web Services Hub to run web services. You can disable the Web Services Hub to prevent external clients from accessing the web services while performing maintenance on the machine or modifying the repository. For more information, see Enabling and Disabling the Web Services Hub on page 266. Configure the Web Services Hub properties. You must configure the Web Services Hub properties to change its behavior. For more information, see Configuring the Web Services Hub Properties on page 267. Configure the associated repository. You must associate a repository with a Web Services Hub. The Web Services Hub exposes the web-enabled workflows in the associated repository. For more information, see Configuring the Associated Repository on page 271. Configure permissions on the Web Services Hub. You must have permission on a Web Services Hub to view it and full privileges to configure it. For more information about configuring permissions for a service, see Managing Permissions and Privileges on page 72. View the logs for the Web Services Hub. You can view the event logs for the Web Services Hub in the Log Viewer. For more information about the event logs for a service, see Using the Log Viewer on page 315. Remove a Web Services Hub. You may need to remove a Web Services Hub if it becomes obsolete. For more information about removing a service from a domain, see Removing Application Services on page 42.

262

Chapter 13: Creating and Configuring the Web Services Hub

Creating a Web Services Hub

Create a Web Services Hub so that external clients can access the PowerCenter web services. You must associate a repository with the Web Services Hub before you run it. You can assign the repository when you create the Web Services Hub or after you create the Web Services Hub. The repository that you assign to the Web Services Hub is called the associated repository. The Web Services Hub exposes web enabled workflows from the associated repository. To create a Web Services Hub, you must have full privileges and permission on the domain.
To create a Web Services Hub: 1.

On the Navigator of the Administration Console, click Create > Web Services Hub. The Create New Web Services Hub page appears.

Creating a Web Services Hub

263

2.

Enter values for the following Web Services Hub options:

Table 13-1. Create New Web Services Hub Options
Property Service Name Required/ Optional Required Description Name of the Web Services Hub. The name is not case sensitive and must be unique within the domain. The characters must be compatible with the code page of the associated repository. The name can have spaces, but not leading or trailing spaces. The name cannot include carriage returns or tabs, exceed 79 characters, or contain the following characters: /*?<>"| Domain in which the Web Services Hub is created. License to assign to the Web Services Hub. If you do not select a license now, you can assign a license to the service later. Required before you can enable the Web Services Hub. A Web Services Hub runs on a single node. The Web Services Hub does not support the high availability option. Domain that contains the Repository Service associated with the Web Services Hub. Repository Service name to which the Web Services Hub connects. If you do not select an associated repository when you create a Web Services Hub, you can add an associated repository later. User name to access the repository. This is the user name for the database account on the repository database. Password for the repository database account. Name of the machine hosting the Web Services Hub. Port number for the Web Services Hub. Default is 7333. Indicates the security protocol that you configure for the Web Services Hub: HTTP or HTTPS. Default is HTTP. Keystore file that contains the keys and certificates required if you use the SSL security protocol with the Web Services Hub. Appears if you select the HTTPS URL scheme. If the you leave the KeystoreFile property blank, the Web Services Hub looks for the following keystore file: Windows: C:\Documents and Settings\<User>\.keytore UNIX: /home/<User>/.keystore Host name on which the Web Services Hub listens for connections from the Integration Service. If not specified, the default is the Web Services Hub host name. Port number on which the Web Services Hub listens for connections from the Integration Service. Default is 15555.

Location License

Read only Optional

Node Domain for Associated Repository Service Associated Repository Service

Required Optional Optional

Repository User Name Repository Password HubHostName HubPortNumber URLScheme KeystoreFile

Optional Optional Required Required Required Conditional

InternalHostName

Optional

InternalPortNumber

Required

264

Chapter 13: Creating and Configuring the Web Services Hub

3.

Click Create.

Creating a Web Services Hub

265

Enabling and Disabling the Web Services Hub

Use the Administration Console to enable or disable a Web Services Hub. You may want to disable a Web Services Hub if you need to perform maintenance or if you want to temporarily restrict users from accessing web services. You can enable a disabled Web Services Hub to make it available again. When you disable the Web Services Hub, you must choose what to do if a process or workflow is running. Choose one of the following options:

Stop. Stops all web enabled workflows and disables the Web Services Hub. Abort. Aborts all web-enabled workflows immediately and disables the Web Services Hub.

All Repository Services associated with the Web Services Hub must be running before you run the Web Services Hub. If any of the associated Repository Services are not running, the Web Services Hub does not start. If the service is enabled but fails to start, review the logs for the Web Services Hub to determine the reason for failure. After you resolve the problem, you must disable and enable the Web Services Hub to start it again.
To disable or enable a Web Services Hub: 1.

In the Navigator of the Administration Console, select the Web Services Hub. When a Web Services Hub is running, the Disable button is available.

2.

To disable the service, click Disable. The Disable Web Services Hub window appears.

3.

Choose the disable mode and click OK. The Service Manager disables the Web Services Hub. When a service is disabled, the Enable button is available.

4.

To enable the service, click Enable.

266

Chapter 13: Creating and Configuring the Web Services Hub

Configuring the Web Services Hub Properties

The Web Services Hub properties are grouped into the following categories:

Node assignments. Select the node on which the Web Services Hub runs. For more information about the node for Web Services Hub, see Node Assignments on page 268. General properties. Include properties that typically must be set for the Web Services Hub, such as host name and port number. For more information about configuring general properties, see General Properties on page 268. Advanced properties. Include properties that you may not ordinarily configure, such as the level of errors written to the Web Services Hub logs. For more information about advanced properties, see Advanced Properties on page 269. Custom properties. Include properties that are unique to your PowerCenter environment or that apply in special cases. A Web Services Hub does not have custom properties when you initially create it. Use custom properties only if Informatica Technical Support instructs you to.

To view or update properties, select the Web Services Hub in the Navigator and go to the Properties tab. The Properties tab displays the categories of Web Services Hub properties in different sections:

Configuring the Web Services Hub Properties

267

Note: If the Repository Service associated with the Web Services Hub is disabled, the

Properties tab displays the message that the associated repository service is disabled. You must enable the associated Repository Service before you can enable the Web Services Hub.

Node Assignments
You can run one Web Services Hub on one node. You cannot run a Web Services Hub on multiple nodes. You must disable the Web Services Hub before you assign a new node. To edit the node assignment, select the Web Services Hub in the Navigator, click the Properties tab, and then click Edit in the Node Assignments section. Select a new node.

General Properties
To edit the general properties, select the Web Services Hub in the Navigator, click the Properties tab, and then click Edit in the General Properties section.
Note: You must disable and then enable the Web Service Hub before changes to the general

properties can take effect. Table 13-2 describes the general properties for a Web Services Hub:
Table 13-2. General Properties for a Web Services Hub
Property HubHostName HubPortNumber CharacterEncoding URLScheme Required/ Optional Required Required Required Required Description Name of the machine hosting the Web Services Hub. Default is the name of the machine where the Web Services Hub is installed. Port number for the Web Services Hub. Default is 7333. Character encoding for the Web Services Hub. Default is UTF-8. Indicates the security protocol that you configure for the Web Services Hub: HTTP or HTTPS. Default is HTTP. If you select the HTTPS scheme, you must provide the keystore file. Host name on which the Web Services Hub listens for connections from the Integration Service. Port number on which the Web Services Hub listens for connections from the Integration Service. Default is 15555. Keystore file that contains the keys and certificates required if you use the SSL security protocol with the Web Services Hub. Required if you select the HTTPS URL scheme. License assigned to the Web Services Hub.

InternalHostName InternalPortNumber KeystoreFile

Required Required Conditional

License

Read only

268

Chapter 13: Creating and Configuring the Web Services Hub

Advanced Properties
To edit the advanced properties, select the Web Services Hub in the Navigator, click the Properties tab, and then click Edit in the Advanced Properties section. Table 13-3 describes the advanced properties for a Web Services Hub:
Table 13-3. Advanced Properties for a Web Services Hub
Property DTM Timeout SessionExpiryPeriod Required/ Optional Required Required Description Length of time (in seconds) the Web Services Hub attempts to connect or reconnect to the DTM to run a session. Default is 60 seconds. Number of seconds that a session can remain idle before the session times out and the session ID becomes invalid. The Web Services Hub resets the start of the timeout period every time a client application sends a request with a valid session ID. If a request takes longer to complete than the amount of time set in the SessionExpiryPeriod property, the session can time out during the operation. You may want to set the SessionExpiryPeriod property to a higher value. The Web Services Hub returns a fault response to any request with an invalid session ID. Default is 3600 seconds (1 hour). Maximum number of connections to the Integration Service that can be open at one time for the Web Services Hub. Default is 20. Level of Web Services Hub error messages to include in the logs. These messages are written to the Log Manager and log files. Specify one of the following severity levels: - Fatal. Writes FATAL code messages to the log. - Error. Writes ERROR and FATAL code messages to the log. - Warning. Writes WARNING, ERROR, and FATAL code messages to the log. - Info. Writes INFO, WARNING, and ERROR code messages to the log. - Trace. Writes TRACE, INFO, WARNING, ERROR, and FATAL code messages to the log. - Debug. Writes DEBUG, INFO, WARNING, ERROR, and FATAL code messages to the log. Default is INFO. Maximum number of request processing threads available, which determines the maximum number of simultaneous requests that can be handled. Default is 100. This property is equivalent to the maxProcessors property in JBoss for the PowerCenter Web Services Hub 7.x. Maximum queue length for incoming connection requests when all possible request processing threads are in use. Any requests received when the queue is full will be refused. Default is 5000. This property is equivalent to the acceptCount property in JBoss for the PowerCenter Web Services Hub 7.x.

MaxLMConnections

Required

Error Severity Level

Required

MaxConcurrentRequests

Required

MaxQueueLength

Required

You can use the MaxConcurrentRequests property to set the number of clients that connect to the Web Services Hub and the MaxQueueLength property to set the number of client requests the Web Services Hub can process at one time.
Configuring the Web Services Hub Properties 269

You can change the parameter values based on the number of clients you expect to connect to the Web Services Hub. In a test environment, you might want smaller values. In a production environment, you might want larger values. If you increase the values, more clients can connect to the Web Services Hub, but the connections might consume more system resources.

Custom Properties
Typically, you do not need to set up custom properties for the Web Services Hub. Create custom properties only in special circumstances and only on advice from Informatica Technical Support. To add or edit custom properties, select the Web Services Hub in the Navigator, click the Properties tab, and then click Edit in the Custom Properties section.

270

Chapter 13: Creating and Configuring the Web Services Hub

Configuring the Associated Repository

To expose web services through the Web Services Hub, you must associate a repository with a Web Services Hub. When you associate a repository with a Web Services Hub, you must specify the Repository Service and the domain where the Repository Service resides. You also specify the user name and password to use to connect to the repository. If you associate more than one repository with a Web Services Hub, the Repository Services for all the associated repositories must be running before the Web Services Hub can start. If even one of the Repository Services is not running, the Web Services Hub cannot start. The repository that you associate with a Web Services Hub can be in a different domain. If you want to associate a repository in a domain that is not listed in the Administration Console, you can add the domain to the list of domains in the Administration Console. You can then select the repository in the new domain to associate with the Web Services Hub.
Note: You can associate more than one repository with a Web Services Hub. However, you

cannot associate more than one Web Services Hub with one repository.

Adding an Associated Repository

You can associate as many repositories to a Web Services Hub as you want the external clients to access through web services.
To add an associated repository: 1. 2. 3.

On the Navigator of the Administration Console, select the Web Services Hub. Click the Associated Repository tab. Click Add.

Configuring the Associated Repository

271

The Select Repository section appears.

4.

Enter the properties for the associated repository.

Property Domain for Associated Repository Service Required/ Optional Required Description Domain that contains the Repository Service to associate with the Web Services Hub. Select the domain from the domain list. The domain Service Manager maintains a list of domains to which you have set up a connection. Initially, the list contains only the current domain. To add a domain to the list, click Manage Domains List and set up the connection information for the new domain. Associated Repository Service Repository User Name Repository Password Required Required Required Repository Service name to which the Web Services Hub connects. User name to access the repository. This is the user name for the database account on the repository database. Password for the repository database account.

If you want to associate a repository from a domain that is not in the domain selection list, click Manage Domains List and provide the connection information to add a new domain to the list. The new domain appears in the selection list. For more information about managing the domain list, see Working with Multiple Domains on page 61.
5.

Click OK to save the associated repository properties.

272

Chapter 13: Creating and Configuring the Web Services Hub

Editing an Associated Repository

If you want to change the repository that you want to associate with the Web Services Hub, you can edit the properties of the associated repository.
To edit an associated repository: 1. 2. 3.

On the Navigator of the Administration Console, select the Web Services Hub. Click the Associated Repository tab. In the section for the repository you want to edit, click Edit. The Associated Repository Properties window appears.

4.

Edit the properties for the associated repository.

Property Domain for Associated Repository Service Associated Repository Service Repository User Name Repository Password Required/ Optional Required Required Required Required Description Domain that contains the Repository Service associated with the Web Services Hub. Select the domain from the domain list. Repository Service name to which the Web Services Hub connects. User name to access the repository. This is the user name for the database account on the repository database. Password for the repository database account.

If you want to switch to a repository on another domain that is not in the domain selection list, click Manage Domains List and provide the connection information to add a new domain to the list. The new domain appears in the selection list. For more information about managing the domain list, see Working with Multiple Domains on page 61.
5.

Click OK to save the changes to the associated repository properties.

Configuring the Associated Repository

273

274

Chapter 13: Creating and Configuring the Web Services Hub

Chapter 14

Managing Licenses

This chapter includes the following topics:

Overview, 276 Types of License Keys, 279 Creating a License Object, 280 Assigning a License to a Service, 282 Unassigning a License from a Service, 284 Updating a License, 285 Removing a License, 286 Viewing License Details, 287

275

Overview
The Service Manager on the master gateway node manages PowerCenter licenses. A PowerCenter license enables you to perform the following tasks:

Run application services. Application services include the Repository Service, Integration Service, SAP BW Service, and Web Services Hub. Use PowerCenter features. Features include connectivity, Metadata Exchange options, and other options, such as session on grid and high availability.

When you install PowerCenter, the installation program creates a license object in the domain based on the license key you used to install PowerCenter. You assign a license object to each application service to enable the service. For example, you must assign a license to the Integration Service before you can use the Integration Service to run a workflow. You can create additional license objects in the domain. You may have multiple license objects that fulfill the requirements specified in your contract. For example, you may have two license objects, where each object allows you to run services on a different operating system. You might also use multiple license objects if you want the same domain to manage different projects. You may want to use a different set of PowerCenter features for each project.

License Validation
The Service Manager validates application service processes when they start. The Service Manager validates the following information for each service process:

Product version. Verifies that you are running the appropriate version of the application service. Platform. Verifies that the application service is running on a licensed operating system. Expiration date. Verifies that the license is not expired. If the license expires, no application service assigned to the license can start. You must assign a valid license to the application services to start them. PowerCenter Options. Determines the options that the application service has permission to use. For example, the Service Manager verifies if the Integration Service can use the Session on Grid option. Connectivity. Verifies connections that the application service has permission to use. For example, the Service Manager verifies that PowerCenter can connect to a IBM DB2 database. Metadata Exchange options. Determines the Metadata Exchange options that are available for use. For example, the Service Manager verifies that you have access to the Metadata Exchange for Business Objects Designer.

276

Chapter 14: Managing Licenses

Licensing Log Events

The Service Manager generates log events and writes them to the Log Manager. It generates log events for the following actions:

You create or delete a license. You apply an incremental license key to a license. You assign an application service to a license. You unassign a license from an application service. The license expires. The Service Manager encounters an error, such as a validation error.

The log events include the user name and the time associated with the event. You must have permission on the domain to view the logs for Licensing events. The Licensing events appear in the domain logs.

License Management Tasks

You can perform the following tasks to manage the licenses:

Create the license in the Administration Console. You use a license key to create a license in the Administration Console. For more information about creating a license, see Creating a License Object on page 280. Assign a license to each application service. Assign a license to each application service to enable the service. For more information about assigning a license to an application service, see Assigning a License to a Service on page 282. Unassign a license from an application service. Unassign a license from an application service if you want to discontinue the service or migrate the service from a development environment to a production environment. After you unassign a license from a service, you cannot enable the service until you assign another valid license to it. For more information about unassigning a license from an application service, see Unassigning a License from a Service on page 284. Update the license. Update the license to add PowerCenter options to the existing license. For more information about updating a license, see Updating a License on page 285. Remove the license. Remove a license if it is obsolete. For more information about removing a license, see Removing a License on page 286. Configure user permissions on a license. You need full privileges and permission on a license to assign it to a service. For more information about configuring user privileges and object permissions, see Managing Permissions and Privileges on page 72. View license details. You may need to review the licenses to determine details, such as expiration date and the maximum number of licensed CPUs. You may want to review these details to ensure you are in compliance with the license. Use the Administration Console to determine the details for each license. For more information about viewing license details, see Viewing License Details on page 287.

Overview

277

Monitor license usage. You can monitor the usage of logical CPUs and Repository Services in the Domain Activity Monitoring report. For more information about monitoring license usage, see Monitoring License Usage on page 293.

You can perform all of these tasks in the Administration Console or by using infacmd commands. For more information about infacmd commands, see infacmd Command Reference in the Command Line Reference.

278

Chapter 14: Managing Licenses

Types of License Keys

Informatica provides license keys in license files. The license key is encrypted. When you create the license from the license key file, the Service Manager decrypts the license key and enables the purchased PowerCenter options. You create a license from a license key file. You apply license keys to the license to enable additional PowerCenter options. PowerCenter uses the following types of license keys:

Original keys. Informatica generates an original key based on your contract. Informatica may provide multiple original keys depending on your contract. Incremental keys. Informatica generates incremental keys based on updates to an existing license, such as an extended license period or an additional option.

Original Keys
Original keys identify the contract, product, and licensed features. Licensed features include the PowerCenter edition, deployment type, number of authorized CPUs, and authorized PowerCenter options and connectivity. You use the original keys to install PowerCenter and create licenses for services. You must have a license key to install PowerCenter. The installation program creates a license object for the domain in the Administration Console. You can use other original keys to create more licenses in the same domain. You use a different original license key for each license object.

Incremental Keys
You use incremental license keys to update an existing license. You add an incremental key to an existing license to add or remove options, such as PowerCenter options, connectivity, and Metadata Exchange options. For example, if an existing license does not allow high availability, you can add an incremental key with the high availability option to the existing license. The Service Manager updates the license expiration date if the expiration date of an incremental key is later than the expiration date of an original key. The Service Manager uses the latest expiration date. A license object can have different expiration dates for options in the license. For example, the IBM DB2 relational connectivity option may expire on 12/01/2006, and the session on grid option may expire on 04/01/06. The Service Manager validates the incremental key against the original key used to create the license. An error appears if the keys are not compatible. For more information about original and incremental key compatibility, see Updating a License on page 285.

Types of License Keys

279

Creating a License Object

You can create a license object in a domain and assign the license to application services. You can create the license in the Administration Console using a license key file. The license key file contains an encrypted original key. You use the original key to create the license. You can also use the infacmd AddLicense command to add a license to the domain. For more information, see infacmd Command Reference in the Command Line Reference. Use the following guidelines to create a license:

Use a valid license key file. The license key file must contain an original license key. For more information about original keys, see Types of License Keys on page 279. You cannot use the same license key file for multiple licenses. Each license must have a unique original key. Enter a unique name for each license. You create a name for the license when you create the license. The name must be unique among all objects in the domain. Put the license key file in a location that is accessible by the Administration Console machine. When you create the license object, you must specify the location of the license key file.

You must have full privileges and permission on the domain or folder where you want to create the license. After you create the license, you can change the description. To change the description of a license, select the license in Navigator of the Administration Console, and then click Edit.
To create a license: 1.

In the Administration Console, click Create > License. The Create License window appears.

280

Chapter 14: Managing Licenses

2.

Enter the following options:

Option Name Required/ Optional Required Description Name of the license. The name is not case sensitive and must be unique within the domain. The name cannot have leading or trailing spaces, include carriage returns or tabs, exceed 79 characters, or contain the following characters: / * ? < > " | Description of the license. Domain in which you create the license. Read-only field. File containing the original key. Click Browse to locate the file.

Description Location License File

Optional n/a Required

If you try to create a license using an incremental key, the following message appears:
The requested operation could not be performed due to the following error: An original key must be added before an incremental key can be applied.

You must use an original key to create a license.

3.

Click Create.

Creating a License Object

281

Assigning a License to a Service

Assign a license to an application service before you can enable the service. When you assign a license to a service, the Service Manager updates the license metadata. You can also use the infacmd AssignLicense command to assign a license to a service. To assign a license to a service, you must have full privileges and permission on the license.
To assign a license to a service: 1. 2. 3.

Select the license in the Navigator of the Administration Console. Click the Assigned Services tab. Click Edit. The Assigned Services tab shows the unassigned and assigned services.

4.

Select the services in the Unassigned Services list, and click Assign. Use Ctrl-click to select multiple services. -orUse Shift-click to select a range of services.

5.

Click OK.

Rules and Guidelines

Use the following rules and guidelines when you assign licenses:

You can assign licenses to disabled services. If you want to assign a license to a service that has a license assigned to it, you must first unassign the existing license from the service.

282

Chapter 14: Managing Licenses

To start a service with backup nodes, you must assign it to a license with high availability. To restart a service automatically, you must assign the service to a license with high availability.

Assigning a License to a Service

283

Unassigning a License from a Service

You might need to unassign a license from a service if the service becomes obsolete or you want to discontinue a service. You might want to discontinue a service if you are using more CPUs than you are licensed to use. You can use the Administration Console or the infacmd UnassignLicense command to unassign a license from a service. For more information, see infacmd Command Reference in the Command Line Reference. You must disable a service before you can unassign a license from it. After you unassign the license from the service, you cannot enable the service. You must assign a valid license to the service to reenable it. You must have full privileges and permission on the license to unassign the license from the service. You must disable the service before you can unassign the license. If you try to unassign a license from an enabled service, the following message appears:
Cannot remove service <service name> as it is running. To unassign a license from a service: 1. 2. 3.

Select the license in the Navigator of the Administration Console. Click Assigned Services. Click Edit. The Assigned Services tab shows the unassigned and assigned services.

4. 5.

Select the service in the Assigned Services list, and then click Unassign. Click OK.

284

Chapter 14: Managing Licenses

Updating a License
You can use an incremental key to update an existing license. When you add an incremental key to a license, the Service Manager adds or removes licensed options and updates the license expiration date. You can also use the infacmd UpdateLicense command to add an incremental key to an existing license. For more information, see infacmd Command Reference in the Command Line Reference. Use the following guidelines to update a license:

Ensure the license key file is accessible by the Administration Console machine. When you update the license object, you must specify the location of the license key file. The incremental key must be compatible with the original key. An error appears if the keys are not compatible. For more information about original and incremental key compatibility, see Incremental Keys on page 279.

The Service Manager validates the incremental key against the original key based on the following information:

Serial number Deployment type Distributor PowerCenter edition PowerCenter version

For more information about these properties, see Table 14-1 on page 288.
To update a license: 1. 2. 3. 4. 5. 6. 7.

Select a license in the Navigator. Click Properties. In the General Properties section, click Add to update the license with an incremental key. Select the license file that contains the incremental keys. Click Add. In the General Properties area of the Properties tab, click Edit to edit the description of the license. Click OK.

Updating a License

285

Removing a License
You can remove a license from a domain using the Administration Console or the infacmd RemoveLicense command. For more information about the RemoveLicense command, see infacmd Command Reference in the Command Line Reference. Before you remove a license, disable all services assigned to the license. If you do not disable the services, all running service processes abort when you remove the license. When you remove a license, the Service Manager unassigns the license from each assigned service and removes the license from the domain. To reenable a service, assign another license to it. If you remove a license, you can still view License Usage logs in the Log Viewer for this license, but you cannot run the Domain Activity Monitoring report on this license.
Note: You cannot remove License Usage logs from the Log Viewer.

To remove a license from the domain, you must have full privileges and permission on the license.
To remove a license from the domain: 1. 2.

Select the license in the Navigator of the Administration Console. Click the Delete button.

286

Chapter 14: Managing Licenses

Viewing License Details

You can view license details using the Administration Console or the infacmd ShowLicense command. The license details are based on all license keys applied to the license. The Service Manager updates the existing license details when you add a new incremental key to the license. You might review license details to determine PowerCenter options that are available for use. You may also review the license details and License Usage logs when monitoring PowerCenter licenses. For example, you can determine the number of CPUs your company is licensed to use for each operating system. To view license details, select the license in the Navigator. The Administration Console displays the license properties in the following sections:

General Properties. Shows license attributes, such as the license object name, description, and expiration date. For more information, see General Properties on page 287. Supported Platforms. Shows the operating systems and how many CPUs are supported for each operating system. For more information, see Supported Platforms on page 289. Repositories. Shows the maximum number of license repositories. For more information, see Repositories on page 290. PowerCenter Options. Shows all licensed PowerCenter options, such as session on grid, high availability, and pushdown optimization. For more information, see PowerCenter Options on page 290. Connections. Shows all licensed connections. The license enables you to use connections, such as DB2 and Oracle database connections. For more information, see Connections on page 291. Metadata Exchange Options. Shows a list of all licensed Metadata Exchange options, such as Metadata Exchange for Business Objects Designer. For more information, see Metadata Exchange Options on page 291.

You can also run the Domain Activity Monitoring report to monitor licenses. For more information, see Overview on page 294.

General Properties
You can use the general properties to view high-level information about the license. Use this license information when you audit the licensing usage.

Viewing License Details

287

The general properties for the license appear in the General Properties section of the Properties tab.

Table 14-1 describes the general properties for a license:

Table 14-1. General Properties for a License
Property Name Description Location Edition Software Version Distributed By Issued On Expires On Validity Period Serial Number Required/ Optional n/a Optional n/a n/a n/a n/a n/a n/a n/a n/a Description Name of the license. Description of the license. Path to the license in the Navigator. PowerCenter edition. Version of PowerCenter. Distributor of the PowerCenter product. Date when the license is issued to the customer. Date when the license expires. Period for which the license is valid. Serial number of the license. The serial number identifies the customer or project. If the customer has multiple PowerCenter installations, there is a separate serial number for each project. The original and incremental keys for a license have the same serial number. Level of deployment. Values are Development and Production.

Deployment Level

n/a

288

Chapter 14: Managing Licenses

You can also use the license event logs to view audit summary reports. You must have permission on the domain to view the logs for license events.

Supported Platforms
You assign a license to each service. The service can run on any operating system supported by the license. One PowerCenter license can support multiple operating system platforms. The supported platforms for the license appear in the Supported Platforms section of the Properties tab.

Table 14-2 describes the supported platform properties for a license:

Table 14-2. Supported Platform Properties for a License
Property Description Logical CPUs Issued On Expires Required/ Optional n/a n/a n/a n/a Description Name of the supported operating system. Number of CPUs you can run on the operating system. Date on which the license was issued for this option. Date on which the license expires for this option.

Viewing License Details

289

Repositories
The maximum number of active repositories for the license appear in the Repositories section of the Properties tab.

PowerCenter Options
The license enables you to use PowerCenter options such as data cleansing, data federation, and pushdown optimization. The options for the license appear in the PowerCenter Options section of the Properties tab.

290

Chapter 14: Managing Licenses

Connections
The license enables you to use connections, such as DB2 and Oracle database connections. The license also enables you to use PowerCenter Connects such as PowerCenter Connect for Web Services. The connections for the license appear in the Connections section of the Properties tab.

Metadata Exchange Options

The license enables you to use Metadata Exchange options such as Metadata Exchange for Business Objects Designer and Metadata Exchange for Microstrategy.

Viewing License Details

291

The Metadata Exchange options for the license appear in the Metadata Exchange Options section of the Properties tab.

292

Chapter 14: Managing Licenses

Chapter 15

Monitoring License Usage

This chapter includes the following topics:

Overview, 294 Running the Domain Activity Monitoring Report, 295 CPU Usage, 296 Repository Service Usage, 300

293

Overview
The license specifies the number of authorized PowerCenter repositories and logical central processing units (CPUs) that you can use at any given time. A logical CPU is a CPU thread. For example, if a CPU is dual-threaded, then it has two logical CPUs. You can monitor the usage of logical CPUs and Repository Services in the Domain Activity Monitoring report. You may need to monitor license usage information when you start a new data integration project. If you are using most of your licensed logical CPUs or Repository Services and you want to start a new data integration project, you may need to get a new license to increase the number of authorized logical CPUs or Repository Services. Run the Domain Activity Monitoring report to monitor the following license usage information:

CPU usage. The number of logical CPUs used to run application services in the domain. Each service runs on one or more nodes. Each node is assigned to a physical machine with a given number of logical CPUs. Each license specifies the number of authorized, logical CPUs allowed for application services running on a given operating system. You can monitor CPU usage over a given time period for each license and operating system. For more information, see CPU Usage on page 296. Repository Service usage. The number of Repository Services in the domain. Each Repository Service corresponds to one PowerCenter repository. The domain requires a one-to-one relationship between a Repository Service and a PowerCenter repository. Each license specifies the number of Repository Services authorized to run. You can monitor Repository Service usage over a given time period for each license. For more information, see Repository Service Usage on page 300.

The Domain Activity Monitoring report shows the following license usage information for each application service:
Application Service Integration Service Repository Service SAP BW Service Web Services Hub License Usage Information CPU usage CPU usage and Repository Service usage CPU usage CPU usage

294

Chapter 15: Monitoring License Usage

Running the Domain Activity Monitoring Report

The Domain Activity Monitoring report displays the maximum number of logical CPUs and Repository Services used each day in a selected time period. When you run the report, you must specify the time period and the licenses for which you want to view results. You can run the report to view information on one or all licenses in the domain. The following figure shows how to specify the time period and licenses for the Domain Activity Monitoring report:

Select Last to view the most recent log events for the last X days or months. Select From Date to view log events between a from date and to date. Use the yyyy-mm-dd format when you enter the dates.

Select one or Click the Go all licenses. button to run the report.

You run the Domain Activity Monitoring report from the Administration tab in the Administration Console. You must have permission on the domain to access the Administration tab.
Note: If the master gateway node runs on a UNIX machine and the UNIX machine does not

have a graphics display server, you must install X Virtual Frame Buffer on the UNIX machine to view the report charts. If you have multiple gateway nodes running on UNIX machines, install X Virtual Frame Buffer on each UNIX machine. For more information about installing X Virtual Frame Buffer, see Before You Install in the Installation and Configuration Guide.
To run the Domain Activity report: 1. 2.

Click the Administration tab in the Administration Console. Click Domain Activity Monitoring. The Domain Activity Monitoring report appears.

3. 4.

Select a time period and the licenses for which you want to view the report. Click the Go button to run the report.

Running the Domain Activity Monitoring Report

295

CPU Usage
You can run the Domain Activity Monitoring report to monitor CPU usage. The Domain Activity Monitoring report displays the maximum number of logical CPUs used each day in a selected time period. A logical CPU is a CPU thread. For example, if a CPU is dual-threaded, then it has two logical CPUs. The report counts the number of logical CPUs on all nodes that are running application services. The report groups logical CPU totals by license and operating system. For example, your domain has one SAP BW Service, two Integration Services, and one Repository Service. You assign SAP BW Service 1, Repository Service 1, and Integration Service 1 to license A. You assign Integration Service 2 to license B. You run SAP BW Service 1 on Node X, which is hosted on a Windows machine with 16 logical CPUs. You run Repository Service 1 and Integration Service 1 on Node Y, which is hosted on a Windows machine with 8 logical CPUs. You run Integration Service 2 on Node Z, which is hosted on a UNIX machine with 4 logical CPUs. The following table summarizes the information in the example:
License License A License A License A License B Application Service SAP BW Service 1 Repository Service 1 Integration Service 1 Integration Service 2 Node:Operating System (# of logical CPUs) Node X: Windows (16 logical CPUs) Node Y: Windows (8 logical CPUs) Node Y: Windows (8 logical CPUs) Node Z: UNIX (4 logical CPUs)

The report displays the following logical CPU totals for each license and operating system combination:
License / Operating System License A / Windows License B / UNIX Total Number of Logical CPUs 24 logical CPUs (16 from Node X and 8 from Node Y) 4 logical CPUs (from Node Z)

The report displays the results in the following formats:

Chart Table

296

Chapter 15: Monitoring License Usage

CPU Usage Analysis Chart

The CPU Usage Analysis chart in the Domain Activity Monitor report shows the maximum number of logical CPUs used each day for all months in the specified time period. You can specify a threshold in the chart to determine if you have exceeded the threshold. For example, you can find out if you have ever exceeded six logical CPUs on a given day. The following figure shows the CPU Usage Analysis chart.
Set the threshold.

Threshold line. All points above this line represent times when you have exceeded the threshold.

Shows the maximum number of CPUs used each day in the specified time period.

Shows the dates included in the specified time period.

CPU Usage Per Day Table

The CPU Usage Per Day table shows the maximum number of logical CPUs used each day for all months in the specified time period. The following figure shows the CPU Usage Per Day table.

Specifies the month and year.

Maximum number of logical CPUs used on the given day. Click the number to view more details about CPU usage for application services and nodes for the given day.

Specifies the day of the month.

Application services run on nodes. Each node runs on a machine with a given number of logical CPUs. You can view all application services and nodes associated with the number of logical CPUs for a particular day. For example, you notice that there is a high number of logical CPUs for a particular day. You click the number of logical CPUs for that day to determine the cause of the high CPU usage. You find that your organization ran a large

CPU Usage

297

number of Integration Service processes to complete workflow jobs. You can now evaluate whether you need additional licenses for more logical CPUs. When you click a number in the CPU Usage Per Day table, the CPU Usage Analysis window appears. The CPU Usage Analysis window displays the following tables:

CPU Usage Per Node CPU Usage Per Service

CPU Usage Per Node Table

The CPU Usage Per Node table shows the total number of logical CPUs for each node for the specified day. The table lists all nodes that were running application services when the maximum logical CPU count was recorded. The following figure shows the CPU Usage Per Node table.

Name of node.

Number of CPUs on the machine hosting the node.

CPU Usage Per Service Table

The CPU Usage Per Service table shows the total number of logical CPUs for each application service for the specified day. The table lists all application services that were running when the maximum logical CPU count was recorded. If an application service is not running when the count is recorded, the application service does not appear in the table for that day. All application services, except the Integration Service, run on a single node. The number of logical CPUs for these services represents the number of logical CPUs on the machine running the node. An Integration Service can run on one or more nodes. If you have the server grid or session on grid option, the Integration Service can run on multiple nodes. The number of logical CPUs for an Integration Service represents the total number of CPUs for all nodes running the Integration Service processes.

298

Chapter 15: Monitoring License Usage

The following figure shows the CPU Usage Per Service table.

Name of the application service.

Total number of CPUs on the machine running the application service. If the application service is an Integration Service that runs on multiple nodes, this is the total number of CPUs on all machines running the Integration Service.

Note: The sum of all logical CPUs for the application services in this table may not add up to

the maximum number of CPUs specified in the CPU Usage Analysis table. If multiple application services run on the same node, each application service displays a CPU total in this table.

CPU Usage

299

Repository Service Usage

You can run the Domain Activity Monitoring report to monitor Repository Service usage. The Domain Activity Monitoring report displays the maximum number of Repository Services for each day in a selected time period. The report displays a separate number of Repository Services for each license. The report calculates the total number of Repository Services assigned to a given license. For example, there are two Integration Services that run workflows for Repository A. The domain also contains an SAP BW Service associated with Repository B. Repository A and Repository B are assigned to the same license. The Domain Activity Monitoring report calculates two Repository Services for the license. The report groups Repository Service counts by license. The report determines the license of the Repository Service based on the license to which the Repository Service is assigned. The report displays the results in the following formats:

Chart Table

Repository Service Usage Analysis Chart

The Repository Service Usage Analysis chart in the Domain Activity Monitor report shows the maximum number of Repository Services used each day for all months in the specified time period. You can specify a threshold in the chart to determine if you have exceeded the threshold. For example, you can find out if you have ever exceeded three Repository Services on a given day. The following figure shows the Repository Service Usage Analysis chart.
Set the threshold.

Threshold line. All points above this line represent times when you have exceeded the threshold.

Shows the maximum number of Repository Services used each day in the specified time period.

Shows the dates included in the specified time period.

300

Chapter 15: Monitoring License Usage

Repository Service Usage Analysis Table

The Repository Service Usage Analysis table shows the maximum number of Repository Services used each day for all months in the specified time period. The following figure shows the Repository Service Usage Analysis table.

Specifies the month and year.

Maximum number of Repository Services used on the given day. Click the number to view the Repository Services and the nodes to which the Repository Services are assigned for that day.

Specifies the day of the month.

When you click a daily maximum in the Repository Service Usage Analysis table, the Repository Service Usage Analysis window appears.

Name of node that runs the Repository Service.

Name of Repository Service.

The Repository Service Usage Analysis window shows the node to which each Repository Service is assigned on the specified day. The table lists all nodes that were running Repository Services when the maximum Repository Service count was recorded. If a Repository Service is not running when the count is recorded, the Repository Service does not appear in the table for that day.

Repository Service Usage

301

302

Chapter 15: Monitoring License Usage

Chapter 16

Managing Logs

This chapter includes the following topics:

Overview, 304 Log Manager Architecture, 306 Configuring the Log Location, 309 Configuring Log Management, 310 Using the Log Viewer, 315 Understanding Log Events, 322

303

Overview
The Service Manager provides accumulated log events from each service in the domain and for sessions and workflows. To perform the logging function, the Service Manager runs a Log Manager and a Log Agent. The Log Manager runs on the master gateway node. It collects and processes log events for Service Manager domain operations and application services. The log events contain operational and error messages for a domain. The Service Manager and the application services send log events to the Log Manager. When the Log Manager receives log events, it generates log event files. You can view service log events in the Administration Console based on criteria you provide. The Log Agent runs on the nodes to collect and process log events for session and workflows. Log events for workflows include information about tasks performed by the Integration Service, workflow processing, and workflow errors. Log events for sessions include information about the tasks performed by the Integration Service, session errors, and load summary and transformation statistics for the session. You can view log events for the last workflow run with the Log Events window in the Workflow Monitor. Log event files are binary files that the Administration Console Log Viewer uses to display log events. When you view log events in the Administration Console, the Log Manager uses the log event files to display the log events for the domain or application service. For more information about how the Log Manager generates log event files, see Log Manager Architecture on page 306. You can use the Administration Console to perform the following tasks with the Log Manager:

Configure the log location. Configure the node that runs the Log Manager, the directory path for log event files, purge options, and time zone for log events. For more information, see Configuring the Log Location on page 309. Configure log management. Configure the Log Manager to purge logs or purge logs manually. Export log events to XML, text, or binary files. Configure the time zone for the time stamp in the log event files. For more information, see Configuring Log Management on page 310. View log events. View domain function and application service log events in the Log Viewer. Search log events by domain or by application service type. For more information about using the Log Viewer, see Using the Log Viewer on page 315.

For more information about log event types, see Understanding Log Events on page 322.

304

Chapter 16: Managing Logs

The following figure shows the Log Viewer in the Administration Console:

Log Event Detail

Log Events

Query Options

Overview

305

Log Manager Architecture

The Service Manager on the master gateway node controls the Log Manager. The Log Manager starts when you start the Informatica Services. After the Log Manager starts, it listens for log events from the Service Manager and application services. When the Log Manager receives log events, it generates log event files. The Log Manager stores session and workflow logs in a separate location from the domain and application service logs. The Integration Service writes session and workflow log events to binary files on the node where the Integration Service process runs. The Log Manager performs the following tasks to process session and workflow logs: 1. 2. During a session or workflow, the Integration Service writes binary log files on the node. It sends information about the logs to the Log Manager. The Log Manager stores information about workflow and session logs in the domain database. The domain database stores information such as the path to the log file location, the node that contains the log, and the Integration Service that created the log. When you view a session or workflow in the Log Events window, the Log Manager retrieves the information from the domain database to determine the location of the session or workflow logs. The Log Manager dispatches a Log Agent to retrieve the log events on each node to display in the Log Events window.

3.

4.

You view session and workflow logs in the Log Events window of the Workflow Monitor. For more information about viewing log events in the Workflow Monitor, see Session and Workflow Logs in the Workflow Administration Guide. The Log Manager creates the following types of log files:

Log events files. Stores log events in binary format. The Log Manager creates log event files to display log events in the Log Viewer. When you view events in the Administration Console, the Log Manager retrieves the log events from the event nodes. The Log Manager stores the files by date and by node. You configure the directory path for the Log Manager in the Administration Console when you configure gateway nodes for the domain. By default, the directory path is the server\infa_shared\log directory.

Guaranteed Message Delivery files. Stores Service Manager and application log events. Domain and application services write log events to temporary Guaranteed Message Delivery files and send the log events to the Log Manager. If the Log Manager becomes unavailable, the Guaranteed Message Delivery files stay in the server\tomcat\logs directory on the node where the service runs. When the Log Manager becomes available, the Service Manager for the node reads the log events in the temporary files, sends the log events to the Log Manager, and deletes the temporary files.

306

Chapter 16: Managing Logs

Log Manager Recovery

When a service generates log events, it sends them to the Log Manager on the master gateway node. When you have the high availability option and the master gateway node becomes unavailable, the application services send log events to the Log Manager on a new master gateway node. Figure 16-1 shows how the Service Manager, the application services, and the Log Manager process log events:
Figure 16-1. Log Event Processing
4 Node 2 Service Manager 4 Node 1 (Gateway) Service Manager

Application Services Application Services 2 server/tomcat/logs Log Manager - GMD file - GMD file Log Manager directory - GMD file log event files

3 4

The Service Manager, the application services, and the Log Manager perform the following tasks: 1. 2. 3. 4. An application service process writes log events to a Guaranteed Message Delivery file. The application service process sends the log events to the Service Manager on the gateway node for the domain. The Log Manager processes the log events and writes log event files. The application service process deletes the temporary file. If the Log Manager is unavailable, the Guaranteed Message Delivery files stay on the node running the service process. The Service Manager for the node sends the log events in the Guaranteed Message Delivery files when the Log Manager becomes available, and the Log Manager writes log event files.

Troubleshooting the Log Manager

Domain and application services write log events to Service Manager log files when the Log Manager cannot process log events. The Service Manager log files are located in the server\tomcat\logs directory. The Service Manager log files include catalina.out, localhost_<date>.txt, and node.log. Services write log events to different log files depending on the type of error.

Log Manager Architecture

307

Use the Service Manager log files to troubleshoot issues when the Log Manager cannot process log events. You will also need to use these files to troubleshoot issues when you contact Informatica Technical Support.
Note: You can troubleshoot a PowerCenter installation by reviewing the log files generated

during installation. You can use the installation summary log file to find out which components failed during installation. For more information about using installation summary log files, see Troubleshooting a PowerCenter Installation in the Installation and Configuration Guide.

308

Chapter 16: Managing Logs

Configuring the Log Location

The Service Manager on the master gateway node writes domain and application log event files to the log file directory. When you configure a node to serve as a gateway, you must configure the directory where the Service Manager on this node writes the log event files. Each gateway node must have access to the directory path. You configure the log location in the Log and Gateway Configuration area on the Properties tab for the Domain. Configure a directory location that is accessible to the gateway node. Store the logs on a shared disk when you have more than one gateway node. If the Log Manager is unable to write to the directory path, it writes log events to node.log on the master gateway node. The following figure shows the domain properties Log and Gateway Configuration section:

The directory path for the log files defaults to infa_shared\log.

When you configure the log location, the Administration Console validates the directory as you update the configuration. If the directory is invalid, the update fails. The Log Manager verifies that the log directory has read/write permissions on startup. Log files might contain inconsistencies if the log directory is not shared in a highly available environment. If you have multiple PowerCenter domains, you must configure a different directory path for the Log Manager in each domain. Multiple domains cannot use the same shared directory path.
Note: When you change the directory path, you must restart Informatica Services on the node you changed.

Configuring the Log Location

309

Configuring Log Management

The Service Manager and the application services continually send log events to the Log Manager. As a result, the directory location for the logs can grow to contain a large number of log events. You can purge logs events periodically to manage the amount of log events stored by the Log Manager. You can export logs before you purge them to keep a backup of the log events. You can perform the following tasks on the Log Management tab for the domain:

Purge log events. Configure the Log Manager to purge logs after a certain number of days or when the directory containing the log event files reaches a maximum size. You can also manually purge log events. For information about purging log events, see Purging Log Events on page 310. Export log events. You can export log events to XML, text, or binary files. For more information about exporting log events, see Exporting Log Events on page 311. Set time zone. Configure the time zone for the time stamp in the log event files. For information about setting the time zone, see Configuring the Time Zone on page 314.

The following figure shows the Log Management tab:

Purging Log Events

You can automatically or manually purge log events. The Service Manager purges log events from the log directory according to the purge properties you configure in the Administration Console Log Management tab. You can manually purge log events to override the automatic purge properties.

Purging Log Events Automatically

The Service Manager purges log events from the log directory according to the purge properties. The default value for preserving logs is 30 days and the default maximum size for log event files is 200 MB. When the number of days or the size of the log directory exceeds the limit, the Log Manager deletes the log event files, starting with the oldest log events. The Log Manager periodically
310 Chapter 16: Managing Logs

verifies the purge options and purges log events. The Log Manager does not purge session and workflow log files.

Purging Log Events Manually

You can purge log events for the domain or application services. When you purge log events, the Log Manager removes the log event files from the log directory. The Log Manager does not remove log event files currently being written to the logs. Optionally, you can use the infacmd PurgeLog command to purge log events. For more information about infacmd, see infacmd Command Reference in the Command Line Reference. To purge log events for the domain or application service, you must have full privileges and permission on the domain. For more information about privileges and permissions, see Managing Permissions and Privileges on page 72. The following figure shows the purge log options of the Administration Console Log Management tab:

Table 16-1 lists the purge log options:

Table 16-1. Purge Log Options
Option Log Type Service Type Purge Entries Description Application service for which to purge log events. You can purge Domain, Service, or all log events. When you purge Service, you can purge all application service types, Repository Service, Integration Service, SAP BW, or Web Services Hub. Date range of log events you want to purge. You can select the following options: - All Entries. Purges all log events. - Before Date. Purges log events that occurred before this date. Use the yyyy-mm-dd format when you enter a date. Optionally, you can use the calendar to choose the date. To use the calendar, click the date field.

Exporting Log Events

You can export domain and application log events in XML, text, or binary format. When you export log events, you can choose the sort order of the exported log events. The Log Manager does not delete the log events when you export them. The Administration Console prompts you to save or open the exported log events file.
Configuring Log Management 311

Optionally, you can use the infacmd GetLog command to retrieve log events. For more information about infacmd, see infacmd Command Reference in the Command Line Reference. The format you choose to export log events depends on how you plan to use the exported log events file:

XML file. Use XML format if you want to analyze the log events in an external tool that uses XML or if you want to use XML tools, such as XSLT. Text file. Use a text file if you want to analyze the log events in a text editor. Binary file. Use binary format to back up the log events in binary format. You might need to use this format to send log events to Informatica Technical Support.

The following figure shows the export log options in the Log Management tab for the domain:

Table 16-2 lists the export log options:

Table 16-2. Export Log Options
Option Service Type Log Type Service Description Type of application service for which to export log events. You can export log events for Repository Service, Integration Service, SAP BW Service, or Web Services Hub. You can also export log events for all service types. Date range of log events you want to export. You can select the following options: - All Entries. Exports all log events. - Before Date. Exports log events that occurred before this date. Use the yyyy-mm-dd format when you enter a date. Optionally, you can use the calendar to choose the date. To use the calendar, click the date field. Exports log events starting with the most recent log events.

Export Entries

Domain, Service

Export logs in descending chronological order

Domain, Service

312

Chapter 16: Managing Logs

XML Format
When you export log events to an XML file, the Log Manager exports each log event as a separate element in the XML file. The following example shows an excerpt from a log events XML file:
<log xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:common="http:// www.informatica.com/pcsf/common" xmlns:metadata="http:// www.informatica.com/pcsf/metadata" xmlns:domainservice="http:// www.informatica.com/pcsf/domainservice" xmlns:logservice="http:// www.informatica.com/pcsf/logservice" xmlns:xsi="http://www.w3.org/2001/ XMLSchema-instance"> <logEvent xsi:type="logservice:LogEvent" objVersion="1.0.0" timestamp="1129098642698" severity="3" messageCode="AUTHEN_USER_LOGIN_SUCCEEDED" message="User Admin successfully logged in." user="Admin" stacktrace="" service="authenticationservice" serviceType="PCSF" clientNode="sapphire" pid="0" threadName="http-8080-Processor24" context="" /> <logEvent xsi:type="logservice:LogEvent" objVersion="1.0.0" timestamp="1129098517000" severity="3" messageCode="LM_36854" message="Connected to node [garnet] on outbound connection [id = 2]." user="" stacktrace="" service="Copper" serviceType="IS" clientNode="sapphire" pid="4484" threadName="4528" context="" />

Text Format
When you export log events to a text file, the Log Manager exports the log events in Information and Content Exchange (ICE) Protocol. The following example shows an excerpt from a log events text file:
2006-02-27 12:29:41 : INFO : (2628 | 2768) : (IS | Copper) : sapphire : LM_36522 : Started process [pid = 2852] for task instance Session task instance [s_DP_m_DP_AP_T_DISTRIBUTORS4]:Executor - Master. 2006-02-27 12:29:41 : INFO : (2628 | 2760) : (IS | Copper) : sapphire : CMN_1053 : Starting process [Session task instance [s_DP_m_DP_AP_T_DISTRIBUTORS4]:Executor - Master]. 2006-02-27 12:29:36 : INFO : (2628 | 2760) : (IS | Copper) : sapphire : LM_36522 : Started process [pid = 2632] for task instance Session task instance [s_DP_m_DP_AP_T_DISTRIBUTORS4]:Preparer. 2006-02-27 12:29:35 : INFO : (2628 | 2760) : (IS | Copper) : sapphire : CMN_1053 : Starting process [Session task instance [s_DP_m_DP_AP_T_DISTRIBUTORS4]:Preparer].

Binary Format
When you export log events to a binary file, the Log Manager exports the log events to a file that Informatica Technical Support can import. You cannot view the file unless you convert it to text. You can use the infacmd ConvertLogFile command to convert binary log files to text files, XML files, or readable text on the screen.

Configuring Log Management

313

Configuring the Time Zone

When the Log Manager creates log event files, it generates a time stamp based on the time zone for each log event. When the Log Manager creates log folders, it labels folders according to a time stamp. When you export or purge log event files, the Log Manager uses this property to calculate which log event files to purge or export. Set the time zone to the location of the machine that stores the log event files. Verify that you do not lose log event files when you configure the time zone for the Log Manager. If the application service that sends log events to the Log Manager is in a different time zone than the master gateway node, you may lose log event files you did not intend to delete. Configure the same time zone for each gateway node.
Note: When you change the time zone, you must restart Informatica Services on the node that

you changed.

Steps to Configure Log Management Properties

Configure the Log Management properties in the Log Management tab of the Administration Console.
To configure the log management properties: 1. 2. 3. 4. 5.

In the Administration Console, click the Log Management tab for the domain. Click Edit. Enter the number of days for the Log Manager to preserve log events. Enter the maximum disk size for the directory that contains the log event files. Enter the time zone in the following format:
GMT(+|-)<hours>:<minutes>

For example: GMT+08:00

6.

Click OK.

314

Chapter 16: Managing Logs

Using the Log Viewer

You can view domain or application service log events in the Administration Console Log Viewer. You can view log events in the Log Viewer or the Log tab associated with an application service in the domain. When you view log events in the Log Viewer, the Log Manager displays the generated log event files in the log directory. To view log events, you must have permission on the domain or application service object in the Administration Console. For example, you need domain permission to view log events for the domain. You need permission on the Repository Service to view log events for the Repository Service. You can use the Log Viewer to perform the following tasks:

View log events, log event details, and Administration Console operational errors. View log events for the domain or for an application service. Use the query options to select the log events for the domain or application service you want to view. Search log event results. After you display the log events, you can search for log events that match search criteria you configure. For more information, see Searching Log Event Results on page 318. Configure columns. Configure the columns you want the Log Viewer to display. For more information about configuring columns, see Configuring Log Viewer Columns on page 319. Save log events. You can save log events in XML, text, and binary format. For more information about saving log events, see Saving Log Events on page 320.

Using the Log Viewer

315

The following figure shows the Log Viewer:

Set query options.

Navigate Log Viewer pages.

View search results.

Event Detailer Window

Search log event results.

Save log events, customize columns.

Viewing Log Events

To view log events, you need to configure the query options in the Logs tab of the Administration Console. You can configure the log type, application service type or domain function category, application service name, the date range, and the severity level for the log events you want to view. The available options depend on whether you choose to view domain or application service log events. You can configure additional search options, including query parameters to include or exclude from the results. For more information about the log event components for domain or application log events, see Understanding Log Events on page 322. After you search for log events, you can view the log events, configure the amount of log events you want to view on each page in the Log Viewer, and navigate through the pages of
316 Chapter 16: Managing Logs

log event results. You can also view more information about a log event by clicking on the log event in the search results. If the Log Manager receives an internal error message from the Service Manager, it writes a stack trace to the log event detailer window. You can view logs to get more information about errors you receive while working in the Administration Console. When an error message appears in the Administration Console, the error provides a link to the Log Viewer. For more information, see Viewing Administration Console Log Errors on page 321.
To view log events: 1.

Click the Logs tab in the Administration Console. The Log Viewer appears.

2. 3. 4.

Expand the Query Options area if it does not display. In the Query Options area, select Domain or Service for the log type. Configure the query options to view log events. Table 16-3 lists the query options:
Table 16-3. Query Options for Log Viewer
Log Type Service Domain Service Domain, Service Option Service Type Category Service Name Date Range Description Type of service log events you want to view. You can choose a single application service type or all application service types. Category of domain service you want to view. You can choose a single domain service or all services for the domain. Name of the application service for which you want to view log events. You can choose a single application service name or all application services. Date range for the log events you want to view. You can choose the following options: - All Entries. View all log events. - From Date. View log events that occurred starting from this date. You must also configure the start and end dates for this option. - For Date. View log events that occurred on a particular date. - Last. View the most recent log events. You must configure the number and time period (days, hours, or minutes) for which you want to view log events. Use the yyyy-mm-dd format when you enter a date. Optionally, you can use the calendar to choose the date. To use the calendar, click the date field. Search criteria for a log event field to include log events returned by the Log Manager. You can configure search criteria for the following log event fields: - Message Code - Message - Node - Thread You can also use wildcards (*) in this field.

Domain, Service

Include

Using the Log Viewer

317

Table 16-3. Query Options for Log Viewer

Log Type Domain, Service Option Exclude Description Search criteria for a log event field to exclude log events returned by the Log Manager. You can configure search criteria for the following log event fields: - Message Code - Message - Node - Thread You can also use wildcards (*) in this field. The Log Manager returns log events with this severity level.

Domain, Service 5.

Severity

Click Go. The Log Manager retrieves the log events and displays them in the Log Viewer with the most recent log events first. Use the up and down keyboard buttons to browse the log events.

6.

When you configure the Log Viewer to display the log event detailer window, you can view more information about a log event. Click the log event in the search results to display more information about the event in the log event detailer. The Log Viewer highlights the log event and displays more information about the log event in the log event detailer window:

For more information about the log event detailer, see Configuring Log Viewer Columns on page 319.
7.

To configure the number of log events to display in the search results page, select the maximum amount of log events to display from the Show list. You can configure the Log Viewer to display 50, 100, or 200 log events per page.

8.

To navigate through the pages of search results, click the navigation arrows. You can scroll forward and back one page at a time or you can go directly to the beginning or the end of the search results.

Searching Log Event Results

After you display log events in the Log Viewer, you can search for log events. You configure the search criteria and the log event field to search. If the Log Manager finds the search criteria on the page, it highlights the log event. You can use the Next and Previous buttons to move between pages in the Log Viewer that match the search criteria.

318

Chapter 16: Managing Logs

To search log event results on the current page: 1. 2.

Select the log event field you want to search. Enter the search criteria. You can use wildcards (*) for the search criteria.

3.

Click Next. The Log Viewer highlights the log events that match the search criteria.

4. 5.

To view the next page in the Log Viewer that contains log events that match the search criteria, click Next. Click Previous to move to the previous page in the search results that contains log events that match the search criteria.

Figure 16-2 shows the results of a successful search:

Figure 16-2. Search Log Events Results
Field to search Navigate results Search criteria

Highlighted log event

Configuring Log Viewer Columns

You can configure the columns to display when you view log events. Click the Display Settings link in the Logs tab of the Administration Console to display the Display Setting tab and configure the Log Viewer columns. You can configure the Log Viewer to display the following columns:

Message MessageCode ProcessID Node Thread Time stamp Severity

Note: Service Name or Category always appear depending on the query options you choose.

For example, when you display a service type, the service name always appears in the Log Viewer.
Using the Log Viewer 319

You can also configure the Log Viewer to display more details about selected log events. The information displays in the log event detailer below the search results.
To configure the columns for the Log Viewer: 1.

In the Log Viewer, click the Display Settings link. The Display Settings tab appears.

Add a column. Remove a column.

Display detail information about selected log events. 2. 3. 4. 5.

To add a column, select the name of the field you want to add in the right column and click Add. To remove a column, select the name of the field in the left column and click the Remove button. Optionally, choose to display detail information about selected log events below the search results. The log events detailer window does not appear by default. Click OK. The Log Manager updates the Log Viewer configuration and updates the Log Viewer with the added or removed columns.

Saving Log Events

When you view log events in the Log Viewer, you can save the log events to an XML, text, or binary file. When you save log events, the Log Manager saves the events from the most recent search. You can use the Save link in the Logs tab in the Administration Console to save log events to a file. For more information about saving log events to different file formats, see Exporting Log Events on page 311.

320

Chapter 16: Managing Logs

Viewing Administration Console Log Errors

If you receive an error while starting, updating, or removing services in the Administration Console, the error message at the top of the Administration Console provides a link to the Log Viewer. Click the link in the error message to access detail information about the error in the Log Viewer.

Using the Log Viewer

321

Understanding Log Events

The Service Manager and application services send log events to the Log Manager. The Log Manager generates log events for each service type. To view the log events in the Log Viewer, you must configure the type of log events you want to search for in the Log Viewer. You can view the following log event types in the Log Viewer:

Domain log events. Log events generated from the Service Manager functions. For more information, see Domain Log Events on page 323. Repository Service log events. Log events from each Repository Service running in the domain. For more information, see Repository Service Log Events on page 324. Integration Service log events. Log events about each Integration Service running in the domain.For more information, see Integration Service Log Events on page 324. SAP BW Service log events. Log events about the interaction between the PowerCenter and the SAP BW system. For more information, see SAP BW Service Log Events on page 324. Web Services Hub log events. Log events about the interaction between applications and the Web Services Hub. For more information, see Web Services Hub Log Events on page 325.

Log Event Components

The Log Manager uses a common format to store and display log events. You can use the components of the log events to troubleshoot PowerCenter. Each log event contains the following components:

Service name or category. The Log Viewer categorizes events by service type or domain category based on the type of service you view. If you view Service Logs, the Log Viewer groups service names. When you view domain logs, the Log Viewer displays the domain categories in the log. Message. Message text for the log event. Use the message text to get more information about the log event. Some log events contain embedded log event in the message texts. For example, the following log events contains an embedded log event:
Client application [PmDTM], connection [59]: recv failed.

In this log event, the following log event is the embedded log event:
[PmDTM], connection [59]: recv failed.

When the Log Manager displays the log event, the Log Manager displays the severity level for the embedded log event.

Message code. Log event code. You can use the message code to get more information about the log event in the Troubleshooting Guide. ProcessID. The process identification number for the Windows or UNIX service process that generated the log event. You can use the process identification number to identify log

322

Chapter 16: Managing Logs

events from a process when an application service runs multiple processes on the same node.

Node. Name of the node running the process that generated the log event. Thread. Identification number or name of a thread started by a Repository Service process or name of a thread started by an Integration Service process. For more information about thread identification, see Processing Threads on page 211. Time stamp. Date and time the log event occurred. Severity. The severity level for the log event. When you view log events, you can configure the Log Viewer to display only log events for a severity level. For more information about log event severity level, see Configuring Node Properties on page 46.

Domain Log Events

Domain log events are log events generated from the domain functions the Service Manager performs. Use the domain log events to view information about the domain and troubleshoot issues. You can use the domain log events to troubleshoot issues related to the startup and initialization of nodes and application services for the domain. Domain log events include log events from the following functions:

Authentication. Log events from authentication of user requests from the Administration Console and from infacmd. Authorization. Log events that occur when the Service Manager authorizes user requests for services. Requests can come from the Administration Console or from infacmd. Domain Configuration. Log events that occur when the Service Manager manages the domain configuration metadata. Licensing. Log events that occur when the Service Manager registers license information. For more information, see Managing Licenses on page 275. License Usage. Log events that occur when the Service Manager verifies license information from application services. For more information, see Managing Licenses on page 275. Log Manager. Log events from the Log Manager. The Log Manager runs on the master gateway node. It collects and processes log events for Service Manager domain operations and application services. Log Agent. Log events from the Log Agent. The Log Agent runs on all nodes that process workflows and sessions in the domain. It collects and processes log events from workflows and sessions. Node Configuration. Log events that occur as the Service Manager manages node configuration metadata in the domain. Service Manager. Log events from the Service Manager. The Service Manager manages all domain operations.

Understanding Log Events

323

Repository Service Log Events

The Repository Service log events contain information about each Repository Service running in the domain. Repository Service log events contain the following information:

Repository connections. Log events for connections to the repository from PowerCenter client applications, including repository user name and the host name and port number for the client application. Repository objects. Log events for repository objects locked, fetched, inserted, or updated by the Repository Service. Repository Service processes. Log events about Repository Service processes, including starting and stopping the Repository Service and information about repository databases used by the Repository Service processes. Also includes repository operating mode, the nodes where the Repository Service process runs, initialization information, and internal functions used. Repository operations. Log events for repository operations, including creating, deleting, restoring, and upgrading repository content, copying repository contents, and registering and unregistering local repositories. Licensing. Log events about Repository Service license verification. For more information about Licensing, see Managing Licenses on page 275. Security audit trails. Log events for changes to repository users, groups, privileges, and permissions made in the Repository Manager. To include security audit trails in the Repository Service log events, you must enable the SecurityAuditTrail general property for the Repository Service in the Administration Console. For more information, see Configuring Repository Service Properties on page 112.

Integration Service Log Events

The Integration Service log events contain information about each Integration Service running in the domain. Integration Service log events contain the following information:

Integration Service processes. Log events about the Integration Service processes, including service ports, code page, operating mode, service name, and the associated repository and Repository Service status. Licensing. Log events for license verification for the Integration Service by the Service Manager. For more information about licenses, see Managing Licenses on page 275.

SAP BW Service Log Events

The SAP BW Service log events contain information about the interaction between PowerCenter and the SAP BW system.

324

Chapter 16: Managing Logs

SAP BW log events contain the following log events for an SAP BW Service:

BW system log events. Requests from the BW system to start a workflow and status information from the ZPMSENDSTATUS ABAP program in the BW process chain. Integration Service log events. Session and workflow status for sessions and workflows that use an Integration Service process to load data to or extract data from BW.

To view log events about how the Integration Service processes a BW workflow, you must view the session or workflow log. For more information about viewing session and workflow logs, see Session and Workflow Logs in the PowerCenter Workflow Administration Guide. For more information about the SAP BW Service, see Creating and Configuring the SAP BW Service on page 251.

Web Services Hub Log Events

The Web Services Hub log events contain information about the interaction between applications and the Web Services Hub. Web Services Hub log events contain the following log events:

Web Services processes. Log events about web service processes, including starting and stopping Web Services Hub, web services requests, the status of the requests, and error messages for web service calls. Log events include information about which service workflows are fetched from the repository. Integration Service log events. Workflow and session status for service workflows including invalid workflow errors.

For more information about the Web Services Hub, see Creating and Configuring the Web Services Hub, 261.

Understanding Log Events

325

326

Chapter 16: Managing Logs

Chapter 17

Understanding Globalization

This chapter includes the following topics:

Overview, 328 Locales, 331 Data Movement Modes, 333 Code Page Overview, 336 Code Page Compatibility, 339 PowerCenter Code Page Validation, 346 Relaxed Code Page Validation, 348 PowerCenter Code Page Conversion, 351 Case Study: Processing ISO 8859-1 Data, 353 Case Study: Processing Unicode UTF-8 Data, 357

327

Overview
PowerCenter can process data in different languages. Some languages require single-byte data, while other languages require multibyte data. To process data correctly in PowerCenter, you must set up the following items:

Locale. When you install PowerCenter, you must specify the locale. The locale specifies the language, territory, encoding of character set, and collation order. Use the same locale as the operating system locale. For more information about locales, see Locales on page 331. Data movement mode. The Integration Service can process single-byte or multibyte data and write it to targets. When you install PowerCenter, you must decide if you want the Integration Service to process single-byte data or multibyte data. Use the ASCII data movement mode to process single-byte data. Use the Unicode data movement mode for multibyte data. For more information about data movement modes, see Data Movement Modes on page 333. Code pages. Code pages contain the encoding to specify characters in a set of one or more languages. You select a code page based on the type of character data you want to process. To ensure accurate data movement, you must ensure compatibility among code pages for PowerCenter and environment components. You use code pages to distinguish between US-ASCII (7-bit ASCII), ISO 8859-1 (8-bit ASCII), and multibyte characters.

To ensure data passes accurately through your environment, the following components must work together:

Operating system locale settings Operating system code page Integration Service data movement mode Code page for each Integration Service process PowerCenter Client code page PowerCenter repository code page Source and target database code pages

You can configure the Integration Service for relaxed code page validation. Relaxed validation removes restrictions on source and target code pages. This chapter provides case studies that show how to configure your environment to process the following types of data:

ISO 8859-1 multibyte data UTF-8 multibyte data

For more information about code pages, see Code Page Overview on page 336.

328

Chapter 17: Understanding Globalization

Unicode
The Unicode Standard is the work of the Unicode Consortium, an international body that promotes the interchange of data in all languages. The Unicode Standard is designed to support any language, no matter how many bytes each character in that language may require. Currently, it supports all common languages and provides limited support for other less common languages. The Unicode Consortium is continually enhancing the Unicode Standard with new character encodings. For more information about the Unicode Standard, see http://www.unicode.org. The Unicode Standard includes several character sets. PowerCenter uses the following Unicode standards:

UCS-2 (Universal Character Set, double-byte). A character set in which each character uses two bytes. UTF-8 (Unicode Transformation Format). An encoding format in which each character can use between one to six bytes. Currently, the Unicode Standard does not use more than four bytes to encode characters.

PowerCenter is a Unicode application. The PowerCenter Client and Integration Service use UCS-2 internally. The PowerCenter Client converts user input from any language to UCS-2 and converts it from UCS-2 before writing to the repository. The Integration Service converts source data to UCS-2 before processing and converts it from UCS-2 after processing. The repository and Integration Service support UTF-8. You can use PowerCenter to process data in any language.

Working with a Unicode Repository

The repository code page is the code page of the data in the repository. You choose the repository code page when you create or upgrade a repository. When the repository database code page is UTF-8, you can create a repository using UTF-8 as its code page. You might want to choose UTF-8 for the repository code page if you need to store metadata in multiple languages, such as Chinese and English. Use the following guidelines when you use UTF-8 as the repository code page:

The repository database code page must be UTF-8. The repository code page must be a superset of the PowerCenter Client and Integration Service process code pages. You can input any character in the UCS-2 character set. For example, you can store German, Chinese, and English metadata in a UTF-8 enabled repository. Install languages and fonts on the PowerCenter Client machine. If you are using a UTF-8 repository, you may want to enable the PowerCenter Client machines to display multiple languages. By default, the PowerCenter Clients display text in the language set in the system locale. Use the Regional Options tool in the Control Panel to add language groups to the PowerCenter Client machines.

Overview

329

You can use the Windows Input Method Editor (IME) to enter multibyte characters from any language without having to run the version of Windows specific for that language. For more information about use IME, see Input Locale on page 331. Choose a code page for an Integration Service process that can process all repository metadata correctly. The code page of the Integration Service process must be a subset of the repository code page. If the Integration Service has multiple service processes, ensure that the code pages for all Integration Service processes are subsets of the repository code page. If you are running the Integration Service process on Windows, the code page for the Integration Service process must be the same as the code page for the system or user locale. If you are running the Integration Service process on UNIX, use the UTF-8 code page for the Integration Service process. For more information about the code page for an Integration Service process, see Integration Service Process Code Page on page 341.

For more information about code page compatibility, see Code Page Compatibility on page 339. For more information about the repository code page, see Repository Code Page on page 342.

330

Chapter 17: Understanding Globalization

Locales
Every machine has a locale. A locale is a set of preferences related to the user environment, including the input language, keyboard layout, how data is sorted, and the format for currency and dates. PowerCenter uses locale settings on each machine. You can set the following locale settings in the Windows Control Panel Regional Settings and System Properties dialog boxes:

System locale. Determines the language, code pages, and associated bitmap font files that are used as defaults for the system. User locale. Determines the default formats to display date, time, currency, and number formats. Input locale. Describes the input method, such as the keyboard, of the system language.

System Locale
The system locale is also referred to as the system default locale. It determines which ANSI and OEM code pages, as well as bitmap font files, are used as defaults for the system. The system locale contains the language setting, which determines the language in which text appears in the user interface, including in dialog boxes and error messages. A message catalog file defines the language in which messages display. By default, the machine uses the language specified for the system locale for all processes, unless you override the language for a specific process. The system locale is already set on your system and you may not need to change settings to run PowerCenter. If you do need to configure the system locale, you configure the locale on a Windows machine in the Regional Options dialog box. On UNIX, you specify the locale in the LANG environment variable. For more information about the LANG environment variable, see Before You Install in the Installation and Configuration Guide.

User Locale
The user locale displays date, time, currency, and number formats for each user. You can specify different user locales on a single machine. Create a user locale if you are working with data on a machine that is in a different language than the operating system. For example, you might be an English user working in Hong Kong on a Chinese operating system. You can set English as the user locale to use English standards in your work in Hong Kong. When you create a new user account, the machine uses a default user locale. You can change this default setting once the account is created.

Input Locale
An input locale specifies the keyboard layout of a particular language. You can set an input locale in the Regional Settings on a Windows machine to type characters of a specific language.

Locales

331

You can use the Windows Input Method Editor (IME) to enter multibyte characters from any language without having to run the version of Windows specific for that language. For example, if you are working on an English operating system and need to enter text in Chinese, you can use IME to set the input locale to Chinese without having to install the Chinese version of Windows. You might want to use an input method editor to enter multibyte characters into a repository that uses UTF-8.

332

Chapter 17: Understanding Globalization

Data Movement Modes

The data movement mode is an Integration Service option you choose based on the type of data you want to move, single-byte or multibyte data. The data movement mode you select depends the following factors:

Requirements to store single-byte or multibyte metadata in the repository Requirements to access source data containing single-byte or multibyte character data Future needs for single-byte and multibyte data

The data movement mode affects how the Integration Service enforces session code page relationships and code page validation. It can also affect performance. Applications can process single-byte characters faster than multibyte characters.

Character Data Movement Modes

The Integration Service runs in the following modes:

ASCII (American Standard Code for Information Interchange). The US-ASCII code page contains a set of 7-bit ASCII characters and is a subset of other character sets. When the Integration Service runs in ASCII data movement mode, each character requires one byte. Unicode. The universal character-encoding standard that supports all languages. When the Integration Service runs in Unicode data movement mode, it allots up to two bytes for each character. Run the Integration Service in Unicode mode when the source contains multibyte data.

Tip: You can also use ASCII or Unicode data movement mode if the source has 8-bit ASCII data. The Integration Service allots an extra byte when processing data in Unicode data movement mode. To increase performance, use the ASCII data movement mode. For example, if the source contains characters from the ISO 8859-1 code page, use the ASCII data movement.

The data movement you choose affects the requirements for code pages. Ensure the code pages are compatible. For more information about code page compatibility, see Code Page Compatibility on page 339.

ASCII Data Movement Mode

In ASCII mode, the Integration Service processes single-byte characters and does not perform code page conversions. When you run the Integration Service in ASCII mode, it does not enforce session code page relationships.

Unicode Data Movement Mode

In Unicode mode, the Integration Service recognizes multibyte character data and allocates up to two bytes for every character. The Integration Service performs code page conversions from sources to targets. When you set the Integration Service to Unicode data movement mode, it

Data Movement Modes

333

uses a Unicode character set to process characters in a specified code page, such as Shift-JIS or UTF-8. When you run the Integration Service in Unicode mode, it enforces session code page relationships. For more information about how the Integration Service enforces session code page relationships in Unicode data movement mode, see PowerCenter Code Page Validation on page 346.

Changing Data Movement Modes

You can change the data movement mode in the Integration Service properties in the Administration Console. After you change the data movement mode, the Integration Service runs in the new data movement mode the next time you start the Integration Service. When the data movement mode changes, the Integration Service handles character data differently. To avoid creating data inconsistencies in your target tables, the Integration Service performs additional checks for sessions that reuse session caches and files. Table 17-1 describes how the Integration Service handles session files and caches after you change the data movement mode:
Table 17-1. Session and File Cache Handling After Data Movement Mode Change
Session File or Cache Session Log File (*.log) Workflow Log Reject File (*.bad) Output File (*.out) Indicator File (*.in) Incremental Aggregation Files (*.idx, *.dat) Time of Creation or Use Each session. Each workflow. Each session. Sessions writing to flat file. Sessions writing to flat file. Sessions with Incremental Aggregation enabled. Integration Service Behavior After Data Movement Mode Change No change in behavior. Creates a new session log for each session using the code page of the Integration Service process. No change in behavior. Creates a new workflow log file for each workflow using the code page of the Integration Service process. No change in behavior. Appends rejected data to the existing reject file using the code page of the Integration Service process. No change in behavior. Creates a new output file for each session using the target code page. No change in behavior. Creates a new indicator file for each session. When files are removed or deleted, the Integration Service creates new files. When files are not moved or deleted, the Integration Service fails the session with the following error message:
SM_7038 Aggregate Error: ServerMode: [server data movement mode] and CachedMode: [data movement mode that created the files] mismatch.

Move or delete files created using a different code page.

334

Chapter 17: Understanding Globalization

Table 17-1. Session and File Cache Handling After Data Movement Mode Change
Session File or Cache Unnamed Persistent Lookup Files (*.idx, *.dat) Named Persistent Lookup Files (*.idx, *.dat) Time of Creation or Use Sessions with a Lookup transformation configured for an unnamed persistent lookup cache. Sessions with a Lookup transformation configured for a named persistent lookup cache. Integration Service Behavior After Data Movement Mode Change Rebuilds the persistent lookup cache.

When files are removed or deleted, the Integration Service creates new files. When files are not moved or deleted, the Integration Service fails the session. Move or delete files created using a different code page.

Data Movement Modes

335

Code Page Overview

A code page contains the encoding to specify characters in a set of one or more languages. An encoding is the assignment of a number to a character in the character set. You use code pages to identify data that might be in different languages. For example, if you create a mapping to process Japanese data, you must select a Japanese code page for the source data. When you choose a code page, the program or application for which you set the code page refers to a specific set of data that describes the characters the application recognizes. This influences the way that application stores, receives, and sends character data. Most machines use one of the following code pages:

US-ASCII (7-bit ASCII) MS Latin1 (MS 1252) for Windows operating systems Latin1 (ISO 8859-1) for UNIX operating systems IBM EBCDIC US English (IBM037) for mainframe systems

The US-ASCII code page contains all 7-bit ASCII characters and is the most basic of all code pages with support for United States English. The US-ASCII code page is not compatible with any other code page. When you install either the PowerCenter Client, Integration Service, or repository on a US-ASCII system, you must install all components on US-ASCII systems and run the Integration Service in ASCII mode. MS Latin1 and Latin1 both support English and most Western European languages and are compatible with each other. When you install the PowerCenter Client, Integration Service, or repository on a system using one of these code pages, you can install the rest of the components on any machine using the MS Latin1 or Latin1 code pages. You can use the IBM EBCDIC code page for the Integration Service process when you install it on a mainframe system. You cannot install the PowerCenter Client or repository on mainframe systems, so you cannot use the IBM EBCDIC code page for PowerCenter Client or repository installations. For more information about code pages, see Code Pages on page 361.

UNIX Code Pages

In the United States, most UNIX operating systems have more than one code page installed and use the ASCII code page by default. If you want to run PowerCenter in an ASCII-only environment, you can use the ASCII code page and run the Integration Service in ASCII mode. UNIX systems allow you to change the code page by changing the LANG, LC_CTYPE or LC_ALL environment variable. For example, you want to change the code page an HP-UX machine uses. Use the following command in the C shell to view your environment:
locale

336

Chapter 17: Understanding Globalization

This results in the following output, in which C implies ASCII:

LANG="C" LC_CTYPE="C" LC_NUMERIC="C" LC_TIME="C" LC_ALL="C"

To change the language to English and require the system to use the Latin1 code page, you can use the following command:
setenv LANG en_US.iso88591

When you check the locale again, it has been changed to use Latin1 (ISO 8859-1):
LANG="en_US.iso88591" LC_CTYPE="en_US.iso88591" LC_NUMERIC="en_US.iso88591" LC_TIME="en_US.iso88591" LC_ALL="en_US.iso88591"

For more information about changing the locale or code page of a UNIX system, see the UNIX documentation.

Windows Code Pages

The Windows operating system is based on Unicode, but does not display the code page used by the operating system in the environment settings. However, you can make an educated guess based on the country in which you purchased the system and the language the system uses. If you purchase Windows in the United States and use English as an input and display language, your operating system code page is MS Latin1 (MS1252) by default. However, if you install additional display or input languages from the Windows installation CD and use those languages, the operating system might use a different code page. For more information about the default code page for your Windows system, contact Microsoft.

Choosing a Code Page

Choose code pages based on the character data you use in mappings. Character data can be represented by character modes based on the character size. Character size is the storage space a character requires in the database. Different character sizes can be defined as follows:

Single-byte. A character represented as a unique number between 0 and 255. One byte is eight bits. ASCII characters are single-byte characters.

Code Page Overview

337

Double-byte. A character two bytes or 16 bits in size represented as a unique number 256 or greater. Many Asian languages, such as Chinese, have double-byte characters. Multibyte. A character two or more bytes in size is represented as a unique number 256 or greater. Many Asian languages, such as Chinese, have multibyte characters.

338

Chapter 17: Understanding Globalization

Code Page Compatibility

Compatibility between code pages is essential for accurate data movement when the Integration Service runs in the Unicode data movement mode. A code page can be compatible with another code page, or it can be a subset or a superset of another:

Compatible. Two code pages are compatible when the characters encoded in the two code pages are virtually identical. For example, JapanEUC and JIPSE code pages contain identical characters and are compatible with each other. The repository and Integration Service process can each use one of these code pages and can pass data back and forth without data loss. Superset. A code page is a superset of another code page when it contains all the characters encoded in the other code page and additional characters not encoded in the other code page. For example, MS Latin1 is a superset of US-ASCII because it contains all characters in the US-ASCII code page.
Note: Informatica considers a code page to be a superset of itself and all other compatible

code pages.

Subset. A code page is a subset of another code page when all characters in the code page are also encoded in the other code page. For example, US-ASCII is a subset of MS Latin1 because all characters in the US-ASCII code page are also encoded in the MS Latin1 code page.

For more information about compatible, subset, and superset code pages, see Code Page Compatibility on page 369. For accurate data movement, the target code page must be a superset of the source code page. If the target code page is not a superset of the source code page, the Integration Service may not process all characters, resulting in incorrect or missing data. For example, Latin1 is a superset of US-ASCII. If you select Latin1 as the source code page and US-ASCII as the target code page, you might lose character data if the source contains characters that are not included in US-ASCII. When you install or upgrade to run the Integration Service in Unicode mode, you must ensure proper code page compatibility among PowerCenter Clients, Integration Service process nodes, the PowerCenter repository, and the machines hosting pmrep and pmcmd. In Unicode mode, the Integration Service enforces code page compatibility between the PowerCenter Client and the repository, and between the Integration Service process and the repository. In addition, when you run the Integration Service in Unicode mode, code pages associated with sessions must have the appropriate relationships:

For each source in the session, the source code page must be a subset of the target code page. The Integration Service does not require code page compatibility between the source and the Integration Service process or between the Integration Service process and the target. If the session contains a Lookup or Stored Procedure transformation, the database or file code page must be a subset of the target that receives data from the Lookup or Stored
Code Page Compatibility 339

Procedure transformation and a superset of the source that provides data to the Lookup or Stored Procedure transformation.

If the session contains an External Procedure or Custom transformation, the procedure must pass data in a code page that is a subset of the target code page for targets that receive data from the External Procedure or Custom transformation.

For more information about compatible code pages, see Code Page Compatibility on page 369. For more information about character loss in code page conversion, see Characters Lost in Code Page Conversion on page 387. PowerCenter uses code pages for the following components:

PowerCenter Client. You can enter metadata in any language in the PowerCenter Client. The PowerCenter Client includes the Designer, Workflow Manager, Repository Manager, and Workflow Monitor. For more information, see PowerCenter Client Code Page on page 341. Integration Service process. The Integration Service can move data in ASCII mode and Unicode mode. The default data movement mode is ASCII, which passes 7-bit ASCII or 8-bit ASCII character data. To pass multibyte character data from sources to targets, use the Unicode data movement mode. When you run the Integration Service in Unicode mode, it uses up to three bytes for each character to move data and performs additional checks at the session level to ensure data integrity. For more information, see Integration Service Process Code Page on page 341. PowerCenter repository. The PowerCenter repository can store data in any language. You can use the UTF-8 code page for the repository to store multibyte data in the repository. The code page for the repository is the same as the database code page. For more information, see Repository Code Page on page 342. Sources and targets. The sources and targets store data in one or more languages. You use code pages to specify the type of characters in the sources and targets. For more information, see Source Code Page on page 342 and Target Code Page on page 343. PowerCenter command line programs. You must also ensure that the code page for pmrep is compatible with the repository code page and the code page for pmcmd is compatible with the Integration Service process code page. For more information, see Command Line Program Code Pages on page 343.

Most database servers use two code pages, a client code page to receive data from client applications and a server code page to store the data. When the database server is running, it converts data between the two code pages if they are different. In this type of database configuration, the Integration Service process interacts with the database client code page. Thus, code pages used by the Integration Service process, such as the repository, source, or target code pages, must be identical to the database client code page. The database client code page is usually identical to the operating system code page on which the Integration Service process runs. The database client code page is a subset of the database server code page. For information about specific database client and server code pages, see your database documentation.

340

Chapter 17: Understanding Globalization

PowerCenter Client Code Page

The PowerCenter Client code page is the code page of the operating system of the PowerCenter Client. To communicate with the repository, the PowerCenter Client code page must be a subset of the repository code page.

Integration Service Process Code Page

The code page of an Integration Service process is the code page of the node that runs the Integration Service process. Define the code page for each Integration Service process in the Administration Console on the Processes tab. However, on UNIX, you can change the code page of the Integration Service process by changing the LANG, LC_CTYPE or LC_ALL environment variable for the user that starts the process. The code page of the Integration Service process must be:

A subset of the repository code page Compatible with the machine hosting pmcmd or, if you set the INFA_CODEPAGENAME environment variable for pmcmd, compatible with code page specified in the INFA_CODEPAGENAME environment variable

The code pages of all Integration Service processes must be compatible with each other. For example, you can use MS Windows Latin1 for a node on Windows and ISO-8859-1 for a node on UNIX. Integration Services configured for Unicode mode validate code pages when you start a session to ensure accurate data movement. It uses session code pages to convert character data. When the Integration Service runs in ASCII mode, it does not validate session code pages. It reads all character data as ASCII characters and does not perform code page conversions. Each code page has associated sort orders. When you configure a session, you can select one of the sort orders associated with the code page of the Integration Service process. When you run the Integration Service in Unicode mode, it uses the selected session sort order to sort character data. When you run the Integration Service in ASCII mode, it sorts all character data using a binary sort order. If you run the Integration Service in the United States on Windows, consider using MS Windows Latin1 (ANSI) as the code page of the Integration Service process. If you run the Integration Service in the United States on UNIX, consider using ISO 8859-1 as the code page for the Integration Service process. If you use pmcmd to communicate with the Integration Service, the code page of the operating system hosting pmcmd must be identical to the code page of the Integration Service process. The Integration Service generates session log files, reject files, caches and cache files, and performance detail files based on the code page of the Integration Service process.

Code Page Compatibility

341

Repository Code Page

The repository code page is the code page of the data in the repository. The Repository Service uses the repository code page to save metadata in and retrieve metadata from the repository database. Choose the repository code page when you create or upgrade a repository. When the repository database code page is UTF-8, you can create a repository using UTF-8 as its code page. The repository code page must be:

A superset of the PowerCenter Client code page A superset of the code page for the Integration Service process Compatible with the machine hosting pmrep or, if you set the INFA_CODEPAGENAME environment variable for pmrep, compatible with code page specified in the INFA_CODEPAGENAME environment variable

A global repository code page must be a subset of the local repository code page if you want to create shortcuts in the local repository that reference an object in a global repository. If you copy objects from one repository to another repository, the code page for the target repository must be a superset of the code page for the source repository.

Source Code Page

The source code page depends on the type of source:

Flat files and VSAM files. The code page of the data in the file. When you configure the flat file or COBOL source definition, choose a code page that matches the code page of the data in the file. XML files. The code page declared in the XML file. Relational databases. The code page of the database client. When you configure the relational connection in the Workflow Manager, choose a code page that is compatible with the code page of the database client. If you set a database environment variable to specify the language for the database, ensure the code page for the connection is compatible with the language set for the variable. For example, if you set the NLS_LANG environment variable for an Oracle database, ensure that the code page of the Oracle connection is identical to the value set in the NLS_LANG variable. If you do not use compatible code pages, sessions may hang, data may become inconsistent, or you might receive a database error, such as:
ORA-00911: Invalid character specified.

For more information about configuring environment variables for database clients, see Before You Install in the Installation and Configuration Guide. Regardless of the type of source, the source code page must be a subset of the code page of transformations and targets that receive data from the source. The source code page does not need to be a subset of transformations or targets that do not receive data from the source.
Note: Select IBM EBCDIC as the source database connection code page only if you access

EBCDIC data, such as data from a mainframe extract file.

342 Chapter 17: Understanding Globalization

Target Code Page

The target code page depends on the type of target:

Flat files. The code page of the data in the file. When you configure the flat file target definition, choose a code page that matches the code page of the data in the file. XML files. The code page declared in the XML file. Relational databases. The code page of the database client. When you configure the relational connection in the Workflow Manager, choose a code page that is compatible with the code page of the database client. If you set a database environment variable to specify the language for the database, ensure the code page for the connection is compatible with the language set for the variable. For example, if you set the NLS_LANG environment variable for an Oracle database, ensure that the code page of the Oracle connection is compatible with the value set in the NLS_LANG variable. If you do not use compatible code pages, sessions may hang or you might receive a database error, such as:
ORA-00911: Invalid character specified.

For more information about configuring environment variables for database clients, see Before You Install in the Installation and Configuration Guide. The target code page must be a superset of the code page of transformations and sources that provide data to the target. The target code page does not need to be a superset of transformations or sources that do not provide data to the target. The Integration Service creates session indicator files, session output files, and external loader control and data files using the target flat file code page.
Note: Select IBM EBCDIC as the target database connection code page only if you access

EBCDIC data, such as data from a mainframe extract file.

Command Line Program Code Pages

The pmcmd and pmrep command line programs require code page compatibility. pmcmd and pmrep use code pages when sending commands in Unicode. Other command line programs do not require code pages. The code page compatibility for pmcmd and pmrep depends on whether you configured the code page environment variable INFA_CODEPAGENAME for pmcmd or pmrep. You can set this variable for either command line program or for both If you did not set this variable for a command line program, ensure the following requirements are met:

If you did not set the variable for pmcmd, then the code page of the machine hosting pmcmd must be compatible with the code page for the Integration Service process. If you did not set the variable for pmrep, then the code page of the machine hosting pmrep must be compatible with the repository code page.

If you set the code page environment variable INFA_CODEPAGENAME for pmcmd or pmrep, ensure the following requirements are met:

Code Page Compatibility

343

If you set INFA_CODEPAGENAME for pmcmd, the code page defined for the variable must be compatible with the code page for the Integration Service process. If you set INFA_CODEPAGENAME for pmrep, the code page defined for the variable must be compatible with the repository code page. If you run pmcmd and pmrep from the same machine and you set the INFA_CODEPAGENAME variable, the code page defined for the variable must be compatible with the code pages for the Integration Service process and the repository.

If the code pages are not compatible, the Integration Service process may not fetch the workflow, session, or task from the repository. For more information about the INFA_CODEPAGENAME environment variable, see the Command Line Reference.

Code Page Compatibility Summary

Figure 17-1 shows code page compatibility in the PowerCenter environment:
Figure 17-1. Code Page Compatibility
Lookup and Stored Procedure Database

Sources

Targets

External Procedure and Custom Transformation Procedure Data

pmcmd

Integration Service

PowerCenter Client

Repository Database

pmrep

Subset

Superset

344

Chapter 17: Understanding Globalization

Table 17-2 summarizes code page compatibility between sources, targets, repository, PowerCenter Client, and Integration Service process:
Table 17-2. Code Page Compatibility
Component Code Page Source (including relational, flat file, and XML file) Code Page Compatibility Subset of target. Subset of lookup data. Subset of stored procedures. Subset of External Procedure or Custom transformation procedure code page. Superset of source. Superset of lookup data. Superset of stored procedures. Superset of External Procedure or Custom transformation procedure code page. Integration Service process creates external loader data and control files using the target flat file code page. Subset of target. Superset of source. Subset of target. Superset of source. Compatible with its operating system and the machine hosting pmcmd. Subset of repository. Identical to other nodes running the Integration Service processes. Superset of PowerCenter Client. Superset of the nodes running the Integration Service process. A global repository code page must be a subset of a local repository. Subset of repository. Subset to Integration Service process. Subset of repository.

Target (including relational, XML files, and flat files)

Lookup and stored procedure database External Procedure and Custom transformation procedures Integration Service process

Repository

PowerCenter Client Machine running pmcmd Machine running pmrep

Code Page Compatibility

345

PowerCenter Code Page Validation

The machines hosting the PowerCenter Client, Integration Service process, and repository database must use appropriate code pages. This eliminates the risk of data or repository inconsistencies. When the Integration Service runs in Unicode data movement mode, it enforces session code page relationships. When the Integration Service runs in ASCII mode, it does not enforce session code page relationships. To ensure compatibility, the PowerCenter Client and Integration Service perform the following code page validations:

PowerCenter restricts the use of EBCDIC-based code pages for repositories. Since you cannot install the PowerCenter Client or repository on mainframe systems, you cannot select EBCDIC-based code pages, like IBM EBCDIC, as the repository code page. PowerCenter Client can connect to the repository when its code page is a subset of the repository code page. If the PowerCenter Client code page is not a subset of the repository code page, the PowerCenter Client fails to connect to the repository code page with the following error:
REP_61082 <PowerCenter Client>'s code page <PowerCenter Client code page> is not one-way compatible to repository <repository name>'s code page <repository code page>.

After you set the repository code page, you cannot change it. After you create or upgrade a repository, you cannot change the repository code page. This prevents data loss and inconsistencies in the repository. The Integration Service process can start if its code page is a subset of the repository code page. The code page of the Integration Service process must be a subset of the repository code page to prevent data loss or inconsistencies. If it is not a subset of the repository code page, the Integration Service writes the following message to the log files:
REP_61082 <Integration Service>'s code page <Integration Service code page> is not one-way compatible to repository <repository name>'s code page <repository code page>.

When in Unicode data movement mode, the Integration Service starts workflows with the appropriate source and target code page relationships for each session. When the Integration Service runs in Unicode mode, the code page for every source in a session must be a subset of the target code page. This prevents data loss during a session. For more information about code page relationships, see Supported Code Pages and Related Code Pages on page 374. If the source and target code pages do not have the appropriate relationships with each other, the Integration Service fails the session and writes the following message to the session log:
TM_6227 Error: Code page incompatible in session <session name>. <Additional details>.

The Workflow Manager validates source, target, lookup, and stored procedure code page relationships for each session. The Workflow Manager checks code page relationships when you save a session, regardless of the Integration Service data movement mode. If you

346

Chapter 17: Understanding Globalization

configure a session with invalid source, target, lookup, or stored procedure code page relationships, the Workflow Manager issues a warning similar to the following when you save the session:
CMN_1933 Code page <code page name> for data from file or connection associated with transformation <name of source, target, or transformation> needs to be one-way compatible with code page <code page name> for transformation <source or target or transformation name>.

If you want to run the session in ASCII mode, you can save the session as configured. If you want to run the session in Unicode mode, edit the session to use appropriate code pages. For more information about code page compatibility requirements, see Code Page Compatibility Summary on page 344.

PowerCenter Code Page Validation

347

Relaxed Code Page Validation

Your environment may require you to process data from different sources using character sets from different languages. For example, you may need to process data from English and Japanese sources using the same repository, or you may want to extract source data encoded in a Unicode encoding such as UTF-8. You can configure the Integration Service for relaxed code page validation. Relaxed code page validation enables you to process data using sources and targets with incompatible code pages. Although relaxed code page validation removes source and target code page restrictions, it still enforces code page compatibility between the Integration Service and repository.
Note: Relaxed code page validation does not safeguard against possible data inconsistencies

when you move data between two incompatible code pages. You must verify that the characters the Integration Service reads from the source are included in the target code page. PowerCenter removes the following restrictions when you relax code page validation:

Source and target code pages. You can use any code page supported by PowerCenter for your source and target data. Session sort order. You can use any sort order supported by PowerCenter when you configure a session.

When you run a session with relaxed code page validation, the Integration Service writes the following message to the session log:
TM_6185 WARNING! Data code page validation is disabled in this session.

When you relax code page validation, the Integration Service writes descriptions of the database connection code pages to the session log. The following text shows sample code page messages in the session log:
TM_6187 Repository code page: [MS Windows Latin 1 (ANSI), superset of Latin 1] WRT_8222 Target file [$PMTargetFileDir\passthru.out] code page: [MS Windows Traditional Chinese, superset of Big 5] WRT_8221 Target database connection [Japanese Oracle] code page: [MS Windows Japanese, superset of Shift-JIS] TM_6189 Source database connection [Japanese Oracle] code page: [MS Windows Japanese, superset of Shift-JIS] CMN_1716 Lookup [LKP_sjis_lookup] uses database connection [Japanese Oracle] in code page [MS Windows Japanese, superset of Shift-JIS] CMN_1717 Stored procedure [J_SP_INCREMENT] uses database connection [Japanese Oracle] in code page [MS Windows Japanese, superset of Shift-JIS]

If the Integration Service cannot correctly convert data, it writes an error message to the session log.

348

Chapter 17: Understanding Globalization

Configuring the Integration Service

To configure the Integration Service for code page relaxation, complete the following tasks in the Administration Console:

Disable code page validation. Disable the ValidateDataCodePages option in the Integration Service properties. Configure the Integration Service for Unicode data movement mode. Select Unicode for the Data Movement Mode option in the Integration Service properties. Configure the Integration Service to write to the logs using the UTF-8 character set. If you configure sessions or workflows to write to log files, enable the LogsInUTF8 option in the Integration Service properties. The Integration Service writes all logs in UTF8 when you enable the LogsInUTF8 option. The Integration Service writes to the Log Manager in UTF-8 by default.

For more information about configuring the Integration Service properties, Configuring the Integration Service Properties on page 176.

Selecting Compatible Source and Target Code Pages

Although PowerCenter allows you to use any supported code page, there are risks associated with using incompatible code pages for sources and targets. If your target code page is not a superset of your source code page, you risk inconsistencies in the target data because the source data may contain characters not encoded in the target code page. When the Integration Service reads characters that are not included in the target code page, you risk transformation errors, inconsistent data, or failed sessions.
Note: If you relax code page validation, it is your responsibility to ensure that data converts

from the source to target properly.

Troubleshooting for Code Page Relaxation

The Integration Service failed a session and wrote the following message to the session log: TM_6188 Cause: Action: Session sort order <sort order name> is incompatible with the Integration Service's code page <code page name>. The specified sort order is incompatible with the Integration Service code page. If you want to validate code pages, select a sort order compatible with the Integration Service code page. If you want to relax code page validation, configure the Integration Service to relax code page validation in Unicode data movement mode. For more information about configuring the Integration Service, see Configuring the Integration Service on page 349.

Relaxed Code Page Validation

349

I tried to view the session or workflow log, but it contains garbage characters. Cause: Action: The Integration Service is not configured to write session or workflow logs using the UTF-8 character set. Enable the LogsInUTF8 option in the Integration Service properties.

350

Chapter 17: Understanding Globalization

PowerCenter Code Page Conversion

When in data movement mode is set to Unicode, the PowerCenter Client accepts input in any language and converts it to UCS-2. The Integration Service converts source data to UCS-2 before processing and converts the processed data from UCS-2 to the target code page before loading. When you run a session, the Integration Service converts source, target, and lookup queries from the repository code page to the source, target, or lookup code page. The Integration Service also converts the name and call text of stored procedures from the repository code page to the stored procedure database code page. At run time, the Integration Service verifies that it can convert the following queries and procedure text from the repository code page without data loss:

Source query. Must convert to source database code page. Lookup query. Must convert to lookup database code page. Target SQL query. Must convert to target database code page. Name and call text of stored procedures. Must convert to stored procedure database code page.

Choosing Characters for Repository Metadata

You can use any character in the repository code page when inputting repository metadata. If the repository uses UTF-8, you can input any Unicode character. For example, you can store German, Japanese, and English metadata in a UTF-8 enabled repository. However, you must ensure that the Integration Service can successfully perform SQL transactions with source, target, lookup, and stored procedure databases. You must also ensure that the Integration Service can read from source and lookup files and write to target and lookup files. Therefore, when you run a session, you must ensure that the repository metadata characters are encoded in the source, target, lookup, and stored procedure code pages.

Example
The Integration Service, repository, and PowerCenter Client use the ISO 8859-1 Latin1 code page, and the source database contains Japanese data encoded using the Shift-JIS code page. Each code page contains characters not encoded in the other. Using characters other than 7bit ASCII for the repository and source database metadata can cause the sessions to fail or load no rows to the target in the following situations:

You create a mapping that contains a string literal with characters specific to the German language range of ISO 8859-1 in a query. The source database may reject the query or return inconsistent results. You use the PowerCenter Client to generate SQL queries containing characters specific to the German language range of ISO 8859-1. The source database cannot convert the German-specific characters from the ISO 8859-1 code page into the Shift-JIS code page.

PowerCenter Code Page Conversion

351

The source database has a table name that contains Japanese characters. The Designer cannot convert the Japanese characters from the source database code page to the PowerCenter Client code page. Instead, the Designer imports the Japanese characters as question marks (?), changing the name of the table. The Repository Service saves the source table name in the repository as question marks. If the Integration Service sends a query to the source database using the changed table name, the source database cannot find the correct table, and returns no rows or an error to the Integration Service, causing the session to fail.

Because the US-ASCII code page is a subset of both the ISO 8859-1 and Shift-JIS code pages, you can avoid these data inconsistencies if you use 7-bit ASCII characters for all of your metadata.

352

Chapter 17: Understanding Globalization

Case Study: Processing ISO 8859-1 Data

This case study describes how you might set up an environment to process ISO 8859-1 multibyte data. You might want to configure your environment this way if you need to process data from different Western European languages with character sets contained in the ISO 8859-1 code page. This example describes an environment that processes English and German language data. For this case study, the ISO 8859-1 environment consists of the following elements:

The Integration Service on a UNIX system PowerCenter Client on a Windows system, purchased in the United States The repository stored on an Oracle database on UNIX A source database containing English language data Another source database containing German and English language data A target database containing German and English language data A lookup database containing English language data

The ISO 8859-1 Environment

The data environment must process English and German character data. Figure 17-2 shows the ISO 8859-1 data environment:
Figure 17-2. ISO 8859-1 Case Study Environment
Sources (English data ISO 8859-1 code page) Sources (German and English data ISO 8859-1) Lookup Database (English data ISO 8859-1 code page)

External Procedures (English data ISO 8859-1 code page)

Targets (English and German data ISO 8859-1 code page)

Integration Service process on UNIX - Configure ASCII data movement mode - Set code page to ISO 8859-1 Repository Database (Oracle on UNIX UTF-8 code page)

PowerCenter Client (Windows: MS Windows Latin 1 code page)

Case Study: Processing ISO 8859-1 Data

353

Configuring the ISO 8859-1 Environment

Use the following guidelines when you configure an environment similar to this case study for ISO 8859-1 data processing: 1. 2. 3. 4. 5. 6. 7. Verify code page compatibility between the repository database client and the database server. Verify code page compatibility between the PowerCenter Client and the repository, and between the Integration Service process and the repository. Set the Integration Service data movement mode to ASCII. Verify session code page compatibility. Verify lookup and stored procedure database code page compatibility. Verify External Procedure or Custom transformation procedure code page compatibility. Configure session sort order.

Step 1. Verify Repository Database Client and Server Compatibility

The database client and server hosting the PowerCenter repository must be able to communicate without data loss. The repository resides in an Oracle database. Use NLS_LANG to set the locale (language, territory, and character set) you want the database client and server to use with your login:
NLS_LANG = LANGUAGE_TERRITORY.CHARACTERSET

By default, Oracle configures NLS_LANG for the U.S. English language, the U.S. territory, and the 7-bit ASCII character set:
NLS_LANG = AMERICAN_AMERICA.US7ASCII

Change the default configuration to write ISO 8859-1 data to the repository using the Oracle WE8ISO8859P1 code page. For example:
NLS_LANG = AMERICAN_AMERICA.WE8ISO8859P1

For more information about verifying and changing the repository database code page, see your database documentation. For more information about repository database code pages, see Repository Code Page on page 342.

Step 2. Verify PowerCenter Code Page Compatibility

The Integration Service and PowerCenter Client code pages must be subsets of the repository code page. Because the PowerCenter Client and Integration Service each use the system code pages of the machines they are installed on, you must verify that the system code pages are subsets of the repository code page. In this case, the PowerCenter Client on Windows systems were purchased in the United States. Thus the system code pages for the PowerCenter Client machines are set to MS Windows Latin1 by default. To verify system input and display languages, open the Regional

354

Chapter 17: Understanding Globalization

Options dialog box from the Windows Control Panel. For systems purchased in the United States, the Regional Settings and Input Locale must be configured for English (United States). The Integration Service is installed on a UNIX machine. The default code page for UNIX operating systems is ASCII. In this environment, change the UNIX system code page to ISO 8859-1 Western European so that it is a subset of the repository code page. To verify code page compatibility, check the code page compatibility tables in Code Page Compatibility on page 369. For more information about changing the UNIX system code page, see UNIX Code Pages on page 336.

Step 3. Configure the Integration Service for ASCII Data Movement Mode
Configure the Integration Service to process ISO 8859-1 data. In the Administration Console, set the Data Movement Mode to ASCII for the Integration Service. For more information about the ASCII data movement mode, see Character Data Movement Modes on page 333.

Step 4. Verify Session Code Page Compatibility

When you run a workflow in ASCII data movement mode, the Integration Service enforces source and target code page relationships. To guarantee accurate data conversion, the source code page must be a subset of the target code page. In this case, the environment contains source databases containing German and English data. When you configure a source database connection in the Workflow Manager, the code page for the connection must be identical to the source database code page and must be a subset of the target code page. Since both the MS Windows Latin1 and the ISO 8859-1 Western European code pages contain German characters, you would most likely use one of these code pages for source database connections. Because the target code page must be a superset of the source code page, use either MS Windows Latin1, ISO 8859-1 Western European, or UTF-8 for target database connection or flat file code pages. To ensure data consistency, the configured target code page must match the target database or flat file system code page. If you configure the Integration Service for relaxed code page validation, the Integration Service removes restrictions on source and target code page compatibility. You can select any supported code page for source and target data. However, you must ensure that the targets only receive character data encoded in the target code page.

Step 5. Verify Lookup and Stored Procedure Database Code Page Compatibility
Lookup and stored procedure database code pages must be supersets of the source code pages and subsets of the target code pages. In this case, all lookup and stored procedure database connections must use a code page compatible with the ISO 8859-1 Western European or MS Windows Latin1 code pages.

Case Study: Processing ISO 8859-1 Data

355

Step 6. Verify External Procedure or Custom Transformation Procedure Compatibility

External Procedure and Custom transformation procedures must be able to process character data from the source code pages, and they must pass characters that are compatible in the target code pages. In this case, all data processed by the External Procedure or Custom transformations must be in the ISO 8859-1 Western European or MS Windows Latin1 code pages.

Step 7. Configure Session Sort Order

When you run the Integration Service in ASCII mode, it uses a binary sort order for all sessions. In the session properties, the Workflow Manager lists all sort orders associated with the Integration Service code page. You can select a sort order for the session.

356

Chapter 17: Understanding Globalization

Case Study: Processing Unicode UTF-8 Data

This case study describes how you might set up an environment that processes Unicode UTF-8 multibyte data. You might want to configure your environment this way if you need to process data from Western European, Middle Eastern, Asian, or any other language with characters encoded in the UTF-8 character set. This example describes an environment that processes German and Japanese language data. For this case study, the UTF-8 environment consists of the following elements:

The Integration Service on a UNIX machine The PowerCenter Clients on Windows systems The repository stored on an Oracle database on UNIX A source database contains German language data A source database contains German and Japanese language data A target database contains German and Japanese language data A lookup database contains German language data

The UTF-8 Environment

The data environment must process German and Japanese character data. Figure 17-3 shows the UTF-8 data environment:
Figure 17-3. UTF-8 Case Study Environment
Lookup Database (German data ISO 8859-1 code page) Sources (German data ISO 8859-1 code page) Sources (German and Japanese data UTF-8 code page) External Procedures (German data UTF-8 code page) Targets (German and Japanese data UTF-8 code page)

Integration Service on UNIX - Configure Unicode data movement mode - Set code page to UTF-8 PowerCenter Client (Windows: MS Windows Latin 1 code page)

Repository Database (Oracle on UNIX UTF-8 code page)

Case Study: Processing Unicode UTF-8 Data

357

Configuring the UTF-8 Environment

Use the following guidelines when you configure an environment similar to this case study for UTF-8 data processing: 1. 2. 3. 4. 5. 6. 7. Verify code page compatibility between the repository database client and the database server. Verify code page compatibility between the PowerCenter Client and the repository, and between the Integration Service and the repository. Configure the Integration Service for Unicode data movement mode. Verify session code page compatibility. Verify lookup and stored procedure database code page compatibility. Verify External Procedure or Custom transformation procedure code page compatibility. Configure session sort order.

Step 1. Verify Repository Database Client and Server Code Page Compatibility
The database client and server hosting the PowerCenter repository must be able to communicate without data loss. The repository resides in an Oracle database. With Oracle, you can use NLS_LANG to set the locale (language, territory, and character set) you want the database client and server to use with your login:
NLS_LANG = LANGUAGE_TERRITORY.CHARACTERSET

By default, Oracle configures NLS_LANG for U.S. English language, the U.S. territory, and the 7-bit ASCII character set:
NLS_LANG = AMERICAN_AMERICA.US7ASCII

Change the default configuration to write UTF-8 data to the repository using the Oracle UTF8 character set. For example:
NLS_LANG = AMERICAN_AMERICA.UTF8

For more information about verifying and changing the repository database code page, see your database documentation. For more information about repository database code pages, see Repository Code Page on page 342.

Step 2. Verify PowerCenter Code Page Compatibility

The Integration Service and PowerCenter Client code pages must be subsets of the repository code page. Because the PowerCenter Client and Integration Service each use the system code pages of the machines they are installed on, you must verify that the system code pages are subsets of the repository code page. In this case, the PowerCenter Client on Windows systems were purchased in Switzerland. Thus, the system code pages for the PowerCenter Client machines are set to MS Windows
358 Chapter 17: Understanding Globalization

Latin1 by default. To verify system input and display languages, open the Regional Options dialog box from the Windows Control Panel. The Integration Service is installed on a UNIX machine. The default code page for UNIX operating systems is ASCII. In this environment, the UNIX system character set must be changed to UTF-8. To verify code page compatibility, check the code page compatibility tables in Code Page Compatibility on page 369. For more information about changing the UNIX system code page, see UNIX Code Pages on page 336.

Step 3. Configure the Integration Service for Unicode Data Movement Mode
You must configure the Integration Service to process UTF-8 data. In the Administration Console, set the Data Movement Mode to Unicode for the Integration Service. The Integration Service allots an extra byte for each character when processing multibyte data. For more information about Unicode data movement mode, see Character Data Movement Modes on page 333.

Step 4. Verify Session Code Page Compatibility

When you run a workflow in Unicode data movement mode, the Integration Service enforces source and target code page relationships. To guarantee accurate data conversion, the source code page must be a subset of the target code page. In this case, the environment contains a source database containing German and Japanese data. When you configure a source database connection in the Workflow Manager, the code page for the connection must be identical to the source database code page. You can use any code page for the source database. Because the target code page must be a superset of the source code pages, you must use UTF8 for the target database connections or flat files. To ensure data consistency, the configured target code page must match the target database or flat file system code page. If you configure the Integration Service for relaxed code page validation, the Integration Service removes restrictions on source and target code page compatibility. You can select any supported code page for source and target data. However, you must ensure that the targets only receive character data encoded in the target code page.

Step 5. Verify Lookup and Stored Procedure Database Code Page Compatibility
Lookup and stored procedure database code pages must be supersets of the source code pages and subsets of the target code pages. In this case, all lookup and stored procedure database connections must use a code page compatible with UTF-8.

Case Study: Processing Unicode UTF-8 Data

359

Step 6. Verify External Procedure or Custom Transformation Procedure Compatibility

External Procedure and Custom transformation procedures must be able to process character data from the source code pages, and they must pass characters that are compatible in the target code pages. In this case, the External Procedure or Custom transformations must be able to process the German and Japanese data from the sources. However, the Integration Service passes data to procedures in UCS-2. Therefore, all data processed by the External Procedure or Custom transformations must be in the UCS-2 character set.

Step 7. Configure Session Sort Order

When you run the Integration Service in Unicode mode, it sorts session data using the sort order configured for the session. By default, sessions are configured for a binary sort order. To sort German and Japanese data when the Integration Service uses UTF-8, you most likely want to use the default binary sort order.

UTF-8 Case Study: Summary

Figure 17-4 shows the guidelines in this case study to configure an environment to process UTF-8 data:
Figure 17-4. Summary of UTF-8 Case Study
Lookup Database (German data ISO 8859-1 code page) Sources (German data ISO 8859-1 code page) Sources (German and Japanese data UTF-8 code page) External Procedures (German data UTF-8 code page) Targets (German and Japanese data UTF-8 code page)

Integration Service on UNIX - Configure Unicode data movement mode - Set code page to UTF-8 PowerCenter Client (Windows: MS Windows Latin 1 code page)

Repository Database (Oracle on UNIX UTF-8 code page)

360

Chapter 17: Understanding Globalization

Appendix A

Code Pages

This appendix includes the following topics:

Supported Code Pages, 362 Code Page Reference, 365 Code Page Compatibility, 369 Characters Lost in Code Page Conversion, 387

361

Supported Code Pages

PowerCenter supports code pages for internationalization. Table A-1 displays available code pages, including the code page name, description, and code page ID:
Table A-1. Code Page Descriptions
Name EuroShift-JIS HKSCS IBM037 IBM273 IBM280 IBM285 IBM297 IBM500 IBM833 IBM834 IBM850 IBM930 IBM933 IBM935 IBM937 IBM939 ISO-8859-10 ISO-8859-15 ISO-8859-2 ISO-8859-3 ISO-8859-4 ISO-8859-5 ISO-8859-6 ISO-8859-7 ISO-8859-8 ISO-8859-9 Description Test code page, Shift-JIS with European characters Hong Kong Supplementary Character Set IBM EBCDIC US English IBM EBCDIC German IBM EBCDIC Italian IBM EBCDIC UK English IBM EBCDIC French IBM EBCDIC International Latin-1 IBM EBCDIC Korean CP833 IBM EBCDIC Korean CP834 IBM 850 IBM EBCDIC Japanese IBM EBCDIC Korean CP933 IBM EBCDIC Simplified Chinese IBM EBCDIC Traditional Chinese IBM EBCDIC Japanese CP939 ISO 8859-10 Latin 6 (Nordic) ISO 8859-15 Latin 9 (Western European) ISO 8859-2 Eastern European ISO 8859-3 Southeast European ISO 8859-4 Baltic ISO 8859-5 Cyrillic ISO 8859-6 Arabic ISO 8859-7 Greek ISO 8859-8 Hebrew ISO 8859-9 Latin 5 (Turkish) ID 9999 9200 2028 2030 2035 2038 2040 2044 833 834 850 930 933 935 937 939 13 201 5 6 7 8 9 10 11 12

362

Appendix A: Code Pages

Table A-1. Code Page Descriptions

Name JapanEUC* JEF JEF-kana JIPSE JIPSE-kana KEIS KEIS-kana Latin1* MELCOM MELCOM-kana MS1250 MS1251 MS1252* MS1253 MS1254 MS1255 MS1256 MS1257 MS1258 MS1361 MS874 MS932* MS936 MS949 MS950 UNISYS UNISYS-kana US-ASCII* UTF-8* Description Japanese Extended UNIX Code (including JIS X 0212) Japanese EBCDIC Fujitsu Japanese EBCDIC-Kana Fujitsu NEC ACOS JIPSE Japanese NEC ACOS JIPSE-Kana Japanese HITACHI KEIS Japanese HITACHI KEIS-Kana Japanese ISO 8859-1 Western European MITSUBISHI MELCOM Japanese MITSUBISHI MELCOM-Kana Japanese MS Windows Latin 2 (Central Europe) MS Windows Cyrillic (Slavic) MS Windows Latin1 (ANSI), superset of Latin1 MS Windows Greek MS Windows Latin 5 (Turkish), superset of ISO 8859-9 MS Windows Hebrew MS Windows Arabic MS Windows Baltic Rim MS Windows Vietnamese MS Windows Korean (Johab) MS-DOS Thai, superset of TIS 620 MS Windows Japanese, Shift-JIS MS Windows Simplified Chinese, superset of GB 231280, EUC encoding MS Windows Korean, superset of KS C 5601-1992 MS Windows Traditional Chinese, superset of Big 5 UNISYS Japanese UNISYS-Kana Japanese 7-bit ASCII Unicode Transformation Format, multibyte ID 18 9000 9005 9002 9007 9001 9006 4 9004 9009 2250 2251 2252 2253 2254 2255 2256 2257 2258 1361 874 2024 936 949 950 9003 9008 1 106

* PowerCenter uses these code pages.

Supported Code Pages

363

Note: Select IBM EBCDIC as your source database connection code page only if you access

EBCDIC data, such as data from a mainframe extract file.

364

Appendix A: Code Pages

Code Page Reference

Each language might have multiple associated code pages.
Note: The code pages listed are the most appropriate for English. However, all code pages include the 7-bit ASCII characters.

Table A-2 lists the territories, code pages, and sort orders most appropriate for each language:
Table A-2. Code Pages By Language
Language Albanian Territory Albania Code Page ISO-8859-2 MS1250 Latin1 MS1252 ISO-8859-9 UTF-8 ISO-8859-6 MS1256 UTF-8 ISO-8859-5 MS1251 UTF-8 ISO-8859-5 MS1251 UTF-8 Latin1 MS1252 ISO-8859-9 UTF-8 IBM297 Latin1 MS1252 ISO-8859-9 UTF-8 ISO-8859-2 MS1250 UTF-8 ISO-8859-5 MS1251 UTF-8 ISO-8859-2 MS1250 UTF-8 Sort Order Binary (default)

Arabic

Saudi Arabia

Binary (default)

Belorussian

Belarus

Binary (default)

Bulgarian

Bulgaria

Binary (default)

Canadian French

French-Canada

Binary (default)

Catalan

Catalonia

Binary (default)

Croatian

Croatia

Croatian Binary Binary (default)

Cyrillic Serbian

Yugoslavia

Czech

Czech Republic

Czech Binary

Code Page Reference

365

Table A-2. Code Pages By Language

Language Danish Territory Denmark Code Page Latin1 MS1252 ISO-8859-9 UTF-8 Latin1 MS1252 ISO-8859-9 UTF-8 IBM037 US-ASCII IBM 850 Latin1 MS1252 UTF-8 IBM037 IBM285 ISO-8859-4 ISO-8859-10 MS1257 UTF-8 ISO-8859-6 UTF-8 Latin1 MS1252 ISO-8859-9 UTF-8 Latin1 MS1252 ISO-8859-9 UTF-8 IBM297 Latin1 MS1252 ISO-8859-9 UTF-8 IBM273 ISO-8859-7 MS1253 UTF-8 ISO-8859-8 MS1255 UTF-8 ISO-8859-2 MS1250 UTF-8 Sort Order Danish Binary

Dutch

Netherlands Dutch-Belgium

Binary (default)

English

United States Australia Canada New Zealand South Africa United Kingdom Estonia

Binary (default)

Estonian

Estonian Binary

Farsi Finnish

Iran Finland

Binary (default) Finnish Binary

French

France French-Belgium French-Canada French-Switzerland Germany Austria German-Switzerland

Binary (default)

German

Binary (default)

Greek

Greece

Binary (default)

Hebrew

Israel

Binary (default)

Hungarian

Hungary

Hungarian Binary

366

Appendix A: Code Pages

Table A-2. Code Pages By Language

Language Italian Territory Italy Italian-Switzerland Code Page Latin1 MS1252 ISO-8859-9 UTF-8 IBM280 JapanEUC MS932 UTF-8 IBM930 IBM939 JEF JEF-kana KEIS KEIS-kana JIPSE JIPSE-kana UNISYS UNISYS-kana MELCOM MELCOM-kana IBM833 IBM834 IBM933 MS949 MS1361 UTF-8 ISO-8859-4 ISO-8859-10 MS1257 UTF-8 ISO-8859-4 ISO-8859-10 MS1257 UTF-8 ISO-8859-5 MS1251 UTF-8 Latin1 MS1252 ISO-8859-9 UTF-8 ISO-8859-2 MS1250 Sort Order Binary (default)

Japanese

Japan

Binary

Korean

Korea

Binary

Latvian

Latvia

Latvian Binary

Lithuanian

Lithuania

Lithuanian Binary

Macedonian

Macedonia

Binary (default)

Norwegian

Norway

Danish Binary

Polish

Poland

Binary (default)

Code Page Reference

367

Table A-2. Code Pages By Language

Language Portuguese Territory Portugal Brazil Code Page Latin1 MS1252 ISO-8859-9 UTF-8 IBM037 ISO-8859-2 MS1250 UTF-8 ISO-8859-5 MS1251 UTF-8 ISO-8859-2 MS1250 UTF-8 MS936 UTF-8 IBM935 ISO-8859-2 MS1250 UTF-8 ISO-8859-2 MS1250 UTF-8 Latin1 MS1252 ISO-8859-9 UTF-8 Latin1 MS1252 ISO-8859-9 UTF-8 MS874 UTF-8 HKSCS ISO-8859-9 ISO-8859-3 MS1254 UTF-8 ISO-8859-5 MS1251 UTF-8 MS1258 UTF-8 Sort Order Binary (default)

Romanian

Romania

Romanian Binary Binary (default)

Russian

Russia

Serbian

Yugoslavia

Binary (default)

Simplified Chinese

China

Binary

Slovak

Slovakia

Slovak

Slovenian

Slovenia

Slovenian Binary Spanish Traditional Spanish Binary Swedish Binary

Spanish

Spain Argentina Chile Mexico Sweden

Swedish

Thai Traditional Chinese Turkish

Thailand Hong Kong Turkey

Thai Binary Binary (default) Turkish Binary

Ukrainian

Ukraine

Ukrainian Binary Vietnamese Binary

Vietnamese

Vietnam

368

Appendix A: Code Pages

Code Page Compatibility

To allow greater flexibility in using code pages, Informatica considers some code pages compatible, although they do not contain identical character sets. Table A-3 describes the code pages Informatica considers compatible with each other:
Table A-3. Compatible Code Pages
Code Page HITACHI KEIS Japanese Compatible with JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese IBM EBCDIC Japanese CP939 Japanese EBCDIC Fujitsu NEC ACOS JIPSE Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese IBM EBCDIC Japanese CP939 Japanese EBCDIC Fujitsu HITACHI KEIS Japanese NEC ACOS JIPSE Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese Japanese EBCDIC Fujitsu HITACHI KEIS Japanese NEC ACOS JIPSE Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese Latin1 (ISO-8859-1)* MS1252 MS Latin1

HITACHI KEIS-Kana Japanese

IBM EBCDIC Japanese CP939

IBM037 IBM EBCDIC US English*

Code Page Compatibility

369

Table A-3. Compatible Code Pages

Code Page IBM EBCDIC Korean CP833 Compatible with IBM EBCDIC Korean CP833 IBM EBCDIC Korean CP933 MS Windows Korean (Johab)* MS Windows Korean, superset of KS C 5601-1992* MS Windows Korean (Johab)* MS Windows Korean, superset of KS C 5601-1992* IBM EBCDIC Korean CP833 IBM EBCDIC Korean CP933 MS Windows Korean (Johab)* MS Windows Korean, superset of KS C 5601-1992* JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese CP939 Japanese EBCDIC Fujitsu HITACHI KEIS Japanese NEC ACOS JIPSE Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese MS1250 MS Latin 2 JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese IBM EBCDIC Japanese CP939 HITACHI KEIS Japanese NEC ACOS JIPSE Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese

IBM EBCDIC Korean CP834 IBM EBCDIC Korean CP933

IBM930 IBM EBCDIC Japanese

ISO-8859-2 Eastern European* Japanese EBCDIC Fujitsu

370

Appendix A: Code Pages

Table A-3. Compatible Code Pages

Code Page Japanese EBCDIC-Kana Fujitsu Compatible with JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese IBM EBCDIC Japanese CP939 Japanese EBCDIC Fujitsu HITACHI KEIS Japanese NEC ACOS JIPSE Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese IBM 930 IBM EBCDIC Japanese IBM 939 IBM EBCDIC Japanese CP939 MS932 MS Shift JIS Japanese EBCDIC Fujitsu HITACHI KEIS Japanese NEC ACOS JIPSE Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese IBM037 IBM EBCDIC US English* MS1252 MS Latin1 JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese IBM EBCDIC Japanese CP939 Japanese EBCDIC Fujitsu HITACHI KEIS Japanese NEC ACOS JIPSE Japanese UNISYS Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese

JapanEUC

Latin1 (ISO-8859-1)* MITSUBISHI MELCOM Japanese

Code Page Compatibility

371

Table A-3. Compatible Code Pages

Code Page MITSUBISHI MELCOM-Kana Japanese Compatible with JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese IBM EBCDIC Japanese CP939 Japanese EBCDIC Fujitsu HITACHI KEIS Japanese NEC ACOS JIPSE Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese ISO-8859-2 Eastern European Latin1 (ISO-8859-1) IBM037 IBM EBCDIC US English IBM930 IBM EBCDIC Japanese JapanEUC IBM EBCDIC Japanese IBM EBCDIC Japanese CP939 Japanese EBCDIC Fujitsu HITACHI KEIS Japanese NEC ACOS JIPSE Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese IBM EBCDIC Korean CP833 IBM EBCDIC Korean CP834* IBM EBCDIC Korean CP933 MS Windows Korean, superset of KS C 5601-1992 IBM EBCDIC Korean CP833 IBM EBCDIC Korean CP834* IBM EBCDIC Korean CP933 MS Windows Korean (Johab)

MS1250 MS Latin 2 MS1252 MS Latin1 MS932 MS Shift JIS

MS Windows Korean (Johab)

MS Windows Korean, superset of KS C 56011992

372

Appendix A: Code Pages

Table A-3. Compatible Code Pages

Code Page NEC ACOS JIPSE Japanese Compatible with JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese IBM EBCDIC Japanese CP939 Japanese EBCDIC Fujitsu HITACHI KEIS Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese IBM EBCDIC Japanese CP939 Japanese EBCDIC Fujitsu HITACHI KEIS Japanese NEC ACOS JIPSE Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese IBM EBCDIC Japanese CP939 Japanese EBCDIC Fujitsu HITACHI KEIS Japanese NEC ACOS JIPSE Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese UNISYS-Kana Japanese MITSUBISHI MELCOM-Kana Japanese

NEC ACOS JIPSE-Kana Japanese

UNISYS Japanese

Code Page Compatibility

373

Table A-3. Compatible Code Pages

Code Page UNISYS-Kana Japanese Compatible with JapanEUC MS932 MS Shift JIS IBM EBCDIC Japanese IBM EBCDIC Japanese CP939 Japanese EBCDIC Fujitsu HITACHI KEIS Japanese NEC ACOS JIPSE Japanese UNISYS Japanese MITSUBISHI MELCOM Japanese Japanese EBCDIC-Kana Fujitsu HITACHI KEIS-Kana Japanese NEC ACOS JIPSE-Kana Japanese MITSUBISHI MELCOM-Kana Japanese

*No character loss occurs during code page conversion.

Supported Code Pages and Related Code Pages

Table A-4 on page 375 lists all supported code pages. Each supported code page has a corresponding column for each of the following code pages:

Code pages compatible with the specified code page Code pages that are supersets of the specified code page Code pages that are subsets of the specified code page

Because a code page that is compatible with another code page can also be superset or subset of that code page, each compatible code page appears at the top of the list of supersets and subsets. All other superset and subset code pages appear alphabetically below compatible code pages. For example, Table A-4 shows that the IBM037 (IBM EBCDIC US English) code page is compatible with the following code pages:

IBM037 (itself ) Latin1 (ISO 8859-1 Western European) MS Latin1 (MS1252)

Table A-4 on page 375 also shows that these code pages are also supersets and subsets of IBM037. In addition, the Supersets column contains UTF-8, indicating it contains all characters in the IBM037 code page. The Subsets column contains US-ASCII, indicating IBM037 contains all US-ASCII characters.
Note: You can use the IBM EBCDIC code page for the Integration Service when you install it on a mainframe system. You cannot install the PowerCenter Client or repository on mainframe systems, so you cannot use the IBM EBCDIC code page for PowerCenter Client or repository installations.

374

Appendix A: Code Pages

Table A-4 describes supported and compatible code pages:

Table A-4. Supported Code Pages and Related Code Pages
Supported Code Page HKSCS (Hong Kong Supplementary Character Set) Compatible Code Page HKSCS (Hong Kong Supplementary Character Set) Subsets HKSCS (Hong Kong Supplementary Character Set) MS950 (MS Windows Traditional Chinese, superset of Big 5) US-ASCII (7-bit ASCII) IBM037 (IBM EBCDIC US English) Latin1 (ISO 8859-1 Western European) US-ASCII (7-bit ASCII) Supersets HKSCS (Hong Kong Supplementary Character Set) UTF-8 (UTF-8 encoding of Unicode)

IBM037 (IBM EBCDIC US English)

IBM037 IBM EBCDIC US English) Latin1(ISO 8859-1 Western European) MS 1252 (MS Windows Latin1 (ANSI), superset of Latin1)

IBM037 (IBM EBCDIC US English) Latin1 (ISO 8859-1 Western European) MS 1252 (MS Windows Latin1 (ANSI), superset of Latin1) UTF-8 (UTF-8 encoding of Unicode) IBM273 (IBM EBCDIC German UTF-8 (UTF-8 encoding of Unicode) IBM280 (IBM EBCDIC Italian) UTF-8 (UTF-8 encoding of Unicode) IBM285 (IBM EBCDIC UK English) UTF-8 (UTF-8 encoding of Unicode) IBM297 (IBM EBCDIC French) UTF-8 (UTF-8 encoding of Unicode) IBM500 (IBM EBCDIC International Latin-1) UTF-8 (UTF-8 encoding of Unicode) IBM833 (IBM EBCDIC Korean CP833) UTF-8 (UTF-8 encoding of Unicode)

IBM273 (IBM EBCDIC German)

IBM273 (IBM EBCDIC German)

IBM273 (IBM EBCDIC German US-ASCII (7-bit ASCII) IBM280 (IBM EBCDIC Italian) US-ASCII (7-bit ASCII) IBM285 (IBM EBCDIC UK English) US-ASCII (7-bit ASCII) IBM297 (IBM EBCDIC French) US-ASCII (7-bit ASCII) IBM500 (IBM EBCDIC International Latin-1) US-ASCII (7-bit ASCII) IBM833 (IBM EBCDIC Korean CP833) US-ASCII (7-bit ASCII)

IBM280 (IBM EBCDIC Italian)

IBM280 (IBM EBCDIC Italian)

IBM285 (IBM EBCDIC UK English)

IBM285 (IBM EBCDIC UK English)

IBM297 (IBM EBCDIC French)

IBM297 (IBM EBCDIC French)

IBM500 (IBM EBCDIC International Latin-1)

IBM500 (IBM EBCDIC International Latin-1)

IBM833 (IBM EBCDIC Korean CP833)

IBM833 (IBM EBCDIC Korean CP833) IBM933 (IBM EBCDIC Korean CP933) MS Windows Korean (Johab) MS Windows Korean, superset of KS C 56011992

Code Page Compatibility

375

Table A-4. Supported Code Pages and Related Code Pages

Supported Code Page IBM834 (IBM EBCDIC Korean CP834) Compatible Code Page IBM834 (IBM EBCDIC Korean CP834) MS Windows Korean (Johab)* MS Windows Korean, superset of KS C 56011992* IBM850 (IBM 850) Subsets IBM834 (IBM EBCDIC Korean CP834) US-ASCII (7-bit ASCII) Supersets IBM834 (IBM EBCDIC Korean CP834) UTF-8 (UTF-8 encoding of Unicode)

IBM850 (IBM 850)

IBM850 (IBM 850) US-ASCII (7-bit ASCII) IBM930 (IBM EBCDIC Japanese) JapanEUC (Japanese Extended UNIX Code (incl. JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) IBM939 (IBM EBCDIC Japanese CP939) US-ASCII (7-bit ASCII) IBM933 (IBM EBCDIC Korean CP933) US-ASCII (7-bit ASCII)

IBM850 (IBM 850) UTF-8 (UTF-8 encoding of Unicode) IBM930 (IBM EBCDIC Japanese) JapanEUC (Japanese Extended UNIX Code (incl. JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) IBM939 (IBM EBCDIC Japanese CP939) UTF-8 (UTF-8 encoding of Unicode) IBM933 (IBM EBCDIC Korean CP933) UTF-8 (UTF-8 encoding of Unicode)

IBM930 (IBM EBCDIC Japanese)

IBM930 (IBM EBCDIC Japanese) JapanEUC (Japanese Extended UNIX Code (incl. JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) IBM939 (IBM EBCDIC Japanese CP939)

IBM933 (IBM EBCDIC Korean CP933)

IBM833 (IBM EBCDIC Korean CP833) IBM933 (IBM EBCDIC Korean CP933) MS Windows Korean (Johab) MS949 IBM935 (IBM EBCDIC Simplified Chinese)

IBM935 (IBM EBCDIC Simplified Chinese)

IBM935 (IBM EBCDIC Simplified Chinese) US-ASCII (7-bit ASCII) IBM937 (IBM EBCDIC Traditional Chinese) US-ASCII (7-bit ASCII)

IBM935 (IBM EBCDIC Simplified Chinese) UTF-8 (UTF-8 encoding of Unicode) IBM937 (IBM EBCDIC Traditional Chinese) UTF-8 (UTF-8 encoding of Unicode)

IBM937 (IBM EBCDIC Traditional Chinese)

IBM937 (IBM EBCDIC Traditional Chinese)

376

Appendix A: Code Pages

Table A-4. Supported Code Pages and Related Code Pages

Supported Code Page IBM939 (IBM EBCDIC Japanese CP939) Compatible Code Page IBM939 (IBM EBCDIC Japanese CP939) JapanEUC (Japanese Extended UNIX Code (incl. JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) IBM930 (IBM EBCDIC Japanese) Subsets IBM939 (IBM EBCDIC Japanese CP939) JapanEUC (Japanese Extended UNIX Code (incl. JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) IBM930 (IBM EBCDIC Japanese) US-ASCII (7-bit ASCII) ISO-8859-2 (ISO 8859-2 Eastern European) US-ASCII (7-bit ASCII) ISO-8859-3 (ISO 8859-3 Southeast European) US-ASCII (7-bit ASCII) ISO-8859-4 (ISO 8859-4 Baltic) US-ASCII (7-bit ASCII) ISO-8859-5 (ISO 8859-5 Cyrillic) US-ASCII (7-bit ASCII) ISO-8859-6 (ISO 8859-6 Arabic) US-ASCII (7-bit ASCII) ISO-8859-7 (ISO 8859-7 Greek) UTF-8 (UTF-8 encoding of Unicode) ISO-8859-8 (ISO 8859-8 Hebrew) US-ASCII (7-bit ASCII) ISO-8859-9 (ISO 8859-9 Latin 5 (Turkish)) US-ASCII (7-bit ASCII) Supersets IBM939 (IBM EBCDIC Japanese CP939) JapanEUC (Japanese Extended UNIX Code (incl. JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) IBM930 (IBM EBCDIC Japanese) UTF-8 (UTF-8 encoding of Unicode) ISO-8859-2 (ISO 8859-2 Eastern European) UTF-8 (UTF-8 encoding of Unicode) ISO-8859-3 (ISO 8859-3 Southeast European) UTF-8 (UTF-8 encoding of Unicode) ISO-8859-4 (ISO 8859-4 Baltic) UTF-8 (UTF-8 encoding of Unicode) ISO-8859-5 (ISO 8859-5 Cyrillic) UTF-8 (UTF-8 encoding of Unicode) ISO-8859-6 (ISO 8859-6 Arabic) UTF-8 (UTF-8 encoding of Unicode) ISO-8859-7 (ISO 8859-7 Greek) UTF-8 (UTF-8 encoding of Unicode) ISO-8859-8 (ISO 8859-8 Hebrew) UTF-8 (UTF-8 encoding of Unicode) ISO-8859-9 (ISO 8859-9 Latin 5 (Turkish)) UTF-8 (UTF-8 encoding of Unicode)

ISO-8859-2 (ISO 8859-2 Eastern European)

ISO-8859-2 (ISO 8859-2 Eastern European) MS1250 Latin 2 (Central European) ISO-8859-3 (ISO 8859-3 Southeast European)

ISO-8859-3 (ISO 8859-3 Southeast European)

ISO-8859-4 (ISO 8859-4 Baltic)

ISO-8859-4 (ISO 8859-4 Baltic)

ISO-8859-5 (ISO 8859-5 Cyrillic)

ISO-8859-5 (ISO 8859-5 Cyrillic)

ISO-8859-6 (ISO 8859-6 Arabic)

ISO-8859-6 (ISO 8859-6 Arabic)

ISO-8859-7 (ISO 8859-7 Greek)

ISO-8859-7 (ISO 8859-7 Greek)

ISO-8859-8 (ISO 8859-8 Hebrew)

ISO-8859-8 (ISO 8859-8 Hebrew)

ISO-8859-9 (ISO 8859-9 Latin 5 (Turkish))

ISO-8859-9 (ISO 8859-9 Latin 5 (Turkish))

Code Page Compatibility

377

Table A-4. Supported Code Pages and Related Code Pages

Supported Code Page ISO-8859-10 (ISO 885910 Latin 6 (Nordic)) Compatible Code Page ISO-8859-10 (ISO 885910 Latin 6 (Nordic)) Subsets ISO-8859-10 (ISO 885910 Latin 6 (Nordic)) US-ASCII (7-bit ASCII) ISO-8859-15 (ISO 885915 Latin 9 (Western European)) US-ASCII (7-bit ASCII) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) IBM930 (IBM EBCDIC Japanese) IBM939 (IBM EBCDIC Japanese CP939) JEF (Japanese EBCDIC Fujitsu) JEF-kana (Japanese EBCDIC-Kana Fujitsu) JIPSE (NEC ACOS JIPSE Japanese) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) KEIS (HITACHI KEIS Japanese) KEIS-kana (HITACHI KEIS-Kana Japanese) MELCOM (MITSUBISHI MELCOM Japanese) MELCOM-kana (MITSUBISHI MELCOMKana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) UNISYS (UNISYS Japanese) UNISYS-kana (UNISYSKana Japanese) US-ASCII (7-bit ASCII) Supersets ISO-8859-10 (ISO 885910 Latin 6 (Nordic)) UTF-8 (UTF-8 encoding of Unicode) ISO-8859-15 (ISO 885915 Latin 9 (Western European)) UTF-8 (UTF-8 encoding of Unicode) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) IBM930 (IBM EBCDIC Japanese) IBM939 (IBM EBCDIC Japanese CP939) JEF (Japanese EBCDIC Fujitsu) JEF-kana (Japanese EBCDIC-Kana Fujitsu) JIPSE (NEC ACOS JIPSE Japanese) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) KEIS (HITACHI KEIS Japanese) KEIS-kana (HITACHI KEIS-Kana Japanese) MELCOM (MITSUBISHI MELCOM Japanese) MELCOM-kana (MITSUBISHI MELCOMKana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) UNISYS (UNISYS Japanese) UNISYS-kana (UNISYSKana Japanese) UTF-8 (UTF-8 encoding of Unicode)

ISO-8859-15 (ISO 885915 Latin 9 (Western European))

ISO-8859-15 (ISO 885915 Latin 9 (Western European))

JapanEUC (Japanese Extended UNIX Code (including JIS X 0212))

JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) IBM930 (IBM EBCDIC Japanese) IBM939 (IBM EBCDIC Japanese CP939) JEF (Japanese EBCDIC Fujitsu) JEF-kana (Japanese EBCDIC-Kana Fujitsu) JIPSE (NEC ACOS JIPSE Japanese) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) KEIS (HITACHI KEIS Japanese) KEIS-kana (HITACHI KEIS-Kana Japanese) MELCOM (MITSUBISHI MELCOM Japanese) MELCOM-kana (MITSUBISHI MELCOMKana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) UNISYS (UNISYS Japanese) UNISYS-kana (UNISYSKana Japanese)

378

Appendix A: Code Pages

Table A-4. Supported Code Pages and Related Code Pages

Supported Code Page JEF (Japanese EBCDIC Fujitsu) Compatible Code Page JEF (Japanese EBCDIC Fujitsu) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JEF-kana (Japanese EBCDIC-Kana Fujitsu) MS932 (MS Windows Japanese, superset of Shift-JIS) Subsets JEF (Japanese EBCDIC Fujitsu) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JEF-kana (Japanese EBCDIC-Kana Fujitsu) MS932 (MS Windows Japanese, superset of Shift-JIS) US-ASCII (7-bit ASCII) JEF-kana (Japanese EBCDIC-Kana Fujitsu) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JEF (Japanese EBCDIC Fujitsu) MS932 (MS Windows Japanese, superset of Shift-JIS) US-ASCII (7-bit ASCII) JIPSE (NEC ACOS JIPSE Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) US-ASCII (7-bit ASCII) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JIPSE (NEC ACOS JIPSE Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) US-ASCII (7-bit ASCII) Supersets JEF (Japanese EBCDIC Fujitsu) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JEF-kana (Japanese EBCDIC-Kana Fujitsu) MS932 (MS Windows Japanese, superset of Shift-JIS) UTF-8 (UTF-8 encoding of Unicode) JEF-kana (Japanese EBCDIC-Kana Fujitsu) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JEF (Japanese EBCDIC Fujitsu) MS932 (MS Windows Japanese, superset of Shift-JIS) UTF-8 (UTF-8 encoding of Unicode) JIPSE (NEC ACOS JIPSE Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) UTF-8 (UTF-8 encoding of Unicode) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JIPSE (NEC ACOS JIPSE Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) UTF-8 (UTF-8 encoding of Unicode)

JEF-kana (Japanese EBCDIC-Kana Fujitsu)

JEF-kana (Japanese EBCDIC-Kana Fujitsu) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JEF (Japanese EBCDIC Fujitsu) MS932 (MS Windows Japanese, superset of Shift-JIS)

JIPSE (NEC ACOS JIPSE Japanese)

JIPSE (NEC ACOS JIPSE Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS)

JIPSE-kana (NEC ACOS JIPSE-Kana Japanese)

JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) JIPSE (NEC ACOS JIPSE Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS)

Code Page Compatibility

379

Table A-4. Supported Code Pages and Related Code Pages

Supported Code Page KEIS (HITACHI KEIS Japanese) Compatible Code Page KEIS (HITACHI KEIS Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) KEIS-kana (HITACHI KEIS-Kana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) Subsets KEIS (HITACHI KEIS Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) KEIS-kana (HITACHI KEIS-Kana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) US-ASCII (7-bit ASCII) KEIS-kana (HITACHI KEIS-Kana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) KEIS (HITACHI KEIS Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) US-ASCII (7-bit ASCII) Latin1 (ISO 8859-1 Western European) IBM037 (IBM EBCDIC US English) MS1252 (MS Windows Latin 1 (ANSI), superset of Latin1) US-ASCII (7-bit ASCII) MELCOM (MITSUBISHI MELCOM Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MELCOM-kana (MITSUBISHI MELCOMKana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) US-ASCII (7-bit ASCII) Supersets KEIS (HITACHI KEIS Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) KEIS-kana (HITACHI KEIS-Kana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) UTF-8 (UTF-8 encoding of Unicode) KEIS-kana (HITACHI KEIS-Kana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) KEIS (HITACHI KEIS Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) UTF-8 (UTF-8 encoding of Unicode) Latin1 (ISO 8859-1 Western European) IBM037 (IBM EBCDIC US English) MS1252 (MS Windows Latin 1 (ANSI), superset of Latin1) UTF-8 (UTF-8 encoding of Unicode) MELCOM (MITSUBISHI MELCOM Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MELCOM-kana (MITSUBISHI MELCOMKana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) UTF-8 (UTF-8 encoding of Unicode)

KEIS-kana (HITACHI KEIS-Kana Japanese)

KEIS-kana (HITACHI KEIS-Kana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) KEIS (HITACHI KEIS Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS)

Latin1 (ISO 8859-1 Western European)

Latin1 (ISO 8859-1 Western European) IBM037 (IBM EBCDIC US English) MS1252 (MS Windows Latin 1 (ANSI), superset of Latin1)

MELCOM (MITSUBISHI MELCOM Japanese)

MELCOM (MITSUBISHI MELCOM Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MELCOM-kana (MITSUBISHI MELCOMKana Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS)

380

Appendix A: Code Pages

Table A-4. Supported Code Pages and Related Code Pages

Supported Code Page MELCOM-kana (MITSUBISHI MELCOMKana Japanese) Compatible Code Page MELCOM-kana (MITSUBISHI MELCOMKana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MELCOM (MITSUBISHI MELCOM Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) Subsets MELCOM-kana (MITSUBISHI MELCOMKana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MELCOM (MITSUBISHI MELCOM Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) US-ASCII (7-bit ASCII) MS874 (MS-DOS Thai, superset of TIS 620) US-ASCII (7-bit ASCII) MS932 (MS Windows Japanese, superset of Shift-JIS) IBM930 (IBM EBCDIC Japanese) IBM939 (IBM EBCDIC Japanese CP939) JapanEUC (Japanese Extended UNIX Code (incl. JIS X 0212)) JEF (Japanese EBCDIC Fujitsu) JEF-kana (Japanese EBCDIC-Kana Fujitsu) JIPSE (NEC ACOS JIPSE Japanese) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) KEIS (HITACHI KEIS Japanese) KEIS-kana (HITACHI KEIS-Kana Japanese) MELCOM (MITSUBISHI MELCOM Japanese) MELCOM-kana (MITSUBISHI MELCOMKana Japanese) UNISYS (UNISYS Japanese) UNISYS-kana (UNISYSKana Japanese) US-ASCII (7-bit ASCII) Supersets MELCOM-kana (MITSUBISHI MELCOMKana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MELCOM (MITSUBISHI MELCOM Japanese) MS932 (MS Windows Japanese, superset of Shift-JIS) UTF-8 (UTF-8 encoding of Unicode) MS874 (MS-DOS Thai, superset of TIS 620) UTF-8 (UTF-8 encoding of Unicode) MS932 (MS Windows Japanese, superset of Shift-JIS) IBM930 (IBM EBCDIC Japanese) IBM939 (IBM EBCDIC Japanese CP939) JapanEUC (Japanese Extended UNIX Code (incl. JIS X 0212)) JEF (Japanese EBCDIC Fujitsu) JEF-kana (Japanese EBCDIC-Kana Fujitsu) JIPSE (NEC ACOS JIPSE Japanese) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) KEIS (HITACHI KEIS Japanese) KEIS-kana (HITACHI KEIS-Kana Japanese) MELCOM (MITSUBISHI MELCOM Japanese) MELCOM-kana (MITSUBISHI MELCOMKana Japanese) UNISYS (UNISYS Japanese) UNISYS-kana (UNISYSKana Japanese) UTF-8 (UTF-8 encoding of Unicode)

MS874 (MS-DOS Thai, superset of TIS 620)

MS874 (MS-DOS Thai, superset of TIS 620)

MS932 (MS Windows Japanese, superset of Shift-JIS)

MS932 (MS Windows Japanese, superset of Shift-JIS) IBM930 (IBM EBCDIC Japanese) IBM939 (IBM EBCDIC Japanese CP939) JapanEUC (Japanese Extended UNIX Code (incl. JIS X 0212)) JEF (Japanese EBCDIC Fujitsu) JEF-kana (Japanese EBCDIC-Kana Fujitsu) JIPSE (NEC ACOS JIPSE Japanese) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) KEIS (HITACHI KEIS Japanese) KEIS-kana (HITACHI KEIS-Kana Japanese) MELCOM (MITSUBISHI MELCOM Japanese) MELCOM-kana (MITSUBISHI MELCOMKana Japanese) UNISYS (UNISYS Japanese) UNISYS-kana (UNISYSKana Japanese)

Code Page Compatibility

381

Table A-4. Supported Code Pages and Related Code Pages

Supported Code Page MS936 (MS Windows Simplified Chinese, superset of GB 2312-80, EUC encoding) Compatible Code Page MS936 (MS Windows Simplified Chinese, superset of GB 2312-80, EUC encoding) Subsets MS936 (MS Windows Simplified Chinese, superset of GB 2312-80, EUC encoding) US-ASCII (7-bit ASCII) MS949 (MS Windows Korean, superset of KS C 5601-1992) US-ASCII (7-bit ASCII) MS950 (MS Windows Traditional Chinese, superset of Big 5) US-ASCII (7-bit ASCII) Supersets MS936 (MS Windows Simplified Chinese, superset of GB 2312-80, EUC encoding) UTF-8 (UTF-8 encoding of Unicode) MS949 (MS Windows Korean, superset of KS C 5601-1992) UTF-8 (UTF-8 encoding of Unicode) MS950 (MS Windows Traditional Chinese, superset of Big 5) HKSCS (Hong Kong Supplementary Character Set) UTF-8 (UTF-8 encoding of Unicode) MS1250 (MS Windows Latin 2 (Central Europe)) UTF-8 (UTF-8 encoding of Unicode) MS1251 (MS Windows Cyrillic (Slavic)) UTF-8 (UTF-8 encoding of Unicode) MS1252 (MS Windows Latin 1 (ANSI), superset of Latin1) IBM037 (IBM EBCDIC US English) Latin1 (ISO 8859-1 Western European) UTF-8 (UTF-8 encoding of Unicode) MS1253 (MS Windows Greek) UTF-8 (UTF-8 encoding of Unicode) MS1254 (MS Windows Latin 5 (Turkish), superset of ISO 8859-9) UTF-8 (UTF-8 encoding of Unicode)

MS949 (MS Windows Korean, superset of KS C 5601-1992)

MS949 (MS Windows Korean, superset of KS C 5601-1992)

MS950 (MS Windows Traditional Chinese, superset of Big 5)

MS950 (MS Windows Traditional Chinese, superset of Big 5)

MS1250 (MS Windows Latin 2 (Central Europe))

MS1250 (MS Windows Latin 2 (Central Europe))

MS1250 (MS Windows Latin 2 (Central Europe)) US-ASCII (7-bit ASCII) MS1251 (MS Windows Cyrillic (Slavic)) US-ASCII (7-bit ASCII) MS1252 (MS Windows Latin 1 (ANSI), superset of Latin1) IBM037 (IBM EBCDIC US English) Latin1 (ISO 8859-1 Western European) US-ASCII (7-bit ASCII) MS1253 (MS Windows Greek) US-ASCII (7-bit ASCII) MS1254 (MS Windows Latin 5 (Turkish), superset of ISO 8859-9) US-ASCII (7-bit ASCII)

MS1251 (MS Windows Cyrillic (Slavic))

MS1251 (MS Windows Cyrillic (Slavic))

MS1252 (MS Windows Latin 1 (ANSI), superset of Latin1)

MS1252 (MS Windows Latin 1 (ANSI), superset of Latin1) IBM037 (IBM EBCDIC US English) Latin1 (ISO 8859-1 Western European)

MS1253 (MS Windows Greek)

MS1253 (MS Windows Greek)

MS1254 (MS Windows Latin 5 (Turkish), superset of ISO 8859-9)

MS1254 (MS Windows Latin 5 (Turkish), superset of ISO 8859-9)

382

Appendix A: Code Pages

Table A-4. Supported Code Pages and Related Code Pages

Supported Code Page MS1255 (MS Windows Hebrew) Compatible Code Page MS1255 (MS Windows Hebrew) Subsets MS1255 (MS Windows Hebrew) US-ASCII (7-bit ASCII) MS1256 (MS Windows Arabic) US-ASCII (7-bit ASCII) MS1257 (MS Windows Baltic Rim) US-ASCII (7-bit ASCII) MS1258 (MS Windows Vietnamese) US-ASCII (7-bit ASCII) MS1361 (MS Windows Korean (Johab)) US-ASCII (7-bit ASCII) UNISYS (UNISYS Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) UNISYS-kana (UNISYSKana Japanese) US-ASCII (7-bit ASCII) UNISYS-kana (UNISYSKana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) UNISYS (UNISYS Japanese) US-ASCII (7-bit ASCII) Supersets MS1255 (MS Windows Hebrew) UTF-8 (UTF-8 encoding of Unicode) MS1256 (MS Windows Arabic) UTF-8 (UTF-8 encoding of Unicode) MS1257 (MS Windows Baltic Rim) UTF-8 (UTF-8 encoding of Unicode) MS1258 (MS Windows Vietnamese) UTF-8 (UTF-8 encoding of Unicode) MS1361 (MS Windows Korean (Johab)) UTF-8 (UTF-8 encoding of Unicode) UNISYS (UNISYS Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) UNISYS-kana (UNISYSKana Japanese) UTF-8 (UTF-8 encoding of Unicode) UNISYS-kana (UNISYSKana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) UNISYS (UNISYS Japanese) UTF-8 (UTF-8 encoding of Unicode)

MS1256 (MS Windows Arabic)

MS1256 (MS Windows Arabic)

MS1257 (MS Windows Baltic Rim)

MS1257 (MS Windows Baltic Rim)

MS1258 (MS Windows Vietnamese)

MS1258 (MS Windows Vietnamese)

MS1361 (MS Windows Korean (Johab))

MS1361 (MS Windows Korean (Johab))

UNISYS (UNISYS Japanese)

UNISYS (UNISYS Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) UNISYS-kana (UNISYSKana Japanese)

UNISYS-kana (UNISYSKana Japanese)

UNISYS-kana (UNISYSKana Japanese) JapanEUC (Japanese Extended UNIX Code (including JIS X 0212)) MS932 (MS Windows Japanese, superset of Shift-JIS) UNISYS (UNISYS Japanese)

Code Page Compatibility

383

Table A-4. Supported Code Pages and Related Code Pages

Supported Code Page US-ASCII (7-bit ASCII) Compatible Code Page US-ASCII (7-bit ASCII) Subsets US-ASCII (7-bit ASCII)\ Supersets US-ASCII (7-bit ASCII) HKSCS (Hong Kong Supplementary Character Set) IBM037 (IBM EBCDIC US English) IBM273 (IBM EBCDIC German) IBM280 (IBM EBCDIC Italian) IBM285 (IBM EBCDIC UK English) IBM297 (IBM EBCDIC French) IBM500 (IBM EBCDIC International Latin-1) IBM930 (IBM EBCDIC Japanese)

384

Appendix A: Code Pages

Table A-4. Supported Code Pages and Related Code Pages

Supported Code Page US-ASCII (7-bit ASCII) Compatible Code Page US-ASCII (7-bit ASCII) Subsets US-ASCII (7-bit ASCII) Supersets IBM935 (IBM EBCDIC Simplified Chinese) IBM937 (IBM EBCDIC Traditional Chinese) IBM 939 (IBM EBCDIC Japanese CP939) ISO-8859-2 (ISO 8859-2 Eastern European) ISO-8859-3 (ISO 8859-3 Southeast European) ISO-8859-4 (ISO 8859-4 Baltic) ISO-8859-5 (ISO 8859-5 Cyrillic) ISO-8859-6 (ISO 8859-6 Arabic) ISO-8859-7 (ISO 8859-7 Greek) ISO-8859-8 (ISO 8859-8 Hebrew) ISO-8859-9 (ISO 8859-9 Latin 5 (Turkish)) ISO-8859-15 (ISO 885915 Latin 9 (Western European)) JapanEUC (Japanese Extended UNIX Code (incl. JEF (Japanese EBCDIC Fujitsu) JEF-kana (Japanese EBCDIC-Kana Fujitsu) JIPSE (NEC ACOS JIPSE Japanese) JIPSE-kana (NEC ACOS JIPSE-Kana Japanese) JIS X 0212)) KEIS (HITACHI KEIS Japanese) KEIS-kana (HITACHI KEIS-Kana Japanese) Latin1 (ISO 8859-1 Western European) MELCOM (MITSUBISHI MELCOM Japanese) MELCOM-kana (MITSUBISHI MELCOMKana Japanese)

Code Page Compatibility

385

Table A-4. Supported Code Pages and Related Code Pages

Supported Code Page US-ASCII (7-bit ASCII) Compatible Code Page US-ASCII (7-bit ASCII) Subsets US-ASCII (7-bit ASCII) Supersets MS874 (MS-DOS Thai, superset of TIS 620) MS932 (MS Windows Japanese, superset of Shift-JIS) MS936 (MS Windows Simplified Chinese, superset of GB 2312-80, EUC encoding) MS949 (MS Windows Korean, superset of KS C 5601-1992) Korean (Johab)) MS950 (MS Windows Traditional Chinese, superset of Big 5) MS1250 (MS Windows Latin 2 (Central Europe)) MS1251 (MS Windows Cyrillic (Slavic)) MS1252 (MS Windows Latin 1 (ANSI), superset of Latin1) MS1253 (MS Windows Greek) MS1254 (MS Windows Latin 5 (Turkish), superset of ISO 8859-9) MS1255 (MS Windows Hebrew) MS1256 (MS Windows Arabic) MS1257 (MS Windows Baltic Rim) MS1361 (MS Windows Korean (Johab)) UNISYS (UNISYS Japanese) UNISYS-kana (UNISYSKana Japanese) UTF-8 (UTF-8 encoding of Unicode)

386

Appendix A: Code Pages

Characters Lost in Code Page Conversion

When you select code pages that Informatica considers compatible, keep in mind that some characters do not convert from one code page to another. These characters are unlikely to be in your source data. For more information about the characters you may lose in code page conversion, find the code pages you are converting from and to in Table A-5 and see the section indicated:
Table A-5. Characters Lost in Code Page Conversion
Characters lost converting from code page MS Latin1 Latin1 MS Latin 2 IBM EBCDIC US English Latin1 MS Shift JIS JapanEUC IBM EBCDIC Japanese IBM EBCDIC Korean CP833 To code page Latin1 MS Latin1 ISO-8859-2 Latin 1 IBM EBCDIC US English JapanEUC MS Shift JIS JapanEUC MS Windows Korean, superset of KS C 5601-1992 MS Windows Korean (Johab) MS Windows Korean, superset of KS C 5601-1992 MS Windows Korean (Johab) IMB EBCDIC Japanese MS Shift JIS IBM EBCDIC Japanese See this section Converting from MS Latin1 to Latin1 on page 388 Converting from Latin1 to MS Latin1 on page 388 Converting from MS Latin 2 to ISO-8859-2 on page 389 Converting from IBM EBCDIC US English to Latin 1 on page 390 Converting from Latin1 to IBM EBCDIC US English on page 390 Converting from MS Shift JIS to JapanEUC on page 420 Converting from JapanEUC to MS Shift JIS on page 423 Converting from IBM EBCDIC Japanese to JapanEUC on page 428 Converting from IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 on page 391

IBM EBCDIC Korean CP833 IBM EBCDIC Korean CP933

Converting from IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) on page 395 Converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 on page 399

IBM EBCDIC Korean CP933 JapanEUC IBM EBCDIC Japanese MS Shift JIS

Converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) on page 410 Converting from JapanEUC to IBM EBCDIC Japanese on page 429 Converting from IBM EBCDIC Japanese to MS Shift JIS on page 434 Converting from MS Shift JIS to IBM EBCDIC Japanese on page 435

Characters Lost in Code Page Conversion

387

Converting from MS Latin1 to Latin1

Table A-6 lists all characters by character ID and description that do not convert from MS Latin1 to Latin1:
Table A-6. MS Latin1 to Latin1 Character Conversion
Characters lost when converting from MS1252 MS Latin1 to Latin1 (ISO-8859-1) 338 (LATIN CAPITAL LIGATURE OE) 339 (LATIN SMALL LIGATURE OE) 352 (LATIN CAPITAL LETTER S WITH CARON) 353 (LATIN SMALL LETTER S WITH CARON) 376 (LATIN CAPITAL LETTER Y WITH DIAERESIS) 381 (LATIN CAPITAL LETTER Z WITH CARON) 382 (LATIN SMALL LETTER Z WITH CARON) 402 (LATIN SMALL LETTER F WITH HOOK) 710 (MODIFIER LETTER CIRCUMFLEX ACCENT) 732 (SMALL TILDE) 8211 (EN DASH) 8212 (EM DASH) 8216 (LEFT SINGLE QUOTATION MARK) 8217 (RIGHT SINGLE QUOTATION MARK) 8218 (SINGLE LOW-9 QUOTATION MARK) 8220 (LEFT DOUBLE QUOTATION MARK) 8221 (RIGHT DOUBLE QUOTATION MARK) 8222 (DOUBLE LOW-9 QUOTATION MARK) 8224 (DAGGER) 8225 (DOUBLE DAGGER) 8226 (BULLET) 8230 (HORIZONTAL ELLIPSIS) 8240 (PER MILLE SIGN) 8249 (SINGLE LEFT-POINTING ANGLE QUOTATION MARK) 8250 (SINGLE RIGHT-POINTING ANGLE QUOTATION MARK) 8364 (EURO SIGN) 8482 (TRADE MARK SIGN)

Converting from Latin1 to MS Latin1

Table A-7 lists all characters by character ID and description that do not convert from Latin1 to MS Latin1:
Table A-7. Latin1 to MS Latin1 Character Conversion
Characters lost when converting from Latin1 (ISO-8859-1) to MS1252 MS Latin1 128 (<control character>) 129 (<control character>) 130 (<control character>) 131 (<control character>) 132 (<control character>) 133 (<control character>) 134 (<control character>) 388 Appendix A: Code Pages 144 (<control character>) 145 (<control character>) 146 (<control character>) 147 (<control character>) 148 (<control character>) 149 (<control character>) 150 (<control character>)

Table A-7. Latin1 to MS Latin1 Character Conversion

Characters lost when converting from Latin1 (ISO-8859-1) to MS1252 MS Latin1 135 (<control character>) 136 (<control character>) 137 (<control character>) 138 (<control character>) 139 (<control character>) 140 (<control character>) 141 (<control character>) 142 (<control character>) 143 (<control character>) 151 (<control character>) 152 (<control character>) 153 (<control character>) 154 (<control character>) 155 (<control character>) 156 (<control character>) 157 (<control character>) 158 (<control character>) 159 (<control character>)

Converting from MS Latin 2 to ISO-8859-2

Table A-8 lists all characters by character ID and description that do not convert from MS Latin 2 to ISO-8859-2:
Table A-8. MS Latin 2 to ISO-8859-2 Character Conversion
Characters lost when converting from MS Latin 2 (MS1250) to ISO-8859-2 127 (<control>) 166 (BROKEN BAR) 169 (COPYRIGHT SIGN) 171 (LEFT-POINTING DOUBLE ANGLE QUOTATION MARK) 172 (NOT SIGN) 174 (REGISTERED SIGN) 177 (PLUS-MINUS SIGN) 181 (MICRO SIGN) 182 (PILCROW SIGN) 183 (MIDDLE DOT) 187 (RIGHT-POINTING DOUBLE ANGLE QUOTATION MARK) 8211 (EN DASH) 8212 (EM DASH) 8216 (LEFT SINGLE QUOTATION MARK) 8217 (RIGHT SINGLE QUOTATION MARK) 8218 (SINGLE LOW-9 QUOTATION MARK) 8220 (LEFT DOUBLE QUOTATION MARK) 8221 (RIGHT DOUBLE QUOTATION MARK) 8222 (DOUBLE LOW-9 QUOTATION MARK) 8224 (DAGGER) 8225 (DOUBLE DAGGER) 8226 (BULLET) 8230 (HORIZONTAL ELLIPSIS) 8240 (PER MILLE SIGN) 8249 (SINGLE LEFT-POINTING ANGLE QUOTATION MARK) 8250 (SINGLE RIGHT-POINTING ANGLE QUOTATION MARK) 8364 (EURO SIGN) 8482 (TRADE MARK SIGN)

Characters Lost in Code Page Conversion

389

Converting from IBM EBCDIC US English to Latin 1

Table A-9 lists all characters by character ID and description that do not convert from IBM EBCDIC US English to Latin1:
Table A-9. IBM EBCDIC US English to Latin1 Character Conversion
Characters lost when converting from IBM037 (IBM EBCDIC US English) to Latin1 (ISO-8859-1) 338 (LATIN CAPITAL LIGATURE OE) 339 (LATIN SMALL LIGATURE OE) 352 (LATIN CAPITAL LETTER S WITH CARON) 353 (LATIN SMALL LETTER S WITH CARON) 376 (LATIN CAPITAL LETTER Y WITH DIAERESIS) 381 (LATIN CAPITAL LETTER Z WITH CARON) 382 (LATIN SMALL LETTER Z WITH CARON) 402 (LATIN SMALL LETTER F WITH HOOK) 710 (MODIFIER LETTER CIRCUMFLEX ACCENT) 732 (SMALL TILDE) 8211 (EN DASH) 8212 (EM DASH) 8216 (LEFT SINGLE QUOTATION MARK) 8217 (RIGHT SINGLE QUOTATION MARK) 8218 (SINGLE LOW-9 QUOTATION MARK) 8220 (LEFT DOUBLE QUOTATION MARK) 8221 (RIGHT DOUBLE QUOTATION MARK) 8222 (DOUBLE LOW-9 QUOTATION MARK) 8224 (DAGGER) 8225 (DOUBLE DAGGER) 8226 (BULLET) 8230 (HORIZONTAL ELLIPSIS) 8240 (PER MILLE SIGN) 8249 (SINGLE LEFT-POINTING ANGLE QUOTATION MARK) 8250 (SINGLE RIGHT-POINTING ANGLE QUOTATION MARK) 8364 (EURO SIGN) 8482 (TRADE MARK SIGN)

Converting from Latin1 to IBM EBCDIC US English

Table A-10 lists all characters by character ID and description that do not convert from Latin1 to IBM EBCDIC US English:
Table A-10. Latin1 to IBM EBCDIC US English Character Conversion
Characters lost when converting from Latin1 (ISO-8859-1) to IBM037 (IBM EBCDIC US English) 128 (<control character>) 129 (<control character>) 130 (<control character>) 131 (<control character>) 132 (<control character>) 133 (<control character>) 144 (<control character>) 145 (<control character>) 146 (<control character>) 147 (<control character>) 148 (<control character>) 149 (<control character>)

390

Appendix A: Code Pages

Table A-10. Latin1 to IBM EBCDIC US English Character Conversion

Characters lost when converting from Latin1 (ISO-8859-1) to IBM037 (IBM EBCDIC US English) 134 (<control character>) 135 (<control character>) 136 (<control character>) 137 (<control character>) 138 (<control character>) 139 (<control character>) 140 (<control character>) 141 (<control character>) 142 (<control character>) 143 (<control character>) 150 (<control character>) 151 (<control character>) 152 (<control character>) 153 (<control character>) 154 (<control character>) 155 (<control character>) 156 (<control character>) 157 (<control character>) 158 (<control character>) 159 (<control character>)

Converting from IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992
Table A-11 lists all characters by character ID and description that do not convert from IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992:
Table A-11. IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 0x01 (START OF HEADING) 0x03 (END OF TEXT) 0x2D (ENQUIRY) 0x2F (BELL) 0x05 (CHARACTER TABULATION) 0x0B (LINE TABULATION) 0x0D (CARRIAGE RETURN (CR)) 0x0F (SHIFT IN) 0x11 (DEVICE CONTROL ONE) 0x13 (DEVICE CONTROL THREE) 0x3D (NEGATIVE ACKNOWLEDGE) 0x26 (END OF TRANSMISSION BLOCK) 0x19 (END OF MEDIUM) 0x02 (START OF TEXT) 0x37 (END OF TRANSMISSION) 0x2E (ACKNOWLEDGE) 0x16 (BACKSPACE) 0x25 (LINE FEED (LF)) 0x0C (FORM FEED (FF)) 0x0E (SHIFT OUT) 0x10 (DATA LINK ESCAPE) 0x12 (DEVICE CONTROL TWO) 0x3C (DEVICE CONTROL FOUR) 0x32 (SYNCHRONOUS IDLE) 0x18 (CANCEL) 0x3F (SUBSTITUTE)

Characters Lost in Code Page Conversion

391

Table A-11. IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 0x27 (ESCAPE) 0x1D (INFORMATION SEPARATOR THREE) 0x1F (INFORMATION SEPARATOR ONE) 0x5A (EXCLAMATION MARK) 0x7B (NUMBER SIGN) 0x6C (PERCENT SIGN) 0x7D (APOSTROPHE) 0x5D (RIGHT PARENTHESIS) 0x4E (PLUS SIGN) 0x60 (HYPHEN-MINUS) 0x61 (SOLIDUS) 0xF1 (DIGIT ONE) 0xF3 (DIGIT THREE) 0xF5 (DIGIT FIVE) 0xF7 (DIGIT SEVEN) 0xF9 (DIGIT NINE) 0x5E (SEMICOLON) 0x7E (EQUALS SIGN) 0x6F (QUESTION MARK) 0xC1 (LATIN CAPITAL LETTER A) 0xC3 (LATIN CAPITAL LETTER C) 0xC5 (LATIN CAPITAL LETTER E) 0xC7 (LATIN CAPITAL LETTER G) 0xC9 (LATIN CAPITAL LETTER I) 0xD2 (LATIN CAPITAL LETTER K) 0xD4 (LATIN CAPITAL LETTER M) 0xD6 (LATIN CAPITAL LETTER O) 0xD8 (LATIN CAPITAL LETTER Q) 0xE2 (LATIN CAPITAL LETTER S) 0xE4 (LATIN CAPITAL LETTER U) 0x1C (INFORMATION SEPARATOR FOUR) 0x1E (INFORMATION SEPARATOR TWO) 0x40 (SPACE) 0x7F (QUOTATION MARK) 0x5B (DOLLAR SIGN) 0x50 (AMPERSAND) 0x4D (LEFT PARENTHESIS) 0x5C (ASTERISK) 0x6B (COMMA) 0x4B (FULL STOP) 0xF0 (DIGIT ZERO) 0xF2 (DIGIT TWO) 0xF4 (DIGIT FOUR) 0xF6 (DIGIT SIX) 0xF8 (DIGIT EIGHT) 0x7A (COLON) 0x4C (LESS-THAN SIGN) 0x6E (GREATER-THAN SIGN) 0x7C (COMMERCIAL AT) 0xC2 (LATIN CAPITAL LETTER B) 0xC4 (LATIN CAPITAL LETTER D) 0xC6 (LATIN CAPITAL LETTER F) 0xC8 (LATIN CAPITAL LETTER H) 0xD1 (LATIN CAPITAL LETTER J) 0xD3 (LATIN CAPITAL LETTER L) 0xD5 (LATIN CAPITAL LETTER N) 0xD7 (LATIN CAPITAL LETTER P) 0xD9 (LATIN CAPITAL LETTER R) 0xE3 (LATIN CAPITAL LETTER T) 0xE5 (LATIN CAPITAL LETTER V)

392

Appendix A: Code Pages

Table A-11. IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 0xE6 (LATIN CAPITAL LETTER W) 0xE8 (LATIN CAPITAL LETTER Y) 0x70 (LEFT SQUARE BRACKET) 0x80 (RIGHT SQUARE BRACKET) 0x6D (LOW LINE) 0x81 (LATIN SMALL LETTER A) 0x83 (LATIN SMALL LETTER C) 0x85 (LATIN SMALL LETTER E) 0x87 (LATIN SMALL LETTER G) 0x89 (LATIN SMALL LETTER I) 0x92 (LATIN SMALL LETTER K) 0x94 (LATIN SMALL LETTER M) 0x96 (LATIN SMALL LETTER O) 0x98 (LATIN SMALL LETTER Q) 0xA2 (LATIN SMALL LETTER S) 0xA4 (LATIN SMALL LETTER U) 0xA6 (LATIN SMALL LETTER W) 0xA8 (LATIN SMALL LETTER Y) 0xC0 (LEFT CURLY BRACKET) 0xD0 (RIGHT CURLY BRACKET) 0x07 (DELETE) 0x21 (<control-0081>) 0x23 (NO BREAK HERE) 0x15 (NEXT LINE (NEL)) 0x17 (END OF SELECTED AREA) 0x29 (CHARACTER TABULATION WITH JUSTIFICATION) 0x2B (PARTIAL LINE FORWARD) 0x09 (REVERSE LINE FEED) 0x1B (SINGLE SHIFT THREE) 0x31 (PRIVATE USE ONE) 0xE7 (LATIN CAPITAL LETTER X) 0xE9 (LATIN CAPITAL LETTER Z) 0xB2 (REVERSE SOLIDUS) 0xB0 (CIRCUMFLEX ACCENT) 0x79 (GRAVE ACCENT) 0x82 (LATIN SMALL LETTER B) 0x84 (LATIN SMALL LETTER D) 0x86 (LATIN SMALL LETTER F) 0x88 (LATIN SMALL LETTER H) 0x91 (LATIN SMALL LETTER J) 0x93 (LATIN SMALL LETTER L) 0x95 (LATIN SMALL LETTER N) 0x97 (LATIN SMALL LETTER P) 0x99 (LATIN SMALL LETTER R) 0xA3 (LATIN SMALL LETTER T) 0xA5 (LATIN SMALL LETTER V) 0xA7 (LATIN SMALL LETTER X) 0xA9 (LATIN SMALL LETTER Z) 0x4F (VERTICAL LINE) 0xA1 (TILDE) 0x20 (<control-0080>) 0x22 (BREAK PERMITTED HERE) 0x24 (<control-0084>) 0x06 (START OF SELECTED AREA) 0x28 (CHARACTER TABULATION SET) 0x2A (LINE TABULATION SET) 0x2C (PARTIAL LINE BACKWARD) 0x0A (SINGLE SHIFT TWO) 0x30 (DEVICE CONTROL STRING) 0x1A (PRIVATE USE TWO) Characters Lost in Code Page Conversion 393

Table A-11. IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 0x33 (SET TRANSMIT STATE) 0x35 (MESSAGE WAITING) 0x08 (END OF GUARDED AREA) 0x39 (<control-0099>) 0x3B (CONTROL SEQUENCE INTRODUCER) 0x14 (OPERATING SYSTEM COMMAND) 0xFF (APPLICATION PROGRAM COMMAND) 0x6A (BROKEN BAR) 0xA0 (OVERLINE) 0x43 (HALFWIDTH HANGUL LETTER KIYEOK) 0x45 (HALFWIDTH HANGUL LETTER KIYEOK-SIOS) 0x47 (HALFWIDTH HANGUL LETTER NIEUN-CIEUC) 0x49 (HALFWIDTH HANGUL LETTER TIKEUT) 0x53 (HALFWIDTH HANGUL LETTER RIEUL) 0x55 (HALFWIDTH HANGUL LETTER RIEUL-MIEUM) 0x57 (HALFWIDTH HANGUL LETTER RIEUL-SIOS) 0x59 (HALFWIDTH HANGUL LETTER RIEUL-PHIEUPH) 0x63 (HALFWIDTH HANGUL LETTER MIEUM) 0x65 (HALFWIDTH HANGUL LETTER SSANGPIEUP) 0x67 (HALFWIDTH HANGUL LETTER SIOS) 0x69 (HALFWIDTH HANGUL LETTER IEUNG) 0x73 (HALFWIDTH HANGUL LETTER SSANGCIEUC) 0x75 (HALFWIDTH HANGUL LETTER KHIEUKH) 0x77 (HALFWIDTH HANGUL LETTER PHIEUPH) 0x8A (HALFWIDTH HANGUL LETTER A) 0x8C (HALFWIDTH HANGUL LETTER YA) 0x8E (HALFWIDTH HANGUL LETTER EO) 0x9A (HALFWIDTH HANGUL LETTER YEO) 0x9C (HALFWIDTH HANGUL LETTER O) 0x9E (HALFWIDTH HANGUL LETTER WAE) 0x34 (CANCEL CHARACTER) 0x36 (START OF GUARDED AREA) 0x38 (START OF STRING) 0x3A (SINGLE CHARACTER INTRODUCER) 0x04 (STRING TERMINATOR) 0x3E (PRIVACY MESSAGE) 0x4A (CENT SIGN) 0x5F (NOT SIGN) 0x42 (HALFWIDTH HANGUL FILLER) 0x44 (HALFWIDTH HANGUL LETTER SSANGKIYEOK) 0x46 (HALFWIDTH HANGUL LETTER NIEUN) 0x48 (HALFWIDTH HANGUL LETTER NIEUN-HIEUH) 0x52 (HALFWIDTH HANGUL LETTER SSANGTIKEUT) 0x54 (HALFWIDTH HANGUL LETTER RIEUL-KIYEOK) 0x56 (HALFWIDTH HANGUL LETTER RIEUL-PIEUP) 0x58 (HALFWIDTH HANGUL LETTER RIEUL-THIEUTH) 0x62 (HALFWIDTH HANGUL LETTER RIEUL-HIEUH) 0x64 (HALFWIDTH HANGUL LETTER PIEUP) 0x66 (HALFWIDTH HANGUL LETTER PIEUP-SIOS) 0x68 (HALFWIDTH HANGUL LETTER SSANGSIOS) 0x72 (HALFWIDTH HANGUL LETTER CIEUC) 0x74 (HALFWIDTH HANGUL LETTER CHIEUCH) 0x76 (HALFWIDTH HANGUL LETTER THIEUTH) 0x78 (HALFWIDTH HANGUL LETTER HIEUH) 0x8B (HALFWIDTH HANGUL LETTER AE) 0x8D (HALFWIDTH HANGUL LETTER YAE) 0x8F (HALFWIDTH HANGUL LETTER E) 0x9B (HALFWIDTH HANGUL LETTER YE) 0x9D (HALFWIDTH HANGUL LETTER WA) 0x9F (HALFWIDTH HANGUL LETTER OE)

394

Appendix A: Code Pages

Table A-11. IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP833 to MS Windows Korean, superset of KS C 5601-1992 0xAA (HALFWIDTH HANGUL LETTER YO) 0xAC (HALFWIDTH HANGUL LETTER WEO) 0xAE (HALFWIDTH HANGUL LETTER WI) 0xBA (HALFWIDTH HANGUL LETTER EU) 0xBC (HALFWIDTH HANGUL LETTER I) 0xAB (HALFWIDTH HANGUL LETTER U) 0xAD (HALFWIDTH HANGUL LETTER WE) 0xAF (HALFWIDTH HANGUL LETTER YU) 0xBB (HALFWIDTH HANGUL LETTER YI)

Converting from IBM EBCDIC Korean CP833 to MS Windows Korean (Johab)

Table A-12 lists all characters by character ID and description that do not convert from IBM EBCDIC Korean CP833 to MS Windows Korean (Johab):
Table A-12. IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) 0x01 (START OF HEADING) 0x03 (END OF TEXT) 0x2D (ENQUIRY) 0x2F (BELL) 0x05 (CHARACTER TABULATION) 0x0B (LINE TABULATION) 0x0D (CARRIAGE RETURN (CR)) 0x0F (SHIFT IN) 0x11 (DEVICE CONTROL ONE) 0x13 (DEVICE CONTROL THREE) 0x3D (NEGATIVE ACKNOWLEDGE) 0x26 (END OF TRANSMISSION BLOCK) 0x19 (END OF MEDIUM) 0x27 (ESCAPE) 0x1D (INFORMATION SEPARATOR THREE) 0x1F (INFORMATION SEPARATOR ONE) 0x5A (EXCLAMATION MARK) 0x02 (START OF TEXT) 0x37 (END OF TRANSMISSION) 0x2E (ACKNOWLEDGE) 0x16 (BACKSPACE) 0x25 (LINE FEED (LF)) 0x0C (FORM FEED (FF)) 0x0E (SHIFT OUT) 0x10 (DATA LINK ESCAPE) 0x12 (DEVICE CONTROL TWO) 0x3C (DEVICE CONTROL FOUR) 0x32 (SYNCHRONOUS IDLE) 0x18 (CANCEL) 0x3F (SUBSTITUTE) 0x1C (INFORMATION SEPARATOR FOUR) 0x1E (INFORMATION SEPARATOR TWO) 0x40 (SPACE) 0x7F (QUOTATION MARK)

Characters Lost in Code Page Conversion

395

Table A-12. IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) 0x7B (NUMBER SIGN) 0x6C (PERCENT SIGN) 0x7D (APOSTROPHE) 0x5D (RIGHT PARENTHESIS) 0x4E (PLUS SIGN) 0x60 (HYPHEN-MINUS) 0x61 (SOLIDUS) 0xF1 (DIGIT ONE) 0xF3 (DIGIT THREE) 0xF5 (DIGIT FIVE) 0xF7 (DIGIT SEVEN) 0xF9 (DIGIT NINE) 0x5E (SEMICOLON) 0x7E (EQUALS SIGN) 0x6F (QUESTION MARK) 0xC1 (LATIN CAPITAL LETTER A) 0xC3 (LATIN CAPITAL LETTER C) 0xC5 (LATIN CAPITAL LETTER E) 0xC7 (LATIN CAPITAL LETTER G) 0xC9 (LATIN CAPITAL LETTER I) 0xD2 (LATIN CAPITAL LETTER K) 0xD4 (LATIN CAPITAL LETTER M) 0xD6 (LATIN CAPITAL LETTER O) 0xD8 (LATIN CAPITAL LETTER Q) 0xE2 (LATIN CAPITAL LETTER S) 0xE4 (LATIN CAPITAL LETTER U) 0xE6 (LATIN CAPITAL LETTER W) 0xE8 (LATIN CAPITAL LETTER Y) 0x70 (LEFT SQUARE BRACKET) 0x80 (RIGHT SQUARE BRACKET) 0x5B (DOLLAR SIGN) 0x50 (AMPERSAND) 0x4D (LEFT PARENTHESIS) 0x5C (ASTERISK) 0x6B (COMMA) 0x4B (FULL STOP) 0xF0 (DIGIT ZERO) 0xF2 (DIGIT TWO) 0xF4 (DIGIT FOUR) 0xF6 (DIGIT SIX) 0xF8 (DIGIT EIGHT) 0x7A (COLON) 0x4C (LESS-THAN SIGN) 0x6E (GREATER-THAN SIGN) 0x7C (COMMERCIAL AT) 0xC2 (LATIN CAPITAL LETTER B) 0xC4 (LATIN CAPITAL LETTER D) 0xC6 (LATIN CAPITAL LETTER F) 0xC8 (LATIN CAPITAL LETTER H) 0xD1 (LATIN CAPITAL LETTER J) 0xD3 (LATIN CAPITAL LETTER L) 0xD5 (LATIN CAPITAL LETTER N) 0xD7 (LATIN CAPITAL LETTER P) 0xD9 (LATIN CAPITAL LETTER R) 0xE3 (LATIN CAPITAL LETTER T) 0xE5 (LATIN CAPITAL LETTER V) 0xE7 (LATIN CAPITAL LETTER X) 0xE9 (LATIN CAPITAL LETTER Z) 0xB2 (REVERSE SOLIDUS) 0xB0 (CIRCUMFLEX ACCENT)

396

Appendix A: Code Pages

Table A-12. IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) 0x6D (LOW LINE) 0x81 (LATIN SMALL LETTER A) 0x83 (LATIN SMALL LETTER C) 0x85 (LATIN SMALL LETTER E) 0x87 (LATIN SMALL LETTER G) 0x89 (LATIN SMALL LETTER I) 0x92 (LATIN SMALL LETTER K) 0x94 (LATIN SMALL LETTER M) 0x96 (LATIN SMALL LETTER O) 0x98 (LATIN SMALL LETTER Q) 0xA2 (LATIN SMALL LETTER S) 0xA4 (LATIN SMALL LETTER U) 0xA6 (LATIN SMALL LETTER W) 0xA8 (LATIN SMALL LETTER Y) 0xC0 (LEFT CURLY BRACKET) 0xD0 (RIGHT CURLY BRACKET) 0x07 (DELETE) 0x21 (<control-0081>) 0x23 (NO BREAK HERE) 0x15 (NEXT LINE (NEL)) 0x17 (END OF SELECTED AREA) 0x29 (CHARACTER TABULATION WITH JUSTIFICATION) 0x2B (PARTIAL LINE FORWARD) 0x09 (REVERSE LINE FEED) 0x1B (SINGLE SHIFT THREE) 0x31 (PRIVATE USE ONE) 0x33 (SET TRANSMIT STATE) 0x35 (MESSAGE WAITING) 0x08 (END OF GUARDED AREA) 0x39 (<control-0099>) 0x79 (GRAVE ACCENT) 0x82 (LATIN SMALL LETTER B) 0x84 (LATIN SMALL LETTER D) 0x86 (LATIN SMALL LETTER F) 0x88 (LATIN SMALL LETTER H) 0x91 (LATIN SMALL LETTER J) 0x93 (LATIN SMALL LETTER L) 0x95 (LATIN SMALL LETTER N) 0x97 (LATIN SMALL LETTER P) 0x99 (LATIN SMALL LETTER R) 0xA3 (LATIN SMALL LETTER T) 0xA5 (LATIN SMALL LETTER V) 0xA7 (LATIN SMALL LETTER X) 0xA9 (LATIN SMALL LETTER Z) 0x4F (VERTICAL LINE) 0xA1 (TILDE) 0x20 (<control-0080>) 0x22 (BREAK PERMITTED HERE) 0x24 (<control-0084>) 0x06 (START OF SELECTED AREA) 0x28 (CHARACTER TABULATION SET) 0x2A (LINE TABULATION SET) 0x2C (PARTIAL LINE BACKWARD) 0x0A (SINGLE SHIFT TWO) 0x30 (DEVICE CONTROL STRING) 0x1A (PRIVATE USE TWO) 0x34 (CANCEL CHARACTER) 0x36 (START OF GUARDED AREA) 0x38 (START OF STRING) 0x3A (SINGLE CHARACTER INTRODUCER)

Characters Lost in Code Page Conversion

397

Table A-12. IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) 0x3B (CONTROL SEQUENCE INTRODUCER) 0x14 (OPERATING SYSTEM COMMAND) 0xFF (APPLICATION PROGRAM COMMAND) 0x6A (BROKEN BAR) 0xA0 (OVERLINE) 0x43 (HALFWIDTH HANGUL LETTER KIYEOK) 0x45 (HALFWIDTH HANGUL LETTER KIYEOK-SIOS) 0x47 (HALFWIDTH HANGUL LETTER NIEUN-CIEUC) 0x49 (HALFWIDTH HANGUL LETTER TIKEUT) 0x53 (HALFWIDTH HANGUL LETTER RIEUL) 0x55 (HALFWIDTH HANGUL LETTER RIEUL-MIEUM) 0x57 (HALFWIDTH HANGUL LETTER RIEUL-SIOS) 0x59 (HALFWIDTH HANGUL LETTER RIEUL-PHIEUPH) 0x63 (HALFWIDTH HANGUL LETTER MIEUM) 0x65 (HALFWIDTH HANGUL LETTER SSANGPIEUP) 0x67 (HALFWIDTH HANGUL LETTER SIOS) 0x69 (HALFWIDTH HANGUL LETTER IEUNG) 0x73 (HALFWIDTH HANGUL LETTER SSANGCIEUC) 0x75 (HALFWIDTH HANGUL LETTER KHIEUKH) 0x77 (HALFWIDTH HANGUL LETTER PHIEUPH) 0x8A (HALFWIDTH HANGUL LETTER A) 0x8C (HALFWIDTH HANGUL LETTER YA) 0x8E (HALFWIDTH HANGUL LETTER EO) 0x9A (HALFWIDTH HANGUL LETTER YEO) 0x9C (HALFWIDTH HANGUL LETTER O) 0x9E (HALFWIDTH HANGUL LETTER WAE) 0xAA (HALFWIDTH HANGUL LETTER YO) 0xAC (HALFWIDTH HANGUL LETTER WEO) 0xAE (HALFWIDTH HANGUL LETTER WI) 0x04 (STRING TERMINATOR) 0x3E (PRIVACY MESSAGE) 0x4A (CENT SIGN) 0x5F (NOT SIGN) 0x42 (HALFWIDTH HANGUL FILLER) 0x44 (HALFWIDTH HANGUL LETTER SSANGKIYEOK) 0x46 (HALFWIDTH HANGUL LETTER NIEUN) 0x48 (HALFWIDTH HANGUL LETTER NIEUN-HIEUH) 0x52 (HALFWIDTH HANGUL LETTER SSANGTIKEUT) 0x54 (HALFWIDTH HANGUL LETTER RIEUL-KIYEOK) 0x56 (HALFWIDTH HANGUL LETTER RIEUL-PIEUP) 0x58 (HALFWIDTH HANGUL LETTER RIEUL-THIEUTH) 0x62 (HALFWIDTH HANGUL LETTER RIEUL-HIEUH) 0x64 (HALFWIDTH HANGUL LETTER PIEUP) 0x66 (HALFWIDTH HANGUL LETTER PIEUP-SIOS) 0x68 (HALFWIDTH HANGUL LETTER SSANGSIOS) 0x72 (HALFWIDTH HANGUL LETTER CIEUC) 0x74 (HALFWIDTH HANGUL LETTER CHIEUCH) 0x76 (HALFWIDTH HANGUL LETTER THIEUTH) 0x78 (HALFWIDTH HANGUL LETTER HIEUH) 0x8B (HALFWIDTH HANGUL LETTER AE) 0x8D (HALFWIDTH HANGUL LETTER YAE) 0x8F (HALFWIDTH HANGUL LETTER E) 0x9B (HALFWIDTH HANGUL LETTER YE) 0x9D (HALFWIDTH HANGUL LETTER WA) 0x9F (HALFWIDTH HANGUL LETTER OE) 0xAB (HALFWIDTH HANGUL LETTER U) 0xAD (HALFWIDTH HANGUL LETTER WE) 0xAF (HALFWIDTH HANGUL LETTER YU)

398

Appendix A: Code Pages

Table A-12. IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP833 to MS Windows Korean (Johab) 0xBA (HALFWIDTH HANGUL LETTER EU) 0xBC (HALFWIDTH HANGUL LETTER I) 0xBB (HALFWIDTH HANGUL LETTER YI)

Converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992
Table A-13 lists all characters by character ID and description that do not convert from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992:
Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 0x01 (START OF HEADING) 0x03 (END OF TEXT) 0x2D (ENQUIRY) 0x2F (BELL) 0x05 (CHARACTER TABULATION) 0x0B (LINE TABULATION) 0x0D (CARRIAGE RETURN (CR)) 0x3F (SHIFT IN) 0x11 (DEVICE CONTROL ONE) 0x13 (DEVICE CONTROL THREE) 0x3D (NEGATIVE ACKNOWLEDGE) 0x26 (END OF TRANSMISSION BLOCK) 0x19 (END OF MEDIUM) 0x27 (ESCAPE) 0x1D (INFORMATION SEPARATOR THREE) 0x1F (INFORMATION SEPARATOR ONE) 0x5A (EXCLAMATION MARK) 0x7B (NUMBER SIGN) 0x6C (PERCENT SIGN) 0x7D (APOSTROPHE) 0x02 (START OF TEXT) 0x37 (END OF TRANSMISSION) 0x2E (ACKNOWLEDGE) 0x16 (BACKSPACE) 0x25 (LINE FEED (LF)) 0x0C (FORM FEED (FF)) 0x3F (SHIFT OUT) 0x10 (DATA LINK ESCAPE) 0x12 (DEVICE CONTROL TWO) 0x3C (DEVICE CONTROL FOUR) 0x32 (SYNCHRONOUS IDLE) 0x18 (CANCEL) 0x3F (SUBSTITUTE) 0x1C (INFORMATION SEPARATOR FOUR) 0x1E (INFORMATION SEPARATOR TWO) 0x40 (SPACE) 0x7F (QUOTATION MARK) 0x5B (DOLLAR SIGN) 0x50 (AMPERSAND) 0x4D (LEFT PARENTHESIS)

Characters Lost in Code Page Conversion

399

Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 0x5D (RIGHT PARENTHESIS) 0x4E (PLUS SIGN) 0x60 (HYPHEN-MINUS) 0x61 (SOLIDUS) 0xF1 (DIGIT ONE) 0xF3 (DIGIT THREE) 0xF5 (DIGIT FIVE) 0xF7 (DIGIT SEVEN) 0xF9 (DIGIT NINE) 0x5E (SEMICOLON) 0x7E (EQUALS SIGN) 0x6F (QUESTION MARK) 0xC1 (LATIN CAPITAL LETTER A) 0xC3 (LATIN CAPITAL LETTER C) 0xC5 (LATIN CAPITAL LETTER E) 0xC7 (LATIN CAPITAL LETTER G) 0xC9 (LATIN CAPITAL LETTER I) 0xD2 (LATIN CAPITAL LETTER K) 0xD4 (LATIN CAPITAL LETTER M) 0xD6 (LATIN CAPITAL LETTER O) 0xD8 (LATIN CAPITAL LETTER Q) 0xE2 (LATIN CAPITAL LETTER S) 0xE4 (LATIN CAPITAL LETTER U) 0xE6 (LATIN CAPITAL LETTER W) 0xE8 (LATIN CAPITAL LETTER Y) 0x70 (LEFT SQUARE BRACKET) 0x80 (RIGHT SQUARE BRACKET) 0x6D (LOW LINE) 0x81 (LATIN SMALL LETTER A) 0x83 (LATIN SMALL LETTER C) 0x5C (ASTERISK) 0x6B (COMMA) 0x4B (FULL STOP) 0xF0 (DIGIT ZERO) 0xF2 (DIGIT TWO) 0xF4 (DIGIT FOUR) 0xF6 (DIGIT SIX) 0xF8 (DIGIT EIGHT) 0x7A (COLON) 0x4C (LESS-THAN SIGN) 0x6E (GREATER-THAN SIGN) 0x7C (COMMERCIAL AT) 0xC2 (LATIN CAPITAL LETTER B) 0xC4 (LATIN CAPITAL LETTER D) 0xC6 (LATIN CAPITAL LETTER F) 0xC8 (LATIN CAPITAL LETTER H) 0xD1 (LATIN CAPITAL LETTER J) 0xD3 (LATIN CAPITAL LETTER L) 0xD5 (LATIN CAPITAL LETTER N) 0xD7 (LATIN CAPITAL LETTER P) 0xD9 (LATIN CAPITAL LETTER R) 0xE3 (LATIN CAPITAL LETTER T) 0xE5 (LATIN CAPITAL LETTER V) 0xE7 (LATIN CAPITAL LETTER X) 0xE9 (LATIN CAPITAL LETTER Z) 0xB2 (REVERSE SOLIDUS) 0xB0 (CIRCUMFLEX ACCENT) 0x79 (GRAVE ACCENT) 0x82 (LATIN SMALL LETTER B) 0x84 (LATIN SMALL LETTER D)

400

Appendix A: Code Pages

Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 0x85 (LATIN SMALL LETTER E) 0x87 (LATIN SMALL LETTER G) 0x89 (LATIN SMALL LETTER I) 0x92 (LATIN SMALL LETTER K) 0x94 (LATIN SMALL LETTER M) 0x96 (LATIN SMALL LETTER O) 0x98 (LATIN SMALL LETTER Q) 0xA2 (LATIN SMALL LETTER S) 0xA4 (LATIN SMALL LETTER U) 0xA6 (LATIN SMALL LETTER W) 0xA8 (LATIN SMALL LETTER Y) 0xC0 (LEFT CURLY BRACKET) 0xD0 (RIGHT CURLY BRACKET) 0x07 (DELETE) 0x21 (<control-0081>) 0x23 (NO BREAK HERE) 0x15 (NEXT LINE (NEL)) 0x17 (END OF SELECTED AREA) 0x29 (CHARACTER TABULATION WITH JUSTIFICATION) 0x2B (PARTIAL LINE FORWARD) 0x09 (REVERSE LINE FEED) 0x1B (SINGLE SHIFT THREE) 0x31 (PRIVATE USE ONE) 0x33 (SET TRANSMIT STATE) 0x35 (MESSAGE WAITING) 0x08 (END OF GUARDED AREA) 0x39 (<control-0099>) 0x3B (CONTROL SEQUENCE INTRODUCER) 0x14 (OPERATING SYSTEM COMMAND) 0x86 (LATIN SMALL LETTER F) 0x88 (LATIN SMALL LETTER H) 0x91 (LATIN SMALL LETTER J) 0x93 (LATIN SMALL LETTER L) 0x95 (LATIN SMALL LETTER N) 0x97 (LATIN SMALL LETTER P) 0x99 (LATIN SMALL LETTER R) 0xA3 (LATIN SMALL LETTER T) 0xA5 (LATIN SMALL LETTER V) 0xA7 (LATIN SMALL LETTER X) 0xA9 (LATIN SMALL LETTER Z) 0x4F (VERTICAL LINE) 0xA1 (TILDE) 0x20 (<control-0080>) 0x22 (BREAK PERMITTED HERE) 0x24 (<control-0084>) 0x06 (START OF SELECTED AREA) 0x28 (CHARACTER TABULATION SET) 0x2A (LINE TABULATION SET) 0x2C (PARTIAL LINE BACKWARD) 0x0A (SINGLE SHIFT TWO) 0x30 (DEVICE CONTROL STRING) 0x1A (PRIVATE USE TWO) 0x34 (CANCEL CHARACTER) 0x36 (START OF GUARDED AREA) 0x38 (START OF STRING) 0x3A (SINGLE CHARACTER INTRODUCER) 0x04 (STRING TERMINATOR) 0x3E (PRIVACY MESSAGE)

Characters Lost in Code Page Conversion

401

Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 0xFF (APPLICATION PROGRAM COMMAND) 0x4A (CENT SIGN) 0x3F (YEN SIGN) 0x3F (COPYRIGHT SIGN) 0x5F (NOT SIGN) 0x3F (MACRON) 0x3F (RIGHT-POINTING DOUBLE ANGLE QUOTATION MARK) 0x3F (LATIN CAPITAL LETTER A WITH ACUTE) 0x3F (LATIN CAPITAL LETTER A WITH TILDE) 0x3F (LATIN CAPITAL LETTER A WITH RING ABOVE) 0x3F (LATIN CAPITAL LETTER E WITH GRAVE) 0x3F (LATIN CAPITAL LETTER E WITH CIRCUMFLEX) 0x3F (LATIN CAPITAL LETTER I WITH GRAVE) 0x3F (LATIN CAPITAL LETTER I WITH CIRCUMFLEX) 0x3F (LATIN CAPITAL LETTER N WITH TILDE) 0x3F (LATIN CAPITAL LETTER O WITH ACUTE) 0x3F (LATIN CAPITAL LETTER O WITH TILDE) 0x3F (LATIN CAPITAL LETTER U WITH GRAVE) 0x3F (LATIN CAPITAL LETTER U WITH CIRCUMFLEX) 0x3F (LATIN CAPITAL LETTER Y WITH ACUTE) 0x3F (LATIN SMALL LETTER A WITH ACUTE) 0x3F (LATIN SMALL LETTER A WITH TILDE) 0x3F (LATIN SMALL LETTER A WITH RING ABOVE) 0x3F (LATIN SMALL LETTER E WITH GRAVE) 0x3F (LATIN SMALL LETTER E WITH CIRCUMFLEX) 0x3F (LATIN SMALL LETTER I WITH GRAVE) 0x3F (LATIN SMALL LETTER I WITH CIRCUMFLEX) 0x3F (LATIN SMALL LETTER N WITH TILDE) 0x3F (LATIN SMALL LETTER O WITH ACUTE) 0x3F (NO-BREAK SPACE) 0x3F (POUND SIGN) 0x6A (BROKEN BAR) 0x3F (LEFT-POINTING DOUBLE ANGLE QUOTATION MARK) 0x3F (REGISTERED SIGN) 0x3F (MICRO SIGN) 0x3F (LATIN CAPITAL LETTER A WITH GRAVE) 0x3F (LATIN CAPITAL LETTER A WITH CIRCUMFLEX) 0x3F (LATIN CAPITAL LETTER A WITH DIAERESIS) 0x3F (LATIN CAPITAL LETTER C WITH CEDILLA) 0x3F (LATIN CAPITAL LETTER E WITH ACUTE) 0x3F (LATIN CAPITAL LETTER E WITH DIAERESIS) 0x3F (LATIN CAPITAL LETTER I WITH ACUTE) 0x3F (LATIN CAPITAL LETTER I WITH DIAERESIS) 0x3F (LATIN CAPITAL LETTER O WITH GRAVE) 0x3F (LATIN CAPITAL LETTER O WITH CIRCUMFLEX) 0x3F (LATIN CAPITAL LETTER O WITH DIAERESIS) 0x3F (LATIN CAPITAL LETTER U WITH ACUTE) 0x3F (LATIN CAPITAL LETTER U WITH DIAERESIS) 0x3F (LATIN SMALL LETTER A WITH GRAVE) 0x3F (LATIN SMALL LETTER A WITH CIRCUMFLEX) 0x3F (LATIN SMALL LETTER A WITH DIAERESIS) 0x3F (LATIN SMALL LETTER C WITH CEDILLA) 0x3F (LATIN SMALL LETTER E WITH ACUTE) 0x3F (LATIN SMALL LETTER E WITH DIAERESIS) 0x3F (LATIN SMALL LETTER I WITH ACUTE) 0x3F (LATIN SMALL LETTER I WITH DIAERESIS) 0x3F (LATIN SMALL LETTER O WITH GRAVE) 0x3F (LATIN SMALL LETTER O WITH CIRCUMFLEX)

402

Appendix A: Code Pages

Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 0x3F (LATIN SMALL LETTER O WITH TILDE) 0x3F (LATIN SMALL LETTER U WITH GRAVE) 0x3F (LATIN SMALL LETTER U WITH CIRCUMFLEX) 0x3F (LATIN SMALL LETTER Y WITH ACUTE) 0x41 0x60 (LATIN LETTER ALVEOLAR CLICK) 0x49 0x54 (SMALL TILDE) 0x41 0x49 (EM DASH) 0x41 0x69 (KELVIN SIGN) 0x41 0x62 (GREATER-THAN OVER EQUAL TO) 0x42 0xA1 (WAVE DASH) 0x58 0xA4 (CJK UNIFIED IDEOGRAPH-4E30) 0x5F 0x9B (CJK UNIFIED IDEOGRAPH-4EDE) 0x53 0xBC (CJK UNIFIED IDEOGRAPH-4F5E) 0x5A 0xA2 (CJK UNIFIED IDEOGRAPH-5070) 0x55 0xD5 (CJK UNIFIED IDEOGRAPH-50C2) 0x63 0xF3 (CJK UNIFIED IDEOGRAPH-51B2) 0x62 0xD5 (CJK UNIFIED IDEOGRAPH-5231) 0x5E 0x78 (CJK UNIFIED IDEOGRAPH-5401) 0x51 0x4E (CJK UNIFIED IDEOGRAPH-54FD) 0x53 0xA9 (CJK UNIFIED IDEOGRAPH-5583) 0x5A 0x53 (CJK UNIFIED IDEOGRAPH-566C) 0x67 0x69 (CJK UNIFIED IDEOGRAPH-56C2) 0x66 0xE9 (CJK UNIFIED IDEOGRAPH-571C) 0x54 0xE4 (CJK UNIFIED IDEOGRAPH-57D3) 0x59 0x48 (CJK UNIFIED IDEOGRAPH-59A3) 0x5A 0x56 (CJK UNIFIED IDEOGRAPH-5A7F) 0x5D 0xCA (CJK UNIFIED IDEOGRAPH-5ABC) 0x52 0x7E (CJK UNIFIED IDEOGRAPH-5ABE) 0x5D 0x88 (CJK UNIFIED IDEOGRAPH-5B30) 0x5A 0x88 (CJK UNIFIED IDEOGRAPH-5C20) 0x3F (LATIN SMALL LETTER O WITH DIAERESIS) 0x3F (LATIN SMALL LETTER U WITH ACUTE) 0x3F (LATIN SMALL LETTER U WITH DIAERESIS) 0x3F (LATIN SMALL LETTER Y WITH DIAERESIS) 0x49 0x94 (MODIFIER LETTER DOUBLE PRIME) 0x41 0x48 (HYPHEN) 0xA0 (OVERLINE) 0x41 0x61 (LESS-THAN OVER EQUAL TO) 0x49 0x6F (FISHEYE) 0x41 0x43 (KATAKANA MIDDLE DOT) 0x58 0xB5 (CJK UNIFIED IDEOGRAPH-4EC6) 0x52 0x73 (CJK UNIFIED IDEOGRAPH-4F5D) 0x56 0xC3 (CJK UNIFIED IDEOGRAPH-4FDB) 0x52 0x75 (CJK UNIFIED IDEOGRAPH-50B4) 0x54 0x42 (CJK UNIFIED IDEOGRAPH-515A) 0x55 0xFC (CJK UNIFIED IDEOGRAPH-51DB) 0x5B 0x54 (CJK UNIFIED IDEOGRAPH-53DF) 0x54 0x97 (CJK UNIFIED IDEOGRAPH-5484) 0x5B 0xCA (CJK UNIFIED IDEOGRAPH-557B) 0x61 0x6C (CJK UNIFIED IDEOGRAPH-566A) 0x60 0xA7 (CJK UNIFIED IDEOGRAPH-56C0) 0x5E 0xDB (CJK UNIFIED IDEOGRAPH-56FF) 0x54 0x9F (CJK UNIFIED IDEOGRAPH-578C) 0x5D 0x7A (CJK UNIFIED IDEOGRAPH-5869) 0x59 0x94 (CJK UNIFIED IDEOGRAPH-59D2) 0x67 0x41 (CJK UNIFIED IDEOGRAPH-5A93) 0x56 0x72 (CJK UNIFIED IDEOGRAPH-5ABD) 0x52 0x7F (CJK UNIFIED IDEOGRAPH-5AD7) 0x53 0xC1 (CJK UNIFIED IDEOGRAPH-5B65) 0x53 0x4D (CJK UNIFIED IDEOGRAPH-5C8C)

Characters Lost in Code Page Conversion

403

Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 0x56 0x6D (CJK UNIFIED IDEOGRAPH-5CA6) 0x5C 0x8A (CJK UNIFIED IDEOGRAPH-5D52) 0x60 0xAC (CJK UNIFIED IDEOGRAPH-5DD3) 0x52 0xF0 (CJK UNIFIED IDEOGRAPH-5DF9) 0x5E 0xC2 (CJK UNIFIED IDEOGRAPH-5E43) 0x65 0x69 (CJK UNIFIED IDEOGRAPH-5E96) 0x55 0xFD (CJK UNIFIED IDEOGRAPH-5EE9) 0x64 0x59 (CJK UNIFIED IDEOGRAPH-5FB4) 0x67 0xA2 (CJK UNIFIED IDEOGRAPH-5FFB) 0x63 0xBC (CJK UNIFIED IDEOGRAPH-6031) 0x5D 0x42 (CJK UNIFIED IDEOGRAPH-605A) 0x5A 0x89 (CJK UNIFIED IDEOGRAPH-6103) 0x66 0xED (CJK UNIFIED IDEOGRAPH-61FD) 0x51 0x54 (CJK UNIFIED IDEOGRAPH-6243) 0x5A 0xA7 (CJK UNIFIED IDEOGRAPH-6308) 0x52 0xAC (CJK UNIFIED IDEOGRAPH-63AC) 0x59 0x73 (CJK UNIFIED IDEOGRAPH-64EF) 0x5C 0xE5 (CJK UNIFIED IDEOGRAPH-6554) 0x61 0x54 (CJK UNIFIED IDEOGRAPH-6662) 0x53 0xAE (CJK UNIFIED IDEOGRAPH-66E9) 0x5F 0xDE (CJK UNIFIED IDEOGRAPH-67DE) 0x5F 0x88 (CJK UNIFIED IDEOGRAPH-682E) 0x60 0xEF (CJK UNIFIED IDEOGRAPH-6883) 0x59 0xA3 (CJK UNIFIED IDEOGRAPH-6942) 0x59 0xC4 (CJK UNIFIED IDEOGRAPH-69CA) 0x51 0xCF (CJK UNIFIED IDEOGRAPH-69D3) 0x64 0x43 (CJK UNIFIED IDEOGRAPH-6A47) 0x51 0x5A (CJK UNIFIED IDEOGRAPH-6AA0) 0x55 0x6A (CJK UNIFIED IDEOGRAPH-6ADF) 0x5C 0xA3 (CJK UNIFIED IDEOGRAPH-6B38) 0x63 0x93 (CJK UNIFIED IDEOGRAPH-5CED) 0x5F 0xFA (CJK UNIFIED IDEOGRAPH-5D82) 0x64 0x57 (CJK UNIFIED IDEOGRAPH-5DF5) 0x5E 0xDE (CJK UNIFIED IDEOGRAPH-5E37) 0x54 0xDC (CJK UNIFIED IDEOGRAPH-5E71) 0x65 0xF4 (CJK UNIFIED IDEOGRAPH-5EE8) 0x58 0x6D (CJK UNIFIED IDEOGRAPH-5F46) 0x64 0x75 (CJK UNIFIED IDEOGRAPH-5FF1) 0x53 0xE9 (CJK UNIFIED IDEOGRAPH-601B) 0x67 0x43 (CJK UNIFIED IDEOGRAPH-6033) 0x62 0xDB (CJK UNIFIED IDEOGRAPH-60B5) 0x62 0xCE (CJK UNIFIED IDEOGRAPH-615A) 0x5C 0x84 (CJK UNIFIED IDEOGRAPH-621E) 0x64 0x90 (CJK UNIFIED IDEOGRAPH-62C6) 0x5F 0x64 (CJK UNIFIED IDEOGRAPH-6339) 0x63 0xC5 (CJK UNIFIED IDEOGRAPH-6467) 0x50 0x60 (CJK UNIFIED IDEOGRAPH-64F1) 0x55 0x8C (CJK UNIFIED IDEOGRAPH-6624) 0x5B 0x65 (CJK UNIFIED IDEOGRAPH-666C) 0x51 0x99 (CJK UNIFIED IDEOGRAPH-6772) 0x60 0x79 (CJK UNIFIED IDEOGRAPH-67E2) 0x51 0xCE (CJK UNIFIED IDEOGRAPH-6831) 0x60 0xDA (CJK UNIFIED IDEOGRAPH-6904) 0x54 0xF5 (CJK UNIFIED IDEOGRAPH-6994) 0x59 0xA4 (CJK UNIFIED IDEOGRAPH-69CE) 0x61 0xA8 (CJK UNIFIED IDEOGRAPH-6A05) 0x64 0x94 (CJK UNIFIED IDEOGRAPH-6A50) 0x5F 0x56 (CJK UNIFIED IDEOGRAPH-6ABC) 0x57 0x97 (CJK UNIFIED IDEOGRAPH-6B02) 0x59 0xDF (CJK UNIFIED IDEOGRAPH-6B43)

404

Appendix A: Code Pages

Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 0x59 0xF7 (CJK UNIFIED IDEOGRAPH-6BA4) 0x58 0x64 (CJK UNIFIED IDEOGRAPH-6C74) 0x55 0x8D (CJK UNIFIED IDEOGRAPH-6CE0) 0x5B 0x6B (CJK UNIFIED IDEOGRAPH-6EB2) 0x55 0xAF (CJK UNIFIED IDEOGRAPH-6F09) 0x56 0x4F (CJK UNIFIED IDEOGRAPH-6F13) 0x55 0xA0 (CJK UNIFIED IDEOGRAPH-6F66) 0x63 0x56 (CJK UNIFIED IDEOGRAPH-6FFA) 0x54 0xC0 (CJK UNIFIED IDEOGRAPH-706F) 0x65 0x71 (CJK UNIFIED IDEOGRAPH-70AE) 0x51 0x5D (CJK UNIFIED IDEOGRAPH-71B2) 0x57 0x99 (CJK UNIFIED IDEOGRAPH-7254) 0x67 0x7A (CJK UNIFIED IDEOGRAPH-7334) 0x61 0x57 (CJK UNIFIED IDEOGRAPH-7445) 0x63 0xCF (CJK UNIFIED IDEOGRAPH-7503) 0x51 0x60 (CJK UNIFIED IDEOGRAPH-754A) 0x56 0x6A (CJK UNIFIED IDEOGRAPH-75F3) 0x60 0x4D (CJK UNIFIED IDEOGRAPH-7634) 0x61 0x7E (CJK UNIFIED IDEOGRAPH-7681) 0x66 0xAE (CJK UNIFIED IDEOGRAPH-769E) 0x56 0xAE (CJK UNIFIED IDEOGRAPH-771B) 0x59 0x59 (CJK UNIFIED IDEOGRAPH-7765) 0x51 0x9E (CJK UNIFIED IDEOGRAPH-77BD) 0x5B 0xFC (CJK UNIFIED IDEOGRAPH-77E7) 0x54 0x57 (CJK UNIFIED IDEOGRAPH-7893) 0x5C 0xA8 (CJK UNIFIED IDEOGRAPH-7919) 0x56 0x55 (CJK UNIFIED IDEOGRAPH-79BB) 0x55 0xF8 (CJK UNIFIED IDEOGRAPH-7ABF) 0x53 0x51 (CJK UNIFIED IDEOGRAPH-7B08) 0x59 0xB1 (CJK UNIFIED IDEOGRAPH-7B25) 0x62 0xE1 (CJK UNIFIED IDEOGRAPH-6C05) 0x59 0x52 (CJK UNIFIED IDEOGRAPH-6C98) 0x55 0x48 (CJK UNIFIED IDEOGRAPH-6DBC) 0x54 0xBF (CJK UNIFIED IDEOGRAPH-6ED5) 0x52 0xF5 (CJK UNIFIED IDEOGRAPH-6F0C) 0x5F 0xEE (CJK UNIFIED IDEOGRAPH-6F5C) 0x56 0xFE (CJK UNIFIED IDEOGRAPH-6FDB) 0x57 0x78 (CJK UNIFIED IDEOGRAPH-7030) 0x65 0xE7 (CJK UNIFIED IDEOGRAPH-7095) 0x5E 0x9C (CJK UNIFIED IDEOGRAPH-71A8) 0x5A 0x8E (CJK UNIFIED IDEOGRAPH-71F9) 0x54 0xD4 (CJK UNIFIED IDEOGRAPH-7296) 0x5F 0x58 (CJK UNIFIED IDEOGRAPH-73E2) 0x5B 0x4D (CJK UNIFIED IDEOGRAPH-7463) 0x52 0x93 (CJK UNIFIED IDEOGRAPH-750C) 0x62 0x5D (CJK UNIFIED IDEOGRAPH-75E3) 0x65 0xB8 (CJK UNIFIED IDEOGRAPH-7627) 0x55 0x5A (CJK UNIFIED IDEOGRAPH-7658) 0x5C 0xA5 (CJK UNIFIED IDEOGRAPH-769A) 0x51 0xEB (CJK UNIFIED IDEOGRAPH-76E5) 0x5F 0xCB (CJK UNIFIED IDEOGRAPH-7725) 0x5D 0xA1 (CJK UNIFIED IDEOGRAPH-7768) 0x57 0x41 (CJK UNIFIED IDEOGRAPH-77C7) 0x63 0x8A (CJK UNIFIED IDEOGRAPH-780C) 0x60 0xB8 (CJK UNIFIED IDEOGRAPH-78DA) 0x5B 0x6F (CJK UNIFIED IDEOGRAPH-795F) 0x60 0xCC (CJK UNIFIED IDEOGRAPH-7A83) 0x61 0x85 (CJK UNIFIED IDEOGRAPH-7AC8) 0x61 0x86 (CJK UNIFIED IDEOGRAPH-7B0A) 0x63 0xD2 (CJK UNIFIED IDEOGRAPH-7B92)

Characters Lost in Code Page Conversion

405

Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 0x51 0xD1 (CJK UNIFIED IDEOGRAPH-7B9C) 0x67 0x7C (CJK UNIFIED IDEOGRAPH-7BCC) 0x59 0x5D (CJK UNIFIED IDEOGRAPH-7BE6) 0x63 0x70 (CJK UNIFIED IDEOGRAPH-7C37) 0x5C 0xC6 (CJK UNIFIED IDEOGRAPH-7C65) 0x57 0x7B (CJK UNIFIED IDEOGRAPH-7CDC) 0x60 0x97 (CJK UNIFIED IDEOGRAPH-7CF4) 0x61 0x8B (CJK UNIFIED IDEOGRAPH-7D5B) 0x5B 0xDD (CJK UNIFIED IDEOGRAPH-7DE6) 0x58 0xCB (CJK UNIFIED IDEOGRAPH-7F58) 0x50 0x82 (CJK UNIFIED IDEOGRAPH-7FAF) 0x5D 0xA3 (CJK UNIFIED IDEOGRAPH-7FF3) 0x56 0xED (CJK UNIFIED IDEOGRAPH-8004) 0x61 0xD4 (CJK UNIFIED IDEOGRAPH-8098) 0x57 0xB6 (CJK UNIFIED IDEOGRAPH-80D6) 0x59 0x61 (CJK UNIFIED IDEOGRAPH-8153) 0x5D 0x6C (CJK UNIFIED IDEOGRAPH-81D9) 0x65 0x76 (CJK UNIFIED IDEOGRAPH-8216) 0x5A 0xEB (CJK UNIFIED IDEOGRAPH-8258) 0x55 0x91 (CJK UNIFIED IDEOGRAPH-82D3) 0x58 0xD0 (CJK UNIFIED IDEOGRAPH-82FB) 0x5C 0x76 (CJK UNIFIED IDEOGRAPH-843C) 0x63 0xC0 (CJK UNIFIED IDEOGRAPH-8471) 0x65 0x9C (CJK UNIFIED IDEOGRAPH-84D6) 0x5D 0xA5 (CJK UNIFIED IDEOGRAPH-854B) 0x58 0xF1 (CJK UNIFIED IDEOGRAPH-8561) 0x55 0xC3 (CJK UNIFIED IDEOGRAPH-857E) 0x59 0x7A (CJK UNIFIED IDEOGRAPH-860B) 0x5F 0xF1 (CJK UNIFIED IDEOGRAPH-8695) 0x60 0x85 (CJK UNIFIED IDEOGRAPH-86C6) 0x66 0x7B (CJK UNIFIED IDEOGRAPH-7BCB) 0x5C 0xC5 (CJK UNIFIED IDEOGRAPH-7BDB) 0x62 0xF7 (CJK UNIFIED IDEOGRAPH-7C00) 0x55 0xC2 (CJK UNIFIED IDEOGRAPH-7C5F) 0x5F 0xCD (CJK UNIFIED IDEOGRAPH-7CA2) 0x53 0xA0 (CJK UNIFIED IDEOGRAPH-7CEF) 0x61 0x89 (CJK UNIFIED IDEOGRAPH-7CF6) 0x63 0xA2 (CJK UNIFIED IDEOGRAPH-7D83) 0x60 0x67 (CJK UNIFIED IDEOGRAPH-7E94) 0x5C 0xDD (CJK UNIFIED IDEOGRAPH-7F98) 0x60 0xBD (CJK UNIFIED IDEOGRAPH-7FE6) 0x58 0x44 (CJK UNIFIED IDEOGRAPH-7FFB) 0x5F 0xD0 (CJK UNIFIED IDEOGRAPH-8014) 0x54 0xB3 (CJK UNIFIED IDEOGRAPH-809A) 0x56 0xB6 (CJK UNIFIED IDEOGRAPH-8109) 0x55 0x5C (CJK UNIFIED IDEOGRAPH-8182) 0x5E 0x6B (CJK UNIFIED IDEOGRAPH-8202) 0x63 0xE9 (CJK UNIFIED IDEOGRAPH-8233) 0x55 0xA5 (CJK UNIFIED IDEOGRAPH-826B) 0x56 0xB0 (CJK UNIFIED IDEOGRAPH-82FA) 0x54 0x7A (CJK UNIFIED IDEOGRAPH-83DF) 0x58 0xAF (CJK UNIFIED IDEOGRAPH-8451) 0x51 0x46 (CJK UNIFIED IDEOGRAPH-84B9) 0x61 0xCF (CJK UNIFIED IDEOGRAPH-851F) 0x5E 0x53 (CJK UNIFIED IDEOGRAPH-8558) 0x5E 0xF4 (CJK UNIFIED IDEOGRAPH-8564) 0x5D 0xCF (CJK UNIFIED IDEOGRAPH-8580) 0x5B 0xB7 (CJK UNIFIED IDEOGRAPH-8671) 0x54 0xB4 (CJK UNIFIED IDEOGRAPH-86AA) 0x55 0x92 (CJK UNIFIED IDEOGRAPH-86C9)

406

Appendix A: Code Pages

Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 0x5E 0x6E (CJK UNIFIED IDEOGRAPH-86F9) 0x63 0x4A (CJK UNIFIED IDEOGRAPH-8734) 0x5E 0xB1 (CJK UNIFIED IDEOGRAPH-873F) 0x65 0x50 (CJK UNIFIED IDEOGRAPH-8759) 0x56 0x58 (CJK UNIFIED IDEOGRAPH-87AD) 0x56 0x77 (CJK UNIFIED IDEOGRAPH-87C7) 0x5D 0x6D (CJK UNIFIED IDEOGRAPH-8815) 0x5E 0xCE (CJK UNIFIED IDEOGRAPH-885E) 0x52 0x9E (CJK UNIFIED IDEOGRAPH-89AF) 0x62 0x49 (CJK UNIFIED IDEOGRAPH-8A3C) 0x55 0xC4 (CJK UNIFIED IDEOGRAPH-8A84) 0x56 0x8E (CJK UNIFIED IDEOGRAPH-8B3E) 0x60 0x87 (CJK UNIFIED IDEOGRAPH-8C6C) 0x5F 0xD7 (CJK UNIFIED IDEOGRAPH-8D6D) 0x61 0x5E (CJK UNIFIED IDEOGRAPH-8E36) 0x61 0xB1 (CJK UNIFIED IDEOGRAPH-8E64) 0x63 0x4B (CJK UNIFIED IDEOGRAPH-8E91) 0x59 0x6A (CJK UNIFIED IDEOGRAPH-8F61) 0x58 0x5E (CJK UNIFIED IDEOGRAPH-8F9F) 0x67 0xA9 (CJK UNIFIED IDEOGRAPH-8FC4) 0x53 0xB4 (CJK UNIFIED IDEOGRAPH-8FFA) 0x5D 0xC3 (CJK UNIFIED IDEOGRAPH-9068) 0x66 0xB9 (CJK UNIFIED IDEOGRAPH-9190) 0x65 0x7B (CJK UNIFIED IDEOGRAPH-924B) 0x56 0xF3 (CJK UNIFIED IDEOGRAPH-927E) 0x56 0x90 (CJK UNIFIED IDEOGRAPH-93DD) 0x66 0xE6 (CJK UNIFIED IDEOGRAPH-944A) 0x55 0x61 (CJK UNIFIED IDEOGRAPH-9462) 0x53 0xEE (CJK UNIFIED IDEOGRAPH-95E5) 0x61 0xF2 (CJK UNIFIED IDEOGRAPH-96BC) 0x58 0xD1 (CJK UNIFIED IDEOGRAPH-8709) 0x63 0x81 (CJK UNIFIED IDEOGRAPH-873B) 0x51 0xD8 (CJK UNIFIED IDEOGRAPH-874C) 0x58 0x9D (CJK UNIFIED IDEOGRAPH-8760) 0x5B 0x43 (CJK UNIFIED IDEOGRAPH-87C0) 0x54 0x4B (CJK UNIFIED IDEOGRAPH-87F7) 0x55 0x60 (CJK UNIFIED IDEOGRAPH-8821) 0x60 0x57 (CJK UNIFIED IDEOGRAPH-88C5) 0x5F 0xD4 (CJK UNIFIED IDEOGRAPH-89DC) 0x51 0xA7 (CJK UNIFIED IDEOGRAPH-8A41) 0x5C 0x90 (CJK UNIFIED IDEOGRAPH-8AF3) 0x5D 0x6F (CJK UNIFIED IDEOGRAPH-8B8C) 0x5C 0x80 (CJK UNIFIED IDEOGRAPH-8D0B) 0x52 0xCD (CJK UNIFIED IDEOGRAPH-8DEA) 0x65 0xA6 (CJK UNIFIED IDEOGRAPH-8E55) 0x63 0xB4 (CJK UNIFIED IDEOGRAPH-8E85) 0x55 0xB3 (CJK UNIFIED IDEOGRAPH-8F46) 0x55 0xAA (CJK UNIFIED IDEOGRAPH-8F64) 0x58 0x65 (CJK UNIFIED IDEOGRAPH-8FAE) 0x58 0x7F (CJK UNIFIED IDEOGRAPH-8FF8) 0x5C 0x88 (CJK UNIFIED IDEOGRAPH-904F) 0x50 0x93 (CJK UNIFIED IDEOGRAPH-9163) 0x63 0xAB (CJK UNIFIED IDEOGRAPH-9214) 0x52 0x6B (CJK UNIFIED IDEOGRAPH-9278) 0x59 0xE3 (CJK UNIFIED IDEOGRAPH-9364) 0x54 0xC7 (CJK UNIFIED IDEOGRAPH-9419) 0x59 0xC7 (CJK UNIFIED IDEOGRAPH-9460) 0x57 0x8B (CJK UNIFIED IDEOGRAPH-95A9) 0x5C 0xB2 (CJK UNIFIED IDEOGRAPH-9628) 0x51 0x8A (CJK UNIFIED IDEOGRAPH-96DE)

Characters Lost in Code Page Conversion

407

Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 0x5A 0xF4 (CJK UNIFIED IDEOGRAPH-9704) 0x59 0xE4 (CJK UNIFIED IDEOGRAPH-970E) 0x5C 0xAD (CJK UNIFIED IDEOGRAPH-9749) 0x65 0x7D (CJK UNIFIED IDEOGRAPH-9784) 0x63 0xAC (CJK UNIFIED IDEOGRAPH-9798) 0x53 0xEF (CJK UNIFIED IDEOGRAPH-97C3) 0x5F 0x93 (CJK UNIFIED IDEOGRAPH-9823) 0x59 0x7E (CJK UNIFIED IDEOGRAPH-9870) 0x5D 0x82 (CJK UNIFIED IDEOGRAPH-995C) 0x58 0x6B (CJK UNIFIED IDEOGRAPH-99E2) 0x59 0x6E (CJK UNIFIED IDEOGRAPH-9AC0) 0x63 0xB5 (CJK UNIFIED IDEOGRAPH-9AD1) 0x58 0xF8 (CJK UNIFIED IDEOGRAPH-9AF4) 0x66 0xF8 (CJK UNIFIED IDEOGRAPH-9B1F) 0x55 0x86 (CJK UNIFIED IDEOGRAPH-9B23) 0x56 0xA4 (CJK UNIFIED IDEOGRAPH-9B4D) 0x56 0x5D (CJK UNIFIED IDEOGRAPH-9B51) 0x58 0xDE (CJK UNIFIED IDEOGRAPH-9B92) 0x5A 0x49 (CJK UNIFIED IDEOGRAPH-9C13) 0x5D 0xD1 (CJK UNIFIED IDEOGRAPH-9C2E) 0x5C 0x83 (CJK UNIFIED IDEOGRAPH-9D08) 0x5B 0xAE (CJK UNIFIED IDEOGRAPH-9D89) 0x65 0xCA (CJK UNIFIED IDEOGRAPH-9DF3) 0x63 0xDF (CJK UNIFIED IDEOGRAPH-9E81) 0x5F 0x43 (CJK UNIFIED IDEOGRAPH-9EDD) 0x58 0xF9 (CJK UNIFIED IDEOGRAPH-9EFB) 0x5F 0x5C (CJK UNIFIED IDEOGRAPH-9F66) 0x43 (HALFWIDTH HANGUL LETTER KIYEOK) 0x45 (HALFWIDTH HANGUL LETTER KIYEOK-SIOS) 0x47 (HALFWIDTH HANGUL LETTER NIEUN-CIEUC) 0x51 0xE1 (CJK UNIFIED IDEOGRAPH-970D) 0x63 0x8F (CJK UNIFIED IDEOGRAPH-9746) 0x53 0xE8 (CJK UNIFIED IDEOGRAPH-977C) 0x5C 0x9D (CJK UNIFIED IDEOGRAPH-9785) 0x63 0xDD (CJK UNIFIED IDEOGRAPH-97A6) 0x67 0xC2 (CJK UNIFIED IDEOGRAPH-9821) 0x58 0xDC (CJK UNIFIED IDEOGRAPH-982B) 0x52 0xA4 (CJK UNIFIED IDEOGRAPH-98B6) 0x64 0xBE (CJK UNIFIED IDEOGRAPH-99C4) 0x50 0xF0 (CJK UNIFIED IDEOGRAPH-9ABC) 0x55 0xDF (CJK UNIFIED IDEOGRAPH-9ACF) 0x57 0xDE (CJK UNIFIED IDEOGRAPH-9AE3) 0x56 0x92 (CJK UNIFIED IDEOGRAPH-9B18) 0x59 0x7F (CJK UNIFIED IDEOGRAPH-9B22) 0x5F 0x47 (CJK UNIFIED IDEOGRAPH-9B3B) 0x55 0x51 (CJK UNIFIED IDEOGRAPH-9B4E) 0x57 0xDF (CJK UNIFIED IDEOGRAPH-9B74) 0x61 0x98 (CJK UNIFIED IDEOGRAPH-9BDB) 0x53 0x92 (CJK UNIFIED IDEOGRAPH-9C2D) 0x58 0x8F (CJK UNIFIED IDEOGRAPH-9D07) 0x64 0x6A (CJK UNIFIED IDEOGRAPH-9D44) 0x66 0xC9 (CJK UNIFIED IDEOGRAPH-9DBB) 0x51 0xF3 (CJK UNIFIED IDEOGRAPH-9E1B) 0x63 0xE0 (CJK UNIFIED IDEOGRAPH-9EA4) 0x5C 0x92 (CJK UNIFIED IDEOGRAPH-9EEF) 0x58 0x90 (CJK UNIFIED IDEOGRAPH-9EFC) 0x42 (HALFWIDTH HANGUL FILLER) 0x44 (HALFWIDTH HANGUL LETTER SSANGKIYEOK) 0x46 (HALFWIDTH HANGUL LETTER NIEUN) 0x48 (HALFWIDTH HANGUL LETTER NIEUN-HIEUH)

408

Appendix A: Code Pages

Table A-13. IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean, superset of KS C 5601-1992 0x49 (HALFWIDTH HANGUL LETTER TIKEUT) 0x53 (HALFWIDTH HANGUL LETTER RIEUL) 0x55 (HALFWIDTH HANGUL LETTER RIEUL-MIEUM) 0x57 (HALFWIDTH HANGUL LETTER RIEUL-SIOS) 0x59 (HALFWIDTH HANGUL LETTER RIEUL-PHIEUPH) 0x63 (HALFWIDTH HANGUL LETTER MIEUM) 0x65 (HALFWIDTH HANGUL LETTER SSANGPIEUP) 0x67 (HALFWIDTH HANGUL LETTER SIOS) 0x69 (HALFWIDTH HANGUL LETTER IEUNG) 0x73 (HALFWIDTH HANGUL LETTER SSANGCIEUC) 0x75 (HALFWIDTH HANGUL LETTER KHIEUKH) 0x77 (HALFWIDTH HANGUL LETTER PHIEUPH) 0x8A (HALFWIDTH HANGUL LETTER A) 0x8C (HALFWIDTH HANGUL LETTER YA) 0x8E (HALFWIDTH HANGUL LETTER EO) 0x9A (HALFWIDTH HANGUL LETTER YEO) 0x9C (HALFWIDTH HANGUL LETTER O) 0x9E (HALFWIDTH HANGUL LETTER WAE) 0xAA (HALFWIDTH HANGUL LETTER YO) 0xAC (HALFWIDTH HANGUL LETTER WEO) 0xAE (HALFWIDTH HANGUL LETTER WI) 0xBA (HALFWIDTH HANGUL LETTER EU) 0xBC (HALFWIDTH HANGUL LETTER I) 0x52 (HALFWIDTH HANGUL LETTER SSANGTIKEUT) 0x54 (HALFWIDTH HANGUL LETTER RIEUL-KIYEOK) 0x56 (HALFWIDTH HANGUL LETTER RIEUL-PIEUP) 0x58 (HALFWIDTH HANGUL LETTER RIEUL-THIEUTH) 0x62 (HALFWIDTH HANGUL LETTER RIEUL-HIEUH) 0x64 (HALFWIDTH HANGUL LETTER PIEUP) 0x66 (HALFWIDTH HANGUL LETTER PIEUP-SIOS) 0x68 (HALFWIDTH HANGUL LETTER SSANGSIOS) 0x72 (HALFWIDTH HANGUL LETTER CIEUC) 0x74 (HALFWIDTH HANGUL LETTER CHIEUCH) 0x76 (HALFWIDTH HANGUL LETTER THIEUTH) 0x78 (HALFWIDTH HANGUL LETTER HIEUH) 0x8B (HALFWIDTH HANGUL LETTER AE) 0x8D (HALFWIDTH HANGUL LETTER YAE) 0x8F (HALFWIDTH HANGUL LETTER E) 0x9B (HALFWIDTH HANGUL LETTER YE) 0x9D (HALFWIDTH HANGUL LETTER WA) 0x9F (HALFWIDTH HANGUL LETTER OE) 0xAB (HALFWIDTH HANGUL LETTER U) 0xAD (HALFWIDTH HANGUL LETTER WE) 0xAF (HALFWIDTH HANGUL LETTER YU) 0xBB (HALFWIDTH HANGUL LETTER YI) 0x42 0x6A (FULLWIDTH BROKEN BAR)

Characters Lost in Code Page Conversion

409

Converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab)

Table A-14 lists all characters by character ID and description that do not convert from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab):
Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) 0x01 (START OF HEADING) 0x03 (END OF TEXT) 0x2D (ENQUIRY) 0x2F (BELL) 0x05 (CHARACTER TABULATION) 0x0B (LINE TABULATION) 0x0D (CARRIAGE RETURN (CR)) 0x3F (SHIFT IN) 0x11 (DEVICE CONTROL ONE) 0x13 (DEVICE CONTROL THREE) 0x3D (NEGATIVE ACKNOWLEDGE) 0x26 (END OF TRANSMISSION BLOCK) 0x19 (END OF MEDIUM) 0x27 (ESCAPE) 0x1D (INFORMATION SEPARATOR THREE) 0x1F (INFORMATION SEPARATOR ONE) 0x5A (EXCLAMATION MARK) 0x7B (NUMBER SIGN) 0x6C (PERCENT SIGN) 0x7D (APOSTROPHE) 0x5D (RIGHT PARENTHESIS) 0x4E (PLUS SIGN) 0x60 (HYPHEN-MINUS) 0x61 (SOLIDUS) 0xF1 (DIGIT ONE) 0xF3 (DIGIT THREE) 0x02 (START OF TEXT) 0x37 (END OF TRANSMISSION) 0x2E (ACKNOWLEDGE) 0x16 (BACKSPACE) 0x25 (LINE FEED (LF)) 0x0C (FORM FEED (FF)) 0x3F (SHIFT OUT) 0x10 (DATA LINK ESCAPE) 0x12 (DEVICE CONTROL TWO) 0x3C (DEVICE CONTROL FOUR) 0x32 (SYNCHRONOUS IDLE) 0x18 (CANCEL) 0x3F (SUBSTITUTE) 0x1C (INFORMATION SEPARATOR FOUR) 0x1E (INFORMATION SEPARATOR TWO) 0x40 (SPACE) 0x7F (QUOTATION MARK) 0x5B (DOLLAR SIGN) 0x50 (AMPERSAND) 0x4D (LEFT PARENTHESIS) 0x5C (ASTERISK) 0x6B (COMMA) 0x4B (FULL STOP) 0xF0 (DIGIT ZERO) 0xF2 (DIGIT TWO) 0xF4 (DIGIT FOUR)

410

Appendix A: Code Pages

Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) 0xF5 (DIGIT FIVE) 0xF7 (DIGIT SEVEN) 0xF9 (DIGIT NINE) 0x5E (SEMICOLON) 0x7E (EQUALS SIGN) 0x6F (QUESTION MARK) 0xC1 (LATIN CAPITAL LETTER A) 0xC3 (LATIN CAPITAL LETTER C) 0xC5 (LATIN CAPITAL LETTER E) 0xC7 (LATIN CAPITAL LETTER G) 0xC9 (LATIN CAPITAL LETTER I) 0xD2 (LATIN CAPITAL LETTER K) 0xD4 (LATIN CAPITAL LETTER M) 0xD6 (LATIN CAPITAL LETTER O) 0xD8 (LATIN CAPITAL LETTER Q) 0xE2 (LATIN CAPITAL LETTER S) 0xE4 (LATIN CAPITAL LETTER U) 0xE6 (LATIN CAPITAL LETTER W) 0xE8 (LATIN CAPITAL LETTER Y) 0x70 (LEFT SQUARE BRACKET) 0x80 (RIGHT SQUARE BRACKET) 0x6D (LOW LINE) 0x81 (LATIN SMALL LETTER A) 0x83 (LATIN SMALL LETTER C) 0x85 (LATIN SMALL LETTER E) 0x87 (LATIN SMALL LETTER G) 0x89 (LATIN SMALL LETTER I) 0x92 (LATIN SMALL LETTER K) 0x94 (LATIN SMALL LETTER M) 0x96 (LATIN SMALL LETTER O) 0xF6 (DIGIT SIX) 0xF8 (DIGIT EIGHT) 0x7A (COLON) 0x4C (LESS-THAN SIGN) 0x6E (GREATER-THAN SIGN) 0x7C (COMMERCIAL AT) 0xC2 (LATIN CAPITAL LETTER B) 0xC4 (LATIN CAPITAL LETTER D) 0xC6 (LATIN CAPITAL LETTER F) 0xC8 (LATIN CAPITAL LETTER H) 0xD1 (LATIN CAPITAL LETTER J) 0xD3 (LATIN CAPITAL LETTER L) 0xD5 (LATIN CAPITAL LETTER N) 0xD7 (LATIN CAPITAL LETTER P) 0xD9 (LATIN CAPITAL LETTER R) 0xE3 (LATIN CAPITAL LETTER T) 0xE5 (LATIN CAPITAL LETTER V) 0xE7 (LATIN CAPITAL LETTER X) 0xE9 (LATIN CAPITAL LETTER Z) 0xB2 (REVERSE SOLIDUS) 0xB0 (CIRCUMFLEX ACCENT) 0x79 (GRAVE ACCENT) 0x82 (LATIN SMALL LETTER B) 0x84 (LATIN SMALL LETTER D) 0x86 (LATIN SMALL LETTER F) 0x88 (LATIN SMALL LETTER H) 0x91 (LATIN SMALL LETTER J) 0x93 (LATIN SMALL LETTER L) 0x95 (LATIN SMALL LETTER N) 0x97 (LATIN SMALL LETTER P)

Characters Lost in Code Page Conversion

411

Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) 0x98 (LATIN SMALL LETTER Q) 0xA2 (LATIN SMALL LETTER S) 0xA4 (LATIN SMALL LETTER U) 0xA6 (LATIN SMALL LETTER W) 0xA8 (LATIN SMALL LETTER Y) 0xC0 (LEFT CURLY BRACKET) 0xD0 (RIGHT CURLY BRACKET) 0x07 (DELETE) 0x21 (<control-0081>) 0x23 (NO BREAK HERE) 0x15 (NEXT LINE (NEL)) 0x17 (END OF SELECTED AREA) 0x29 (CHARACTER TABULATION WITH JUSTIFICATION) 0x2B (PARTIAL LINE FORWARD) 0x09 (REVERSE LINE FEED) 0x1B (SINGLE SHIFT THREE) 0x31 (PRIVATE USE ONE) 0x33 (SET TRANSMIT STATE) 0x35 (MESSAGE WAITING) 0x08 (END OF GUARDED AREA) 0x39 (<control-0099>) 0x3B (CONTROL SEQUENCE INTRODUCER) 0x14 (OPERATING SYSTEM COMMAND) 0xFF (APPLICATION PROGRAM COMMAND) 0x4A (CENT SIGN) 0x3F (YEN SIGN) 0x3F (COPYRIGHT SIGN) 0x5F (NOT SIGN) 0x3F (MACRON) 0x99 (LATIN SMALL LETTER R) 0xA3 (LATIN SMALL LETTER T) 0xA5 (LATIN SMALL LETTER V) 0xA7 (LATIN SMALL LETTER X) 0xA9 (LATIN SMALL LETTER Z) 0x4F (VERTICAL LINE) 0xA1 (TILDE) 0x20 (<control-0080>) 0x22 (BREAK PERMITTED HERE) 0x24 (<control-0084>) 0x06 (START OF SELECTED AREA) 0x28 (CHARACTER TABULATION SET) 0x2A (LINE TABULATION SET) 0x2C (PARTIAL LINE BACKWARD) 0x0A (SINGLE SHIFT TWO) 0x30 (DEVICE CONTROL STRING) 0x1A (PRIVATE USE TWO) 0x34 (CANCEL CHARACTER) 0x36 (START OF GUARDED AREA) 0x38 (START OF STRING) 0x3A (SINGLE CHARACTER INTRODUCER) 0x04 (STRING TERMINATOR) 0x3E (PRIVACY MESSAGE) 0x3F (NO-BREAK SPACE) 0x3F (POUND SIGN) 0x6A (BROKEN BAR) 0x3F (LEFT-POINTING DOUBLE ANGLE QUOTATION MARK) 0x3F (REGISTERED SIGN) 0x3F (MICRO SIGN)

412

Appendix A: Code Pages

Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) 0x3F (RIGHT-POINTING DOUBLE ANGLE QUOTATION MARK) 0x3F (LATIN CAPITAL LETTER A WITH ACUTE) 0x3F (LATIN CAPITAL LETTER A WITH TILDE) 0x3F (LATIN CAPITAL LETTER A WITH RING ABOVE) 0x3F (LATIN CAPITAL LETTER E WITH GRAVE) 0x3F (LATIN CAPITAL LETTER E WITH CIRCUMFLEX) 0x3F (LATIN CAPITAL LETTER I WITH GRAVE) 0x3F (LATIN CAPITAL LETTER I WITH CIRCUMFLEX) 0x3F (LATIN CAPITAL LETTER N WITH TILDE) 0x3F (LATIN CAPITAL LETTER O WITH ACUTE) 0x3F (LATIN CAPITAL LETTER O WITH TILDE) 0x3F (LATIN CAPITAL LETTER U WITH GRAVE) 0x3F (LATIN CAPITAL LETTER U WITH CIRCUMFLEX) 0x3F (LATIN CAPITAL LETTER Y WITH ACUTE) 0x3F (LATIN SMALL LETTER A WITH ACUTE) 0x3F (LATIN SMALL LETTER A WITH TILDE) 0x3F (LATIN SMALL LETTER A WITH RING ABOVE) 0x3F (LATIN SMALL LETTER E WITH GRAVE) 0x3F (LATIN SMALL LETTER E WITH CIRCUMFLEX) 0x3F (LATIN SMALL LETTER I WITH GRAVE) 0x3F (LATIN SMALL LETTER I WITH CIRCUMFLEX) 0x3F (LATIN SMALL LETTER N WITH TILDE) 0x3F (LATIN SMALL LETTER O WITH ACUTE) 0x3F (LATIN SMALL LETTER O WITH TILDE) 0x3F (LATIN SMALL LETTER U WITH GRAVE) 0x3F (LATIN SMALL LETTER U WITH CIRCUMFLEX) 0x3F (LATIN SMALL LETTER Y WITH ACUTE) 0x41 0x60 (LATIN LETTER ALVEOLAR CLICK) 0x49 0x54 (SMALL TILDE) 0x41 0x49 (EM DASH) 0x3F (LATIN CAPITAL LETTER A WITH GRAVE) 0x3F (LATIN CAPITAL LETTER A WITH CIRCUMFLEX) 0x3F (LATIN CAPITAL LETTER A WITH DIAERESIS) 0x3F (LATIN CAPITAL LETTER C WITH CEDILLA) 0x3F (LATIN CAPITAL LETTER E WITH ACUTE) 0x3F (LATIN CAPITAL LETTER E WITH DIAERESIS) 0x3F (LATIN CAPITAL LETTER I WITH ACUTE) 0x3F (LATIN CAPITAL LETTER I WITH DIAERESIS) 0x3F (LATIN CAPITAL LETTER O WITH GRAVE) 0x3F (LATIN CAPITAL LETTER O WITH CIRCUMFLEX) 0x3F (LATIN CAPITAL LETTER O WITH DIAERESIS) 0x3F (LATIN CAPITAL LETTER U WITH ACUTE) 0x3F (LATIN CAPITAL LETTER U WITH DIAERESIS) 0x3F (LATIN SMALL LETTER A WITH GRAVE) 0x3F (LATIN SMALL LETTER A WITH CIRCUMFLEX) 0x3F (LATIN SMALL LETTER A WITH DIAERESIS) 0x3F (LATIN SMALL LETTER C WITH CEDILLA) 0x3F (LATIN SMALL LETTER E WITH ACUTE) 0x3F (LATIN SMALL LETTER E WITH DIAERESIS) 0x3F (LATIN SMALL LETTER I WITH ACUTE) 0x3F (LATIN SMALL LETTER I WITH DIAERESIS) 0x3F (LATIN SMALL LETTER O WITH GRAVE) 0x3F (LATIN SMALL LETTER O WITH CIRCUMFLEX) 0x3F (LATIN SMALL LETTER O WITH DIAERESIS) 0x3F (LATIN SMALL LETTER U WITH ACUTE) 0x3F (LATIN SMALL LETTER U WITH DIAERESIS) 0x3F (LATIN SMALL LETTER Y WITH DIAERESIS) 0x49 0x94 (MODIFIER LETTER DOUBLE PRIME) 0x41 0x48 (HYPHEN) 0xA0 (OVERLINE)

Characters Lost in Code Page Conversion

413

Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) 0x41 0x69 (KELVIN SIGN) 0x41 0x62 (GREATER-THAN OVER EQUAL TO) 0x42 0xA1 (WAVE DASH) 0x58 0xA4 (CJK UNIFIED IDEOGRAPH-4E30) 0x5F 0x9B (CJK UNIFIED IDEOGRAPH-4EDE) 0x53 0xBC (CJK UNIFIED IDEOGRAPH-4F5E) 0x5A 0xA2 (CJK UNIFIED IDEOGRAPH-5070) 0x55 0xD5 (CJK UNIFIED IDEOGRAPH-50C2) 0x63 0xF3 (CJK UNIFIED IDEOGRAPH-51B2) 0x62 0xD5 (CJK UNIFIED IDEOGRAPH-5231) 0x5E 0x78 (CJK UNIFIED IDEOGRAPH-5401) 0x51 0x4E (CJK UNIFIED IDEOGRAPH-54FD) 0x53 0xA9 (CJK UNIFIED IDEOGRAPH-5583) 0x5A 0x53 (CJK UNIFIED IDEOGRAPH-566C) 0x67 0x69 (CJK UNIFIED IDEOGRAPH-56C2) 0x66 0xE9 (CJK UNIFIED IDEOGRAPH-571C) 0x54 0xE4 (CJK UNIFIED IDEOGRAPH-57D3) 0x59 0x48 (CJK UNIFIED IDEOGRAPH-59A3) 0x5A 0x56 (CJK UNIFIED IDEOGRAPH-5A7F) 0x5D 0xCA (CJK UNIFIED IDEOGRAPH-5ABC) 0x52 0x7E (CJK UNIFIED IDEOGRAPH-5ABE) 0x5D 0x88 (CJK UNIFIED IDEOGRAPH-5B30) 0x5A 0x88 (CJK UNIFIED IDEOGRAPH-5C20) 0x56 0x6D (CJK UNIFIED IDEOGRAPH-5CA6) 0x5C 0x8A (CJK UNIFIED IDEOGRAPH-5D52) 0x60 0xAC (CJK UNIFIED IDEOGRAPH-5DD3) 0x52 0xF0 (CJK UNIFIED IDEOGRAPH-5DF9) 0x5E 0xC2 (CJK UNIFIED IDEOGRAPH-5E43) 0x65 0x69 (CJK UNIFIED IDEOGRAPH-5E96) 0x55 0xFD (CJK UNIFIED IDEOGRAPH-5EE9) 0x41 0x61 (LESS-THAN OVER EQUAL TO) 0x49 0x6F (FISHEYE) 0x41 0x43 (KATAKANA MIDDLE DOT) 0x58 0xB5 (CJK UNIFIED IDEOGRAPH-4EC6) 0x52 0x73 (CJK UNIFIED IDEOGRAPH-4F5D) 0x56 0xC3 (CJK UNIFIED IDEOGRAPH-4FDB) 0x52 0x75 (CJK UNIFIED IDEOGRAPH-50B4) 0x54 0x42 (CJK UNIFIED IDEOGRAPH-515A) 0x55 0xFC (CJK UNIFIED IDEOGRAPH-51DB) 0x5B 0x54 (CJK UNIFIED IDEOGRAPH-53DF) 0x54 0x97 (CJK UNIFIED IDEOGRAPH-5484) 0x5B 0xCA (CJK UNIFIED IDEOGRAPH-557B) 0x61 0x6C (CJK UNIFIED IDEOGRAPH-566A) 0x60 0xA7 (CJK UNIFIED IDEOGRAPH-56C0) 0x5E 0xDB (CJK UNIFIED IDEOGRAPH-56FF) 0x54 0x9F (CJK UNIFIED IDEOGRAPH-578C) 0x5D 0x7A (CJK UNIFIED IDEOGRAPH-5869) 0x59 0x94 (CJK UNIFIED IDEOGRAPH-59D2) 0x67 0x41 (CJK UNIFIED IDEOGRAPH-5A93) 0x56 0x72 (CJK UNIFIED IDEOGRAPH-5ABD) 0x52 0x7F (CJK UNIFIED IDEOGRAPH-5AD7) 0x53 0xC1 (CJK UNIFIED IDEOGRAPH-5B65) 0x53 0x4D (CJK UNIFIED IDEOGRAPH-5C8C) 0x63 0x93 (CJK UNIFIED IDEOGRAPH-5CED) 0x5F 0xFA (CJK UNIFIED IDEOGRAPH-5D82) 0x64 0x57 (CJK UNIFIED IDEOGRAPH-5DF5) 0x5E 0xDE (CJK UNIFIED IDEOGRAPH-5E37) 0x54 0xDC (CJK UNIFIED IDEOGRAPH-5E71) 0x65 0xF4 (CJK UNIFIED IDEOGRAPH-5EE8) 0x58 0x6D (CJK UNIFIED IDEOGRAPH-5F46)

414

Appendix A: Code Pages

Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) 0x64 0x59 (CJK UNIFIED IDEOGRAPH-5FB4) 0x67 0xA2 (CJK UNIFIED IDEOGRAPH-5FFB) 0x63 0xBC (CJK UNIFIED IDEOGRAPH-6031) 0x5D 0x42 (CJK UNIFIED IDEOGRAPH-605A) 0x5A 0x89 (CJK UNIFIED IDEOGRAPH-6103) 0x66 0xED (CJK UNIFIED IDEOGRAPH-61FD) 0x51 0x54 (CJK UNIFIED IDEOGRAPH-6243) 0x5A 0xA7 (CJK UNIFIED IDEOGRAPH-6308) 0x52 0xAC (CJK UNIFIED IDEOGRAPH-63AC) 0x59 0x73 (CJK UNIFIED IDEOGRAPH-64EF) 0x5C 0xE5 (CJK UNIFIED IDEOGRAPH-6554) 0x61 0x54 (CJK UNIFIED IDEOGRAPH-6662) 0x53 0xAE (CJK UNIFIED IDEOGRAPH-66E9) 0x5F 0xDE (CJK UNIFIED IDEOGRAPH-67DE) 0x5F 0x88 (CJK UNIFIED IDEOGRAPH-682E) 0x60 0xEF (CJK UNIFIED IDEOGRAPH-6883) 0x59 0xA3 (CJK UNIFIED IDEOGRAPH-6942) 0x59 0xC4 (CJK UNIFIED IDEOGRAPH-69CA) 0x51 0xCF (CJK UNIFIED IDEOGRAPH-69D3) 0x64 0x43 (CJK UNIFIED IDEOGRAPH-6A47) 0x51 0x5A (CJK UNIFIED IDEOGRAPH-6AA0) 0x55 0x6A (CJK UNIFIED IDEOGRAPH-6ADF) 0x5C 0xA3 (CJK UNIFIED IDEOGRAPH-6B38) 0x59 0xF7 (CJK UNIFIED IDEOGRAPH-6BA4) 0x58 0x64 (CJK UNIFIED IDEOGRAPH-6C74) 0x55 0x8D (CJK UNIFIED IDEOGRAPH-6CE0) 0x5B 0x6B (CJK UNIFIED IDEOGRAPH-6EB2) 0x55 0xAF (CJK UNIFIED IDEOGRAPH-6F09) 0x56 0x4F (CJK UNIFIED IDEOGRAPH-6F13) 0x55 0xA0 (CJK UNIFIED IDEOGRAPH-6F66) 0x64 0x75 (CJK UNIFIED IDEOGRAPH-5FF1) 0x53 0xE9 (CJK UNIFIED IDEOGRAPH-601B) 0x67 0x43 (CJK UNIFIED IDEOGRAPH-6033) 0x62 0xDB (CJK UNIFIED IDEOGRAPH-60B5) 0x62 0xCE (CJK UNIFIED IDEOGRAPH-615A) 0x5C 0x84 (CJK UNIFIED IDEOGRAPH-621E) 0x64 0x90 (CJK UNIFIED IDEOGRAPH-62C6) 0x5F 0x64 (CJK UNIFIED IDEOGRAPH-6339) 0x63 0xC5 (CJK UNIFIED IDEOGRAPH-6467) 0x50 0x60 (CJK UNIFIED IDEOGRAPH-64F1) 0x55 0x8C (CJK UNIFIED IDEOGRAPH-6624) 0x5B 0x65 (CJK UNIFIED IDEOGRAPH-666C) 0x51 0x99 (CJK UNIFIED IDEOGRAPH-6772) 0x60 0x79 (CJK UNIFIED IDEOGRAPH-67E2) 0x51 0xCE (CJK UNIFIED IDEOGRAPH-6831) 0x60 0xDA (CJK UNIFIED IDEOGRAPH-6904) 0x54 0xF5 (CJK UNIFIED IDEOGRAPH-6994) 0x59 0xA4 (CJK UNIFIED IDEOGRAPH-69CE) 0x61 0xA8 (CJK UNIFIED IDEOGRAPH-6A05) 0x64 0x94 (CJK UNIFIED IDEOGRAPH-6A50) 0x5F 0x56 (CJK UNIFIED IDEOGRAPH-6ABC) 0x57 0x97 (CJK UNIFIED IDEOGRAPH-6B02) 0x59 0xDF (CJK UNIFIED IDEOGRAPH-6B43) 0x62 0xE1 (CJK UNIFIED IDEOGRAPH-6C05) 0x59 0x52 (CJK UNIFIED IDEOGRAPH-6C98) 0x55 0x48 (CJK UNIFIED IDEOGRAPH-6DBC) 0x54 0xBF (CJK UNIFIED IDEOGRAPH-6ED5) 0x52 0xF5 (CJK UNIFIED IDEOGRAPH-6F0C) 0x5F 0xEE (CJK UNIFIED IDEOGRAPH-6F5C) 0x56 0xFE (CJK UNIFIED IDEOGRAPH-6FDB)

Characters Lost in Code Page Conversion

415

Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) 0x63 0x56 (CJK UNIFIED IDEOGRAPH-6FFA) 0x54 0xC0 (CJK UNIFIED IDEOGRAPH-706F) 0x65 0x71 (CJK UNIFIED IDEOGRAPH-70AE) 0x51 0x5D (CJK UNIFIED IDEOGRAPH-71B2) 0x57 0x99 (CJK UNIFIED IDEOGRAPH-7254) 0x67 0x7A (CJK UNIFIED IDEOGRAPH-7334) 0x61 0x57 (CJK UNIFIED IDEOGRAPH-7445) 0x63 0xCF (CJK UNIFIED IDEOGRAPH-7503) 0x51 0x60 (CJK UNIFIED IDEOGRAPH-754A) 0x56 0x6A (CJK UNIFIED IDEOGRAPH-75F3) 0x60 0x4D (CJK UNIFIED IDEOGRAPH-7634) 0x61 0x7E (CJK UNIFIED IDEOGRAPH-7681) 0x66 0xAE (CJK UNIFIED IDEOGRAPH-769E) 0x56 0xAE (CJK UNIFIED IDEOGRAPH-771B) 0x59 0x59 (CJK UNIFIED IDEOGRAPH-7765) 0x51 0x9E (CJK UNIFIED IDEOGRAPH-77BD) 0x5B 0xFC (CJK UNIFIED IDEOGRAPH-77E7) 0x54 0x57 (CJK UNIFIED IDEOGRAPH-7893) 0x5C 0xA8 (CJK UNIFIED IDEOGRAPH-7919) 0x56 0x55 (CJK UNIFIED IDEOGRAPH-79BB) 0x55 0xF8 (CJK UNIFIED IDEOGRAPH-7ABF) 0x53 0x51 (CJK UNIFIED IDEOGRAPH-7B08) 0x59 0xB1 (CJK UNIFIED IDEOGRAPH-7B25) 0x51 0xD1 (CJK UNIFIED IDEOGRAPH-7B9C) 0x67 0x7C (CJK UNIFIED IDEOGRAPH-7BCC) 0x59 0x5D (CJK UNIFIED IDEOGRAPH-7BE6) 0x63 0x70 (CJK UNIFIED IDEOGRAPH-7C37) 0x5C 0xC6 (CJK UNIFIED IDEOGRAPH-7C65) 0x57 0x7B (CJK UNIFIED IDEOGRAPH-7CDC) 0x60 0x97 (CJK UNIFIED IDEOGRAPH-7CF4) 0x57 0x78 (CJK UNIFIED IDEOGRAPH-7030) 0x65 0xE7 (CJK UNIFIED IDEOGRAPH-7095) 0x5E 0x9C (CJK UNIFIED IDEOGRAPH-71A8) 0x5A 0x8E (CJK UNIFIED IDEOGRAPH-71F9) 0x54 0xD4 (CJK UNIFIED IDEOGRAPH-7296) 0x5F 0x58 (CJK UNIFIED IDEOGRAPH-73E2) 0x5B 0x4D (CJK UNIFIED IDEOGRAPH-7463) 0x52 0x93 (CJK UNIFIED IDEOGRAPH-750C) 0x62 0x5D (CJK UNIFIED IDEOGRAPH-75E3) 0x65 0xB8 (CJK UNIFIED IDEOGRAPH-7627) 0x55 0x5A (CJK UNIFIED IDEOGRAPH-7658) 0x5C 0xA5 (CJK UNIFIED IDEOGRAPH-769A) 0x51 0xEB (CJK UNIFIED IDEOGRAPH-76E5) 0x5F 0xCB (CJK UNIFIED IDEOGRAPH-7725) 0x5D 0xA1 (CJK UNIFIED IDEOGRAPH-7768) 0x57 0x41 (CJK UNIFIED IDEOGRAPH-77C7) 0x63 0x8A (CJK UNIFIED IDEOGRAPH-780C) 0x60 0xB8 (CJK UNIFIED IDEOGRAPH-78DA) 0x5B 0x6F (CJK UNIFIED IDEOGRAPH-795F) 0x60 0xCC (CJK UNIFIED IDEOGRAPH-7A83) 0x61 0x85 (CJK UNIFIED IDEOGRAPH-7AC8) 0x61 0x86 (CJK UNIFIED IDEOGRAPH-7B0A) 0x63 0xD2 (CJK UNIFIED IDEOGRAPH-7B92) 0x66 0x7B (CJK UNIFIED IDEOGRAPH-7BCB) 0x5C 0xC5 (CJK UNIFIED IDEOGRAPH-7BDB) 0x62 0xF7 (CJK UNIFIED IDEOGRAPH-7C00) 0x55 0xC2 (CJK UNIFIED IDEOGRAPH-7C5F) 0x5F 0xCD (CJK UNIFIED IDEOGRAPH-7CA2) 0x53 0xA0 (CJK UNIFIED IDEOGRAPH-7CEF) 0x61 0x89 (CJK UNIFIED IDEOGRAPH-7CF6)

416

Appendix A: Code Pages

Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) 0x61 0x8B (CJK UNIFIED IDEOGRAPH-7D5B) 0x5B 0xDD (CJK UNIFIED IDEOGRAPH-7DE6) 0x58 0xCB (CJK UNIFIED IDEOGRAPH-7F58) 0x50 0x82 (CJK UNIFIED IDEOGRAPH-7FAF) 0x5D 0xA3 (CJK UNIFIED IDEOGRAPH-7FF3) 0x56 0xED (CJK UNIFIED IDEOGRAPH-8004) 0x61 0xD4 (CJK UNIFIED IDEOGRAPH-8098) 0x57 0xB6 (CJK UNIFIED IDEOGRAPH-80D6) 0x59 0x61 (CJK UNIFIED IDEOGRAPH-8153) 0x5D 0x6C (CJK UNIFIED IDEOGRAPH-81D9) 0x65 0x76 (CJK UNIFIED IDEOGRAPH-8216) 0x5A 0xEB (CJK UNIFIED IDEOGRAPH-8258) 0x55 0x91 (CJK UNIFIED IDEOGRAPH-82D3) 0x58 0xD0 (CJK UNIFIED IDEOGRAPH-82FB) 0x5C 0x76 (CJK UNIFIED IDEOGRAPH-843C) 0x63 0xC0 (CJK UNIFIED IDEOGRAPH-8471) 0x65 0x9C (CJK UNIFIED IDEOGRAPH-84D6) 0x5D 0xA5 (CJK UNIFIED IDEOGRAPH-854B) 0x58 0xF1 (CJK UNIFIED IDEOGRAPH-8561) 0x55 0xC3 (CJK UNIFIED IDEOGRAPH-857E) 0x59 0x7A (CJK UNIFIED IDEOGRAPH-860B) 0x5F 0xF1 (CJK UNIFIED IDEOGRAPH-8695) 0x60 0x85 (CJK UNIFIED IDEOGRAPH-86C6) 0x5E 0x6E (CJK UNIFIED IDEOGRAPH-86F9) 0x63 0x4A (CJK UNIFIED IDEOGRAPH-8734) 0x5E 0xB1 (CJK UNIFIED IDEOGRAPH-873F) 0x65 0x50 (CJK UNIFIED IDEOGRAPH-8759) 0x56 0x58 (CJK UNIFIED IDEOGRAPH-87AD) 0x56 0x77 (CJK UNIFIED IDEOGRAPH-87C7) 0x5D 0x6D (CJK UNIFIED IDEOGRAPH-8815) 0x63 0xA2 (CJK UNIFIED IDEOGRAPH-7D83) 0x60 0x67 (CJK UNIFIED IDEOGRAPH-7E94) 0x5C 0xDD (CJK UNIFIED IDEOGRAPH-7F98) 0x60 0xBD (CJK UNIFIED IDEOGRAPH-7FE6) 0x58 0x44 (CJK UNIFIED IDEOGRAPH-7FFB) 0x5F 0xD0 (CJK UNIFIED IDEOGRAPH-8014) 0x54 0xB3 (CJK UNIFIED IDEOGRAPH-809A) 0x56 0xB6 (CJK UNIFIED IDEOGRAPH-8109) 0x55 0x5C (CJK UNIFIED IDEOGRAPH-8182) 0x5E 0x6B (CJK UNIFIED IDEOGRAPH-8202) 0x63 0xE9 (CJK UNIFIED IDEOGRAPH-8233) 0x55 0xA5 (CJK UNIFIED IDEOGRAPH-826B) 0x56 0xB0 (CJK UNIFIED IDEOGRAPH-82FA) 0x54 0x7A (CJK UNIFIED IDEOGRAPH-83DF) 0x58 0xAF (CJK UNIFIED IDEOGRAPH-8451) 0x51 0x46 (CJK UNIFIED IDEOGRAPH-84B9) 0x61 0xCF (CJK UNIFIED IDEOGRAPH-851F) 0x5E 0x53 (CJK UNIFIED IDEOGRAPH-8558) 0x5E 0xF4 (CJK UNIFIED IDEOGRAPH-8564) 0x5D 0xCF (CJK UNIFIED IDEOGRAPH-8580) 0x5B 0xB7 (CJK UNIFIED IDEOGRAPH-8671) 0x54 0xB4 (CJK UNIFIED IDEOGRAPH-86AA) 0x55 0x92 (CJK UNIFIED IDEOGRAPH-86C9) 0x58 0xD1 (CJK UNIFIED IDEOGRAPH-8709) 0x63 0x81 (CJK UNIFIED IDEOGRAPH-873B) 0x51 0xD8 (CJK UNIFIED IDEOGRAPH-874C) 0x58 0x9D (CJK UNIFIED IDEOGRAPH-8760) 0x5B 0x43 (CJK UNIFIED IDEOGRAPH-87C0) 0x54 0x4B (CJK UNIFIED IDEOGRAPH-87F7) 0x55 0x60 (CJK UNIFIED IDEOGRAPH-8821)

Characters Lost in Code Page Conversion

417

Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) 0x5E 0xCE (CJK UNIFIED IDEOGRAPH-885E) 0x52 0x9E (CJK UNIFIED IDEOGRAPH-89AF) 0x62 0x49 (CJK UNIFIED IDEOGRAPH-8A3C) 0x55 0xC4 (CJK UNIFIED IDEOGRAPH-8A84) 0x56 0x8E (CJK UNIFIED IDEOGRAPH-8B3E) 0x60 0x87 (CJK UNIFIED IDEOGRAPH-8C6C) 0x5F 0xD7 (CJK UNIFIED IDEOGRAPH-8D6D) 0x61 0x5E (CJK UNIFIED IDEOGRAPH-8E36) 0x61 0xB1 (CJK UNIFIED IDEOGRAPH-8E64) 0x63 0x4B (CJK UNIFIED IDEOGRAPH-8E91) 0x59 0x6A (CJK UNIFIED IDEOGRAPH-8F61) 0x58 0x5E (CJK UNIFIED IDEOGRAPH-8F9F) 0x67 0xA9 (CJK UNIFIED IDEOGRAPH-8FC4) 0x53 0xB4 (CJK UNIFIED IDEOGRAPH-8FFA) 0x5D 0xC3 (CJK UNIFIED IDEOGRAPH-9068) 0x66 0xB9 (CJK UNIFIED IDEOGRAPH-9190) 0x65 0x7B (CJK UNIFIED IDEOGRAPH-924B) 0x56 0xF3 (CJK UNIFIED IDEOGRAPH-927E) 0x56 0x90 (CJK UNIFIED IDEOGRAPH-93DD) 0x66 0xE6 (CJK UNIFIED IDEOGRAPH-944A) 0x55 0x61 (CJK UNIFIED IDEOGRAPH-9462) 0x53 0xEE (CJK UNIFIED IDEOGRAPH-95E5) 0x61 0xF2 (CJK UNIFIED IDEOGRAPH-96BC) 0x5A 0xF4 (CJK UNIFIED IDEOGRAPH-9704) 0x59 0xE4 (CJK UNIFIED IDEOGRAPH-970E) 0x5C 0xAD (CJK UNIFIED IDEOGRAPH-9749) 0x65 0x7D (CJK UNIFIED IDEOGRAPH-9784) 0x63 0xAC (CJK UNIFIED IDEOGRAPH-9798) 0x53 0xEF (CJK UNIFIED IDEOGRAPH-97C3) 0x5F 0x93 (CJK UNIFIED IDEOGRAPH-9823) 0x60 0x57 (CJK UNIFIED IDEOGRAPH-88C5) 0x5F 0xD4 (CJK UNIFIED IDEOGRAPH-89DC) 0x51 0xA7 (CJK UNIFIED IDEOGRAPH-8A41) 0x5C 0x90 (CJK UNIFIED IDEOGRAPH-8AF3) 0x5D 0x6F (CJK UNIFIED IDEOGRAPH-8B8C) 0x5C 0x80 (CJK UNIFIED IDEOGRAPH-8D0B) 0x52 0xCD (CJK UNIFIED IDEOGRAPH-8DEA) 0x65 0xA6 (CJK UNIFIED IDEOGRAPH-8E55) 0x63 0xB4 (CJK UNIFIED IDEOGRAPH-8E85) 0x55 0xB3 (CJK UNIFIED IDEOGRAPH-8F46) 0x55 0xAA (CJK UNIFIED IDEOGRAPH-8F64) 0x58 0x65 (CJK UNIFIED IDEOGRAPH-8FAE) 0x58 0x7F (CJK UNIFIED IDEOGRAPH-8FF8) 0x5C 0x88 (CJK UNIFIED IDEOGRAPH-904F) 0x50 0x93 (CJK UNIFIED IDEOGRAPH-9163) 0x63 0xAB (CJK UNIFIED IDEOGRAPH-9214) 0x52 0x6B (CJK UNIFIED IDEOGRAPH-9278) 0x59 0xE3 (CJK UNIFIED IDEOGRAPH-9364) 0x54 0xC7 (CJK UNIFIED IDEOGRAPH-9419) 0x59 0xC7 (CJK UNIFIED IDEOGRAPH-9460) 0x57 0x8B (CJK UNIFIED IDEOGRAPH-95A9) 0x5C 0xB2 (CJK UNIFIED IDEOGRAPH-9628) 0x51 0x8A (CJK UNIFIED IDEOGRAPH-96DE) 0x51 0xE1 (CJK UNIFIED IDEOGRAPH-970D) 0x63 0x8F (CJK UNIFIED IDEOGRAPH-9746) 0x53 0xE8 (CJK UNIFIED IDEOGRAPH-977C) 0x5C 0x9D (CJK UNIFIED IDEOGRAPH-9785) 0x63 0xDD (CJK UNIFIED IDEOGRAPH-97A6) 0x67 0xC2 (CJK UNIFIED IDEOGRAPH-9821) 0x58 0xDC (CJK UNIFIED IDEOGRAPH-982B)

418

Appendix A: Code Pages

Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) 0x59 0x7E (CJK UNIFIED IDEOGRAPH-9870) 0x5D 0x82 (CJK UNIFIED IDEOGRAPH-995C) 0x58 0x6B (CJK UNIFIED IDEOGRAPH-99E2) 0x59 0x6E (CJK UNIFIED IDEOGRAPH-9AC0) 0x63 0xB5 (CJK UNIFIED IDEOGRAPH-9AD1) 0x58 0xF8 (CJK UNIFIED IDEOGRAPH-9AF4) 0x66 0xF8 (CJK UNIFIED IDEOGRAPH-9B1F) 0x55 0x86 (CJK UNIFIED IDEOGRAPH-9B23) 0x56 0xA4 (CJK UNIFIED IDEOGRAPH-9B4D) 0x56 0x5D (CJK UNIFIED IDEOGRAPH-9B51) 0x58 0xDE (CJK UNIFIED IDEOGRAPH-9B92) 0x5A 0x49 (CJK UNIFIED IDEOGRAPH-9C13) 0x5D 0xD1 (CJK UNIFIED IDEOGRAPH-9C2E) 0x5C 0x83 (CJK UNIFIED IDEOGRAPH-9D08) 0x5B 0xAE (CJK UNIFIED IDEOGRAPH-9D89) 0x65 0xCA (CJK UNIFIED IDEOGRAPH-9DF3) 0x63 0xDF (CJK UNIFIED IDEOGRAPH-9E81) 0x5F 0x43 (CJK UNIFIED IDEOGRAPH-9EDD) 0x58 0xF9 (CJK UNIFIED IDEOGRAPH-9EFB) 0x5F 0x5C (CJK UNIFIED IDEOGRAPH-9F66) 0x43 (HALFWIDTH HANGUL LETTER KIYEOK) 0x45 (HALFWIDTH HANGUL LETTER KIYEOK-SIOS) 0x47 (HALFWIDTH HANGUL LETTER NIEUN-CIEUC) 0x49 (HALFWIDTH HANGUL LETTER TIKEUT) 0x53 (HALFWIDTH HANGUL LETTER RIEUL) 0x55 (HALFWIDTH HANGUL LETTER RIEUL-MIEUM) 0x57 (HALFWIDTH HANGUL LETTER RIEUL-SIOS) 0x59 (HALFWIDTH HANGUL LETTER RIEUL-PHIEUPH) 0x63 (HALFWIDTH HANGUL LETTER MIEUM) 0x65 (HALFWIDTH HANGUL LETTER SSANGPIEUP) 0x52 0xA4 (CJK UNIFIED IDEOGRAPH-98B6) 0x64 0xBE (CJK UNIFIED IDEOGRAPH-99C4) 0x50 0xF0 (CJK UNIFIED IDEOGRAPH-9ABC) 0x55 0xDF (CJK UNIFIED IDEOGRAPH-9ACF) 0x57 0xDE (CJK UNIFIED IDEOGRAPH-9AE3) 0x56 0x92 (CJK UNIFIED IDEOGRAPH-9B18) 0x59 0x7F (CJK UNIFIED IDEOGRAPH-9B22) 0x5F 0x47 (CJK UNIFIED IDEOGRAPH-9B3B) 0x55 0x51 (CJK UNIFIED IDEOGRAPH-9B4E) 0x57 0xDF (CJK UNIFIED IDEOGRAPH-9B74) 0x61 0x98 (CJK UNIFIED IDEOGRAPH-9BDB) 0x53 0x92 (CJK UNIFIED IDEOGRAPH-9C2D) 0x58 0x8F (CJK UNIFIED IDEOGRAPH-9D07) 0x64 0x6A (CJK UNIFIED IDEOGRAPH-9D44) 0x66 0xC9 (CJK UNIFIED IDEOGRAPH-9DBB) 0x51 0xF3 (CJK UNIFIED IDEOGRAPH-9E1B) 0x63 0xE0 (CJK UNIFIED IDEOGRAPH-9EA4) 0x5C 0x92 (CJK UNIFIED IDEOGRAPH-9EEF) 0x58 0x90 (CJK UNIFIED IDEOGRAPH-9EFC) 0x42 (HALFWIDTH HANGUL FILLER) 0x44 (HALFWIDTH HANGUL LETTER SSANGKIYEOK) 0x46 (HALFWIDTH HANGUL LETTER NIEUN) 0x48 (HALFWIDTH HANGUL LETTER NIEUN-HIEUH) 0x52 (HALFWIDTH HANGUL LETTER SSANGTIKEUT) 0x54 (HALFWIDTH HANGUL LETTER RIEUL-KIYEOK) 0x56 (HALFWIDTH HANGUL LETTER RIEUL-PIEUP) 0x58 (HALFWIDTH HANGUL LETTER RIEUL-THIEUTH) 0x62 (HALFWIDTH HANGUL LETTER RIEUL-HIEUH) 0x64 (HALFWIDTH HANGUL LETTER PIEUP) 0x66 (HALFWIDTH HANGUL LETTER PIEUP-SIOS)

Characters Lost in Code Page Conversion

419

Table A-14. IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) Character Conversion
Characters lost when converting from IBM EBCDIC Korean CP933 to MS Windows Korean (Johab) 0x67 (HALFWIDTH HANGUL LETTER SIOS) 0x69 (HALFWIDTH HANGUL LETTER IEUNG) 0x73 (HALFWIDTH HANGUL LETTER SSANGCIEUC) 0x75 (HALFWIDTH HANGUL LETTER KHIEUKH) 0x77 (HALFWIDTH HANGUL LETTER PHIEUPH) 0x8A (HALFWIDTH HANGUL LETTER A) 0x8C (HALFWIDTH HANGUL LETTER YA) 0x8E (HALFWIDTH HANGUL LETTER EO) 0x9A (HALFWIDTH HANGUL LETTER YEO) 0x9C (HALFWIDTH HANGUL LETTER O) 0x9E (HALFWIDTH HANGUL LETTER WAE) 0xAA (HALFWIDTH HANGUL LETTER YO) 0xAC (HALFWIDTH HANGUL LETTER WEO) 0xAE (HALFWIDTH HANGUL LETTER WI) 0xBA (HALFWIDTH HANGUL LETTER EU) 0xBC (HALFWIDTH HANGUL LETTER I) 0x68 (HALFWIDTH HANGUL LETTER SSANGSIOS) 0x72 (HALFWIDTH HANGUL LETTER CIEUC) 0x74 (HALFWIDTH HANGUL LETTER CHIEUCH) 0x76 (HALFWIDTH HANGUL LETTER THIEUTH) 0x78 (HALFWIDTH HANGUL LETTER HIEUH) 0x8B (HALFWIDTH HANGUL LETTER AE) 0x8D (HALFWIDTH HANGUL LETTER YAE) 0x8F (HALFWIDTH HANGUL LETTER E) 0x9B (HALFWIDTH HANGUL LETTER YE) 0x9D (HALFWIDTH HANGUL LETTER WA) 0x9F (HALFWIDTH HANGUL LETTER OE) 0xAB (HALFWIDTH HANGUL LETTER U) 0xAD (HALFWIDTH HANGUL LETTER WE) 0xAF (HALFWIDTH HANGUL LETTER YU) 0xBB (HALFWIDTH HANGUL LETTER YI) 0x42 0x6A (FULLWIDTH BROKEN BAR)

Converting from MS Shift JIS to JapanEUC

Table A-15 lists all characters by character ID and description that do not convert from MS Shift JIS to JapanEUC:
Table A-15. MS Shift JIS to JapanEUC Character Conversion
Characters lost when converting from MS932 (MS Shift JIS) to JapanEUC 8481 (TELEPHONE SIGN) 8544 (ROMAN NUMERAL ONE) 8545 (ROMAN NUMERAL TWO) 8546 (ROMAN NUMERAL THREE) 8547 (ROMAN NUMERAL FOUR) 8548 (ROMAN NUMERAL FIVE) 8549 (ROMAN NUMERAL SIX) 8550 (ROMAN NUMERAL SEVEN) 13095 (SQUARE TON) 13099 (SQUARE PAASENTO) 13110 (SQUARE HEKUTAARU) 13115 (SQUARE PEEZI) 13129 (SQUARE MIRI) 13130 (SQUARE MIRIBAARU) 13133 (SQUARE MEETORU) 13137 (SQUARE RITTORU)

420

Appendix A: Code Pages

Table A-15. MS Shift JIS to JapanEUC Character Conversion

Characters lost when converting from MS932 (MS Shift JIS) to JapanEUC 8551 (ROMAN NUMERAL EIGHT) 8552 (ROMAN NUMERAL NINE) 8553 (ROMAN NUMERAL TEN) 8560 (SMALL ROMAN NUMERAL ONE) 8561 (SMALL ROMAN NUMERAL TWO) 8562 (SMALL ROMAN NUMERAL THREE) 8563 (SMALL ROMAN NUMERAL FOUR) 8564 (SMALL ROMAN NUMERAL FIVE) 8565 (SMALL ROMAN NUMERAL SIX) 8566 (SMALL ROMAN NUMERAL SEVEN) 8567 (SMALL ROMAN NUMERAL EIGHT) 8568 (SMALL ROMAN NUMERAL NINE) 8569 (SMALL ROMAN NUMERAL TEN) 8721 (N-ARY SUMMATION) 8735 (RIGHT ANGLE) 8741 (PARALLEL TO) 8750 (CONTOUR INTEGRAL) 8895 (RIGHT TRIANGLE) 9312 (CIRCLED DIGIT ONE) 9313 (CIRCLED DIGIT TWO) 9314 (CIRCLED DIGIT THREE) 9315 (CIRCLED DIGIT FOUR) 9316 (CIRCLED DIGIT FIVE) 9317 (CIRCLED DIGIT SIX) 9318 (CIRCLED DIGIT SEVEN) 9319 (CIRCLED DIGIT EIGHT) 9320 (CIRCLED DIGIT NINE) 9321 (CIRCLED NUMBER TEN) 9322 (CIRCLED NUMBER ELEVEN) 9323 (CIRCLED NUMBER TWELVE) 9324 (CIRCLED NUMBER THIRTEEN) 13143 (SQUARE WATTO) 13179 (SQUARE ERA NAME HEISEI) 13180 (SQUARE ERA NAME SYOUWA) 13181 (SQUARE ERA NAME TAISYOU) 13182 (SQUARE ERA NAME MEIZI) 13198 (SQUARE MG) 13199 (SQUARE KG) 13212 (SQUARE MM) 13213 (SQUARE CM) 13214 (SQUARE KM) 13217 (SQUARE M SQUARED) 13252 (SQUARE CC) 13261 (SQUARE KK) 63785 (CJK COMPATIBILITY IDEOGRAPH-F929) 63964 (CJK COMPATIBILITY IDEOGRAPH-F9DC) 64014 (CJK COMPATIBILITY IDEOGRAPH-FA0E) 64015 (CJK COMPATIBILITY IDEOGRAPH-FA0F) 64016 (CJK COMPATIBILITY IDEOGRAPH-FA10) 64017 (CJK COMPATIBILITY IDEOGRAPH-FA11) 64018 (CJK COMPATIBILITY IDEOGRAPH-FA12) 64019 (CJK COMPATIBILITY IDEOGRAPH-FA13) 64020 (CJK COMPATIBILITY IDEOGRAPH-FA14) 64021 (CJK COMPATIBILITY IDEOGRAPH-FA15) 64022 (CJK COMPATIBILITY IDEOGRAPH-FA16) 64023 (CJK COMPATIBILITY IDEOGRAPH-FA17) 64024 (CJK COMPATIBILITY IDEOGRAPH-FA18) 64025 (CJK COMPATIBILITY IDEOGRAPH-FA19) 64026 (CJK COMPATIBILITY IDEOGRAPH-FA1A) 64027 (CJK COMPATIBILITY IDEOGRAPH-FA1B) 64028 (CJK COMPATIBILITY IDEOGRAPH-FA1C) 64029 (CJK COMPATIBILITY IDEOGRAPH-FA1D)

Characters Lost in Code Page Conversion

421

Table A-15. MS Shift JIS to JapanEUC Character Conversion

Characters lost when converting from MS932 (MS Shift JIS) to JapanEUC 9325 (CIRCLED NUMBER FOURTEEN) 9326 (CIRCLED NUMBER FIFTEEN) 9327 (CIRCLED NUMBER SIXTEEN) 9328 (CIRCLED NUMBER SEVENTEEN) 9329 (CIRCLED NUMBER EIGHTEEN) 9330 (CIRCLED NUMBER NINETEEN) 9331 (CIRCLED NUMBER TWENTY) 12317 (REVERSED DOUBLE PRIME QUOTATION MARK) 12319 (LOW DOUBLE PRIME QUOTATION MARK) 12849 (PARENTHESIZED IDEOGRAPH STOCK) 12850 (PARENTHESIZED IDEOGRAPH HAVE) 12857 (PARENTHESIZED IDEOGRAPH REPRESENT) 12964 (CIRCLED IDEOGRAPH HIGH) 12965 (CIRCLED IDEOGRAPH CENTRE) 12966 (CIRCLED IDEOGRAPH LOW) 12967 (CIRCLED IDEOGRAPH LEFT) 12968 (CIRCLED IDEOGRAPH RIGHT) 13059 (SQUARE AARU) 13069 (SQUARE KARORII) 13076 (SQUARE KIRO) 13080 (SQUARE GURAMU) 13090 (SQUARE SENTI) 13091 (SQUARE SENTO) 13094 (SQUARE DORU) 64030 (CJK COMPATIBILITY IDEOGRAPH-FA1E) 64031 (CJK COMPATIBILITY IDEOGRAPH-FA1F) 64032 (CJK COMPATIBILITY IDEOGRAPH-FA20) 64033 (CJK COMPATIBILITY IDEOGRAPH-FA21) 64034 (CJK COMPATIBILITY IDEOGRAPH-FA22) 64035 (CJK COMPATIBILITY IDEOGRAPH-FA23) 64036 (CJK COMPATIBILITY IDEOGRAPH-FA24) 64037 (CJK COMPATIBILITY IDEOGRAPH-FA25) 64038 (CJK COMPATIBILITY IDEOGRAPH-FA26) 64039 (CJK COMPATIBILITY IDEOGRAPH-FA27) 64040 (CJK COMPATIBILITY IDEOGRAPH-FA28) 64041 (CJK COMPATIBILITY IDEOGRAPH-FA29) 64042 (CJK COMPATIBILITY IDEOGRAPH-FA2A) 64043 (CJK COMPATIBILITY IDEOGRAPH-FA2B) 64044 (CJK COMPATIBILITY IDEOGRAPH-FA2C) 64045 (CJK COMPATIBILITY IDEOGRAPH-FA2D) 65282 (FULLWIDTH QUOTATION MARK) 65287 (FULLWIDTH APOSTROPHE) 65293 (FULLWIDTH HYPHEN-MINUS) 65504 (FULLWIDTH CENT SIGN) 65505 (FULLWIDTH POUND SIGN) 65506 (FULLWIDTH NOT SIGN) 65508 (FULLWIDTH BROKEN BAR)

422

Appendix A: Code Pages

Converting from JapanEUC to MS Shift JIS

Table A-16 lists all characters by character ID and description that do not convert from JapanEUC to MS Shift JIS:
Table A-16. JapanEUC to MS Shift JIS Character Conversion
Characters lost when converting from JapanEUC to MS932 (MS Shift JIS) 161 (INVERTED EXCLAMATION MARK) 162 (CENT SIGN) 163 (POUND SIGN) 164 (CURRENCY SIGN) 166 (BROKEN BAR) 169 (COPYRIGHT SIGN) 170 (FEMININE ORDINAL INDICATOR) 172 (NOT SIGN) 174 (REGISTERED SIGN) 175 (MACRON) 184 (CEDILLA) 186 (MASCULINE ORDINAL INDICATOR) 191 (INVERTED QUESTION MARK) 192 (LATIN CAPITAL LETTER A WITH GRAVE) 193 (LATIN CAPITAL LETTER A WITH ACUTE) 194 (LATIN CAPITAL LETTER A WITH CIRCUMFLEX) 195 (LATIN CAPITAL LETTER A WITH TILDE) 196 (LATIN CAPITAL LETTER A WITH DIAERESIS) 197 (LATIN CAPITAL LETTER A WITH RING ABOVE) 198 (LATIN CAPITAL LETTER AE) 199 (LATIN CAPITAL LETTER C WITH CEDILLA) 200 (LATIN CAPITAL LETTER E WITH GRAVE) 201 (LATIN CAPITAL LETTER E WITH ACUTE) 202 (LATIN CAPITAL LETTER E WITH CIRCUMFLEX) 203 (LATIN CAPITAL LETTER E WITH DIAERESIS) 204 (LATIN CAPITAL LETTER I WITH GRAVE) 205 (LATIN CAPITAL LETTER I WITH ACUTE) 323 (LATIN CAPITAL LETTER N WITH ACUTE) 324 (LATIN SMALL LETTER N WITH ACUTE) 325 (LATIN CAPITAL LETTER N WITH CEDILLA) 326 (LATIN SMALL LETTER N WITH CEDILLA) 327 (LATIN CAPITAL LETTER N WITH CARON) 328 (LATIN SMALL LETTER N WITH CARON) 329 (LATIN SMALL LETTER N PRECEDED BY APOSTROPHE) 330 (LATIN CAPITAL LETTER ENG) 331 (LATIN SMALL LETTER ENG) 332 (LATIN CAPITAL LETTER O WITH MACRON) 333 (LATIN SMALL LETTER O WITH MACRON) 336 (LATIN CAPITAL LETTER O WITH DOUBLE ACUTE) 337 (LATIN SMALL LETTER O WITH DOUBLE ACUTE) 338 (LATIN CAPITAL LIGATURE OE) 339 (LATIN SMALL LIGATURE OE) 340 (LATIN CAPITAL LETTER R WITH ACUTE) 341 (LATIN SMALL LETTER R WITH ACUTE) 342 (LATIN CAPITAL LETTER R WITH CEDILLA) 343 (LATIN SMALL LETTER R WITH CEDILLA) 344 (LATIN CAPITAL LETTER R WITH CARON) 345 (LATIN SMALL LETTER R WITH CARON) 346 (LATIN CAPITAL LETTER S WITH ACUTE) 347 (LATIN SMALL LETTER S WITH ACUTE) 348 (LATIN CAPITAL LETTER S WITH CIRCUMFLEX) 349 (LATIN SMALL LETTER S WITH CIRCUMFLEX) 350 (LATIN CAPITAL LETTER S WITH CEDILLA) 351 (LATIN SMALL LETTER S WITH CEDILLA)

Characters Lost in Code Page Conversion

423

Table A-16. JapanEUC to MS Shift JIS Character Conversion

Characters lost when converting from JapanEUC to MS932 (MS Shift JIS) 206 (LATIN CAPITAL LETTER I WITH CIRCUMFLEX) 207 (LATIN CAPITAL LETTER I WITH DIAERESIS) 209 (LATIN CAPITAL LETTER N WITH TILDE) 210 (LATIN CAPITAL LETTER O WITH GRAVE) 211 (LATIN CAPITAL LETTER O WITH ACUTE) 212 (LATIN CAPITAL LETTER O WITH CIRCUMFLEX) 213 (LATIN CAPITAL LETTER O WITH TILDE) 214 (LATIN CAPITAL LETTER O WITH DIAERESIS) 216 (LATIN CAPITAL LETTER O WITH STROKE) 217 (LATIN CAPITAL LETTER U WITH GRAVE) 218 (LATIN CAPITAL LETTER U WITH ACUTE) 219 (LATIN CAPITAL LETTER U WITH CIRCUMFLEX) 220 (LATIN CAPITAL LETTER U WITH DIAERESIS) 221 (LATIN CAPITAL LETTER Y WITH ACUTE) 222 (LATIN CAPITAL LETTER THORN) 223 (LATIN SMALL LETTER SHARP S) 224 (LATIN SMALL LETTER A WITH GRAVE) 225 (LATIN SMALL LETTER A WITH ACUTE) 226 (LATIN SMALL LETTER A WITH CIRCUMFLEX) 227 (LATIN SMALL LETTER A WITH TILDE) 228 (LATIN SMALL LETTER A WITH DIAERESIS) 229 (LATIN SMALL LETTER A WITH RING ABOVE) 230 (LATIN SMALL LETTER AE) 231 (LATIN SMALL LETTER C WITH CEDILLA) 232 (LATIN SMALL LETTER E WITH GRAVE) 233 (LATIN SMALL LETTER E WITH ACUTE) 234 (LATIN SMALL LETTER E WITH CIRCUMFLEX) 235 (LATIN SMALL LETTER E WITH DIAERESIS) 236 (LATIN SMALL LETTER I WITH GRAVE) 237 (LATIN SMALL LETTER I WITH ACUTE) 238 (LATIN SMALL LETTER I WITH CIRCUMFLEX) 352 (LATIN CAPITAL LETTER S WITH CARON) 353 (LATIN SMALL LETTER S WITH CARON) 354 (LATIN CAPITAL LETTER T WITH CEDILLA) 355 (LATIN SMALL LETTER T WITH CEDILLA) 356 (LATIN CAPITAL LETTER T WITH CARON) 357 (LATIN SMALL LETTER T WITH CARON) 358 (LATIN CAPITAL LETTER T WITH STROKE) 359 (LATIN SMALL LETTER T WITH STROKE) 360 (LATIN CAPITAL LETTER U WITH TILDE) 361 (LATIN SMALL LETTER U WITH TILDE) 362 (LATIN CAPITAL LETTER U WITH MACRON) 363 (LATIN SMALL LETTER U WITH MACRON) 364 (LATIN CAPITAL LETTER U WITH BREVE) 365 (LATIN SMALL LETTER U WITH BREVE) 366 (LATIN CAPITAL LETTER U WITH RING ABOVE) 367 (LATIN SMALL LETTER U WITH RING ABOVE) 368 (LATIN CAPITAL LETTER U WITH DOUBLE ACUTE) 369 (LATIN SMALL LETTER U WITH DOUBLE ACUTE) 370 (LATIN CAPITAL LETTER U WITH OGONEK) 371 (LATIN SMALL LETTER U WITH OGONEK) 372 (LATIN CAPITAL LETTER W WITH CIRCUMFLEX) 373 (LATIN SMALL LETTER W WITH CIRCUMFLEX) 374 (LATIN CAPITAL LETTER Y WITH CIRCUMFLEX) 375 (LATIN SMALL LETTER Y WITH CIRCUMFLEX) 376 (LATIN CAPITAL LETTER Y WITH DIAERESIS) 377 (LATIN CAPITAL LETTER Z WITH ACUTE) 378 (LATIN SMALL LETTER Z WITH ACUTE) 379 (LATIN CAPITAL LETTER Z WITH DOT ABOVE) 380 (LATIN SMALL LETTER Z WITH DOT ABOVE) 381 (LATIN CAPITAL LETTER Z WITH CARON) 382 (LATIN SMALL LETTER Z WITH CARON)

424

Appendix A: Code Pages

Table A-16. JapanEUC to MS Shift JIS Character Conversion

Characters lost when converting from JapanEUC to MS932 (MS Shift JIS) 239 (LATIN SMALL LETTER I WITH DIAERESIS) 240 (LATIN SMALL LETTER ETH) 241 (LATIN SMALL LETTER N WITH TILDE) 242 (LATIN SMALL LETTER O WITH GRAVE) 243 (LATIN SMALL LETTER O WITH ACUTE) 244 (LATIN SMALL LETTER O WITH CIRCUMFLEX) 245 (LATIN SMALL LETTER O WITH TILDE) 246 (LATIN SMALL LETTER O WITH DIAERESIS) 248 (LATIN SMALL LETTER O WITH STROKE) 249 (LATIN SMALL LETTER U WITH GRAVE) 250 (LATIN SMALL LETTER U WITH ACUTE) 251 (LATIN SMALL LETTER U WITH CIRCUMFLEX) 252 (LATIN SMALL LETTER U WITH DIAERESIS) 253 (LATIN SMALL LETTER Y WITH ACUTE) 254 (LATIN SMALL LETTER THORN) 255 (LATIN SMALL LETTER Y WITH DIAERESIS) 256 (LATIN CAPITAL LETTER A WITH MACRON) 257 (LATIN SMALL LETTER A WITH MACRON) 258 (LATIN CAPITAL LETTER A WITH BREVE) 259 (LATIN SMALL LETTER A WITH BREVE) 260 (LATIN CAPITAL LETTER A WITH OGONEK) 261 (LATIN SMALL LETTER A WITH OGONEK) 262 (LATIN CAPITAL LETTER C WITH ACUTE) 263 (LATIN SMALL LETTER C WITH ACUTE) 264 (LATIN CAPITAL LETTER C WITH CIRCUMFLEX) 265 (LATIN SMALL LETTER C WITH CIRCUMFLEX) 461 (LATIN CAPITAL LETTER A WITH CARON) 462 (LATIN SMALL LETTER A WITH CARON) 463 (LATIN CAPITAL LETTER I WITH CARON) 464 (LATIN SMALL LETTER I WITH CARON) 465 (LATIN CAPITAL LETTER O WITH CARON) 466 (LATIN SMALL LETTER O WITH CARON) 467 (LATIN CAPITAL LETTER U WITH CARON) 468 (LATIN SMALL LETTER U WITH CARON) 469 (LATIN CAPITAL LETTER U WITH DIAERESIS AND MACRON) 470 (LATIN SMALL LETTER U WITH DIAERESIS AND MACRON) 471 (LATIN CAPITAL LETTER U WITH DIAERESIS AND ACUTE) 472 (LATIN SMALL LETTER U WITH DIAERESIS AND ACUTE) 473 (LATIN CAPITAL LETTER U WITH DIAERESIS AND CARON) 474 (LATIN SMALL LETTER U WITH DIAERESIS AND CARON) 475 (LATIN CAPITAL LETTER U WITH DIAERESIS AND GRAVE) 476 (LATIN SMALL LETTER U WITH DIAERESIS AND GRAVE) 501 (LATIN SMALL LETTER G WITH ACUTE) 711 (CARON) 728 (BREVE) 729 (DOT ABOVE) 730 (RING ABOVE) 731 (OGONEK) 733 (DOUBLE ACUTE ACCENT) 900 (GREEK TONOS) 901 (GREEK DIALYTIKA TONOS) 902 (GREEK CAPITAL LETTER ALPHA WITH TONOS)

Characters Lost in Code Page Conversion

425

Table A-16. JapanEUC to MS Shift JIS Character Conversion

Characters lost when converting from JapanEUC to MS932 (MS Shift JIS) 266 (LATIN CAPITAL LETTER C WITH DOT ABOVE) 267 (LATIN SMALL LETTER C WITH DOT ABOVE) 268 (LATIN CAPITAL LETTER C WITH CARON) 269 (LATIN SMALL LETTER C WITH CARON) 270 (LATIN CAPITAL LETTER D WITH CARON) 271 (LATIN SMALL LETTER D WITH CARON) 272 (LATIN CAPITAL LETTER D WITH STROKE) 273 (LATIN SMALL LETTER D WITH STROKE) 274 (LATIN CAPITAL LETTER E WITH MACRON) 275 (LATIN SMALL LETTER E WITH MACRON) 278 (LATIN CAPITAL LETTER E WITH DOT ABOVE) 279 (LATIN SMALL LETTER E WITH DOT ABOVE) 280 (LATIN CAPITAL LETTER E WITH OGONEK) 281 (LATIN SMALL LETTER E WITH OGONEK) 282 (LATIN CAPITAL LETTER E WITH CARON) 283 (LATIN SMALL LETTER E WITH CARON) 284 (LATIN CAPITAL LETTER G WITH CIRCUMFLEX) 285 (LATIN SMALL LETTER G WITH CIRCUMFLEX) 286 (LATIN CAPITAL LETTER G WITH BREVE) 287 (LATIN SMALL LETTER G WITH BREVE) 288 (LATIN CAPITAL LETTER G WITH DOT ABOVE) 289 (LATIN SMALL LETTER G WITH DOT ABOVE) 290 (LATIN CAPITAL LETTER G WITH CEDILLA) 292 (LATIN CAPITAL LETTER H WITH CIRCUMFLEX) 293 (LATIN SMALL LETTER H WITH CIRCUMFLEX) 294 (LATIN CAPITAL LETTER H WITH STROKE) 295 (LATIN SMALL LETTER H WITH STROKE) 904 (GREEK CAPITAL LETTER EPSILON WITH TONOS) 905 (GREEK CAPITAL LETTER ETA WITH TONOS) 906 (GREEK CAPITAL LETTER IOTA WITH TONOS) 908 (GREEK CAPITAL LETTER OMICRON WITH TONOS) 910 (GREEK CAPITAL LETTER UPSILON WITH TONOS) 911 (GREEK CAPITAL LETTER OMEGA WITH TONOS) 912 (GREEK SMALL LETTER IOTA WITH DIALYTIKA AND TONOS) 938 (GREEK CAPITAL LETTER IOTA WITH DIALYTIKA) 939 (GREEK CAPITAL LETTER UPSILON WITH DIALYTIKA) 940 (GREEK SMALL LETTER ALPHA WITH TONOS) 941 (GREEK SMALL LETTER EPSILON WITH TONOS) 942 (GREEK SMALL LETTER ETA WITH TONOS) 943 (GREEK SMALL LETTER IOTA WITH TONOS) 944 (GREEK SMALL LETTER UPSILON WITH DIALYTIKA AND TONOS) 962 (GREEK SMALL LETTER FINAL SIGMA) 970 (GREEK SMALL LETTER IOTA WITH DIALYTIKA) 971 (GREEK SMALL LETTER UPSILON WITH DIALYTIKA) 972 (GREEK SMALL LETTER OMICRON WITH TONOS) 973 (GREEK SMALL LETTER UPSILON WITH TONOS) 974 (GREEK SMALL LETTER OMEGA WITH TONOS) 1026 (CYRILLIC CAPITAL LETTER DJE) 1027 (CYRILLIC CAPITAL LETTER GJE) 1028 (CYRILLIC CAPITAL LETTER UKRAINIAN IE) 1029 (CYRILLIC CAPITAL LETTER DZE) 1030 (CYRILLIC CAPITAL LETTER BYELORUSSIANUKRAINIAN I) 1031 (CYRILLIC CAPITAL LETTER YI) 1032 (CYRILLIC CAPITAL LETTER JE)

426

Appendix A: Code Pages

Table A-16. JapanEUC to MS Shift JIS Character Conversion

Characters lost when converting from JapanEUC to MS932 (MS Shift JIS) 296 (LATIN CAPITAL LETTER I WITH TILDE) 297 (LATIN SMALL LETTER I WITH TILDE) 298 (LATIN CAPITAL LETTER I WITH MACRON) 299 (LATIN SMALL LETTER I WITH MACRON) 302 (LATIN CAPITAL LETTER I WITH OGONEK) 303 (LATIN SMALL LETTER I WITH OGONEK) 304 (LATIN CAPITAL LETTER I WITH DOT ABOVE) 305 (LATIN SMALL LETTER DOTLESS I) 306 (LATIN CAPITAL LIGATURE IJ) 307 (LATIN SMALL LIGATURE IJ) 308 (LATIN CAPITAL LETTER J WITH CIRCUMFLEX) 309 (LATIN SMALL LETTER J WITH CIRCUMFLEX) 310 (LATIN CAPITAL LETTER K WITH CEDILLA) 311 (LATIN SMALL LETTER K WITH CEDILLA) 312 (LATIN SMALL LETTER KRA) 313 (LATIN CAPITAL LETTER L WITH ACUTE) 314 (LATIN SMALL LETTER L WITH ACUTE) 315 (LATIN CAPITAL LETTER L WITH CEDILLA) 316 (LATIN SMALL LETTER L WITH CEDILLA) 317 (LATIN CAPITAL LETTER L WITH CARON) 318 (LATIN SMALL LETTER L WITH CARON) 319 (LATIN CAPITAL LETTER L WITH MIDDLE DOT) 320 (LATIN SMALL LETTER L WITH MIDDLE DOT) 321 (LATIN CAPITAL LETTER L WITH STROKE) 322 (LATIN SMALL LETTER L WITH STROKE) 1033 (CYRILLIC CAPITAL LETTER LJE) 1034 (CYRILLIC CAPITAL LETTER NJE) 1035 (CYRILLIC CAPITAL LETTER TSHE) 1036 (CYRILLIC CAPITAL LETTER KJE) 1038 (CYRILLIC CAPITAL LETTER SHORT U) 1039 (CYRILLIC CAPITAL LETTER DZHE) 1106 (CYRILLIC SMALL LETTER DJE) 1107 (CYRILLIC SMALL LETTER GJE) 1108 (CYRILLIC SMALL LETTER UKRAINIAN IE) 1109 (CYRILLIC SMALL LETTER DZE) 1110 (CYRILLIC SMALL LETTER BYELORUSSIANUKRAINIAN I) 1111 (CYRILLIC SMALL LETTER YI) 1112 (CYRILLIC SMALL LETTER JE) 1113 (CYRILLIC SMALL LETTER LJE) 1114 (CYRILLIC SMALL LETTER NJE) 1115 (CYRILLIC SMALL LETTER TSHE) 1116 (CYRILLIC SMALL LETTER KJE) 1118 (CYRILLIC SMALL LETTER SHORT U) 1119 (CYRILLIC SMALL LETTER DZHE) 8214 (DOUBLE VERTICAL LINE) 8482 (TRADE MARK SIGN) 8722 (MINUS SIGN) 12316 (WAVE DASH) 40869 (<CJK Ideograph Last>)

Characters Lost in Code Page Conversion

427

Converting from IBM EBCDIC Japanese to JapanEUC

Table A-17 lists all characters by character ID and description that do not convert from IBM EBCDIC Japanese to JapanEUC:
Table A-17. IBM EBCDIC Japanese to JapanEUC Character Conversion
Characters lost when converting from IBM930 (IBM EBCDIC Japanese) to JapanEUC 128 (<control character>) 129 (<control character>) 130 (<control character>) 131 (<control character>) 132 (<control character>) 133 (<control character>) 134 (<control character>) 135 (<control character>) 136 (<control character>) 137 (<control character>) 138 (<control character>) 139 (<control character>) 140 (<control character>) 141 (<control character>) 142 (<control character>) 143 (<control character>) 144 (<control character>) 145 (<control character>) 146 (<control character>) 147 (<control character>) 148 (<control character>) 149 (<control character>) 150 (<control character>) 151 (<control character>) 152 (<control character>) 153 (<control character>) 154 (<control character>) 155 (<control character>) 8562 (SMALL ROMAN NUMERAL THREE) 8563 (SMALL ROMAN NUMERAL FOUR) 8564 (SMALL ROMAN NUMERAL FIVE) 8565 (SMALL ROMAN NUMERAL SIX) 8566 (SMALL ROMAN NUMERAL SEVEN) 8567 (SMALL ROMAN NUMERAL EIGHT) 8568 (SMALL ROMAN NUMERAL NINE) 8569 (SMALL ROMAN NUMERAL TEN) 12849 (PARENTHESIZED IDEOGRAPH STOCK) 57344 (<Private Use First>) 63785 (CJK COMPATIBILITY IDEOGRAPH-F929) 63964 (CJK COMPATIBILITY IDEOGRAPH-F9DC) 64015 (CJK COMPATIBILITY IDEOGRAPH-FA0F) 64016 (CJK COMPATIBILITY IDEOGRAPH-FA10) 64018 (CJK COMPATIBILITY IDEOGRAPH-FA12) 64019 (CJK COMPATIBILITY IDEOGRAPH-FA13) 64020 (CJK COMPATIBILITY IDEOGRAPH-FA14) 64021 (CJK COMPATIBILITY IDEOGRAPH-FA15) 64022 (CJK COMPATIBILITY IDEOGRAPH-FA16) 64023 (CJK COMPATIBILITY IDEOGRAPH-FA17) 64024 (CJK COMPATIBILITY IDEOGRAPH-FA18) 64025 (CJK COMPATIBILITY IDEOGRAPH-FA19) 64026 (CJK COMPATIBILITY IDEOGRAPH-FA1A) 64027 (CJK COMPATIBILITY IDEOGRAPH-FA1B) 64028 (CJK COMPATIBILITY IDEOGRAPH-FA1C) 64029 (CJK COMPATIBILITY IDEOGRAPH-FA1D) 64030 (CJK COMPATIBILITY IDEOGRAPH-FA1E) 64031 (CJK COMPATIBILITY IDEOGRAPH-FA1F)

428

Appendix A: Code Pages

Table A-17. IBM EBCDIC Japanese to JapanEUC Character Conversion

Characters lost when converting from IBM930 (IBM EBCDIC Japanese) to JapanEUC 156 (<control character>) 157 (<control character>) 158 (<control character>) 159 (<control character>) 165 (YEN SIGN) 8212 (EM DASH) 8254 (OVERLINE) 8481 (TELEPHONE SIGN) 8544 (ROMAN NUMERAL ONE) 8545 (ROMAN NUMERAL TWO) 8546 (ROMAN NUMERAL THREE) 8547 (ROMAN NUMERAL FOUR) 8548 (ROMAN NUMERAL FIVE) 8549 (ROMAN NUMERAL SIX) 8550 (ROMAN NUMERAL SEVEN) 8551 (ROMAN NUMERAL EIGHT) 8552 (ROMAN NUMERAL NINE) 8553 (ROMAN NUMERAL TEN) 8560 (SMALL ROMAN NUMERAL ONE) 8561 (SMALL ROMAN NUMERAL TWO) 64032 (CJK COMPATIBILITY IDEOGRAPH-FA20) 64033 (CJK COMPATIBILITY IDEOGRAPH-FA21) 64034 (CJK COMPATIBILITY IDEOGRAPH-FA22) 64035 (CJK COMPATIBILITY IDEOGRAPH-FA23) 64036 (CJK COMPATIBILITY IDEOGRAPH-FA24) 64037 (CJK COMPATIBILITY IDEOGRAPH-FA25) 64038 (CJK COMPATIBILITY IDEOGRAPH-FA26) 64039 (CJK COMPATIBILITY IDEOGRAPH-FA27) 64040 (CJK COMPATIBILITY IDEOGRAPH-FA28) 64041 (CJK COMPATIBILITY IDEOGRAPH-FA29) 64042 (CJK COMPATIBILITY IDEOGRAPH-FA2A) 64043 (CJK COMPATIBILITY IDEOGRAPH-FA2B) 64044 (CJK COMPATIBILITY IDEOGRAPH-FA2C) 64045 (CJK COMPATIBILITY IDEOGRAPH-FA2D) 65282 (FULLWIDTH QUOTATION MARK) 65287 (FULLWIDTH APOSTROPHE) 65504 (FULLWIDTH CENT SIGN) 65505 (FULLWIDTH POUND SIGN) 65506 (FULLWIDTH NOT SIGN)

Converting from JapanEUC to IBM EBCDIC Japanese

Table A-18 lists all characters by character ID and description that do not convert from JapanEUC to IBM EBCDIC Japanese:
Table A-18. JapanEUC to IBM EBCDIC Japanese Character Conversion
Characters lost when converting from JapanEUC to IBM930 (IBM EBCDIC Japanese) 161 (INVERTED EXCLAMATION MARK) 164 (CURRENCY SIGN) 169 (COPYRIGHT SIGN) 170 (FEMININE ORDINAL INDICATOR) 325 (LATIN CAPITAL LETTER N WITH CEDILLA) 326 (LATIN SMALL LETTER N WITH CEDILLA) 327 (LATIN CAPITAL LETTER N WITH CARON) 328 (LATIN SMALL LETTER N WITH CARON)

Characters Lost in Code Page Conversion

429

Table A-18. JapanEUC to IBM EBCDIC Japanese Character Conversion

Characters lost when converting from JapanEUC to IBM930 (IBM EBCDIC Japanese) 174 (REGISTERED SIGN) 175 (MACRON) 184 (CEDILLA) 186 (MASCULINE ORDINAL INDICATOR) 191 (INVERTED QUESTION MARK) 192 (LATIN CAPITAL LETTER A WITH GRAVE) 193 (LATIN CAPITAL LETTER A WITH ACUTE) 194 (LATIN CAPITAL LETTER A WITH CIRCUMFLEX) 195 (LATIN CAPITAL LETTER A WITH TILDE) 196 (LATIN CAPITAL LETTER A WITH DIAERESIS) 197 (LATIN CAPITAL LETTER A WITH RING ABOVE) 198 (LATIN CAPITAL LETTER AE) 199 (LATIN CAPITAL LETTER C WITH CEDILLA) 200 (LATIN CAPITAL LETTER E WITH GRAVE) 201 (LATIN CAPITAL LETTER E WITH ACUTE) 202 (LATIN CAPITAL LETTER E WITH CIRCUMFLEX) 203 (LATIN CAPITAL LETTER E WITH DIAERESIS) 204 (LATIN CAPITAL LETTER I WITH GRAVE) 205 (LATIN CAPITAL LETTER I WITH ACUTE) 206 (LATIN CAPITAL LETTER I WITH CIRCUMFLEX) 207 (LATIN CAPITAL LETTER I WITH DIAERESIS) 209 (LATIN CAPITAL LETTER N WITH TILDE) 210 (LATIN CAPITAL LETTER O WITH GRAVE) 211 (LATIN CAPITAL LETTER O WITH ACUTE) 212 (LATIN CAPITAL LETTER O WITH CIRCUMFLEX) 213 (LATIN CAPITAL LETTER O WITH TILDE) 214 (LATIN CAPITAL LETTER O WITH DIAERESIS) 216 (LATIN CAPITAL LETTER O WITH STROKE) 217 (LATIN CAPITAL LETTER U WITH GRAVE) 218 (LATIN CAPITAL LETTER U WITH ACUTE) 329 (LATIN SMALL LETTER N PRECEDED BY APOSTROPHE) 330 (LATIN CAPITAL LETTER ENG) 331 (LATIN SMALL LETTER ENG) 332 (LATIN CAPITAL LETTER O WITH MACRON) 333 (LATIN SMALL LETTER O WITH MACRON) 336 (LATIN CAPITAL LETTER O WITH DOUBLE ACUTE) 337 (LATIN SMALL LETTER O WITH DOUBLE ACUTE) 338 (LATIN CAPITAL LIGATURE OE) 339 (LATIN SMALL LIGATURE OE) 340 (LATIN CAPITAL LETTER R WITH ACUTE) 341 (LATIN SMALL LETTER R WITH ACUTE) 342 (LATIN CAPITAL LETTER R WITH CEDILLA) 343 (LATIN SMALL LETTER R WITH CEDILLA) 344 (LATIN CAPITAL LETTER R WITH CARON) 345 (LATIN SMALL LETTER R WITH CARON) 346 (LATIN CAPITAL LETTER S WITH ACUTE) 347 (LATIN SMALL LETTER S WITH ACUTE) 348 (LATIN CAPITAL LETTER S WITH CIRCUMFLEX) 349 (LATIN SMALL LETTER S WITH CIRCUMFLEX) 350 (LATIN CAPITAL LETTER S WITH CEDILLA) 351 (LATIN SMALL LETTER S WITH CEDILLA) 352 (LATIN CAPITAL LETTER S WITH CARON) 353 (LATIN SMALL LETTER S WITH CARON) 354 (LATIN CAPITAL LETTER T WITH CEDILLA) 355 (LATIN SMALL LETTER T WITH CEDILLA) 356 (LATIN CAPITAL LETTER T WITH CARON) 357 (LATIN SMALL LETTER T WITH CARON) 358 (LATIN CAPITAL LETTER T WITH STROKE) 359 (LATIN SMALL LETTER T WITH STROKE) 360 (LATIN CAPITAL LETTER U WITH TILDE)

430

Appendix A: Code Pages

Table A-18. JapanEUC to IBM EBCDIC Japanese Character Conversion

Characters lost when converting from JapanEUC to IBM930 (IBM EBCDIC Japanese) 219 (LATIN CAPITAL LETTER U WITH CIRCUMFLEX) 220 (LATIN CAPITAL LETTER U WITH DIAERESIS) 221 (LATIN CAPITAL LETTER Y WITH ACUTE) 222 (LATIN CAPITAL LETTER THORN) 223 (LATIN SMALL LETTER SHARP S) 224 (LATIN SMALL LETTER A WITH GRAVE) 225 (LATIN SMALL LETTER A WITH ACUTE) 226 (LATIN SMALL LETTER A WITH CIRCUMFLEX) 227 (LATIN SMALL LETTER A WITH TILDE) 228 (LATIN SMALL LETTER A WITH DIAERESIS) 229 (LATIN SMALL LETTER A WITH RING ABOVE) 230 (LATIN SMALL LETTER AE) 231 (LATIN SMALL LETTER C WITH CEDILLA) 232 (LATIN SMALL LETTER E WITH GRAVE) 233 (LATIN SMALL LETTER E WITH ACUTE) 234 (LATIN SMALL LETTER E WITH CIRCUMFLEX) 235 (LATIN SMALL LETTER E WITH DIAERESIS) 236 (LATIN SMALL LETTER I WITH GRAVE) 237 (LATIN SMALL LETTER I WITH ACUTE) 238 (LATIN SMALL LETTER I WITH CIRCUMFLEX) 239 (LATIN SMALL LETTER I WITH DIAERESIS) 240 (LATIN SMALL LETTER ETH) 241 (LATIN SMALL LETTER N WITH TILDE) 242 (LATIN SMALL LETTER O WITH GRAVE) 243 (LATIN SMALL LETTER O WITH ACUTE) 244 (LATIN SMALL LETTER O WITH CIRCUMFLEX) 245 (LATIN SMALL LETTER O WITH TILDE) 246 (LATIN SMALL LETTER O WITH DIAERESIS) 248 (LATIN SMALL LETTER O WITH STROKE) 249 (LATIN SMALL LETTER U WITH GRAVE) 361 (LATIN SMALL LETTER U WITH TILDE) 362 (LATIN CAPITAL LETTER U WITH MACRON) 363 (LATIN SMALL LETTER U WITH MACRON) 364 (LATIN CAPITAL LETTER U WITH BREVE) 365 (LATIN SMALL LETTER U WITH BREVE) 366 (LATIN CAPITAL LETTER U WITH RING ABOVE) 367 (LATIN SMALL LETTER U WITH RING ABOVE) 368 (LATIN CAPITAL LETTER U WITH DOUBLE ACUTE) 369 (LATIN SMALL LETTER U WITH DOUBLE ACUTE) 370 (LATIN CAPITAL LETTER U WITH OGONEK) 371 (LATIN SMALL LETTER U WITH OGONEK) 372 (LATIN CAPITAL LETTER W WITH CIRCUMFLEX) 373 (LATIN SMALL LETTER W WITH CIRCUMFLEX) 374 (LATIN CAPITAL LETTER Y WITH CIRCUMFLEX) 375 (LATIN SMALL LETTER Y WITH CIRCUMFLEX) 376 (LATIN CAPITAL LETTER Y WITH DIAERESIS) 377 (LATIN CAPITAL LETTER Z WITH ACUTE) 378 (LATIN SMALL LETTER Z WITH ACUTE) 379 (LATIN CAPITAL LETTER Z WITH DOT ABOVE) 380 (LATIN SMALL LETTER Z WITH DOT ABOVE) 381 (LATIN CAPITAL LETTER Z WITH CARON) 382 (LATIN SMALL LETTER Z WITH CARON) 461 (LATIN CAPITAL LETTER A WITH CARON) 462 (LATIN SMALL LETTER A WITH CARON) 463 (LATIN CAPITAL LETTER I WITH CARON) 464 (LATIN SMALL LETTER I WITH CARON) 465 (LATIN CAPITAL LETTER O WITH CARON) 466 (LATIN SMALL LETTER O WITH CARON) 467 (LATIN CAPITAL LETTER U WITH CARON) 468 (LATIN SMALL LETTER U WITH CARON)

Characters Lost in Code Page Conversion

431

Table A-18. JapanEUC to IBM EBCDIC Japanese Character Conversion

Characters lost when converting from JapanEUC to IBM930 (IBM EBCDIC Japanese) 250 (LATIN SMALL LETTER U WITH ACUTE) 251 (LATIN SMALL LETTER U WITH CIRCUMFLEX) 252 (LATIN SMALL LETTER U WITH DIAERESIS) 253 (LATIN SMALL LETTER Y WITH ACUTE) 254 (LATIN SMALL LETTER THORN) 255 (LATIN SMALL LETTER Y WITH DIAERESIS) 256 (LATIN CAPITAL LETTER A WITH MACRON) 257 (LATIN SMALL LETTER A WITH MACRON) 258 (LATIN CAPITAL LETTER A WITH BREVE) 259 (LATIN SMALL LETTER A WITH BREVE) 260 (LATIN CAPITAL LETTER A WITH OGONEK) 261 (LATIN SMALL LETTER A WITH OGONEK) 262 (LATIN CAPITAL LETTER C WITH ACUTE) 263 (LATIN SMALL LETTER C WITH ACUTE) 264 (LATIN CAPITAL LETTER C WITH CIRCUMFLEX) 265 (LATIN SMALL LETTER C WITH CIRCUMFLEX) 266 (LATIN CAPITAL LETTER C WITH DOT ABOVE) 267 (LATIN SMALL LETTER C WITH DOT ABOVE) 268 (LATIN CAPITAL LETTER C WITH CARON) 269 (LATIN SMALL LETTER C WITH CARON) 270 (LATIN CAPITAL LETTER D WITH CARON) 271 (LATIN SMALL LETTER D WITH CARON) 272 (LATIN CAPITAL LETTER D WITH STROKE) 273 (LATIN SMALL LETTER D WITH STROKE) 274 (LATIN CAPITAL LETTER E WITH MACRON) 469 (LATIN CAPITAL LETTER U WITH DIAERESIS AND MACRON) 470 (LATIN SMALL LETTER U WITH DIAERESIS AND MACRON) 471 (LATIN CAPITAL LETTER U WITH DIAERESIS AND ACUTE) 472 (LATIN SMALL LETTER U WITH DIAERESIS AND ACUTE) 473 (LATIN CAPITAL LETTER U WITH DIAERESIS AND CARON) 474 (LATIN SMALL LETTER U WITH DIAERESIS AND CARON) 475 (LATIN CAPITAL LETTER U WITH DIAERESIS AND GRAVE) 476 (LATIN SMALL LETTER U WITH DIAERESIS AND GRAVE) 501 (LATIN SMALL LETTER G WITH ACUTE) 711 (CARON) 728 (BREVE) 729 (DOT ABOVE) 730 (RING ABOVE) 731 (OGONEK) 733 (DOUBLE ACUTE ACCENT) 900 (GREEK TONOS) 901 (GREEK DIALYTIKA TONOS) 902 (GREEK CAPITAL LETTER ALPHA WITH TONOS) 904 (GREEK CAPITAL LETTER EPSILON WITH TONOS) 905 (GREEK CAPITAL LETTER ETA WITH TONOS) 906 (GREEK CAPITAL LETTER IOTA WITH TONOS) 908 (GREEK CAPITAL LETTER OMICRON WITH TONOS) 910 (GREEK CAPITAL LETTER UPSILON WITH TONOS) 911 (GREEK CAPITAL LETTER OMEGA WITH TONOS) 912 (GREEK SMALL LETTER IOTA WITH DIALYTIKA AND TONOS)

432

Appendix A: Code Pages

Table A-18. JapanEUC to IBM EBCDIC Japanese Character Conversion

Characters lost when converting from JapanEUC to IBM930 (IBM EBCDIC Japanese) 275 (LATIN SMALL LETTER E WITH MACRON) 278 (LATIN CAPITAL LETTER E WITH DOT ABOVE) 279 (LATIN SMALL LETTER E WITH DOT ABOVE) 280 (LATIN CAPITAL LETTER E WITH OGONEK) 281 (LATIN SMALL LETTER E WITH OGONEK) 282 (LATIN CAPITAL LETTER E WITH CARON) 283 (LATIN SMALL LETTER E WITH CARON) 284 (LATIN CAPITAL LETTER G WITH CIRCUMFLEX) 285 (LATIN SMALL LETTER G WITH CIRCUMFLEX) 286 (LATIN CAPITAL LETTER G WITH BREVE) 287 (LATIN SMALL LETTER G WITH BREVE) 288 (LATIN CAPITAL LETTER G WITH DOT ABOVE) 289 (LATIN SMALL LETTER G WITH DOT ABOVE) 290 (LATIN CAPITAL LETTER G WITH CEDILLA) 292 (LATIN CAPITAL LETTER H WITH CIRCUMFLEX) 293 (LATIN SMALL LETTER H WITH CIRCUMFLEX) 294 (LATIN CAPITAL LETTER H WITH STROKE) 295 (LATIN SMALL LETTER H WITH STROKE) 296 (LATIN CAPITAL LETTER I WITH TILDE) 297 (LATIN SMALL LETTER I WITH TILDE) 298 (LATIN CAPITAL LETTER I WITH MACRON) 299 (LATIN SMALL LETTER I WITH MACRON) 302 (LATIN CAPITAL LETTER I WITH OGONEK) 303 (LATIN SMALL LETTER I WITH OGONEK) 304 (LATIN CAPITAL LETTER I WITH DOT ABOVE) 305 (LATIN SMALL LETTER DOTLESS I) 306 (LATIN CAPITAL LIGATURE IJ) 307 (LATIN SMALL LIGATURE IJ) 308 (LATIN CAPITAL LETTER J WITH CIRCUMFLEX) 938 (GREEK CAPITAL LETTER IOTA WITH DIALYTIKA) 939 (GREEK CAPITAL LETTER UPSILON WITH DIALYTIKA) 940 (GREEK SMALL LETTER ALPHA WITH TONOS) 941 (GREEK SMALL LETTER EPSILON WITH TONOS) 942 (GREEK SMALL LETTER ETA WITH TONOS) 943 (GREEK SMALL LETTER IOTA WITH TONOS) 944 (GREEK SMALL LETTER UPSILON WITH DIALYTIKA AND TONOS) 962 (GREEK SMALL LETTER FINAL SIGMA) 970 (GREEK SMALL LETTER IOTA WITH DIALYTIKA) 971 (GREEK SMALL LETTER UPSILON WITH DIALYTIKA) 972 (GREEK SMALL LETTER OMICRON WITH TONOS) 973 (GREEK SMALL LETTER UPSILON WITH TONOS) 974 (GREEK SMALL LETTER OMEGA WITH TONOS) 1026 (CYRILLIC CAPITAL LETTER DJE) 1027 (CYRILLIC CAPITAL LETTER GJE) 1028 (CYRILLIC CAPITAL LETTER UKRAINIAN IE) 1029 (CYRILLIC CAPITAL LETTER DZE) 1030 (CYRILLIC CAPITAL LETTER BYELORUSSIANUKRAINIAN I) 1031 (CYRILLIC CAPITAL LETTER YI) 1032 (CYRILLIC CAPITAL LETTER JE) 1033 (CYRILLIC CAPITAL LETTER LJE) 1034 (CYRILLIC CAPITAL LETTER NJE) 1035 (CYRILLIC CAPITAL LETTER TSHE) 1036 (CYRILLIC CAPITAL LETTER KJE) 1038 (CYRILLIC CAPITAL LETTER SHORT U) 1039 (CYRILLIC CAPITAL LETTER DZHE) 1106 (CYRILLIC SMALL LETTER DJE) 1107 (CYRILLIC SMALL LETTER GJE) 1108 (CYRILLIC SMALL LETTER UKRAINIAN IE)

Characters Lost in Code Page Conversion

433

Table A-18. JapanEUC to IBM EBCDIC Japanese Character Conversion

Characters lost when converting from JapanEUC to IBM930 (IBM EBCDIC Japanese) 309 (LATIN SMALL LETTER J WITH CIRCUMFLEX) 310 (LATIN CAPITAL LETTER K WITH CEDILLA) 311 (LATIN SMALL LETTER K WITH CEDILLA) 312 (LATIN SMALL LETTER KRA) 313 (LATIN CAPITAL LETTER L WITH ACUTE) 314 (LATIN SMALL LETTER L WITH ACUTE) 315 (LATIN CAPITAL LETTER L WITH CEDILLA) 316 (LATIN SMALL LETTER L WITH CEDILLA) 317 (LATIN CAPITAL LETTER L WITH CARON) 318 (LATIN SMALL LETTER L WITH CARON) 319 (LATIN CAPITAL LETTER L WITH MIDDLE DOT) 320 (LATIN SMALL LETTER L WITH MIDDLE DOT) 321 (LATIN CAPITAL LETTER L WITH STROKE) 322 (LATIN SMALL LETTER L WITH STROKE) 323 (LATIN CAPITAL LETTER N WITH ACUTE) 324 (LATIN SMALL LETTER N WITH ACUTE) 1109 (CYRILLIC SMALL LETTER DZE) 1110 (CYRILLIC SMALL LETTER BYELORUSSIANUKRAINIAN I) 1111 (CYRILLIC SMALL LETTER YI) 1112 (CYRILLIC SMALL LETTER JE) 1113 (CYRILLIC SMALL LETTER LJE) 1114 (CYRILLIC SMALL LETTER NJE) 1115 (CYRILLIC SMALL LETTER TSHE) 1116 (CYRILLIC SMALL LETTER KJE) 1118 (CYRILLIC SMALL LETTER SHORT U) 1119 (CYRILLIC SMALL LETTER DZHE) 8213 (HORIZONTAL BAR) 8470 (NUMERO SIGN) 8482 (TRADE MARK SIGN) 40869 (<CJK Ideograph Last>) 65374 (FULLWIDTH TILDE)

Converting from IBM EBCDIC Japanese to MS Shift JIS

Table A-19 lists all characters by character ID and description that do not convert from IBM EBCDIC Japanese to MS Shift JIS:
Table A-19. IBM EBCDIC Japanese to MS Shift JIS Character Conversion
Characters lost when converting from IBM930 (IBM EBCDIC Japanese) to MS932 (MS Shift JIS) 128 (<control character>) 129 (<control character>) 130 (<control character>) 131 (<control character>) 132 (<control character>) 133 (<control character>) 134 (<control character>) 135 (<control character>) 150 (<control character>) 151 (<control character>) 152 (<control character>) 153 (<control character>) 154 (<control character>) 155 (<control character>) 156 (<control character>) 157 (<control character>)

434

Appendix A: Code Pages

Table A-19. IBM EBCDIC Japanese to MS Shift JIS Character Conversion

Characters lost when converting from IBM930 (IBM EBCDIC Japanese) to MS932 (MS Shift JIS) 136 (<control character>) 137 (<control character>) 138 (<control character>) 139 (<control character>) 140 (<control character>) 141 (<control character>) 142 (<control character>) 143 (<control character>) 144 (<control character>) 145 (<control character>) 146 (<control character>) 147 (<control character>) 148 (<control character>) 149 (<control character>) 158 (<control character>) 159 (<control character>) 162 (CENT SIGN) 163 (POUND SIGN) 165 (YEN SIGN) 166 (BROKEN BAR) 172 (NOT SIGN) 8212 (EM DASH) 8214 (DOUBLE VERTICAL LINE) 8254 (OVERLINE) 8722 (MINUS SIGN) 12316 (WAVE DASH) 57344 (<Private Use First>)

Converting from MS Shift JIS to IBM EBCDIC Japanese

Table A-20 lists all characters by character ID and description that do not convert from MS Shift JIS to IBM EBCDIC Japanese:
Table A-20. MS Shift JIS to IBM EBCDIC Japanese Character Conversion
Characters lost when converting from MS932 (MS Shift JIS) to IBM930 (IBM EBCDIC Japanese) 8213 (HORIZONTAL BAR) 8470 (NUMERO SIGN) 8721 (N-ARY SUMMATION) 8735 (RIGHT ANGLE) 8741 (PARALLEL TO) 8750 (CONTOUR INTEGRAL) 8895 (RIGHT TRIANGLE) 9312 (CIRCLED DIGIT ONE) 9313 (CIRCLED DIGIT TWO) 9314 (CIRCLED DIGIT THREE) 9315 (CIRCLED DIGIT FOUR) 12968 (CIRCLED IDEOGRAPH RIGHT) 13059 (SQUARE AARU) 13069 (SQUARE KARORII) 13076 (SQUARE KIRO) 13080 (SQUARE GURAMU) 13090 (SQUARE SENTI) 13091 (SQUARE SENTO) 13094 (SQUARE DORU) 13095 (SQUARE TON) 13099 (SQUARE PAASENTO) 13110 (SQUARE HEKUTAARU)

Characters Lost in Code Page Conversion

435

Table A-20. MS Shift JIS to IBM EBCDIC Japanese Character Conversion

Characters lost when converting from MS932 (MS Shift JIS) to IBM930 (IBM EBCDIC Japanese) 9316 (CIRCLED DIGIT FIVE) 9317 (CIRCLED DIGIT SIX) 9318 (CIRCLED DIGIT SEVEN) 9319 (CIRCLED DIGIT EIGHT) 9320 (CIRCLED DIGIT NINE) 9321 (CIRCLED NUMBER TEN) 9322 (CIRCLED NUMBER ELEVEN) 9323 (CIRCLED NUMBER TWELVE) 9324 (CIRCLED NUMBER THIRTEEN) 9325 (CIRCLED NUMBER FOURTEEN) 9326 (CIRCLED NUMBER FIFTEEN) 9327 (CIRCLED NUMBER SIXTEEN) 9328 (CIRCLED NUMBER SEVENTEEN) 9329 (CIRCLED NUMBER EIGHTEEN) 9330 (CIRCLED NUMBER NINETEEN) 9331 (CIRCLED NUMBER TWENTY) 12317 (REVERSED DOUBLE PRIME QUOTATION MARK) 12319 (LOW DOUBLE PRIME QUOTATION MARK) 12850 (PARENTHESIZED IDEOGRAPH HAVE) 12857 (PARENTHESIZED IDEOGRAPH REPRESENT) 12964 (CIRCLED IDEOGRAPH HIGH) 12965 (CIRCLED IDEOGRAPH CENTRE) 12966 (CIRCLED IDEOGRAPH LOW) 12967 (CIRCLED IDEOGRAPH LEFT) 13115 (SQUARE PEEZI) 13129 (SQUARE MIRI) 13130 (SQUARE MIRIBAARU) 13133 (SQUARE MEETORU) 13137 (SQUARE RITTORU) 13143 (SQUARE WATTO) 13179 (SQUARE ERA NAME HEISEI) 13180 (SQUARE ERA NAME SYOUWA) 13181 (SQUARE ERA NAME TAISYOU) 13182 (SQUARE ERA NAME MEIZI) 13198 (SQUARE MG) 13199 (SQUARE KG) 13212 (SQUARE MM) 13213 (SQUARE CM) 13214 (SQUARE KM) 13217 (SQUARE M SQUARED) 13252 (SQUARE CC) 13261 (SQUARE KK) 64014 (CJK COMPATIBILITY IDEOGRAPH-FA0E) 64017 (CJK COMPATIBILITY IDEOGRAPH-FA11) 65293 (FULLWIDTH HYPHEN-MINUS) 65374 (FULLWIDTH TILDE) 65508 (FULLWIDTH BROKEN BAR)

436

Appendix A: Code Pages

Appendix B

Glossary

This appendix includes the following topic:

PowerCenter Glossary Terms, 438

437

PowerCenter Glossary Terms

This appendix lists definitions of terms introduced in the PowerCenter documentation.

A
active source

An active source is an active transformation the Integration Service uses to generate rows.
adaptive dispatch mode

A dispatch mode in which the Load Balancer dispatches tasks to the node with the most available CPUs.
application services

A group of services that represent PowerCenter server-based functionality. You configure each application service based on your environment requirements. Application services include the Integration Service, Repository Service, SAP BW Service, and the Web Services Hub.
available resource

Any PowerCenter resource that is configured to be available to a node.

B
backup node

Any node that is configured to run a service process, but is not configured as a primary node.
blocking

The suspension of the data flow into an input group of a multiple input group transformation.
buffer block

During a session, the Integration Service divides buffer memory into buffer blocks. A buffer block moves rows of data from the source to the target. The number of rows in a block depends on the size of the row data, the configured buffer block size, and the configured buffer memory size.
buffer block size

The size of the blocks of data Configured size of the buffer block used to move rows of data from the source to the target. You specify the buffer block size in bytes or as percentage of total memory. Configure this setting in the session properties.

438

Appendix B: Glossary

buffer memory

Buffer memory allocated to a session. The Integration Service uses buffer memory to move data from sources to targets. The Integration Service divides buffer memory into buffer blocks.
buffer memory size

Total buffer memory allocated to a session specified in bytes or as a percentage of total memory.

C
cache partitioning

A caching process that the Integration Service uses to create a separate cache for each partition. Each partition works with only the rows needed by that partition. The Integration Service can partition caches for the Aggregator, Joiner, Lookup, and Rank transformations.
child dependency

A dependent relationship between two objects in which the child object is used by the parent object.
child object

A dependent object used by another object, the parent object.

commit source

An active source that generates commits for a target in a source-based commit session.
compatible version

An earlier version of a client application or a local repository that you can use to access the latest version repository.
composite object

An object that contains a parent object and its child objects. For example, a mapping parent object contains child objects including sources, targets and transformations.
CPU profile

An index that ranks the computing throughput of each CPU and bus architecture in a grid. In adaptive dispatch mode, nodes with higher CPU profiles get precedence for dispatch.
Custom transformation

A transformation that you bind to a procedure developed outside of the Designer interface to extend PowerCenter functionality. You can create Custom transformations with multiple input and output groups.

PowerCenter Glossary Terms

439

Custom transformation procedure

A C procedure you create using the functions provided with PowerCenter that defines the transformation logic of a Custom transformation.
Custom XML view

An XML view that you define instead of allowing the XML Wizard to choose the default root and columns in the view. You can create custom views using the XML Editor and the XML Wizard in the Designer.

D
denormalized view

An XML view that contains more than one multiple-occurring element.

dependent object

An object used by another object. A dependent object is a child object.

deployment group

A global object that contains references to other objects from multiple folders across the repository. You can copy the objects referenced in a deployment group to multiple target folders in another repository. When you copy objects in a deployment group, the target repository creates new versions of the objects. You can create a static or dynamic deployment group.
deterministic output

Source or transformation output that does not change between session runs when the input data is consistent between runs.
domain

See PowerCenter domain on page 445. See also repository domain on page 446.
DTM buffer memory

See buffer memory on page 439.

dynamic deployment group

A deployment group that is associated with an object query. When you copy a dynamic deployment group, the source repository runs the query and then copies the results to the target repository.

440

Appendix B: Glossary

dynamic partitioning

The ability to scale the number of partitions without manually adding partitions in the session properties. Based on the session configuration, the Integration Service determines the number of partitions when it runs the session.

E
effective Transaction Control transformation

A Transaction Control transformation that does not have a downstream transformation that drops transaction boundaries.
effective transaction generator

A transaction generator that does not have a downstream transformation that drops transaction boundaries.
exclusive mode

Operating mode for the Repository Service. When you run the Repository Service in exclusive mode, you allow only one user to access the repository to perform administrative tasks that require a single user to access the repository and update the configuration.

F
failover

The migration of a service or task to another node when the node running or service process become unavailable.

G
gateway

Receives service requests from clients and route them to the appropriate service and node. In the Administration Console, you designate nodes that can serve as the gateway.
global object

An object that exists at repository level and contains properties you can apply to multiple objects in the repository. Object queries, deployment groups, labels, and connection objects are global objects.
grid object

An alias assigned to a group of nodes to run sessions and workflows.

PowerCenter Glossary Terms

441

group

A set of ports that defines a row of incoming or outgoing data. A group is analogous to a table in a relational source or target definition.

H
high availability

The PowerCenter option that eliminates a single point of failure in a domain and provides minimal service interruption in the event of failure.

I
impacted object

An object that has been marked as impacted by the PowerCenter Client. The PowerCenter Client marks objects as impacted when a child object changes in such a way that the parent object may not be able to run.
incompatible object

An object that a compatible client application cannot access in the latest version repository.
ineffective Transaction Control transformation

A Transaction Control transformation that has a downstream transformation that drops transaction boundaries, such as an Aggregator transformation with Transaction transformation scope.
ineffective transaction generator

A transaction generator that has a downstream transformation that drops transaction boundaries, such as an Aggregator transformation with Transaction transformation scope.
input group

See group on page 442.

Integration Service

An application service that runs data integration sessions and workflows.

invalid object

An object that has been marked as invalid by the PowerCenter Client. When you validate or save a repository object, the PowerCenter Client verifies that the data can flow from all sources in a target load order group to the targets without the Integration Service blocking all sources.

442

Appendix B: Glossary

L
label

A user-defined object that you can associate with any versioned object or group of versioned objects in the repository.
limit on resilience timeout

The amount of time a service waits for a client to connect or reconnect to the service. The limit can override the client resilience timeout configured for a client. See resilience timeout on page 447.
linked domain

A domain that you link to when you need to access the repository metadata in that domain.
Load Balancer

A component of the Integration Service that dispatches Session, Command, and predefined Event-Wait tasks across nodes in a grid.
local domain

The domain that you create when you install PowerCenter. This is the domain you access when you log in to the Administration Console.
Log Agent

A Service Manager function that provides accumulated log events from session and workflows. You can view session and workflow logs in the Workflow Monitor. The Log Agent runs on the nodes where the Integration Service process runs. See also Log Manager on page 443.
Log Manager

A Service Manager function that provides accumulated log events from each service in the domain. You can view logs in the Administration Console. The Log Manager runs on the master gateway node. See also Log Agent on page 443.

M
mapping

A set of source and target definitions linked by transformation objects that define the rules for data transformation.

PowerCenter Glossary Terms

443

master service process

When you run workflows and sessions on a grid, the Integration Service designates one Integration Service process as the master service process. The master service process monitors all Integration Service processes.
metadata explosion

The expansion of referenced or multiple-occurring elements in an XML definition. The relationship model you choose for an XML definition determines if metadata is limited or exploded to multiple areas within the definition. Limited data explosion reduces data redundancy.
metric-based dispatch mode

A dispatch mode in which the Load Balancer checks current computing load against the resource provision thresholds and then dispatches tasks in a round-robin fashion to nodes where the thresholds are not exceeded.

N
node

A logical representation of a machine or a blade. Each node runs a Service Manager that performs domain operations on that node.
normal mode

Operating mode for an Integration Service or Repository Service. Run the Integration Service in normal mode during daily Integration Service operations. Run the Repository Service in normal mode to allow multiple users to access the repository and update content.
normalized view

An XML view that contains no more than one multiple-occurring element. Normalized XML views reduce data redundancy.

O
object query

A user-defined object you use to search for versioned objects that meet specific conditions.
one-way mapping

A mapping that uses a web service client for the source. The Integration Service loads data to a target, often triggered by a real-time event through a web service request.
open transaction

A set of rows that are not bound by commit or rollback rows.

444 Appendix B: Glossary

operating mode

The mode for an Integration Service or Repository Service. An Integration Service runs in normal or safe mode. A Repository Service runs in normal or exclusive mode.
output group

See group on page 442.

P
parent dependency

A dependent relationship between two objects in which the parent object uses the child object.
parent object

An object that uses a dependent object, the child object.

pipeline

See source pipeline on page 448.

pipeline branch

A segment of a pipeline between any two specified sources, transformations, or targets.

pipeline stage

The section of a pipeline executed between any two partition points.

port dependency

The relationship between an output or input/output port and one or more input or input/ output ports.
PowerCenter domain

A collection of nodes and services that define the PowerCenter environment. You group nodes and services in a domain based on administration ownership.
PowerCenter resource

Any resource that may be required to run a task. PowerCenter has predefined resources and user-defined resources.
predefined resource

An available built-in resource. This can include the operating system or any resource installed by the PowerCenter installation, such as a plug-in or a connection object.

PowerCenter Glossary Terms

445

primary node

A node that is configured as the default node to run a service process. By default, the Service Manager starts the service process on the primary node and uses a backup node if the primary node fails.
pushdown group

A group of transformations containing transformation logic that is pushed to the database during a session configured for pushdown optimization. The Integration Service creates one or more SQL statements based on the number of partitions in the pipeline.
pushdown optimization

A session option that allows you to push transformation logic to the source or target database.

R
recovery

The automatic or manual completion of tasks after a service is interrupted. Automatic recovery is available for Integration Service and Repository Service tasks. You can also manually recover Integration Service workflows.
repeatable data

Source or transformation output that is in the same order between session runs when the order of the input data is consistent.
repository client application

Any PowerCenter application that connects to the repository. This includes the PowerCenter Client, Integration Service, pmcmd, pmrep, and MX SDK.
repository domain

A group of linked repositories consisting of one global repository and one or more local repositories.
Repository Service

An application service that manages the repository. It retrieves, inserts, and updates metadata in the repository database tables.
request-response mapping

A mapping that uses a web service source and target. When you create a request-response mapping, you use source and target definitions imported from the same WSDL file.

446

Appendix B: Glossary

required resource

A PowerCenter resource that is required to run a task. A task fails if it cannot find any node where the required resource is available.
reserved words file

A file named reswords.txt that you create and maintain in the Integration Service installation directory. The Integration Service searches this file and places quotes around reserved words when it executes SQL against source, target, and lookup databases.
resilience

The ability for PowerCenter services to tolerate transient network failures until either the resilience timeout expires or the external system failure is fixed.
resilience timeout

The amount of time a client attempts to connect or reconnect to a service. A limit on resilience timeout can override the resilience timeout. See limit on resilience timeout on page 443.
resource provision thresholds

Computing thresholds defined for a node that determine whether the Load Balancer can dispatch tasks to the node. The Load Balancer checks different thresholds depending on the dispatch mode.
round-robin dispatch mode

A dispatch mode in which the Load Balancer dispatches tasks to available nodes in a roundrobin fashion up to the Maximum Processes resource provision threshold.

S
safe mode

Operating mode for the Integration Service. When you run the Integration Service in safe mode, only repository users with privilege to administer the Integration Service can run and get information about sessions and workflows. A subset of the high availability features are available in safe mode.
SAP BW Service

An application service that listens for RFC requests from SAP BW and initiates workflows to extract from or load to SAP BW.
service level

A domain property that establishes priority among tasks that are waiting to be dispatched. When multiple tasks are waiting in the dispatch queue, the Load Balancer checks the service

PowerCenter Glossary Terms

447

level of the associated workflow so that it dispatches high priority tasks before low priority tasks.
Service Manager

A service that manages all domain operations. It runs on all nodes in the domain to support the application services and the domain. When you start Informatica Services, you start the Service Manager. If the Service Manager is not running, the node is not available.
service mapping

A mapping that processes web service requests. A service mapping can contain source or target definitions imported from a Web Services Description Language (WSDL) file containing a web service operation. It can also contain flat file or XML source or target definitions.
service process

The runtime representation of a service running on a node.

service workflow

A workflow that contains exactly one web service input message source and at most one type of web service output message target. Configure service properties in the service workflow.
session recovery

The process that the Integration Service uses to complete failed sessions. When the Integration Service runs a recovery session that writes to a relational target in normal mode, it resumes writing to the target database table at the point at which the previous session failed. For other target types, the Integration Service performs the entire writer run again.
source pipeline

A source qualifier and all of the transformations and target instances that receive data from that source qualifier.
stage

See pipeline stage on page 445.

state of operation

Workflow and session information the Integration Service stores in a shared location for recovery. The state of operation includes task status, workflow variable values, and processing checkpoints.
static deployment group

A deployment group that you must manually add objects to. See also deployment group on page 440.

448

Appendix B: Glossary

T
target load order group

The collection of source qualifiers, transformations, and targets linked together in a mapping.
task release

A process the Workflow Monitor uses to remove older tasks from memory so you can monitor an Integration Service in online mode without exceeding memory limits.
transaction

A set of rows bound by commit or rollback rows.

transaction boundary

A row, such as a commit or rollback row, that defines the rows in a transaction. Transaction boundaries originate from transaction control points.
transaction control

The ability to define commit and rollback points through an expression in the Transaction Control transformation and session properties.
transaction control point

A transformation that defines or redefines the transaction boundary by dropping any incoming transaction boundary and generating new transaction boundaries.
Transaction Control transformation

A transformation used to define conditions to commit and rollback transactions from relational, XML, and dynamic IBM MQSeries targets.
transaction control unit

The group of targets connected to an active source that generates commits or an effective transaction generator. A transaction control unit may contain multiple target connection groups.
transaction generator

A transformation that generates both commit and rollback rows. Transaction generators drop incoming transaction boundaries and generate new transaction boundaries downstream. Transaction generators are Transaction Control transformations and Custom transformation configured to generate commits.

PowerCenter Glossary Terms

449

U
user-defined commit

A commit strategy that the Integration Service uses to commit and roll back transactions defined in a Transaction Control transformation or a Custom transformation configured to generate commits.
user-defined property

A user-defined property is metadata you define, such as metadata extensions you define in PowerCenter. You can create user-defined properties in business intelligence, data modeling, or OLAP tools, such as IBM DB2 Cube Views or PowerCenter, and exchange the metadata between tools using the Metadata Export Wizard and Metadata Import Wizard.
user-defined resource

A resource that you define, such as a file directory or a shared library you want to make available to services.

V
version

Any one of multiple copies of a versioned object stored in the repository. The repository uses version numbers to differentiate versions.
versioned object

Any object that you can store multiple versions of in a repository enabled for version control.
view root

The element in an XML view that is a parent to all the other elements in the view.
view row

The column in an XML view that triggers the Integration Service to generate a row of data for the view in a session.

W
Web Services Hub

An application service that receives requests from web service clients. The Web Services Hub exposes workflows as services.

450

Appendix B: Glossary

worker node

Any node not configured to serve as a gateway. A worker node can run application services, but cannot serve as a master gateway node.
Workflow Wizard

A wizard that creates a workflow with a Start task and sequential Session tasks based on the mappings you choose.

X
XML group

A set of ports in an XML definition that defines a row of incoming or outgoing data. An XML view becomes a group in a PowerCenter definition.
XML view

A portion of any arbitrary hierarchy in an XML definition. An XML view contains columns that are references to the elements and attributes in the hierarchy.

PowerCenter Glossary Terms

451

452

Appendix B: Glossary

Index

A
Abort option to disable Integration Service 168 option to disable Integration Service process 167 option to disable the Web Services Hub 266 active sources definition 438 adaptive dispatch mode definition 438 description 241 overview 206 Administration Console Administration tab 17 backing up repositories 142 Domain tab 15, 20 logging in 13 Logs tab 16 Manage Account tab 17 Navigator 19 overview 32 repository notifications, sending 141 restoring repositories 143 tabs, viewing 14 tasks for Web Services Hub 262 viewing logs 315 Administration Console (SAP) configuring SAP BW Service 253

Administration tab Administration Console 17 administrator changing password 67 PowerCenter domain 67 advanced properties Integration Service 180 Web Services Hub 267, 269 AggregateTreatNullsAsZero option 184 option override 184 AggregateTreatRowsAsInsert option 184 option override 184 Aggregator transformation caches 221, 226 treating nulls as zero 184 treating rows as insert 184 alerts configuring 33 description 4 managing 33 notification email 35 subscribe to 34 tracking 35 viewing 35 allow writes with repository agent caching description 117

453

application service process disabling 39 enabling 39 failed status 39 port assignment 6 standby status 39 status 39 stopped status 39 application services assigning a license 282 configuring resilience 93 definition 438 description 6 disabling 39 enabling 39 overview 24 removing 42 unassigning a license 284 Web Services Hub 26 Application sources code page 342 Application targets code page 343 ASCII mode See also Installation and Configuration Guide See also Unicode mode overview 222, 333 setting ASCII data movement mode 179 associated repository adding to Wed Services Hub 271 editing for Wed Services Hub 273 Manage List option 191 associated Repository Service for new Integration Service 165 Web Services Hub 264, 272, 273 audit trails creating 159 authentication log events 323 switching methods 157 authorization log events 323 auto-select network high availability 104 available resource definition 438

B
backing up domain configuration database 56 list of backup files 143 performance 160 repositories 142 backup directory node property 47 backup node configuring node assignment 178 definition 438 for new Integration Service 165 license requirement 178 BackupDomain command description 56 baseline system CPU profile 248 basic dispatch mode overview 206 binary exporting logs in 311 blocking definition 216, 438 blocking source data Integration Service handling 216 buffer memory buffer blocks 220 DTM process 220 BW Monitor (SAP) log messages 260

C
cache files directory 195 overview 226 permissions 223 cache partitioning definition 439 caches default directory 226 memory 221 memory usage 221 overview 223 transformation 226 case study processing ISO 8859-1 data 353 processing Unicode UTF-8 data 357 catalina.out troubleshooting 307

454

Index

category domain log events 323 category name domain log events 322 certificate keystore file 264, 268 character data sets See also Designer Guide handling options for Microsoft SQL Server and PeopleSoft on Oracle 185 character encoding Web Services Hub 268 character sizes double byte 337 multibyte 337 single byte 337 child dependency definition 439 child object definition 439 classpaths Java SDK 196 ClientStore option 182 code page relaxation configuring the Integration Service 349 data inconsistencies 348 overview 348 selecting compatible code pages 349 troubleshooting 349 code page validation overview 346 relaxed validation 348 code pages Application sources 342 Application targets 343 character loss during conversions 387 choosing 337 compatibility 369 compatibility diagram 344 compatibility overview 339 conversion 351 converting from IBM EBCDIC Japanese to JapanEUC 428 converting from IBM EBCDIC Japanese to MS Shift JIS 434 converting from IBM EBCDIC US English to Latin1 389 converting from JapanEUC to IBM EBCDIC Japanese 429 converting from JapanEUC to MS Shift JIS 423

converting from Latin1 to IBM EBCDIC US English 390 converting from Latin1 to MS Latin1 388 converting from MS Latin1 to Latin1 388 converting from MS Shift JIS to IBM EBCDIC Japanese 435 converting from MS Shift JIS to JapanEUC 420 Custom transformations 345 data movement modes 222 External Procedure transformations 345 flat file sources 342 flat file targets 343 for Integration Service process 192 global repository 133 Integration Service process 341 lookup database 345 overview 336 pmcmd 341 PowerCenter Client 341 reference 365 related languages 365 related sort orders 365 related territories 365 relational sources 342 relational targets 343 relaxed validation for sources and targets 348 repository 342 sort order overview 341 stored procedure database 345 supported code pages 362 UNIX 336 validation 209, 346 validation for sources and targets 188 verifying compatibility 375 Windows 337 Codepage option for Integration Service process 195 command line programs configuring resilience 93 comments required for checkin description 116 commit source definition 439 compatibility between code pages 339, 369 between source and target code pages 349 compatibility properties Integration Service 183 compatible defined for code page compatibility 339

Index

455

compatible version definition 439 Complete option to disable Integration Service 168 option to disable Integration Service process 167 composite objects definition 439 configuration properties Integration Service 186 connect string examples 111 repository database 115 syntax 111 connection resources assigning 236 connection timeout high availability 83 connections See user connections connectivity See also Installation and Configuration Guide connect string examples 111 overview 200 control file overview 225 permissions 223 conversions IBM EBCDIC Japanese to JapanEUC code pages 428 IBM EBCDIC Japanese to MS Shift JIS code pages 434 IBM EBCDIC US English to Latin1 code pages 389 JapanEUC to IBM EBCDIC Japanese code pages 429 JapanEUC to MS Shift JIS code pages 423 Latin1 to IBM EBCDIC US English code pages 390 Latin1 to MS Latin1 code pages 388 MS Latin1 to Latin1 code pages 388 MS Shift JIS to IBM EBCDIC Japanese code pages 435 MS Shift JIS to JapanEUC code pages 420 CPU logical 296 CPU Profile node property 47 CPU profile computing 248 definition 439 description 248 CPU usage calculation 296 description 294 Integration Service 220

CPU Usage Analysis chart description 297 CPU Usage Per Day table description 297 CPU Usage Per Node table description 298 CPU Usage Per Service table description 298 CreateIndicatorFiles option 186 creating grid 231 session logs 209 custom properties displaying 76 domain 60 Integration Service 176 Integration Service process 196 Repository Service 118 Repository Service process 119 Web Services Hub 267, 270 custom resources defining 237 naming conventions 238 Custom transformation definition 439 directory for Java components 193 Custom transformation procedures definition 440 Custom XML view definition 440

D
data caches memory usage 221 data handling setting up prior version compatibility 185 data movement mode See also ASCII mode See also Installation and Configuration Guide See also Unicode mode ASCII 333 changing 334 definition 333 effect on session files and caches 334 for Integration Service 165 option 179 overview 222, 333 setting 179 Unicode 333

456

Index

database domain configuration 55 repositories, creating for 107 database array operation size description 115 database connection resilience 98 updating for domain configuration 60 database connection timeout description 115 database pool expiry threshold description 117 database pool expiry timeout description 118 database pool size description 115 database resilience domain configuration 84 Integration Service 84 Lookup transformation 84 repository 84, 96 sources 84 targets 84 DateDisplayFormat option 188 DateHandling40Compatibility option 185 dates default format for logs 188 DB2 See IBM DB2 deadlock retries setting number 185 DeadlockSleep option 185 Debug error severity level 181, 269 Debugger running 181 dependent objects definition 440 deployment groups definition 440 deterministic output definition 440 directories cache files 195 external procedure files 195 for Java components 193 lookup files 195 recovery files 196

reject files 195 root directory 195 session log files 195 source files 195 target files 195 temporary files 195 workflow log files 195 disable mode services and service processes 39 disabling Integration Service 168 Integration Service process 167 Web Services Hub 266 dispatch mode configuring 241 Load Balancer 206 dispatch priority configuring 244 dispatch queue creating service levels 244 overview 204 dispatch wait time configuring 244 domain See also PowerCenter domains See also repository domains associated repository for Web Services Hub 264, 272, 273 log event categories 323 restarting 54 shutting down 54 Domain Activity Monitoring report CPU usage 294, 296 description 294 license 295 Repository Service usage 294, 300 running 295 time period 295 domain administrator changing password 67 changing user name 67 description 67 domain alerts See alerts domain configuration description 55 log events 323

Index

457

domain configuration database backing up 56 connection for gateway node 60 description 55 migrating 57 restoring 56 tables 55 domain permissions assigning 73 inherited 72 managing 72 object 72 domain privileges Administration Console full 74 Administration Console read-only 74 Domain tab Administration Console 15, 20 domain user description 67 domains See PowerCenter domains See also repository domains DTM (Data Transformation Manager) buffer memory 220 distribution on grids 218 master DTM 218 post-session email 203 preparer DTM 218 process 208 worker DTM 218 DTM timeout Web Services Hub 269 dynamic deployment groups definition 440 dynamic partitioning definition 441

environment variables Integration Service process 196 LANG_C 336 LC_ALL 336 LC_CTYPE 336 NLS_LANG 354, 358 Repository Service process 120 Error severity level 181, 269 error logs messages 224 Error Severity Level advanced Web Services Hub property 269 description 116 option 181 exclusive mode See operating mode definition 441 ExportSessionLogLibName option 187 external procedure files directory 195 external resilience description 84

F
failover definition 441 Repository Service 97 safe mode 173 services 84 file/directory resources defining 237 naming conventions 238 filtering data (SAP) parameter file location 259 flat files exporting logs 313 output files 226 source code page 342 target code page 343 folders Administration Console 36 creating 36, 37 managing 36 moving objects 37 overview 23 removing 37

E
effective Transaction Control transformation definition 441 effective transaction generator definition 441 enabling Integration Service 169 Integration Service process 167 Web Services Hub 266 encoding Web Services Hub 268

458

Index

FTP achieving high availability 104 connection resilience 84 server resilience 98 FTP connections resilience 98

groups definition 442 Guaranteed Message Delivery files Log Manager 306

H
heartbeat interval description 117 high availability backup nodes 88 base product 86 definition 442 described 82 environment, configuring 88 example configurations 88 external connection timeout 83 external systems 88, 90 Informatica Services 88 Integration Service 98 licensed option 176, 178 multiple gateways 88 recovery 85 recovery in base product 86, 87 Repository Service 96 Repository Service failover 97 Repository Service recovery 97 Repository Service resilience 96 Repository Service restart 97 resilience 83, 92 resilience in base product 86 restart in base product 86 rules and guidelines 90 safe mode 173 SAP BW services 88 TCP KeepAlive timeout 104 Web Services Hub 88 high availability option configuring service processes 124 host name Web Services Hub 264, 268 host port number Web Services Hub 264, 268 HTTP proxy domain setting 189 password setting 189 port setting 189 server setting 189 user setting 189 HTTP proxy properties Integration Service 188
Index 459

G
gateway definition 441 resilience 83 gateway node configuring 52 description 3 log directory 52 logging 307 general properties Integration Service 178 Integration Service process 194 Web Services Hub 267, 268 global object definition 441 global repositories code page 133 creating 132 creating from local repositories 133 moving to another PowerCenter domain 136 globalization overview 328 GMD files See Guaranteed Message Delivery files graphics display server requirement 295 grid Administration Console tabs 29 assigning to an Integration Service 232 configuring 231 creating 231 definition 230 description 217 distributing service processes 217 distribution of DTM processes 218 for new Integration Service 164 license requirement 176 permissions 231 grid assignment properties Integration Service 176 grid object definition 441

HTTP proxy server usage 188 HttpProxyDomain option 189 HttpProxyPassword option 189 HttpProxyPort option 189 HttpProxyServer option 189 HttpProxyUser option 189 HTTPS keystore file 264, 268

I
IBM DB2 connect string example 111 IgnoreResourceRequirements option 181 incompatible object definition 442 incremental aggregation See also Installation and Configuration Guide files 227 incremental keys licenses 279 index caches memory usage 221 indicator files description 226 session output 226 ineffective Transaction Control transformation definition 442 ineffective transaction generator definition 442 Informatica Services restart 86 Information and Content Exchange (ICE) log files 313 Information error severity level description 181, 269 inherited permission description 72 input locales configuring 331

Integration Service Administration Console tabs 24 advanced properties 180 architecture 198 assign to grid 164, 232 assign to node 164 associated repository 190 associating a Repository Service 163 blocking data 216 clients 98 compatibility and database properties 183 configuration properties 186 configuring export session log lib name 187 configuring properties 176 connectivity overview 200 creating 163 creating logs 209 custom properties 176 data movement mode 165, 179 data movement modes 222 date display format 188 definition 442 disable process with Abort option 167 disable process with Stop option 167 disable with Abort option 168 disable with Complete option 168 disable with Stop option 168 disabling 168 enabling 169 fail over in safe mode 170 failover, on grid 102 general properties 178 grid and node assignment properties 176 high availability 98 HTTP proxy properties 188 log events 324 logs in UTF-8 182 name 164 normal operating mode 171 operating mode 170 output files 226 performance 117 performance details 224 post-session email 203 process 201 processing data 215 reading sources 215 recovery 85, 103 resilience 98 resilience period 181 resilience timeout 181

460

Index

resilience to database 84 running in safe mode 171 safe operating mode 170 scheduling workflows 201 session recovery 102 shared storage 192 state of operations 85, 103 system resources 220 validating code pages 209 workflow recovery 103 Integration Service process $PMBadFileDir 195 $PMCacheDir 195 $PMExtProcDir 195 $PMLookupFileDir 195 $PMRootDir 195 $PMSessionLogDir 195 $PMSourceFileDir 195 $PMStorageDir 196 $PMTargetFileDir 195 $PMTempDir 195 $PMWorkflowLogDir 195 code page 192, 341 custom properties 196 disable with Complete option 167 disabling 167 enabling 167 environment variables 196 general properties 194 Java component directories 193 specifying code page 195 Integration Service process nodes license requirement 176 Integration Services selecting Repository Service from other domain 190 internal host name Web Services Hub 264, 268 internal port number Web Services Hub 264, 268 internal resilience description 83

Java transformation directory for Java components 193 JCEProvider option 182 Joiner transformation caches 221, 226 setting up for prior version compatibility 184 JoinerSourceOrder6xCompatibility option 184

K
keystore file Web Services Hub 264, 268

L
labels definition 443 LANG_C environment variable setting locale in UNIX 336 language code page reference 365 LC_ALL environment variable setting locale in UNIX 336 LDAP authentication module configuring 151 LDAP security module registering 154 unregistering 156 license Administration Console tabs 30 assigning to a service 282 creating 280 for new Integration Service 164 keys 279 license file 280 log events 323, 324 removing 286 unassigning from a service 284 updating 285 validation 276 viewing details 287 Web Services Hub 264, 268 license details viewing 287 license keys incremental 279, 285 original 279

J
Java SDK class path 196 maximum memory 196 minimum memory 196 Java SDK Class Path option 196

Index

461

license usage Domain Activity Monitoring report 295 log events 323 monitoring 294 licensed options high availability 176, 178 server grid 176 licensing log events 324 Licensing logs log events 277 limit on resilience timeout definition 443 description 117 linked domain definition 443 multiple domains 61 LMAPI resilience 84 Load Balancer assigning priorities to tasks 207, 244 computing CPU profile 248 configuring dispatch mode 241 configuring to check resources 181, 205, 247 creating service levels 244 defining resource provision thresholds 249 definition 443 dispatch mode 206 dispatch queue 204 dispatching tasks in a grid 205 dispatching tasks on a single node 205 overview 204 resource provision thresholds 206 resources 205, 234 service levels 207 settings, configuring 240 load balancing SAP BW Service 252 support for BW system 252 LoadManagerAllowDebugging option 181 local domain definition 443 local repositories moving to another PowerCenter domain 136 promoting 133 registering 134

locales overview 331 localhost_<date>.txt troubleshooting 307 Log Agent log events 323 log directory configuring location 309 for gateway node 52 log event detailer description 320 log event files defined 306 exporting 311 purging 310 log events authentication 323 authorization 323 code 322 components 322 defined 306 domain 323 domain configuration 323 domain function categories 322 exporting 311 licensing 323, 324 Licensing logs 277 licensing usage 323 Log Agent 323 Log Manager 323 message 322 message code 322 node 323 node configuration 323 Repository Service 324 saving 320 searching 318 security audit trail 324 Service Manager 323 service name 322 severity levels 323 thread 323 time zone 314 timestamps 323 viewing 315 viewing details 316 Web Services Hub 325

462

Index

Log Manager architecture 306 catalina.out 307 configuring 314 configuring directory location 309 definition 443 domain log events 323 exporting log events 311 Integration Service log events 324 log event components 322 log events 323 message 322 message code 322 node 323 node.log 307 ProcessID 322 purge properties 310 purging log events 310 recovery 307 Repository Service log events 324 SAP BW log events 324 saving log events 320 searching log events 318 security audit trail 324 service name 322 severity levels 323 thread 323 time zone 314 timestamp 323 troubleshooting 307 using 304 viewing logs 315 Log Viewer access privileges 315 configuring columns 319 error message link 321 log event detailer 320 saving log events 320 searching log events 318 viewing log event details 316 logical CPU description 296 logs See also log events components 322 domain 323 error severity level 181 exporting 311 in UTF-8 182 Integration Service 324 location 309

purging 310 Repository Service 324 SAP BW Service 324 saving 320 searching 318 session 224 viewing 315 workflow 223 Logs tab Administration Console 16 LogsInUTF8 option 182 lookup caches See also Transformation Guide persistent 227 lookup databases code pages 345 lookup files directory 195 Lookup transformation caches 221, 226 database resilience 84

M
Manage Account tab Administration Console 17 Manage List adding linked domains 61 option for associated repository 191 mapping threads description 212 mappings definition 443 master gateway resilience to domain configuration database 84 master gateway node description 3 master service process definition 217, 444 master thread description 211 Max Lookup SP DB Connections option 185 Max MSSQL Connections option 185 Max Sybase Connections option 185 MaxConcurrentRequests advanced Web Services Hub property 269

Index

463

maximum connections description 117 Maximum CPU Run Queue Length node property 48, 249 maximum dispatch wait time configuring 244 maximum locks description 117 Maximum Memory Percent node property 48, 249 Maximum Processes node property 48, 249 Maximum Restart Attempts PowerCenter domain property 42 MaxLMConnections Web Services Hub 269 MaxQueueLength advanced Web Services Hub property 269 memory DTM buffer 220 maximum for Java SDK 196 minimum for Java SDK 196 message code Log Manager 322 metadata adding to repository 351 choosing characters 351 metadata explosion definition 444 metric-based dispatch mode definition 444 description 241 Microsoft SQL Server connect string syntax 111 setting Char handling options 185 mode See data movement mode mode configuration log events 323 monitoring user activity 77 MSExchangeProfile option 187 multibyte data entering in PowerCenter Client 332

N
native connect string See connect string

Navigator Administration Console 19 network high availability 104 NLS_LANG setting locale 354, 358 node assignment Integration Service 176 Web Services Hub 267, 268 node configuration file location 45 node properties backup directory 47 CPU Profile 47 maximum CPU run queue length 48, 249 maximum memory percent 48, 249 maximum processes 48, 249 node.log troubleshooting 307 nodemeta.xml for gateway node 52 location 45 nodes adding to Administration Console 44 Administration Console tabs 28 configuring 46 configuring node assignment 178 defining 44 definition 444 description 2 gateway 52 Log Manager 323 managing 43 port number 47 removing 51 removing host name and port number 46 shutting down 49 starting 49 Web Services Hub 264 normal mode See operating mode configuring for Integration Service 174 definition 444 Integration Service 171 normalized view, definition 444 notifications sending 141 NumOfDeadlockRetries option 185

464

Index

O
object permission description 72 object queries definition 444 one-way mappings definition 444 open transaction definition 444 operating mode configuring for Integration Service 174, 175 definition 445 effect on resilience 94, 127 Integration Service 170 normal mode for Integration Service 170 Repository Service 126 safe mode for Integration Service 170 Oracle connect string syntax 111 setting locale with NLS_LANG 354, 358 original keys licenses 279 output files overview 223, 226 permissions 223 OutputMetaDataForFF option 186

P
parent dependency definition 445 parent objects definition 445 partitioning See pipeline partitioning pass-through pipeline overview 211 passwords changing for domain administrator 67 changing for users 76 PeopleSoft on Oracle setting Char handling options 185 performance details 224 Integration Service 117 repository copy, backup, and restore 160 Repository Service 116 performance detail files permissions 223

permissions See also domain permissions output and log files 223 recovery files 223 Repository Service 106, 122 persistent lookup cache session output 227 pipeline branch definition 445 pipeline partitioning multiple CPUs 213 overview 213 symmetric processing platform 220 pipeline stage definition 445 plug-ins registering 148 $PMBadFileDir option 195 $PMCacheDir option 195 pmcmd See also Command Line Reference code page issues 341 communicating with Integration Service 341 $PMExtProcDir option 195 $PMFailureEmailUser option 179 $PMLookupFileDir option 195 pmrepagent See Repository Service process $PMRootDir description 194 option 195 required syntax 194 shared location 192 PMServer3XCompatibility option 184 $PMSessionErrorThreshold option 180 $PMSessionLogCount option 180 $PMSessionLogDir option 195 $PMSourceFileDir option 195 $PMStorageDir option 196

Index

465

$PMSuccessEmailUser option 179 $PMTargetFileDir option 195 $PMTempDir option 195 $PMWorkflowLogCount option 180 $PMWorkflowLogDir option 195 port application service 6 node 47 node maximum 47 node minimum 47 range for service processes 47 port dependencies definition 445 post-session email configuring Microsoft Exchange profile 187 overview 226 post-session threads description 212 PowerCenter Client code page 341 entering multibyte characters 332 resilience 93 PowerCenter Connect for JMS directory for Java components 193 PowerCenter Connect for Web Services directory for Java components 193 PowerCenter Connect for webMethods directory for Java components 193 PowerCenter domains administrator 67 alerts 33 configuring resilience 92 definition 445 description 2 linking domains 61 managing users 69 multiple domains 61 refreshing 63 resilience 83, 92 state of operations 85 users 67 PowerCenter resource definition 445 predefined resource definition 445

preserve MX data description 118 pre-session threads description 212 primary node configuring node assignment 178 definition 446 for new Integration Service 165 privileges See also domain privileges Log Viewer 315 process identification number Log Manager 322 ProcessID Log Manager 322 message code 322 purge properties Log Manager 310 pushdown group definition 446 pushdown optimization definition 446

R
Rank transformation caches 221, 226 reader threads description 212 reading sources 215 recovery base product 87 definition 446 files, permissions 223 high availability 85 Integration Service 85, 103 PowerCenter Connect for IBM MQSeries 87 Repository Service 85, 97 safe mode 173 workflow and session, manual 87 recovery files directory 196 refresh PowerCenter domains 63 registering local repositories 134 plug-ins 148

466

Index

reject files directory 195 overview 225 permissions 223 relaxed code page validation See code page relaxation removing services application services 42 repagent caching description 117 repeatable data definition 446 repositories associated with Integration Service 190 associated with Web Services Hub 271 backing up 142 backup directory 47 code pages 133, 342 creating content 128 database, creating a 107 deleting content 128 notifications 141 overview of creating 106 performance 160 restoring 143 security log file 159 Unicode 329 UTF-8 329 repository agent cache capacity description 117 repository client application definition 446 repository domains definition 446 description 132 managing 132 moving to another PowerCenter domain 136 prerequisites 132 viewing registered repositories 135 repository locks releasing 139 viewing 137 repository metadata choosing characters 351 repository notifications sending 141

Repository Password option 191 Repository Service Administration Console tabs 25 associating with a Web Services Hub 263 associating with Integration Service 163 creating 106, 108 definition 446 enabling and disabling 123 failover 97 high availability 96 log events 324 operating mode 126 performance 116 permissions 106, 122 properties 112 recovery 85, 97 resilience 96 resilience to database 84, 96 restart 97 service process 124 state of operations 85, 97 Repository Service process description environment variables 120 Repository Service usage description 294 Repository Service Usage Analysis chart description 300 Repository Service Usage Analysis table description 301 Repository User Name associated repository for Web Services Hub 264, 272, 273 option 191 repository user password associated repository for Web Services Hub 264, 272, 273 request-response mappings definition 446 required resource definition 447 reserved words file definition 447

Index

467

resilience application service configuration 93 base product 86 command line program configuration 93 definition 447 domain configuration 92 domain configuration database 84 domain properties 83 external 84 external components 98 external connection timeout 83 FTP connections 84 gateway 83 high availability 83, 92 in exclusive mode 94, 127 Integration Service 98 internal 83 LMAPI 84 managing 92 period for Integration Service 181 PowerCenter Client 93 repository database 84, 96 Repository Service 96 services 83 services in base product 86 TCP KeepAlive timeout 104 Resilience Timeout definition 447 description 117 option 181 resource provision thresholds defining 249 definition 447 description 249 overview 206 setting for nodes 48 resources assigning connection 236 configuring Load Balancer to check 181, 205, 247 defining custom 237 defining file/directory 237 defining for nodes 234 Load Balancer 205 naming conventions 238 node 205 predefined 234 user-defined 234 viewing for nodes 236 restart Informatica Services, automatic 86 Repository Service 97

services 84 restoring domain configuration database 56 repositories 143 root administrator description 67 root directory process variable 195 round-robin dispatch mode definition 447 description 241 row error log files permissions 223

S
safe mode configuring for Integration Service 174 definition 447 high availability 173 Integration Service 170 SAP BW Service Administration Console tabs 26 associated Integration Service 258 creating 253 definition 447 disabling 255 enabling 255 log events 324 managing 252 viewing log events 260 SAP BW Service log viewing 260 saprfc.ini (SAP) DEST 254 security creating an audit trail 159 viewing an audit trail 324 security module restoring repositories with 143 SecurityAuditTrail logging activities 159 server grid licensed option 176 service levels creating and editing 244 definition 447 description 244 overview 207

468

Index

Service Manager definition 448 description 4 log events 323 service mapping definition 448 service name log events 322 Web Services Hub 264 service process definition 448 distribution on a grid 217 viewing status 48 service process variables list of 193 service variables list of 179 service workflow definition 448 services failover 84 resilience 83 restart 84 session logs creation 209 directory 195 overview 224 permissions 223 session details 224 session output cache files 226 control file 225 incremental aggregation files 227 indicator file 226 performance details 224 persistent lookup cache 227 post-session email 226 reject files 225 session logs 224 target output file 226 session recovery definition 448 SessionExpiryPeriod Web Services Hub 269 sessions caches 223 DTM buffer memory 220 output files 223 performance details 224 session details file 224 sort order 341

severity log events 323 shared storage Integration Service 192 state of operations 192 shutting down domain 54 nodes 49 SMTP configuring for alerts 33 sort order code page 341 code page reference 365 source databases code page 342 source files directory 195 source pipeline definition 448 pass-through 211 reading 215 target load order groups 215 sources database resilience 84 reading 215 starting nodes 49 state of operations domain 85 Integration Service 85, 103, 192 Repository Service 85, 97 shared location 192 static deployment group definition 448 Stop option disable Integration Service 168 disable Integration Service process 167 disable the Web Services Hub 266 stopping domain 54 stored procedures code pages 345 subset defined for code page compatibility 339 superset defined for code page compatibility 339 Sybase SQL Server connect string example 111 symmetric processing platform pipeline partitioning 220

Index

469

system locales definition 331

T
table owner name description 115 tablespace name for repository database 115 target databases code page 343 target files directory 195 target load order group definition 449 mappings 215 targets database resilience 84 output files 226 viewing session detail 224 task release definition 449 tasks assigning dispatch priorities 207, 244 dispatching 204 TCP KeepAlive timeout high availability 104 temporary files directory 195 territory code page reference 365 thread identification Log Viewer 323 threads creation 210, 211 Log Manager 323 mapping 211 master 211 post-session 211 pre-session 211 reader 211 transformation 211 types 212 writer 211 time zone Log Manager 314 timestamps Log Manager 323 Tracing error severity level 181, 269

transaction definition 449 transaction boundary definition 449 transaction control definition 449 transaction control point definition 449 Transaction Control transformation definition 449 transaction control unit definition 449 transaction generator definition 449 transformation threads description 213 TreatCHARAsCHAROnRead setting for Microsoft SQL Server and PeopleSoft on Oracle 185 TreatDBPartitionAsPassThrough option 187 TreatNullInComparisonOperatorsAs option 187 troubleshooting catalina.out 307 code page relaxation 349 localhost_<date>.txt 307 node.log 307 trusted connection description 116 TrustStore option 182

U
UCS-2 definition 329 Unicode repositories 329 UCS-2 329 UTF-8 329 Unicode mode See also ASCII See also Installation and Configuration Guide code pages 222 overview 333 setting Unicode data movement mode 179 UNIX environment variables LANG_C 336 LC_ALL 336 LC_CTYPE 336

470

Index

unregistering local repositories 135 Upgrade Wizard displaying 77 URL scheme Web Services Hub 264, 268 User Activity Monitoring description 78 user connections closing 139 managing 137 viewing 138 user locales definition 331 user names changing for domain administrator 67 user preferences configuring 18 setting 76 user-defined commit definition 450 user-defined property definition 450 user-defined resource definition 450 users adding to domain 69 domain administrator 67 domain user 67 editing in a domain 71 PowerCenter domain 67 profile 76 removing from a domain 71 root administrator 67 sending notifications 141 UTF-8 definition 329 repository 342 writing logs 182

versioned object definition 450 versions definition 450 view root definition 450 view row definition 450

W
Warning error severity level 181, 269 Web Services Hub See also PowerCenter Web Services Provider Guide adding associated repository 271 advanced properties 267, 269 application service 8, 26 associated repository 271 associated Repository Service 264, 272, 273 associating a Repository Service 263 character encoding 268 configuring properties 267 creating 263 custom properties 267, 270 definition 450 disable with Abort option 266 disable with Stop option 266 disabling 266 domain for associated repository 264, 272, 273 DTM timeout 269 editing associated repository 273 enabling 266 general properties 267, 268 host name 264, 268 host port number 264, 268 internal host name 264, 268 internal port number 264, 268 keystore file 264, 268 license 264, 268 location 264 log events 325 MaxLMConnections 269 node 264 node assignment 267, 268 selecting repository from other domain 272, 273 selecting Repository Service from other domain 271 service name 264 SessionExpiryPeriod 269 tasks on Administration Console 262 URL scheme 264, 268
Index 471

V
ValidateDataCodePages option 188 validating code pages 346 licenses 276 source and target code pages 188 version control enabling 131

user name for associated repository 264, 272, 273 user password for associated repository 264, 272, 273 Within Restart Period PowerCenter domain property 42 worker node configuring as gateway 52 definition 451 description 3 worker service process definition 217 workflow log files directory 195 workflow logs append timestamp 181 creation 202 overview 223 permissions 223 workflow output email 226 workflow logs 223 workflow schedules safe mode 172 Workflow wizard definition 451 workflows locking 201 parameter file 202 writer threads description 213 WriterWaitTimeOut option 187

X
X Virtual Frame Buffer for Domain Activity Monitoring report 295 XML exporting logs in 313 XML group definition 451 XML view definition 451 XMLWarnDupRows option 186

Z
ZPMSENDSTATUS (SAP) log messages 260

472

Index