Introduction to Data Mining with Case Studies

Introduction to
Data Mining
with
Case Studies
THIRD EDITION

G.K. GUPTA
Adjunct Professor of Computer Science
Monash University
Clayton, Australia

Delhi-110092
2014


INTRODUCTION TO DATA MINING WITH CASE STUDIES, Third Edition

G.K. Gupta

2014 by PHI Learning Private Limited, Delhi. All rights reserved. No part of this book
may be reproduced in any form, by mimeograph or any other means, without permission
in writing from the publisher.

ISBN-978-81-203-5002-1

The export rights of this book are vested solely with the publisher.

Eighth Printing (Third Edition) ... ... July, 2014

Published by Asoke K. Ghosh, PHI Learning Private Limited, Rimjhim House, 111, Patparganj
Industrial Estate, Delhi-110092 and Printed by Baba Barkha Nath Printers, Bahadurgarh,
Haryana-124507.
 To
the memory of
Professor C.S. Wallace
Foundation Professor and Head
Department of Computer Science
Monash University
26 October 19337 August 2004
 Contents

Preface xiii
Preface to the Second Edition xv
Preface to the First Edition xvii

Chapter 1 INTRODUCTION 160

Learning Objectives 1
1.1 Introduction1
Chapter Overview 2
1.2 What is Data Mining? 3
1.3 Why Data Mining Now? 4
1.4 The Data Mining ProcessSoftware Development Approach 10
1.5 The Data Mining ProcessThe CRISP-DM Approach 11
1.6 Data Mining Applications 15
1.7 Data Mining Techniques 18
1.8 Practical Examples of Data Mining 21
1.9 The Future of Data Mining 28
1.10 Guidelines for Successful Data Mining 29
1.11 Limitations of Data Mining 30
1.12 Using WEKA Software in Class 31
1.13 Data Mining Software 31
Summary34
Review Questions35
Exercises35
Multiple Choice Questions36
Bibliography 38
Case Study 1A Data Mining Techniques for Optimizing Inventories for Electronic Commerce 41
Case Study 1B Crime Data Mining: A General Framework and Some Examples 52
vii
viii Contents

Chapter 2 DATA UNDERSTANDING AND DATA PREPARATION 6190

Learning Objectives 61
2.1 Introduction61
Chapter Overview62
2.2 Data Collection and Pre-processing62
2.3 Outliers70
2.4 Mining Outliers72
2.5 Missing Data74
2.6 Types of Data75
2.7 Computing Distance77
2.8 Data Summarising Using Basic Statistical Measurements79
2.9 Displaying Data Graphically82
2.10 Multidimensional Data Visualisation85
Summary85
Review Questions85
Exercises86
Multiple Choice Questions87
Bibliography90

Chapter 3 ASSOCIATION RULES MINING 91151

Learning Objectives 91
3.1 Introduction91
Chapter Overview92
3.2 Basics92
3.3 The Task and a Nave Algorithm 94
3.4 The Apriori Algorithm 97
3.5 Improving the Efficiency of the Apriori Algorithm 110
3.6 Apriori-TID111
3.7 Direct Hashing and Pruning (DHP) 114
3.8 Dynamic Itemset Counting (DIC) 117
3.9 Mining Frequent Patterns without Candidate Generation (FPGrowth) 118
3.10 Performance Evaluation of Algorithms 123
Summary123
Review Questions124
Exercises125
Multiple Choice Questions127
Project 1Using ARM for Table 1.1129
Project 2Designing a Shopping Mall 129
Project 3Distributed ARM130
Bibliography131
Rakesh AgrawalInventor of Association Rules Mining133
Case Study 3 Mining Customer Value: From Association Rules to
Direct Marketing 134
 Contentsix

Chapter 4CLASSIFICATION 152215

Learning Objectives 152
4.1 Introduction152
Chapter Overview153
4.2 Decision Tree 154
4.3 Building a Decision TreeThe Tree Induction Algorithm 156
4.4 Split Algorithm Based on Information Theory 157
4.5 Split Algorithm Based on the Gini Index 163
4.6 Overfitting and Pruning 169
4.7 Decision Tree Rules 169
4.8 Decision Tree Summary 170
4.9 Nave Bayes Method 171
4.10 Estimating Predictive Accuracy of Classification Methods 174
4.11 Improving Accuracy of Classification Methods 177
4.12 Other Evaluation Criteria for Classification Methods 178
4.13 Classification Software 179
Summary181
Review Questions 181
Exercises182
Multiple Choice Questions 184
Projects185
Bibliography187
Ross QuinlanLeading researcher in Decision Trees189
Case Study 4A KDD for Insurance Risk Assessment: A Case Study 190
Case Study 4B A Data Mining Approach for Retailing Bank Customer Attrition Analysis 198

Chapter 5 CLUSTER ANALYSIS 216269

Learning Objectives216
5.1 Introduction216
Chapter Overview219
5.2 Desired Features of Cluster Analysis 219
5.3 Types of Cluster Analysis Methods 220
5.4 Partitional Methods 221
5.5 Hierarchical Methods 228
5.6 Density-Based Methods 238
5.7 Dealing with Large Databases 239
5.8 Quality and Validity of Cluster Analysis Methods 241
5.9 Cluster Analysis Software 243
Summary243
Review Questions244
Exercises245
Multiple Choice Questions245
Projects247
Bibliography250
Case Study 5 Efficient Clustering of Very Large Document Collections 252
x Contents

Chapter 6 WEB DATA MINING 270331

Learning Objectives 270
6.1 Introduction270
Overview272
6.2 Web Mining 272
6.3 Web Terminology and Characteristics 273
6.4 Locality and Hierarchy in the Web 278
6.5 Web Content Mining 280
6.6 Web Usage Mining 286
6.7 Web Structure Mining 288
6.8 Web Mining Software 295
Summary296
Review Questions296
Exercises297
Multiple Choice Questions297
Bibliography300
Tim Berners-LeeInventor of the World Wide Web303
Case Study 6Lessons and Challenges from Mining Retail E-Commerce Data 304

Chapter 7 SEARCH ENGINES AND QUERY MINING 332381

Learning Objectives 332
7.1 Introduction332
Chapter Overview333
7.2 Differences between Web Search and Information Retrieval 333
7.3 Characteristics of Search Engines 334
7.4 Search Engine Functionality 338
7.5 Search Engine Architecture 339
7.6 Ranking of Web Pages 346
7.7 Search Query Mining 352
7.8 Individual Privacy and Query Data Mining 356
Summary357
Review Questions 357
Exercises357
Multiple Choice Questions 359
Project 360
Bibliography 362
Case Study 7 The Anatomy of a Large-Scale Hypertextual Web
Search Engine 364

Chapter 8 DATA WAREHOUSING 382425

Learning Objectives 382
8.1 Introduction382
8.2 Operational Data Stores 385
8.3 Data Warehouses 387
 Contentsxi

8.4 Data Warehouse Design 392

8.5 Guidelines for Data Warehouse Implementation 396
8.6 Data Warehouse Metadata 398
8.7 Software for ODS and Data Warehousing 399
Summary400
Review Questions 401
Exercises402
Multiple Choice Questions 402
Projects404
Bibliography405
Bill InmonInventor of Data Warehouse 407
Case Study 8 Data Warehouse Governance: Best Practices at Blue Cross
and Blue Shield of North Carolina 408

Chapter 9 ONLINE ANALYTICAL PROCESSING (OLAP) 426470

Learning Objectives 426
9.1 Introduction426
9.2 OLAP427
9.3 Characteristics of OLAP Systems 429
9.4 Motivations for Using OLAP 432
9.5 Multidimensional View and Data Cube 433
9.6 Data Cube Implementations 439
9.7 Data Cube Operations 443
9.8 Guidelines for OLAP Implementation 447
9.9 OLAP Software 448
Summary449
Review Questions 450
Exercises450
Multiple Choice Questions 450
Bibliography453
Jim Gray (19442007)Pioneer in Databases and OLAP 454
Case Study 9 Discovering Web Access Patterns and Trends by Applying
OLAP and Data Mining Technology on Web Logs 455

Chapter 10 INFORMATION PRIVACY AND DATA MINING 471504

Learning Objectives 471
10.1 Introduction 471
Chapter Overview472
10.2 What is Information Privacy? 472
10.3 Basic Principles to Protect Information Privacy 472
10.4 Privacy Legislation in India 475
10.5 Uses and Misuses of Data Mining 476
10.6 Primary Aims of Data Mining 478
10.7 Pitfalls of Data Mining 479
xii Contents

10.8 Why Current Privacy Principles are Ineffective for Data Mining? 480
10.9 A Revised Set of Privacy Principles for Data Mining of Personal Information 482
10.10 Technological Solutions 483
10.11 Examples of Use of Data Mining by the US Government 485
Summary488
Review Questions 488
Exercises489
Multiple Choice Questions 489
Bibliography491
Case Study 10 Privacy Conflicts in CRM Services for Online Shops: A Case Study 493

Answers to Multiple Choice Questions 505506

Index 507514
 Preface

The third edition of this book is a substantially revised version of the earlier editions. The first
chapter has been rewritten and expanded. A new example has been added. Whereas the second
chapter is completely new to this edition. It discusses the importance of data preprocessing in data
mining. A number of issues are discussed in this chapter. An interesting example is included as
an exercise at the end of the chapter. This example may also be used in Chapter 5 on Clustering.
Chapter 3 has been revised and a new project has been included. Chapter 4 has been revised and
so has been Chapter 5. Minor modifications have been made to Chapter 6. Whereas Chapter 7 has
been revised substantially. A new section on Query Data Mining has been added to this chapter.
Minor modifications have been made to Chapters 8 and 9. Finally, Chapter 10 has been revised
substantially to focus on privacy developments in India.
Please continue to send me feedback about the book at my email address [email protected].

G.K. Gupta
[email protected]

xiii
 Introduction To Data Mining With Case
Studies

25%
OFF

Publisher : PHI Learning ISBN : 9788120350021 Author : Gupta

Type the URL : http://www.kopykitab.com/product/10277

Get this eBook