Scribd
Upload
30 views

Preprocessing

This document summarizes key concepts from chapter 2 of the textbook "Introduction to Data Mining" including data types, data quality, preprocessing techniques like aggregation, sampling, discretization and feature selection. It provides examples and definitions of these techniques to reduce data dimensions and simplify data for mining algorithms.

Uploaded by

Abdalah Saleh Moustafa Elgholmy
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
30 views

Preprocessing

This document summarizes key concepts from chapter 2 of the textbook "Introduction to Data Mining" including data types, data quality, preprocessing techniques like aggregation, sampling, discretization and feature selection. It provides examples and definitions of these techniques to reduce data dimensions and simplify data for mining algorithms.

Uploaded by

Abdalah Saleh Moustafa Elgholmy
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 20

Data Mining: Data

Lecture Notes for Chapter 2

Introduction to Data Mining , 2nd Edition


by
Tan, Steinbach, Kumar

01/27/2021 Introduction to Data Mining, 2nd Edition 1


Tan, Steinbach, Karpatne, Kumar
Outline

Attributes and Objects

Types of Data

Data Quality

Data Preprocessing

Similarity and Distance

01/27/2021 Introduction to Data Mining, 2nd Edition 2


Tan, Steinbach, Karpatne, Kumar
Knowledge about the Data( meta data)

• Google data set


• Get hub
• Paper with code
• Dataport
• Opendata
• Data catalog

01/27/2021 Introduction to Data Mining, 2nd Edition 3


Tan, Steinbach, Karpatne, Kumar
Data Preprocessing

Aggregation
Sampling
Discretization and Binarization
Attribute Transformation
Dimensionality Reduction
Feature subset selection
Feature creation

01/27/2021 Introduction to Data Mining, 2nd Edition 4


Tan, Steinbach, Karpatne, Kumar
Aggregation

Combining two or more attributes (or objects) into a single


attribute (or object)
Purpose
– Data reduction - reduce the number of attributes or objects reduce time of
processing and memory
– Change of scale high level view of data
◆ Cities aggregated into regions, states, countries, etc.
◆ Days aggregated into weeks, months, or years

01/27/2021 Introduction to Data Mining, 2nd Edition 5


Tan, Steinbach, Karpatne, Kumar
Aggregation

01/27/2021 Introduction to Data Mining, 2nd Edition 6


Tan, Steinbach, Karpatne, Kumar
Example: Precipitation in Australia

This example is based on precipitation in


Australia from the period 1982 to 1993.
The next slide shows
– A histogram for the standard deviation of average
monthly precipitation in Australia, and
– A histogram for the standard deviation of the average
yearly precipitation for the same locations.
The average yearly precipitation has less
variability than the average monthly precipitation.
All precipitation measurements (and their
standard deviations) are in centimeters.
01/27/2021 Introduction to Data Mining, 2nd Edition 7
Tan, Steinbach, Karpatne, Kumar
Example: Precipitation in Australia …

Variation of Precipitation in Australia

Standard Deviation of Average Standard Deviation of


Monthly Precipitation Average Yearly Precipitation
01/27/2021 Introduction to Data Mining, 2nd Edition 8
Tan, Steinbach, Karpatne, Kumar
Sampling
Sampling is the main technique employed for data
reduction.
– It is often used for both the preliminary investigation of
the data and the final data analysis.

Statisticians often sample because obtaining the


entire set of data of interest is too expensive or
time consuming.

Sampling is typically used in data mining because


processing the entire set of data of interest is too
expensive or time consuming.

01/27/2021 Introduction to Data Mining, 2nd Edition 9


Tan, Steinbach, Karpatne, Kumar
Sampling …

The key principle for effective sampling is the


following:

– Using a sample will work almost as well as using the


entire data set, if the sample is representative

– A sample is representative if it has approximately the


same properties (of interest) as the original set of data

01/27/2021 Introduction to Data Mining, 2nd Edition 10


Tan, Steinbach, Karpatne, Kumar
Sample Size

8000 points 2000 Points 500 Points

01/27/2021 Introduction to Data Mining, 2nd Edition 11


Tan, Steinbach, Karpatne, Kumar
Types of Sampling
Simple Random Sampling:(The simplest type of sampling )
– There is an equal probability of selecting any particular
item
– Sampling without replacement
◆ As each item is selected, it is removed from the
population
– Sampling with replacement
◆ Objects are not removed from the population as they
are selected for the sample.
◆ In sampling with replacement, the same object can
be picked up more than once
Stratified sampling
– Split the data into several partitions; then draw random
samples from each partition

01/27/2021 Introduction to Data Mining, 2nd Edition 12


Tan, Steinbach, Karpatne, Kumar
Sample Size
What sample size is necessary to get at least one
object from each of 10 equal-sized groups.

01/27/2021 Introduction to Data Mining, 2nd Edition 13


Tan, Steinbach, Karpatne, Kumar
Discretization

Discretization is the process of converting a


continuous attribute into an categorical attribute
– A potentially infinite number of values are mapped
into a small number of categories
– Discretization is used in both unsupervised and
supervised settings

01/27/2021 Introduction to Data Mining, 2nd Edition 14


Tan, Steinbach, Karpatne, Kumar
Binarization

Binarization maps a continuous or categorical


attribute into one or more binary variables

01/27/2021 Introduction to Data Mining, 2nd Edition 15


Tan, Steinbach, Karpatne, Kumar
Attribute Transformation

An attribute transform is a function that maps the


entire set of values of a given attribute to a new
set of replacement values such that each old
value can be identified with one of the new values
– Normalization
Refers to various techniques to adjust to
◆
differences among attributes in terms of frequency
of occurrence, mean, variance, range
– In statistics, standardization refers to subtracting off
the means and dividing by the standard deviation

01/27/2021 Introduction to Data Mining, 2nd Edition 16


Tan, Steinbach, Karpatne, Kumar
Dimensionality Reduction

Purpose:
– Avoid curse of dimensionality
– Reduce amount of time and memory required by data
mining algorithms
– Allow data to be more easily visualized
– May help to eliminate irrelevant features or reduce
noise

Techniques
– Principal Components Analysis (PCA)

01/27/2021 Introduction to Data Mining, 2nd Edition 17


Tan, Steinbach, Karpatne, Kumar
Dimensionality Reduction: PCA

Goal is to find a projection that captures the


largest amount of variation in data
x2

x1
01/27/2021 Introduction to Data Mining, 2nd Edition 18
Tan, Steinbach, Karpatne, Kumar
Feature Subset Selection

Another way to reduce the dimensionality is to


use only a subset of the features. While it might seem that
such an approach would lose information,this is not the case if redundant and
irrelevant features are present.

Redundant features
– Duplicate much or all of the information contained in
one or more other attributes
– Example: purchase price of a product and the amount
of sales tax paid
Irrelevant features
– Contain no information that is useful for the data
mining task at hand
– Example: students' ID is often irrelevant to the task of
predicting students' GPA
01/27/2021 Introduction to Data Mining, 2nd Edition 19
Tan, Steinbach, Karpatne, Kumar
Feature Creation

Create new attributes that can capture the


important information in a data set much more
efficiently than the original attributes

general methodologies:
– Feature extraction
◆ Example: extracting edges from images
– Feature construction
◆ Example: dividing mass by volume to get density

01/27/2021 Introduction to Data Mining, 2nd Edition 20


Tan, Steinbach, Karpatne, Kumar

You might also like