Scribd
Upload
81 views

A Presentation On The Implementation of Decision Trees in Matlab

This document summarizes the use of the classregtree function in Matlab to create decision trees for classification and regression problems. It explains that classregtree can be used to create a decision tree t given a matrix of predictor values X and responses y. Optional parameters like categorical, method, names, and prune can be specified. Parameter options for all trees, classification trees, and regression trees are described. The presentation concludes with examples of using classregtree that will be shown in class and references for further information.

Uploaded by

Ali Bhutta
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
81 views

A Presentation On The Implementation of Decision Trees in Matlab

This document summarizes the use of the classregtree function in Matlab to create decision trees for classification and regression problems. It explains that classregtree can be used to create a decision tree t given a matrix of predictor values X and responses y. Optional parameters like categorical, method, names, and prune can be specified. Parameter options for all trees, classification trees, and regression trees are described. The presentation concludes with examples of using classregtree that will be shown in class and references for further information.

Uploaded by

Ali Bhutta
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 9

A Presentation on the Implementation

of Decision Trees in Matlab

By: Avirup Sil

2
Avirup Sil

CIS 9603
AI Course

Use Function: classregtree


t=classregtree(X,y)creates a decision tree

t for predicting the response y as a function of the


predictors in the columns of X. X is an n-by-m
matrix of predictor values.
If y is a vector of n response values,
classregtree performs regression. If y is a
categorical variable, character array, or cell array
of strings, classregtree performs classification.
Either way, t is a binary tree where each branching
node is split based on the values of a column of X.

3
Avirup Sil

How to use

classregtree

CIS 9603
AI Course

function??

t=classregtree(X,y,'Name',value)

specifies one or more optional parameter


name/value pairs. Specify Name in single quotes

4
Avirup Sil

CIS 9603
AI Course

Parameter Options
For all trees:
categorical Vector of indices of the columns of X that are to be
treated as unordered categorical variables
method Either 'classification' (default if y is text or a categorical
variable) or 'regression' (default if y is numeric).
names A cell array of names for the predictor variables, in the
order in which they appear in the X from which the tree was created.
prune 'on' (default) to compute the full tree and the optimal
sequence of pruned subtrees, or 'off' for the full tree without pruning.
minparent A number k such that impure nodes must have k or
more observations to be split (default is 10).

5
Avirup Sil

CIS 9603
AI Course

Parameter Options(contd)
minleaf A minimal number of observations per tree leaf (default
is 1). If you supply both 'minparent' and 'minleaf', classregtree uses
the setting which results in larger leaves: minparent =
max(minparent,2*minleaf)
surrogate 'on' to find surrogate splits at each branch node.
Default is 'off'. If you set this parameter to 'on',classregtree can run
significantly slower and consume significantly more memory.
(I could not use surrogate in my MATLAB!!!)
weights Vector of observation weights. By default the weight of
every observation is 1. The length of this vector must be equal to the
number of rows in X.

6
Avirup Sil

CIS 9603
AI Course

Parameter Options(contd)
For Classification Trees:
splitcriterion Criterion for choosing a split.
One of 'gdi' (default) or Gini's diversity index,
'twoing' for the twoing rule, or 'deviance' for
maximum deviance reduction.

7
Avirup Sil

Demos
To be shown in class

CIS 9603
AI Course

8
Avirup Sil

CIS 9603
AI Course

References
Matlab Library
http://www.mathworks.es/help/toolbox/stats/c
lassregtree.html

9
Avirup Sil

Thank You!!

CIS 9603
AI Course

You might also like