Scribd
Upload
14 views

Learning Model

Models in Machine Learning

Uploaded by

ashwini bhosale
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
14 views

Learning Model

Models in Machine Learning

Uploaded by

ashwini bhosale
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 8

For a given problem, the collection of all possible outcomes represents the sample

space or instance space.


The basic idea for creating a taxonomy of algorithms is that we divide the instance
space by using one of three ways:
•Using a Logical expression.
•Using the Geometry of the instance space.
•Using Probability to classify the instance space.
The outcome of the transformation of the instance space by a machine learning
algorithm using the above techniques should be exhaustive (cover all possible
outcomes) and mutually exclusive (non-overlapping).
Learning Models
Geometric Models
In Geometric models, features could be described as points in two dimensions (x- and
y-axis) or a three-dimensional space (x, y, and z). Even when features are not intrinsically
geometric, they could be modelled in a geometric manner (for example, temperature as a
function of time can be modelled in two axes). In geometric models, there are two ways
we could impose similarity.
• We could use geometric concepts like lines or planes to segment (classify) the instance
space. These are called Linear models
• Alternatively, we can use the geometric notion of distance to represent similarity. In this
case, if two points are close together, they have similar values for features and thus can
be classed as similar. We call such models as Distance-based models
Probabilistic Models
Probabilistic models see features and target variables as random variables. The process
of modelling represents and manipulates the level of uncertainty with respect to these
variables.
There are two types of probabilistic models:
Predictive and Generative.
• Predictive probability models use the idea of a conditional probability distribution P
(Y |X) from which Y can be predicted from X
• Generative models estimate the joint distribution P (Y, X). Once we know the joint
distribution for the generative models, we can derive any conditional or marginal
distribution involving the same variables Probabilistic models use the idea of probability
to classify new entities Naïve Bayes is an example of a probabilistic classifier
Logical Models
Logical models use a logical expression to divide the instance space into segments and hence construct grouping
models. A logical expression is an expression that returns a Boolean value, i.e., a True or False outcome. Once the
data is grouped using a logical expression, the data is divided into homogeneous groupings for the problem we are
trying to solve.
There are two types of logical models:
Tree models and Rule models.
• Rule models consist of a collection of implications or IF-THEN rules. For tree-based models, the ‘if-part’ defines a
segment and the ‘then-part’ defines the behaviour of the model for this segment. Rule models follow the same
reasoning
• Tree models can be seen as a particular type of rule model where the ifparts of the rules are organised in a tree
structure. Both Tree models and Rule models use the same approach to supervised learning

You might also like