2/6/2012
Computational Intelligence
Unit # 1
Sajjad Haider
Spring 2012
Information
Course Wiki
http://cse659ci2012.wikispaces.com/
Text/Reference Books
Daniel Ashlock, Evolutionary Computation for Modeling and Optimization, 2005 Gusz Eiben and Jim Smith, Introduction to Evolutionary Computing, 2007 Andries Engelbrecht, Computational Intelligence: An Introduction, 2007 Kenneth DeJong, Evolutionary Computation A Unified Approach, 2006
Sajjad Haider Spring 2012 2
2/6/2012
Marks Distribution
Midterms Final Assignments (3-4) Project = 2 x 15 = 30% 40% 15% 15%
Sajjad Haider
Spring 2012
Tentative Outline
Evolutionary Computation
Evolutionary Algorithms
Genetic Algorithms Evolutionary Strategies Evolutionary Programming
Ant Colony Optimization Particle Swarm Optimization Artificial Immune Systems
Simulated Annealing Tabu Search Neural Networks Fuzzy Logic Other Algorithms
Harmony Search, Co-Evolution, Honey Bee Optimization, Artificial Life
Hybrid Techniques
Sajjad Haider Spring 2012 4
2/6/2012
Definition (Source: Wikipedia)
Computational intelligence (CI) is a set of Natureinspired computational methodologies and approaches to address complex problems of the real world applications to which traditional methodologies and approaches are ineffective or infeasible. It primarily includes Fuzzy logic systems, Neural Networks and Evolutionary Computation. In addition, CI also embraces techniques that stem from the above three or gravitate around one or more of them, such as Swarm intelligence and Artificial immune systems which can be seen as a part of Evolutionary Computation.
Sajjad Haider Spring 2012 5
IEEE Computational Intelligence Societys Scope
The Field of Interest of the Society shall be the theory, design, application, and development of biologically and linguistically motivated computational paradigms emphasizing neural networks, connectionist systems, genetic algorithms, evolutionary programming, fuzzy systems, and hybrid intelligent systems in which these paradigms are contained.
Sajjad Haider Spring 2012 6
2/6/2012
Excerpts from Engelbrechts Book
It is necessary to state that there are different definitions of what constitutes CI. This book reflects the opinion of the author, and may well cause some debate. For example, swarm intelligence (SI) and artificial immune systems (AIS) are classified as CI paradigms, while many researchers consider these paradigms to belong only under Artificial Life. However, both particle swarm optimization (PSO) and ant colony optimization (ACO), as treated under SI, satisfy the definition of CI given above, and are therefore included in this book as being CI techniques. The same applies to AISs
Sajjad Haider Spring 2012 7
Evolutionary Computation (Source: Wikipedia)
In computer science, evolutionary computation is a subfield of artificial intelligence (more particularly computational intelligence) that involves combinatorial optimization problems. Evolutionary techniques mostly involve metaheuristic optimization algorithms such as:
Evolutionary algorithms (comprising genetic algorithms, evolutionary programming, evolution strategy and Genetic programming) Swarm intelligence (comprising ant colony optimization and particle swarm optimization) and in a lesser extent Artificial immune systems, Cultural algorithms, Differential evolution, Harmony search algorithm, etc.
Sajjad Haider Spring 2012 8
2/6/2012
Evolutionary Algorithms (Source: Wikipedia)
In artificial intelligence, an evolutionary algorithm (EA) is a subset of evolutionary computation, a generic population-based metaheuristic optimization algorithm. An EA uses some mechanisms inspired by biological evolution: reproduction, mutation, recombination, and selection. Candidate solutions to the optimization problem play the role of individuals in a population, and the fitness function determines the environment within which the solutions "live" (see also cost function). Evolution of the population then takes place after the repeated application of the above operators.
Sajjad Haider Spring 2012 9
Swarm Intelligence
There are two popular swarm inspired methods in computational intelligence areas:
Ant colony optimization (ACO) Particle swarm optimization (PSO)
ACO was inspired by the behaviors of ants and has many successful applications in discrete optimization problems. The particle swarm concept originated as a simulation of simplified social system. The original intent was to graphically simulate the choreography of bird of a bird block or fish school. However, it was found that particle swarm model can be used as an optimizer.
Sajjad Haider
Spring 2012
10
2/6/2012
Examples
Sajjad Haider
Spring 2012
11
MASON Demo
Sajjad Haider
Spring 2012
12
2/6/2012
Global Optimization
Global optimization is the branch of applied mathematics and numerical analysis that deals with the optimization of single or maybe even multiple, possible conflicting, criteria. These criteria are expressed as a set of mathematical functions F = {f1, f2, . . . , fn}, the so-called objective functions. The result of the optimization process is the set of inputs for which these objective functions return optimal values.
Sajjad Haider Spring 2012 13
Search vs. Optimization
The difference between optimization algorithms and search algorithms is that when performing a search algorithm, we know the element xi we are looking for and just want to find its position in a structured set. In global optimization algorithms on the other hand we do not even know the characteristics of the xi beforehand and are only given some criteria which describe if a given configuration is good or not.
Sajjad Haider Spring 2012 14
2/6/2012
Local Maximum and Minimum
Sajjad Haider
Spring 2012
15
Global Maximum and Minimum
Sajjad Haider
Spring 2012
16
2/6/2012
Global and Local Optima
Sajjad Haider
Spring 2012
17
Simple Functions
Sajjad Haider
Spring 2012
18
2/6/2012
Complex Functions
Rastrigin
Griewank
Rosenbrock
Sajjad Haider
Spring 2012
19
10
