Lecture 5: Backtracking
Depth-FirstSearch
N-QueensProblem
HamiltonianCircuits
Backtracking
Backtracking is closely related to the brute-force problem-solving method in
which the solution space is scanned, but with the additional condition that only the
possible candidate solutions are considered.
What is meant by possible solutions and how these are differentiated from the
impossible ones are issues specific to the problem being solved.
functionbacktrack(currentdepth)
ifsolutionisvalid
return/printthesolution
else
foreachelementfromA[]sourcearray
letX[currentdepth]element
ifpossiblecandidate(currentdepth+1)
backtrack(currentdepth+1)
endif
endfor
endif
endfunction
[Link]
Depth-First Tree Search
procedure depth_first_tree_search(v:node)
u : node;
begin
for each child u of v loop
depth_first_tree_search(u);
2
end loop;
11
end depth_first_tree_search;
3
Wewillusetheconventionofchoosingnodesin
aleft-to-rightorder(oralphabeticaliflabeled).
10
12
13
4
14 15 18
5
6
9
16
17
Depth-First Search
[Link]-numeric
orderfornodetraversalwecandefineauniqueorderingofthenodesencounteredina
connectedgraph.
B
D
E
G
F
H
Edgelistrepresentation
AB
AC
AD
AE
BA
BG
CA
CF
DA
DF
DH
EA
EG
EH
FC
FD
FH
FI
GB
GE
GH
HD
HE
HF
HG
HI
IF
IH
Starting at node A we can traverse every
other node in a depth-first order, making
sure that we do not enter any node more
thanonce.
ABGEHDFCI
WemoveforwardfromAtoCandthen
wehavetobacktracktoFandmove
forwardtoI.
Backtracking Technique
Backtrackingisusedtosolveproblemsinwhichafeasiblesolutionisneededrather
thananoptimalone,suchasthesolutiontoamazeoranarrangementofsquaresin
[Link](orobjects)
chosenfromasetofalternativesthatsatisfysomecriterion.
6
10
14
15
Backtracking Implementation
[Link]
themazethestartlocationistherootofatree,thatbranchesateachpointinthemaze
wherethereisachoiceofdirection.
N-Queens Problem
The problem of placing N queens on an NxN chessboard in such a way that no two
of them are "attacking" each other, is a classic problem used to demonstrate the
backtracking method.
A simple brute-force method would be to try placing the first queens on the first
square, followed by the second queen on the first available square, scanning the
chessboard in a row-column manner.
A more efficient backtracking approach is
to note that each queen must be in its own
column and row. This reduces the search
from (N2)! to N!.
Sample: N Queens Backtracking Algorithm
byAntal
#include <stdio.h>
#include <math.h>
#include <conio.h>
int n, x[30];
int solution(int k)
{
return k==n;
}
void print(int k)
{
for (int i=1;i<k+1;i++)
printf("%d ",x[i]);
printf("\n");
}
Can you see how this code
checks for "attacking" queens?
int possible(int k)
{
for (int i=1;i<k;i++)
if (x[i]==x[k] || abs(x[i]-x[k])==k-i)
return 0;
return 1;
}
void back(int k)
{
if (solution(k))
print(k);
else
for (x[k+1]=1; x[k+1]<=n; x[k+1]++)
if (possible(k+1))
back(k+1);
}
void main()
{
char ch;
printf("Enter the size of NxN chessboard: ");
scanf("%d",&n);
printf("\nThe solution: ");
back(0);
}
Hamiltonian Circuits Problem
AHamiltoniancircuitortourofagraphisapaththatstartsatagivenvertex,visits
eachvertexinthegraphexactlyonce,[Link]
notcontainHamiltoniancircuits.
v1
v2
v3
v1
v2
v3
v4
v5
v6
v4
v5
v6
Astatespacetreeforthisproblemisasfollows.Putthestartingvertexatlevel0inthe
tree,callthisthezero'thvertexonthepath.Atlevel1,considereachvertexotherthan
thestartingvertexasthefirstvertexafterthestartingone.Atlevel2,considereachof
these vertices as the second vertex, and so on. You may now backtrack in this state
spacetree.
Backtracking in a State Space Tree
function ok(i)return boolean
j:index isok:boolean
begin
if i=n-1 and not W(v(n-1),v(0)) then
isok:=false
elsif i>0 and not W(v(n-1),v(i)) then
isok:=false
else
procedure hamiltonian(i:index)
isok:=true;
j : index;
j:=1;
begin
while j<i and isok loop
if ok(i) then
if v(i)=v(j) then
isok:=false;
if i=n-1 then
j:=j+1;
display(v(0..n-1))
end loop;
else
end if;
for j in 2..n loop
end ok;
v(i+1):=j;
1. The ith vertex on the path must be
hamiltonian(i+1);
adjacenttothe(i-1)stvertexonthepath.
end loop;
[Link](n-1)stvertexmustbeadjacenttothe
end if;
0'thvertex.
end if;
3. The ith vertex cannot be one of the i-1 end hamiltonian;
vertices.
Sample Problem
v1
v5
v2
v6
graph
v3
v7
v4
statespacetree
v8
5
6
3
4
3
8
8
:
:
:
:
Game Trees
The state-space tree showing all legal moves of both players starting from some valid
game state is called the game tree. We can define a function that estimates the value of
any game state relative to one of the players. For example, a large positive value can
mean that this is a good move for Player1, while a large negative value would represent
a good move for Player2. The computer plays the game by expanding the game tree to
some arbitrary depth and then bringing back values to the current game state node.
Ply 0
current node
Ply 1
-3
+2
+1
+3
-1
-3
-2
+1
Mini-Max
adefinition
A program starts with the current game state and generates all legal moves...all legal
responses to these moves...and so on until a fixed depth is reached.
At each leaf node, an evaluation function is applied which assigns a numerical score
to that board position. These scores are then ``backed up'' by a process called minimaxing, which is simply the assumption that each side will choose the line of play
most favorable to it at all times.
If positive scores favor Player 1, then Player 1 picks the move of maximum score
and Player 2 picks the move of minimum score.
Minimax Game Tree
We will assume that a large positive value is good for the Player1. To determine Player1's
next move, we will search the possible moves for both players assuming that each player
will make the best possible move. Ply1 is Player2's move so we will want to return the
minimum value from Ply2 into each Ply1 node.
Ply0 is the Player1's move so we choose the maximum of the Ply1 values. So the best
move for Player1 results in at least a +1 return value...
+1
MAX
MIN
-3
-3
Ply 0
+1
+2
+1
-3
+3
-1
-2
-3
-2
Ply 1
+1
Alpha-Beta Pruning Rule
If A is an ancestor of X, where A is a
maxnode and X is a minnode, then
whenever Beta(X) < Alpha(A), we
know that if f(X) is good enough to
be propagated all the way to B, then
it will lose to one of As alternative
moves.
-1
-3
-1
So in either case, f(X) will have no
influence in determining the next
move, so we can stop evaluating its
children.
max
-1
+2
-3
max
-4
min
-4
Similarly, if Y is a max node and a
descendant of B, then we can prune
Y whenever Alpha(Y)>Beta(B).
-1 -2 -3 +2 -1 -3 -4 -3 +3 +4 -4 -5 +4 +5
Summary
Backtracking is...
an efficient means of implementing brute-force search
inherently depth-first
to be considered when anysolution will do
N-Queens Problem
Hamiltonian Circuits
Game Trees
MiniMax and Alpha-Beta Pruning
