linear algebra Module - Final
linear algebra Module - Final
Prepared by:
ShumetAsefa
FirdisaBirru
KidusMarkos
Nekemte, Ethiopia
June, 2013
Course Description
This course is designed to introduce the students the basic concepts of matrices and
determinants: matrix operations, basic properties of determinants, matrix representation
of linear equations, methods of solving systems of linear equations, special determinants
and matrices and their use in Economics, input-output model and Linear Programming.
The course covers the basics to understand a wide variety of applications that use the
ideas of linear algebra, linear programming and their economic applications. The
emphasis is on concepts and problem solving.
Objectives:
The aim of this course is to equip students with a fundamental understanding of basic
concepts in Linear Algebra and its applications in economics. Up on the successful
completion of this course students will be able to:
Solve linear equations and apply them in real – life problems in
economics
Apply matrices to solve applied system linear equations in
economics and business
Formulate and solve applied linear programming problems either
graphical or simplex methods for both maximization and
minimization problems
Formulate and describe transportation problem
Formulate optimization and linear programming problems in
microeconomics and macroeconomics matrix algebra.
Explain and/or use Leontief Input-output model
Solve linear programming problems using graphical and / or simplex
method
Solve economic problems using different kinds of matrix operations.
and subject to certain rules of operation is called an mxn (read “mbyn”) matrix. The
numbers a11, a12,a13 - - - amn are called the elements (entries) of the matrix. We denote this
matrix by Aijor aij where i = 1, 2, 3… m…..rows
j = 1, 2, 3… n…..columns
The matrix above has m rows and n columns. A ij denotes the elements of the matrix lying
in the ith row and jth column and we call this element as the (i,j)th element of the matrix.
Matrices are mathematical tools which are useful in the study of systems of linear
equations. Matrices are arrays of numbers, and they can be manipulated and combined in
much the same way as we handle numbers. In this chapter we are going to develop the
“algebra” of matrices, i.e amethod of adding, subtracting and multiplying matrices when
these operations make sense.
In real life, we do not have to deal with a single magnitude but with a set of magnitudes.
In analysis, we treat such set of magnitudes as a single entity or a single object of
thought, abstracted by numbers.
The above system comprises 3 rows and 4 columns. (Note that we write rows first and
then after columns). Clearly, therefore, 1st column gives us the total number of pants
(3+5+4 = 12) that A, B and C together have in their family. While 2 nd, 3rd and 4th columns
enumerate the total number of shirts, Trousers and Ties those three brothers together have
in their family respectively.
Example 1
Similarly, 4 3
2 5 is a 3x2 matrix
7 4
1 2
3 4 is a matrix of order 2. (2x2 matrix)
Example 2
In the matrix
1 2 3
A= 5 6 7
8 9 10
Remark1: unless and otherwise stated, we shall consider matrices over the field of real
numbers for simplicity.
Remark2: A matrix is simply an arrangement of elements and has no numerical value,
it is wrong to say 8 9 is greater than
3. Square matrix: A matrix in which the number of rows is equal to the number of
columns is called a square matrix.
Linear Algebra for Economists Lecture note, Wollega University, 4
Department of Economics
By:Kumadebis Tamiru
Example: 1 2
3 4 is a 2x2 square matrix
1 2 3
4 5 6 is a 3x3 square matrix
7 8 9
4. Null (Zero) matrix:A matrix of any order whose all elements are zero is called a
null (zero) matrix and denoted by 0.
Example: 0 0
0 0 is a null matrix of order 2 (2 x 2)
0 0 0
0 0 0 is a2x3 null matrix.
5. Diagonal matrix: A square matrix whose all elements except the main diagonals
are zero is called a diagonal matrix.
Example:
A= 2 0 1 0 0 are diagonal matrices of order
0 3 and B= 0 4 0 2 and 3 respectively.
0 0 9
Main
diagonal
6. Scalar Matrix: A square matrix whose all elements except the main diagonals are
zero and the main diagonal elements are all equal is called a scalar matrix
Example:
2 0 4 0 0
0 2 & 0 4 0 are scalar matrices of
order 2 & 3
0 0 4 respectively.
7. Unit (identity) matrix: A square matrix whose main diagonal entries are all unity
(1) and the other elements are zero is called a unit or Identify matrix. A unit
matrix of order n is denoted by In.
Example:
Linear Algebra for Economists Lecture note, Wollega University, 5
Department of Economics
By:Kumadebis Tamiru
1 0 1 0 0 1
0 0 0
I2 = 0 1 I3 = 0 1 0 I4 = 0
1 0 0
0 0 1 0
0 1 0
0
0 0 1
Example:
i. If A = 4 6
2 3 then by definition /A/ = 4x3 -2x6 = 12 – 12 = 0
and therefore, A is a singular matrix of order 2
ii. If A = 4 5
6 8 , then /A/ = 4x8 – 6x5 = 32 – 30 = 2
/A/ 0.Hence, A is a non – singular matrix of order 2.
9. Symmetric and skew – symmetric matrices: A square matrix A = (aij) is said to be
symmetric if aij = aji for all i and j, i.e., a12 = a21 ,a13=a31, a23 = a32, soon.
Example:
2 7 -5 a b c
7 8 -4 and b d a are symmetric matrices of
-5 -4 3 c a e order 3
A square matrix A is said to be skew – symmetric If aij = - aji for all i and
j, i.e., if a21 = - a12, a13 = - a31 , a32 = -a23 and soon and the main diagonal
elements a11 = a22 =a33…ann= 0
Example
0 -2 -4 0 a b
2 0 -6 & -a 0 -c are skew symmetric matrices of
4 6 0 -b c 0 order 3.
2 4 6 5 10
0 8 10 and 0 15 are upper triangular matrices.
0 0 12
11. Augmented matrix: A matrix which includes both coefficients and constants of a
system of linear equations is called an augmented matrix.
Example
Given: 3x+ 2y +7z = 18
9x+ 3y +3z = 28
3x+6y + 5z = 20
The above system of linear equations can be written in matrix form as
3 2 7
9 3 3 = coefficient matrix (A)
3 6 5
x
y = Variable matrix (X)
z
18
28 = constant matrix. (C)
20
3 2 7 18
9 3 3 28 thus, this is an augmented
matrix
3 6 5 20
Example
3 5 7 3 5 7
1 2 3 1 2 3
Let A= 4 5 6 and B= 7 5 6
A B even if matrix A& B have the same order(2x3) due to 4 different from 7.
Solution:
Since the matrices are equal they must have equal dimension and corresponding
entries of the matrices should be equal.
81
a) 4t = t2 +4 b) b- 2 = -7 c) log a = 4 d) 9 = m
Linear Algebra for Economists Lecture note, Wollega University, 8
Department of Economics
By:Kumadebis Tamiru
t2 -4t+4 = 0 b = -7+2 a4 = 81
4
(t – 2) 2 = 0 b = -5 a4 = 3
t=2 a=3
Thus, A = B if and only if t=2, b = -5, a =3 and m = 9.
Example
If = 4 and A = 1 2 4
2 -3 4 , then
Example
If A = 1 2 3 B= 2 3 4
4 5 6 2 x3 and 5 6 7 2 x3
,
2 x3
4+5 5+6 6+7 = 9 11 13
Let us see now how to multiply the above two matrices A and B.
C = AB = a11 a12 a13 b11 b12
a21 a22 a23 x b21 b22
b31 b32
C = AB = a11 b11+ a12b21+ a13 b31 a11 b12 + a12 b22 + a13 b32
a21 b11+ a22b21+ a23 b31 a21 b12 + a22 b22 + a23 b32
n
a ik b kj
C = ail blj + ai2 b2j + - - - + ain bnj = k 1
Remark:
1. If A and B are two matrices, then AB may not be equal to BA (even though both
are defined).
Example
A= 2 2 B= 2 0
0 0 2x2 & 0 0 2x2
BA = 2 0 2 2
0 0 x 0 0 =
2x2 + 0x0 2x2 + 2x0 4 4
0x2 + 0x0 0x2 + 0x0 = 0 0
Thus, this example confirm thatAB BA.
2. If product AB is defined, then it is not necessary that BA must also be defined.
Example
Example
1 0 5 3x 3 0 4 3x2
Solution:
i. Checking for the right side of equality: (AB)C
Since the number of columns of A is equal to the number of rows of B, we can
obtain the product AB as follows:
Example
If A = 1 -2 3 2 3 -1
2 4 -1 and B = 1 0 2
-3 4 5
Solution:
AB = 1 -2 3 2 3 -1
2 4 -1 x 1 0 2
-3 4 5
= -9 15 10
11 2 1
Note: that the product BA is not defined in this case, since the number of
columns in B the number of rows in A. since the number of columns of the
first matrix B is different from the number of rows of the second matrix A we
cannot multiply B with A.)
Linear Algebra for Economists Lecture note, Wollega University, 13
Department of Economics
By:Kumadebis Tamiru
Some more illustrative examples
4. A man buys 8 kgs of Mangoes, 10 kgs of apples, and 4kgs of bananas. Managoes
cost birr 4 per kg, apples 9 birr per kg and bananas cost birr 6 per kg, represent the
quantities bought by a row matrix and the prices by a column matrix and hence
obtain the total cost.
5. If A = 2 -1 and B = 2 , find the matrix C of suitable
4 -3 -3 order such that AC = B.
1. We have 2 A = 2x 0 2 3 0 4 6
2 1 4 = 4 2 8
And 3B = 3 x7 6 3 21 18 9
1 4 5 = 3 12 15
Hence, 2A +3B = 0 4 6 + 21 18 9
4 2 8 3 12 15
= 0+21 4+18 6+9
4+3 2+12 8+15
Linear Algebra for Economists Lecture note, Wollega University, 14
Department of Economics
By:Kumadebis Tamiru
= 21 22 15
7 14 2
2. If x +y = 7 0 3 0
7 5 and x – y = 0 3
We have x +y = 7 0 1
2 5
And x-y = 3 0
0 3 2
( x+ y) + ( x-y) = 7 0 3 0
2 5 + 0 3
10 0
2x = 2 8 => multiplying both sides by ½
10 0
x= ½ 2 8
x= 5 0
1 4
5 0 7 0
1 4 +y = 2 5
y= 7 0 5 0
2 5 - 1 4
y= 2 0
1 1
1
0 xB= 2 4 9 6 5 0
3. A = 7 1x6
8 4x1
AB = 2 4 9 6 5 0
0 0 0 0 0 0
14 28 63 42 35 0
16 32 72 48 40 0
4. Let A be the row matrix representing the quantities bought and B be the column
matrix representing the price
4
A= 8 10 4 1x 3 and B = 9
6 3x1
The total cost is given by the element of the product AB which is 1x1 matrixes.
4
AB = 8 10 4 9 x
6
AB = 8x4 + 10x9 + 4x6
AB = 32 + 90 + 24
AB = 146
5. If A = 2 -1 2
4 -3 and B = -3 , find C such that AC = B
2x –y 2
4x-3y = -3
i. If A = 1 0 2 then transpose of A = At = 1 2
2 3 4 2x3 0 3
2 4 3x2
ii. If B = a b c a d g
d e f , then Bt = b e h rows become columns.
g h i 3x3 c f I 3x3
Example:
For the following two matrices verify that (At)t = A and (A+B)t = At+Bt
A= 1 2 3 2 3 4
4 5 6 , and B = 1 8 6
Solution:
a.) At = 1 4 2 1
t
2 5 and B = 3 8
(At)t = 1 2 3
5 5 6 =A
Thus, (At)t = A
b) A+B = 3 5 7
5 13 12
(A+B)t = 3 5 3 5
5 13 and At +Bt = 5 13
7 12 7 12
Example
Give A = 1 2 3 and B = 4 7
4 5 6 2x3 5 8
6 9 3x2
Solution:
At = 1 4 4 5 6
2 5 Bt = 7 8 9 2x3
3 6 3x2
1 2 3 4 7 1x4+2x5+3x6 1x7+2x8+3x9
Again (AB)t= 4 5 6 x 5 8 = 4x4+5x5+x6x 4x7+5x8+6x9
6 9
(AB)t = 32 50t
77 122
So, (AB)t = 32 77
50 122 2x2
But, (AB)t AtBt, having different orders which is 2x2 and 3x3 respectively.
Note the following points:
A matrix ‘A’ with a property A = At is called a symmetric matrix.
Example:
If A = 2 8 18 2 8 18
8 14 10 , then At = 8 14 10
18 10 16 18 10 16
1. Let A = 1 1
0 1
a. 0 1 4 0 6 -4 0 -1 2
-1 0 7 b. -6 0 8 c. 1 0 5
-6 -7 0 4 -8 0 -2 -5 0
3. If A = ( 1 2 3) and B = 4
5 , then
6
Verify that (AB)t = Bt At.
4. If A = 2 1 1 -2
3 4 and B = -1 1 , then verify (AB)t = Bt At
5. Let A = 1 0 0
4 2 3 , show that A2 – 3A+2I = 0
2 0 1
1.5 Determinants
If A is a square matrix with entries (elements) from the field of complex numbers, then
determinant of A is some complex number. This will be denoted by det A or /A/.
Determinant is a numerical value of a square matrix.
a11 a12 a13 . . . a1n
a21 a22 a23 . . . a2n
If A= , , , ,
, , ,
An1 an3an3ann
thendet A = /A/= , , , ,
an1 an3an3ann
1 2 3 5 -6
4 5 -6 = 8 9 = (5x9) – (-6x9) = 45+54 = 99
7 8 9
The second bracket is determinant of the matrix after removing the first row and the
second column of matrix A.
1 2 3 4 -6
4 5 -6 = 7 9 = (4x9) – (-6x7) = 36 +42 = 78
7 8 9
The third bracket is determinant of the matrix after removing the first row and third
column of matrix A.
1 2 3
4 5 -6 4 5
7 8 9 = 7 8 = (4x8) – (5x7) = 32 -35 = -3
Example 2
Solution:
i.det A = 2 2 -4 1 -4 1 2
1 5 - (-1) -3 5 + 3 -3 1
= 2 (2x5) – (1x-4) +1 (1x5) – (-3x-4) +3(1x1) – (2x-3)
=2 (10+4) + (5-12) +3 (7)
= 28 -7 +21
= 42
1.5.4 Properties of Determinants
List of some important properties of determinants
1. If two rows (or columns) of a matrix are interchanged, its determinant retains its
absolute value but changes its sign,
Let A = a b
c d , then /A/ = ad – bc
and B= c d
a b , interchanging the two rows of A
2. If rows are changed in to columns or columns into rows, the determinate remains
unchanged.
Let A = a b
Linear Algebra for Economists Lecture note, Wollega University, 25
Department of Economics
By:Kumadebis Tamiru
c d , then /A/ = ad – bc
B= a c
b d rows are changed into columns
/B/ = ad – bc = /A/
3. If two rows (or columns) are identical, the determinant is zero (vanishes).
Let A = a b
a b , then /A/ = ab – ab = 0
Similarly if A = a1 a2 a3
a1 a2 a3 , then /A/ = 0
c1 c2 c3
4. If any row (or column) is multiplied by a real number k, then the determinant
obtained is k times the original determinant.
Let A = a b
c d , then /A/ ad – bc
and let B = ka kb
c d = multiplying the first row by K.
B= a+kc b+kd
c d adding k times of the second row to the first row
Self test
Prove (show) the above five properties of determinants by taking your own examplesof
having two and three orders.
Example1
If A = a b
c d , then find the minors of each element.
Solution:
/A/ = a b= ad-bc
c d
M11 (minor of a) = a b =d
c d
M12 (minor of b) a b
c d =c
M21 = (minor of c) a b
c d =b
Example 2
If A = 1 -2
-3 -4 , then find minors of each element
Solution:
Example 3
If A = a1 b1 c1
a2 b2 c2 , find the minors of each
a3 b3 c3 element and evaluate then.
Solution:
The minor of any element in /A/ is a determinant of second order obtained by omitting
from /A/ the row and column in which that element occurs. Thus minors by a 1, b1, a2, b2,
c2
M11 = b2 c2 a2 c2 a2 b2 a2 b2
b3c3 , m12 = a3 c3 , M13 = a3 b3 , M21 = a3 b3, so on.
Example 4
Write the minors of the elements of the first row of the following determinant and hence
evaluate them.
/A/ = 1 2 3
-4 3 6
Solution:
M11 = 3 6
-7 9 = 27 – (-42) = 69
-4 6
M12 = 2 9 = -36 -12 = -48
-4 3
M13 = 2 -7 = 28 -6 = 22
Use the same procedures to find minors of the 2nd and 3rd row elements
1.6.2. Cofactors
The cofactor of any element in /A/ is the minor of that element in /A/ with proper sign
depending on the numbers of the row and the column in which the element occurs. If an
element occurs in ith row and jth column in /A/, then the cofactor of the element = (-1) i+j
x
(Minor of the element), cofactor of the element is denoted by Cij.
Thus, Cij = (-1) i+j x Mij
Example 1
If A = 2 -3
4 3 , find the cofactors of each element.
Solution:
Recalling the method of finding minor of an element, we obtain
M11 = 3, M21 = -3 and
M12 = 4 M22 = 2
After obtaining the minors of the elements, we simply substitute them in the formula to
find the corresponding cofactors.
C11 = (-1) 1+1 .M11 = 1x3=3
C12 = (-1) 1+2 .M12 = -1x4 = -4
Linear Algebra for Economists Lecture note, Wollega University, 29
Department of Economics
By:Kumadebis Tamiru
C21 = (-1) 2+1 . M21 = -1x(-3) = 3
C22 = (-1) 2+2 .M22 = 1x2 = 2
In matrix form the cofactors can be put as follows
cA= 3 -4
3 2
Example2
If A = 1 2 3
-4 3 6 , find the cofactors of each element
2 -7 9
Solution:
First find the minors of each element and multiply each minor by (-1) i+j obtain cofactors.
M11 = 3 6
-7 9 = 27 – (-42) = 69
C11 = (-1) 1+1 M11 = M11 = 69
-4 6
M12 = 2 9 = -36 -12 = -48
C12 = (-1) 1+2 xM12 = -1x (-48) = 48
M13 = -4 3
2 -7 = 28 -6 =22
C13 = (-1) 1+3 xM13 = M13 = 22
Self test
Obtain the cofactors of the 2nd and 3rd row elements in a similar manner.
Note: that in the identity Cij = (-1) i+j xMij,
Exercise
1 2 3 2 5 7 1 1 1
A= 2 4 6 B= 3 6 10 C= 1 1+x 1
3 5 7 8 4 15 1 1 1+y
2. Solve for x if
1 1 1 x+1 2 3
i. 1 x 1 =0 ii. 3 x+2 1 =0
1 1 x 1 2 3
x 1 1 x-5 2
iii. 1 x 1 = 0 iv. -3 x =0
1 1 x
3. Find the minors and cofactors of each element for the following Matrices
1 2 0 2 5 4 46 32 15
i. A = 0 1 2 ii) B= 1 4 3 iii) C = 27 21 9
1 0 6 8 10 2 17 16 7
Example 1
Let A= 1 2
3 4 , then find adj A.
Solution:
Step1: C11 = 4, C12 = -3, C21 = -2, C22 = 1
Step2: Cofactor of matrix A = CA = 4 -3
-2 1
Step3: Transposing the cofactor matrix, we get
CAt = 4 -2
-3 1 = adjA.
Hence, adj A = CAt = 4 -2
-3 1
Example2
Solution:-
We have A = 1 -1 1
2 3 0
Linear Algebra for Economists Lecture note, Wollega University, 32
Department of Economics
By:Kumadebis Tamiru
18 2 10
and using the steps above to find adjoint of a matrix we obtain
adj A =
3 0 -1 1 -1 1
2 10 2 10 3 0
2 0 1 1 1 1
- 18 10 18 10 2 0
2 3 1 -1 1 -1
18 2 18 2 2 3
Adj A= 30 22 -3
-20 -8 2
-50 -20 5
0 0 0
= 0 0 0
0 0 0
where 0 is the null matrix of order 3.
Linear Algebra for Economists Lecture note, Wollega University, 33
Department of Economics
By:Kumadebis Tamiru
1.8. Inverse of A Square Matrix
If A is a square matrix of order n, then a square matrix B of the same order n is said to be
inverse of A if AB = BA = I (unit matrix of order n).
Multiplying A and B
It can be easily see that
AB = BA = I (unit matrix)
In this case, we can say that B isinverse of A and A is inverse of B.
Note that:
i. Inverse of a square matrix is defined only for square matrices. But this does
not mean that every square matrix is invertible.
ii. If B is an inverse of A, then A is also an inverse of B.
iii. If a matrix A has an inverse, then A is said to be invertible
iv. Inverse of a matrix is unique
Uniqueness of inverse of a matrix can be easily shown as follows
For, let B and C be two inverses of A.
then, AB = BA = I and AC = CA = I
So B = BI = B(AC) = (BA)C = IC = C
Hence, B = C
This shows that the matrix A cannot have two distinct inverse.
Notation: Inverse of A is denoted by A-1
In this section, we give a method to determine the inverse of a matrix. .
Let us see now the following two ways of finding the inverse of a square matrix,
namely,adjoint method and Gaussian elimination procedure.
a) The adjoint method of finding an inverse
Linear Algebra for Economists Lecture note, Wollega University, 34
Department of Economics
By:Kumadebis Tamiru
Theorem: If A be a square matrix of order n, then A (adjA) = (adj A) A = ǀAǀI, where I is
the Identity matrix of order n.
By this theorem above, we have
A (adjA) = (adjA) A = ǀAǀI
A(adjA) (adjA) A A I
⇒ = ⇒
A A A
(Dividing both sides by ǀAǀ≠0.)
A(adjA) (adjA) -1
= A = AA =I
Since A-1A= AA-1= I, A A
adj A 1
= (adjA)
This relation shows that A-1 = A A
dividing again both
sides by A
1
(adjA), where A ≠ 0
A
Hence, A-1 = inverse of A=
We can easily obtain the inverse of a square matrix A using adjoint method following
the steps below:
step 1: finding the determinant of the given matrix A
step 2: finding the adjoint of the given matrix
step 3: dividing the adjoint matrix by the determinant obtained in step1.
adjA CA t
=
A A
Thus, A-1 =
Note that if ǀAǀ= 0, then A-1 does not exist.
Example
2 1
1 1 2 1 3 3
.adj A
A 3 1 2
-1
Step3: A = 1 2 = 3 3
2 1
3 3
1 2
Thus, A-1 = 3 3
ii. B = a b
c d
Step 1:ǀBǀ= ad – bc
Step 2: C11 = d, C12 = -C, C21 = -b, C22 = a
CB = d -c
-b a
CBt = d -b
-c a = adj B
d b
d b ad bc ad bc
1
1 x c a
adj B ad bc
B c a = ad bc ad bc
Step 3: B-1 = =
Briefly, the Gaussian method starts by writing the given matrix at the left and the
corresponding identify matrix at the left and the corresponding identify matrix next to it
at the right). Then select and carry out row operations that will convert the given matrix
into the identify matrix, and apply the same operations to the matrix at the right. When
the left matrix becomes the identify matrix, the matrix on the right will be the desired
inverse.
Zeros first: For simplicity, the Gauss- Jordan method proceeds to obtain ones on the
main diagonal and zeros on the off- diagonal elements.
obtain the off –diagonal zeros first and following this, obtain ones on the main
diagonal.
To illustrate, let us find the inverse of the matrix
A= 3 2
1 1
A = AI = 3 2 1 0
1 1 0 1
= 1 1 0 1 interchanging row 1 and row 2
3 2 1 0
= 1 1 0 1 R2 = -3 R1+R2
0 -1 1 -3
R2
= 1 1 0 1 R2 = 1
0 1 -1 3
Linear Algebra for Economists Lecture note, Wollega University, 37
Department of Economics
By:Kumadebis Tamiru
= 1 0 0 1 R1 = R1 –R2
0 1 -1 3
A-1 = 1 -2
-1 3
As a check, we have
3 2 1 -2 1 0
1 1 x -1 3 = 0 1
Example
Find the inverse of the following matrices using Gaussian elimination method.
i. A 7 3 ii. 0 1
2 1 , 2 3
Solution:
Applying the procedure of the above example, we can obtain the inverse of the matrices
A and B as follows.
i. A = AI= 7 3 1 0
2 1 0 1
2 1 0 1
= 7 3 1 0 - Interchanging rows.
1 0 1 -3
7
= 0 -½ 1 /2 R1 = R1+R2
= 1 0 1 -3
0 1 -2 7 R2 = -2 R2
Since the left matrix is converted to identify, the inverse of A
-1
A = 1 -3
-2 3 at the right.
ii. B= 0 1
2 3
= 2 0 -3 1 R1 = -3R2 +R1
0 1 1 0
Linear Algebra for Economists Lecture note, Wollega University, 39
Department of Economics
By:Kumadebis Tamiru
3
= 1 0 /2 ½
0 1 1 0
1
Hence, A = -3/2 ½
1 0
Exercise 4
Observe that a linear equation does not involve any products or roots of variables. All
variables occur only to the first power and do not appear as arguments for trigonometric,
logarithmic, or exponential functions.
A solutionof a linear equationa1x1 + a2x2 +…+ anxn = b is a sequence of n numbers s1, s2,
…,sn such that the equation issatisfied when we substitute x 1 = s1, x2 = s2, …, xn = sn. The
set of all solutions of the equation is called its solution set or sometimes the general
solution of the equation.
Example
Solution:
These formulas describe the solution set in terms of an arbitrary number t, called a
parameter. Particular numerical solutions can beobtained by substituting specific values
for t. For example, t = 3, yields the solution y = 11/2 and t = -½ yields the solution y = -3/2.
If we follow the second approach and assign y the arbitrary value t, we obtain x = ½t + ¼,
y=t
Although these formulas are different from those obtained above, they yield the same
solution set as t varies over all possible realnumbers.
Exercise
Linear Systems:
A finite set of linear equations in the variables x1, x2, …,xnis called a system of linear
equations or a linear system. A sequence of numbers s1, s2, …,sn is called a solution of the
system if x1 = s1, x2 = s2, …, xn = sn is a solution of every equation in the system. For
example, the system
4x1 – x2 + 3x3 = -1
3x 1 + x2 + 9x3 = -4 has the solution x1 = 1, x2 = 2 and x3 = -1 since
these values satisfy both equations.
However, x1 = 1, x2 = 8, x3 = 1 is not a solution since these values satisfy only the first
equation in the system.Not all systems of linear equations have solutions. For example, if
we multiply the second equation of the system
x+y=4
2x + 2y = 6 by ½, it becomes evident that there are no solutions since
the resulting equivalent system x+y=4
x+y=3 has contradictory equations.
The graphs of these equations are lines; call them l1and l2. Since a point (x, y) lies on a
line if and only if the numbers x and y satisfy the equation of the line, the solutions of the
system of equations correspond to points of intersection of l1and l2. There arethree
possibilities, illustrated in Figure 2.1:
l2 y Il
Y 1 2
l1
x x
l1 and l2
y
The lines l1and l2 may be parallel, in which case there is no intersection and
consequently no solution to the system.
Linear Algebra for Economists Lecture note, Wollega University, 44
Department of Economics
By:Kumadebis Tamiru
The lines l1and l2 may intersect at only one point, in which case the system has
exactly one solution.
The lines l1and l2 may coincide, in which case there are infinitely many points of
intersection and consequently infinitelymany solutions to the system.
Every system of linear equations either has no solutions, or has exactly one solution, or
has infinitely many solutions.
Where x1, x2,…,xn are the unknowns and the subscripted a's and b's denote constants. For
example, a general system of three linear equations in four unknowns can be written as
AX = C = a11x+a12y =b1
a21x+a22y=b2
The above system of equations is said to be consistent if it has at least one solution. If the
system has no solution, then it is said to be inconsistent (i.e, not consistent). The system
with exactly one solution is said to be consistent and independent.
Example
2x+3y = 8
x+2y =5 has exactly one solution and thus, consistent and independent.
and the system x+3y = 5 has no solution and the two equations are
2x+6y = 7 inconsistent. Determinant of A is exactly zero.
That is, A= 1 3
2 6 andA =0
Thus, to find the solution of a linear system of equations using the inverse method, first
obtain the inverse of the coefficient matrix and then, multiply it by the constant matrix,
which gives the required solution.
Example
The equilibrium condition for three related markets is given by the following systems of
equations.
11P1 – P2 – P3 = 31
-P1 + 6P2 – 2P3 = 26
-P1- 2P2 + 7P3 = 24
Find the equilibrium prices by using the inverse method.
Solution:
11 -1 -1
Let A = Coefficient matrix = -1 6 -2
-1 -2 7
P1 31
P = variable matrix = P2 and C = Constant matrix = 26
P3 24
Likewise for, 11 -1 -1 P1 31
-1 6 -2 P2 = 26
-1 -2 7 P3 24
c11 = M11 = 42 – 4 = 38
c12 = -M12 = -(- 7– 2) = 9
c13 = M13 = 8
c21 = -M21 = -(-9) = 9 and c33 = M33 = 66 – 1 = 65
, 38 9 8 38 9 8
-1
C = 9 76 23 , A = 1/401 9 76 23
8 23 65 8 23 65
Therefore, P1 38 9 8
-1
P= P2 A C= 9 76 23
P3 8 23 65
Let a1 x + b1y = C1
a2 x + b2y = C2
The solution of the system above according to Cramer’s rule is obtained as follows:
Let a1 b1 X= xc1
A= a2 b2 , y and B = c2
c1 b1
Thus, x= c2 b2 = c1 b2 – b1 c2 Dx
A a1 b2 – b1 a1 A
Thus, x= a1 c1
a2 c2 = a1 c2 – c1 a2 = Dy
A a1 b2 – b1 a1 |A|
Example
Dx = 1 -3
7 5 = 5-(-21) =26
Dy = 2 1
A = 2 -3
1 5 = 10 – (-3) = 13
Dx 26
= =2
A 13
X=
Dy 13
=1
A 13
Y=
Hence, x = 2 and y = 1
Example
Dx = 15 -6 4
19 4 -3 = 1257
46 1 6
Dy = 5 15 4
7 19 -3 = 1676
2 46 6
5 -6 4
A = 2 4 -3 = 419
2 1 6
Dx 1257
= =3
A 419
Now x=
Dy 1676
= =4
A 419
y=
Dz 2514
= =6
A 419
and z=
Hence, x = 3, y = 4 and z = 6
obtain 1 in a11
5 15
1 /4 /2 R 1 = ¼ R1
3 2 19
2 5 20
Next we add – 3 times row 1 to row 2 and -2 times row 1 to row 3.
5 15
1 /4 /2
-7 -7
0 /4 /2 R2 = -3R1+R2
5
0 /2 5 R3 = -2R1+R3
5 15
1 /4 /2 R2 = -7R2 1 0 5
0 1 2 0 1 2
5 -5
0 /2 5 0 /4 5
Then add -5/4 times row 2 to row 1 and -5/2times row 2 to row 3. At this point, the method
terminates since this satisfies the condition. The first, second and third row tells us
x1 +0x2 = 5 then, x1 = 5
x1 +1x2 = 2 then, x2 = 2
0x1 +0x2 = 0 then, 0 = 0
Thus, our solution is given by x1= 5 and x2 =2
Exercises
A= 3 8 3 1 0 1 2
2 1 , B= 4 0 , C= 1 2 3
Linear Algebra for Economists Lecture note, Wollega University, 53
Department of Economics
By:Kumadebis Tamiru
3 1 1
2. Solve the following systems using the four methods of finding a solution.
i. 4x – 3y = 5 ii. 3x+ 2y = 6 iii. x – y = 3
3x – 5y = 1 5x + 4y = 8 2x + 3y – 4z = 17
y+2z=7
vi.x + 2y +3z = 6 v. x +y + z = 3
3x – 2y +3z = 2 2x – y +z = 2
4x +2y +z = 7 x – 2y +3z = 2
Applications Questions
1)
INDIVIDUAL ASSIGNMENT
1).A candy manufacturer regularly makes three kinds of candy, each of which
requires milk and butter as follows; candy 1 requires 3 gallons of milk and 1 pound
of butter per dozen, candy 2, requires 2 gallons of milk and 3 pounds of butter per
dozen and candy 3 requires 3 gallons of milk and 2 pounds of butter per dozen. The
purchasing department buys a variable amount of milk and butter each week,
depending upon the market prices; the production department must then determine
each week the amounts of each candy to be made in order to consume the quantities
of milk and butter bought. If in the current week 23 gallons of milk and 26 pounds
of butter are purchased, find the number of dozens of each candy to be made
2). A special food for athletes is to be developed from tow foods. Food X and Food
y the new food is to be designed so that it contains exactly 16 ounces of vitamin A,
exactly 44 ounces of vitamin B and exactly 12 ounces of vitamin C. Each pound of
food x contains 1 ounce of vitamin A, 5 ounces of vitamin B and 1 ounce of vitamin
C- On the other hand, each pound of food y contains 2 ounces of A, 1 ounce of B
and 1 ounce of C Find the number of pounds of each food to be used in the mixture
in order to meet the above requirements.
If Jacobian determinant becomes zero then it is to mean that there is linear or non – linear
functional dependency between two or more equations. The reverse is true if the
determinant different from zero.
Example given
y1 = f 1 (x1 , x 2 , x3 )
y 2 = f 2 (x1 , x 2 , x3 )
y3 = f 3 (x1 , x2 , x3 )
- If
J =0, then there is functional dependency among equations and hence no
Example
∂y1 ∂y
1 1
y 12 means y11 means 1
y1 =4 x1 x 2 ⇒ y =4 & y = 1
1 2 ∂x 2 and ∂x1
∂y 2
y 2 =16 x12 +8 x1 x 2 +x 22 ⇒ =32 x1 +8 x 2
∂x1
∂y 2
=8 x1 +2 x 2
∂x 2
4 1
J 64 x1 16 x 2 ≠ 0,
32 x1 8 x 2 8 x1 2 x 2
Thus, the system has a solution because the value of the Jacobian determinant is non-
singular, i.e., different from zero.
As stated in the preceding paragraphs, partial derivatives can provide a means of testing
whether there exists functional (linear or nonlinear) dependence among a set of n
functions in n variables. This is related to the notion of Jacobian determinant.
Exercises
(a) 3 (b) 3
9 5
H
It is special types of matrix which is denoted . The economic importance of hessian
whether it has relative maximum value or relative minimum value or neither of the two
(inflection value).
A Hessian determinant is composed of all the second order partial and cross partial
derivatives objective function arranged in ordered sequence.
b) Three-variable case
First order condition:
Linear Algebra for Economists Lecture note, Wollega University, 57
Department of Economics
By:Kumadebis Tamiru
z f ( x1 , x2 , x3 )
First partials: f1 , f 2 , f3
2 z
fij
xi x j
Second partials:
fij f ji
Young’s theorem:
For max, min, dz 0 (for arbitrary values of dx1, dx2, dx3, not all zero)
dz f1dx1 f 2 dx2 f 3dx3 0
Technique: regard dxi as variables that can take on any values, fij as coefficients
We have a symmetric Hessian Determinant.
Rules:
maximum
H1 0, H 2 0, H 3 0
d 2 z is negative definite
z is a if or 2
minimum H1 0, H 2 0, H 3 0
d z is positive definite
Solution:
First order condition:
f x =12 x 9 3 y =0
f y = 3 x 7 +10 y =0
Example 2
Solution:
H1 f11 4
f11 f12
H2 31
f 21 f 22
H 3 H1 54
CHAPTER FOUR
4.0 INPUT –OUTPUT MODEL
4.1. Introduction
Input-output analysis is a technique which was invented by Professor Wassily W.
Leontief in the year 1951. The input-output analysis summarizes the flows of inputs and
outputs in an economy in the form of input-output table. The basic notion of Input-output
analysis depends on the belief that the economy of any country can be divided into a
Each industry requires certain inputs from other sectors in order to produce its own
output. Similarly, each industry (sector) sells some of its output to other industries so that
they too can satisfy their intermediate material needs.
A table summarizing the origin of all the various inputs and destination of all various
outputs of industries in an economy is known as an input-output. The input-output table
provides a convenient framework for measuring and tracing these inter-industry (inter-
sectorial) flows of inputs and outputs among the various sectors of the economy. Thus,
the essence of input-output analysis is that, given certain technological coefficients and
final demand, each endogenous sector would find its output uniquely determined as a
linear combination of multi-sector demand.
Let us assume that an economy consists of 4 producing sectors only, and that the
production of each sector is being used as an input in all the sectors and is used for final
consumption.
Example
3 4 3
A' S = , B ' S = and C ' S = .
10 10 10
Finally let A consumes 10 percent of C’S production, B consumes 20percent of C’s and
C consumes the remaining 70 percent. This is an example of a closed model and can be
summarized as follows:
Production
A B C
Note that the sum of the entries in any column is always one
Example
Notice that the sum of entries in each column is strictly less than 1 as some outside
agency is also using the product.
We can now translate the distribution of total output (product) of four producing sectors
in the following way.
The above identity states that all the output of a particular sector could be utilized either
as an input in one of the producing sectors of the economy and/or as a final demand.
Basically, therefore, Input-output analysis is nothing more than finding the solution of
these simultaneous equations.
Note that all the coefficients are positive (aij0). The above table gives us the total output
of each sector interms of technical coefficients; and if there are “n” producing sectors,
X1 = a11 x1+ a12 x2+ a13 x3+ a14 x4+ - - - a1n xn+F1
∑ aij xj +Fj
Xi = j==1
Where (I = 1,2,3 - - -, n and j 1,2,3, - - -,n)
n
∑ ixj
And L = j=1
=
Xnan1 an2 an3… annXnFn
Hence, X = Ax+F From this, we can derive a relationship in which the total output that
must be produced in each sector using Identity matrix (I), coefficient matrix A ( a ij) and
the final demands (Fi), i.e
X = Ax+F
X – Ax = F
X (I-A) = F
-1 -1
X ( I - A) ( I - A) =( I - A) F
- 1
X = ( I - A) F
-1
The expression ( I - A) is known as the inverted Leontief matrix or the Leontief inverse
and it indicates that the total output of each sector is obtained by multiplying the inverted
Leontief matrix by the total final demand of the sectors. Where A is the given matrix of
input coefficients, while X and F are the two vectors of output and final demand of each
-1
producing sector. If ǀI-Aǀ=0, then ( I - A) exists, we can then estimate for either of the
two matrices x and F by assuming one of them to be given exogenously.
Linear Algebra for Economists Lecture note, Wollega University, 67
Department of Economics
By:Kumadebis Tamiru
It is here that we observe that assumptions made in input-output analysis go a long way in
making the problem simplified. For example, with the assumption of linear homogeneous
function, it is possible to write a linear equation of each producing sector which then can
be easily transformed into matrix notation. On the other hand, as long as the input
coefficients remain fixed (as assumed) the matrix A will not change or (I-A) will not
-1
change. Therefore, in finding the solution of X = ( I - A) only one matrix inversion
needs to be performed even if we are to consider thousands of different final demand
vectors according to alternative development targets. Hence, such an assumption of fixed
technical coefficients has meant considerable saving in computational efforts. Now lets
us consider a hypothetical Input –output table to understand the model nicely.
intermediate
purchase
House hold (h) 40 35 5 80 50 130
Capital (k) 45 50 10 105 60 165
Gross input 115 85 75 285 110 295
Xj
Reading the I-O table:
1. Reading a row (example row1 = Agriculture): Of the total available output of
agricultural products (115) only 15 units are used by agriculture itself, 0 units by
Transaction Matrix:
A transaction matrix shows how the total output of one industry is distributed to all other
industries as inputs and to the final demand sector. For instance in the above table, 115
units of Agricultural output is required to distribute 15 units Agricultural, no units to
manufacturing, 20 units to service sector and 80 units to the final demand sector.
x 21 10 x 0 x 35
a 21 0.04, a 22 22 0, a 23 23 0.47
x 115 x2 85 x3 75
x31 5 x 10 x 15
a31 = = =0.04 a32 = 32 = =0.12 a33 = 33 = =0.20
x1 115 x2 85 x3 75
xij
aij =
xj
Thus using the equation , the matrix of technical coefficients for our hypothetical
example is given as follows.
Linear Algebra for Economists Lecture note, Wollega University, 69
Department of Economics
By:Kumadebis Tamiru
Agriculture Manufacturing Service
Agriculture 0.13 0 0.27
Manufacturing 0.09 0 0.47
Service 0.04 0.12 0.20
Note that: the sum of entries is lest column would always be one in closed model but the
sum in less than one if we assume an open model.
Interpretation:
Any column in the technical coefficient matrix indicates the different materials (inter-
industry) input requirements to produce one unit of output. For instance, column1
indicates different material input requirements needed by the Agricultural sector from all
the sectors to produce one unit of output. More specifically, to produce one unit of
output, the Agricultural Sector needs 0.13 units of inputs from Agricultural sector, 0.09
units of inputs from Manufacturing sector, and 0.04 units of inputs from service sector.
Now we can put the input –output follows among different sectors using a matrix
Algebra.
X =( I - A) - 1 F
-1
x11 0 0 0.13 0 0.27 80
x2 = 0 1 0 - 0.09 0 0.47 x 40
x3 0 0 1 0.04 0.12 0.20 45
Illustrated Examples
Solution :
Since A= 0.3 0.5 0.2 1 0 0 0.3 0.5 0.2
0.2 0 0.5 , I–A= 0 1 0 - 0.2 0 0.5
0.1 0.3 0.1 0 0 1 0.1 0.3 0.1
ǀI-A ǀ= 0.401
Again (I-A)-1 = 1 adj (I-A) = 1 0.75 0.42 0.40
ǀI-A ǀ 0.401 0.23 0.61 0.39
0.16 0.25 0.62
-1
Substituting these values in X = ( I - A) F , weget
X= X1
X2 =
(I - A) .
-1
F
X3
1
(0.75 x100 +0.42 +0.401(50))
x1 = 0.401
x1 = birr 270 million
1
(0.23x100 +0.6(40) +0.39(50))
x2 = 0.401
x2 = birr 167 million and
1
(0.16 x100 +0.25 x 40 +0.62(50))
x3= 0.401
x3 = birr 142 million
Thus, the three industries should produce outputs amounting birr 270 million, 167 million
and 142 million respectively to satisfy the given final demands.
Note that: the three columns sums of A are (0.3+0.2+0.1) = 0.6, (0.5+0) = 0.8 and
(0.2+0.5+0.1) = 0.8 which are less than 1 in each case. In other words (1-0.6) = 0.4, (1-
0.8) = 0.2 and (1-0.8) = 0.2 is the maximum amount of primary input which can be used
for producing a birr worth of the three commodities (P,Q,R) respectively
Hence, the amount of primary input would be needed to get the above amount of output
mix (279 mill, 167 mill & (142 mill) in three producing sectors.
Therefore, the total primary input requirements of the three sectors will be equal to:0.4
(270 mill) + 0.2 (167 mill) +0.2 (142 mill) = birr 190.1 mill.
Solution
1. 0 0.8 0.2
0 .2 0 .2
0.9
(I- A = )
0 1
- 0.7 = 0 .9 0 .3
I-A
= 0.2 (0.3) - (0.2 x0.9) =0.06 - 0.18 = - 0.12
Since the determinant of (I - A) is less than zero, the system will not have a possible
solution.
Solution:
We know that x1 F1
-1
x2 = (I- A) F2
x3F3
1
adj ( I - A)
and (I- A)
-1
= ( I - A)
0. 8 0 .2 0 .3 0.1 0 .3 0. 1
C11 = =0.56 C21 = =0.21 C31 = =0.14
0 0 .7 0 0.7 0.8 0 .2
0. 0. 2 0. 9 0. 1 0.9 0.1
C12 = =0 C22 = =0.63 C32 = =0.18
0 0 .7 0 0 .7 0 0 .2
C (I –A) = 0.56 0 0
0.21 0.63 0
0.14 0.18 0.72
t
C (I – A) = adj (I-A) = 0.56 0.21 0.14
0 0.63 0.18 and
0 0 0.78
-1
I-A
= 1.11 0.42 0.28
0 1.25 0.36
0 0 1.43
x150.2
x2 = 36
x3143
Thus, the total outputs in the three sectors are x1 = 50.2, x2 = 36 and x3 = 143 units.
In the above example, if final demands change by 10 units each, then what will be the
change in sector outputs? (this is a kind self test question).
4. An economy produces only coal and steel. The two commodities serve as
intermediate inputs in each other’s production. 0.4 tons of steel and 0.7 tons of
coal are needed to produce a ton of steel. Similarly 0.1 tons of steel and 0.6 tons
of coal are required to produce a ton of coal. No capital inputs are needed. Does
the system viable?Besides, 2 and 5 labor days are required to produce a tone of
coal and steel respectively. If the economy needs 100 tons of coal and 50 tons of
steel, calculate the gross output of the two commodities and the total labor
required.
Solution:
The technology matrix is given as under
Steel Coal Final demand
Steel 0.4 0.1 50
Coal 0.7 0.6 100
Labor 5 2
By with the final demand, we get using earlier methods to find the inverse of (I-A) and
multiplying
x1 = 176 .5
x2 558 .8
Hence, total output of steel is 176.5 times and total output of coal is 558.8 units.
Total labor days required is: 5x steel output +2times coal output
= 5x176.5 +2x558.8 = 2000 labor days
Exercises
1. The following table gives the input-output coefficients for a two sector economy
consisting of Agriculture and manufacturing industry.
input A B
A 0.10 0.50
B 0.20 0.25
The final demand for the two industries is 300 and 100 units respectively. Find
the gross (total) outputs of the two industries. If the input coefficients for labor for
the two industries are respectively 0.5 and 0.6 find the total units of labor
required.
1 1 1
2. Let A= 8 3 4
1 1 1
2 6 4
1 1 1
4 6 4
3. Find the demand vector F which is consistent with the output vector
X= 10
28 , when the input – output coefficient matrix is
4. From the following matrix find the final output goals of each industry assuming
that the consumer output targets are $ 85 million in steel, 25 million in coal and
55 million in railway transport.
Steel Coal Railway transport
Steel 0.4 0.1 0.2
Coal 0.2 0.2 0.4
Railway transport 0.2 0.3 0.3
Labor 0.2 0.4 0.1
What would be the labor requirements of the final outputs of the three industries?
5. Given the following transaction matrix, find the total output to meet the final
demand of 200 units of Agriculture and 800 units of industry.
Producing sector purchasing sector current
Agriculture Industry Demand
Agriculture 300 600 100
Industry 400 1200 400
In economics not all relationships between variables are represented by equality and that
is why we are now consider the case when the constraints are given by inequalities.
Provided that the function to be optimized is linear and inequalities are all linear, the
problem is said to be linear programming problem.
We have four subsections under this chapter that we are going to consider.Subsection 5.2
describes the graphical method to solve linear programming problems using graphical
approach. For simplicity we concentrate on problems involving just two unknowns to
describe the graphical methods of solution.
Subsection 5.3, describes the simplex method to solve the linear programming problems.
It is an iterative algorithm which is a systematic repetitive solution procedure to obtain
the best possible solution under the given constraints. Under this section we shall discuss
the whole procedure step by step for solving linear programming problems.
At the end of this section students should be able to:
Define linear programming problem
Identify the region defined by a linear inequality and sketch the feasible region
defined by simultaneous linear inequalities
Solve linear programming problems graphically
Use the simplex method to find the solution for linear programming problems
Form dual of linear programming model
Example 5.1
Further, suppose that the company decides to produce units of product. Then the profits
that obtained from marketing of the products will be given by
On the other hand, the production process will use the following amounts of ingredients,
of ingredient , and
of ingredient
The condition on factory is while it is. We are, therefore, faced with the following linear
programing problem:
Thus from the above examples it is possible to understand the maximization and
minimization problem cases of linear programming for the case of bivariate and
multivariate cases. Under the first example we have two unknown variables to be solved.
But the second case is more general it considers more than two unknown cases.
After these examples we are ready to describe the general form of linear programming
problems. As it is possible to understand from the above example the general form of
linear programming must have at least two parts. The first part is a function that to be
maximized or minimized and the second part includes subject functions.
The function to be maximized or minimized is termed as the objective function and the
subject functions are termed as constraintsof linear programming problem. Given be
Linear Algebra for Economists Lecture note, Wollega University, 82
Department of Economics
By:Kumadebis Tamiru
variables the objective function of linear programming problem can be stated as a linear
function of variables which has be maximized or minimized.
These variables are subjected to a number of linear conditions, constraints, which take the
form
Thus, in the above general formulation of the linear programming problem the
constants () are all known quantities. The objective here is to find which optimize the
objective function z, while satisfying the constraints.
Activity 5.1
Provide at least two examples of problems in your area that can be describe and solved
by using the general formulation of linear programing model.
To illustrate this consider the simple inequality. Here, we would like to identify those
points with coordinates for which this inequality holds true. Clearly this has same thing
to do with the straight line initially. Thus we have to start with sketching of straight line
Figure 5.1 Sketching Linear Inequalities
●P
●R
●Q
If a point P lies above the line, then y coordinate is greater than x coordinates, so that.
Similarly, if a point Q lies below the line then the y coordinate is less than x coordinate
so that. The coordinate of point R lies on the lineand satisfying
Linear Algebra for Economists Lecture note, Wollega University, 84
Department of Economics
By:Kumadebis Tamiru
Hence, we can see that the inequality holds for any point that lies on or above the line. It
is useful to be able to indicate this region pictorially. We do this by shading one half of
the coordinate plane.
●P
In general, to sketch any inequalities of form, , we first need to sketch the corresponding
line and then deciding which side of the line to deal with. An easy way of doing this is to
pick a ‘test point’, . It does not matter what point is chosen, provided that it does not
actually lie on the line itself. The numbers of x and y are then substituted into the original
inequality. If the inequality satisfied then the side containing the test point is the region of
interest. If not, then we go for the region on the other side of the line.
Example 5.3
In order to sketch this inequality first we have to sketch the line. This requires finding
and intercepts. When we get y intercept, 4. Similarly, when we get which is . Thus, the
line pass through (0,4) and (2, 0) as shown in Figure 5.3.
● (3, 2)
X
(2, 0)
For a test point let us take (3, 2) which lies above the line. Substituting and in to equation
for gives 2(3) +2=8. This is not less than 4, so the test point does not satisfy the
inequality. It follow that the region of interest lies below the line. This is illustrated in
Figure 5.4. In this example the symbol < is used rather than ≤. Hence, points on the line
itself are not included in the region of interest. This technical can be represented using a
broken line for the boundary.
(0, 4)
● (3, 2)
X
(2, 0)
Activity 5.2
Example 5.4
In this problem the easiest inequalities to handle are the last two non-negativity
inequalities so the feasible region for these two inequalities is in the top right-quadrant of
the plane, as shown in Figure 5.5 below.
For the inequality we need to sketch the line. For this purpose we need to find and
intercepts. When we get and when we get. Thus, the required line pass through
coordinates and.
For testing point let us take, since such a choice minimizes the amount of arithmetic that
we have to do. Substituting the test point in to the inequality gives, which is obviously
true. Now that the origin lies below the line, so we shade the region that lies below it.
This indicated in Figure 5.6.
(0, 6)
●
X
(12, 0)
Y
For the inequality we need to sketch the line using coordinate as Y-intercept and
coordinate as X-intercept of the line. At the test point,, the inequality is satisfied because ,
which is obviously true. Thus, we are interested in the region below the line, since it
contains the test point, the origin. As usual this indicated by shading the area below the
line.
(0, 6)
(0, 3)
X
(-3,0) (12, 0)
Activity 5.3
We know in a better position to describe and solve linear programming problem using
graphical approach. Valuable insight into the nature of the linear programmingproblem is
gained by adopting a geometrical approach on n-dimensionalspace.We shall know
introduce graphical approach to describe and solve the linear programming problem
using solved problem using appropriate example.
Example 5.5
One way of finding the required point is using the trial and error approach. In this
approach the objective function evaluated as every point within the feasible region and
the point that produce the smallest value of the objective function is going to be chosen.
That is why it is considered as a trial approach. For example, point (1, 1) lies in the
feasible region and when these values are substituted in the objective function they yield -
1 (i.e., -2(1) +1=-1). Similarly, we might try point (3.4, 2.1) in the feasible region, which
produces -4.7 (-2(3.4) +2.1=-4.7) which is an improvement, since -4.7<-1.
The drawback of this approach is that there are infinitely many points inside the region,
so it is going to take a very long time before we can be certain of the solution. This
approach geometrical described as the superimposing the family of straight lines on the
top of feasible region. The family of straight lines is represented by the objective function
in the linear programming problem. In our particular example the family of straight lines
represented equation with slope of a line of 2.
A selection among the family of straight lines is represented in Figure 5.8 below. The
values of c range from 0 to -24. These lines have been sketched using the information
that they pass through (-c/2, 0) and have a slope of 2. It is possible to note that as c
decreases from 0 to -24 the lines sweep across the feasible region from left to right. Also,
once c goes below -24 the lines no longer intersect this region. The minimum value of c
Figure 5.8 Sketching the Family of Straight Lines over the Feasible Region
Y
c=0 c=-8 c=-16 c=-24
(0, 3)
X
2 4 6 8 10 (12, 0)
For the above example it is possible to understand that the optimal solution is attained at
one of the corners of the feasible region. This is not simply a coincidence. It can be
shown that the solution for any linear programming problem always occurs at one of the
corners. Consequently the trial and error approach suggested that the only candidates for
answer are the corners and so only a finite number of points need ever be examined.
Given the above example the general procedures for finding the solution for linear
programming problem may be summarized as:
Step 1: sketch the feasible region
Step 2: identify the corners of each feasible region and find their coordinates.
Step 3: evaluate the objective function at the corners and choose the one
which has the maximum of the minimum value
From this we can see that the minimum value of the objective function attained the
coordinate (12, 0). Incidentally, if we also require the maximum value then this can be
deducted without further effort. From the table the maximum is 3, which occurs at corner
(0, 3).
Activity 5.4
Solve the following linear programming problem using the general procedures of
graphical approach
Maximize:
Subjected to constraints:
It is possible for the linear programming problem to have either has no unique solution or
no solution. Next we illustrate such special cases by considering two appropriate
examples.
Example 5.6
Step 1:
The non-negativity constraints and indicate that the region is bounded by the coordinate
axes in the positive quadrant. The remaining constraint passes through the coordinates
(0, 2) and (4, 0). At the test point (0,0) the inequality is satisfied. Therefore, we are
interested in the region below the line, sine this region contains the test point, (0, 0). This
feasible region sketched in the Figurer 5.9 as below.
Figure 5.9 Sketching the Feasible Region of Set of Inequalities in Example 5.6
(0,2)
X
(4, 0)
Y
Step 2:
The feasible region is a triangle with three corners, (0, 0), (0, 2), and (4, 0).
Step 3:
Corner Objective function value
(0, 0) 0+2(0)=0
(0, 2) 0+2(2)=4
(4, 0) 4+2(0)=4
If we superimpose a family of straight lines over the feasible region by setting the
objective function equal to some constant, c. The parallel lines pass through the points
(0, c/2) and (c, 0).
A selection among the family of straight lines is represented in Figure 5.10 below. The
values of c range from 0 to 4. As c increases, the lines sweep across the region from left
to right. Moreover, when c goes above the 4 the lines no longer intersect the feasible
region. The maximum value that c can take is therefore 4. However, instead of the line =4
intersecting the region at only one point, it intersects along a whole line segments of
points. Any point on the line segment lies in the feasible region and the corresponding
value of objective function on this line is 4, which is the maximum value.
Figure 5.10 Sketching the Family of Straight Lines over the Feasible Region
Y
(0,2)
1
X
1 2 3 (4, 0)
c=1 c=2 c=3 c=4
This example suggests that if the maximum (or the minimum) occurs at two corners then
the problem has infinitely many solutions. Any point on the line segment joining these
corners, including the two corners themselves, is also a solution.
Example 5.7
No solution case:
Solve the linear programming problem
Linear Algebra for Economists Lecture note, Wollega University, 94
Department of Economics
By:Kumadebis Tamiru
Maximize:
Subjected to:
Step 1:
The non-negativity constraints and indicate that the region is bounded by the coordinate
axes in the positive quadrant. The remaining constraints:
The line passes through the coordinates (0, 2) and (8, 0).
The line passes through the coordinates (0, 5) and (5, 0).
The line passes through the coordinates (0, 6) and (3, 0).
A test point (0, 0) does not satisfy any of the corresponding constraints. We are therefore
interested in the region above all of these lines, as shown in Figure 5.11.
Figure 5.11 Sketching the Feasible Region of Set of Inequalities in Example 5.7
Y
6 Unbounded
feasible
5
region
4
3
2
1
1 2 3 4 5 6 7 8 9 X
Step 2:
The feasible region has four corners, (0, 6), (1, 4), (4, 1) and (8, 0).
Step 3:
Corner Objective function value
(0, 6) 3(0)+2(6)=12
Linear Algebra for Economists Lecture note, Wollega University, 95
Department of Economics
By:Kumadebis Tamiru
(1, 4) 3(1)+2(4)=11
(4, 1) 3(4)+2(1)=14
(8, 0) 3(8)+2(0)=24
From the table the maximum value of the objective function is 24, which occur at (8, 0).
However, we do have slightly unusual situation in that feasible region is not enclosed on
all sides. The feasible region is unbounded in this case. It is opened at the top and, strictly
speaking, it does not make sense to talk about the corners of such a feasible region. We
can substitute huge values of x and y in to and get an ever-increasing result.
Consequently, if the problem is one of maximization it is possible to conclude that it does
not have a finite solution. On other hand, if the problem is one of minimization then it
does have a solution at the corner (1, 4) , which is 11 in value.
This example shows that a linear programming problem may not have a finite solution
when the feasible region is unbounded. However, when a solution does exist, it may be
found by inspecting the corners in the normal way. In practice, linear programming
problems arise from realistic economic situations. We would therefore expect the
problem to possess a sensible (that is, finite) answer and so the difficulty of the non-
existence of a solution rarely occurs.
Example 5.8
A small manufacturer produces two kinds of good, A and B, for which the demand
exceeds capacity. The production costs for A and B are $6 and $3, respectively for each
unit. The corresponding selling prices are $7 and $4. In addition, the transport costs are
20 cents and 30 cents for each good of type A and B, respectively. The conditions of a
As we have discussed before, there are three things constituting a linear programming
problem: a pair of unknown x and y, an objective function that needs maximizing and
minimizing, and some constraints. We consider each of these in turn. The manufacturer
has to decides how many of good A and good B to produce each week. These are
therefore the unknowns of this problem and we denote these unknowns by x and y; that
is, we let
x= number of goods of type A to be made each week
y=number of goods of type B to be made each week
The final sentence of the problem states that the manufacturer should choose these
quantities to maximize profit. Hence we need to find a formula for profit in terms of x
and y. For each type of good A the production costs are $6 and the transport costs are 20
cents. The total cost is therefore $6.20. If the selling price is $7, the profit made on the
single item of A is 80 cents. Consequently, when x goods of type A are made the total
profit is x times this amount, $0.8x. Notice that the question states that ‘demand exceeds
capacity’, so that all goods are guaranteed to be sold. Exactly the same reasoning can be
applied to B. The profit is 70 cents each, so when y goods of type B are made the total
profit is $0.7y.Hence, the profit resulting from the production of both A and B is
0.8x+0.7y
This is then the objective function that we want to maximize.
The next thing to do is that to specify the restrictions that imposed on the production
level. The total weekly production cost must not exceed $2700. The production costs are
$6 for A and $3 for B. Hence, if x goods made type of A and y goods made type of B the
total cost is
6x+3y ≤ 2700
Collecting all information together, the linear programming problem may be stated as
follows:
Maximize: 0.8x+0.7y
Subjected to:
6x+3y ≤ 2700
0.2x+0.3y ≤ 120
Step 1:
As usual non-negativity constraints indicate that we need only consider points in the
positive quadrant. The line 6x+3y=2700 passes through points (0, 900) and (450, 0). The
line 0.2x+0.3y=120 passes through points (0,400) and (600, 0). Using the origin as the
test point reveals that the region of interest lies below both lines. It is sketched in Figure
5.12.
Step2:
The feasible region has four corners altogether, three of which have obvious coordinates
(0, 0), (0, 400), and (450, 0). Unfortunately, it is not at all easy to read off from the
diagram the exact coordinates of the remaining corner. This is formed by the intersection
of two lines
6x+3y ≤ 2700
0.2x+0.3y ≤ 120
The fourth corner therefore has coordinates (375, 150).
Step 3:
Corner Objective function value
(0, 0) 0
(0, 400) 280
(450, 0) 360
(375, 150) 405
The maximum weekly profit is $405, which occurs when 375 goods of A and 150 goods
of B are manufactured.
This example does suggest the following general strategy, which might be helpful:
i. Identify the unknowns and label them x and y
ii. Write down an expression for the objective function in terms of x and y, and
decide whether it needs maximizing and minimizing
iii. Write down all constraints on the variables x and y.
Activity 5.5
The simplex method is an iterative algorithm (or matrix method) which is a systematic
repetitive solution procedure to obtain the best possible solution under the given
constraints. In every step, the method indicates whether the solution obtained is optimal,
if not, it specifies how to find an improved solution. This method is a little bit long, so we
shall discuss the whole procedure step by step for solving linear programming problems.
we add a non-negative variable “” on the left hand side to convert it into the equality
equation,
Where “s” denotes slack variable and “” with the subscript 1 implies slack in the first in
equation and “” is slack in the second equation. Thus, in this case slack variable can be
considered as the difference between the requirement and the amount produced.
Similarly, the inequality constraint of greater than or equal to, “≥”, in a linear
programming problem can be changed into equations by subtracting some negative
variables form left hand side of the constraint function. These variables are called surplus
variables.
we subtract a non-negative variable “” on the left hand side to convert it into the equality
equation,
Where “s” denotes slack variable and “” with the subscript 1 implies slack in the first in
equation.
For instance, if the constraint function is then multiplying both sides by -1 we get +in
which =16 is positive. By similarly, can be written as.
Here it is possible to notice that any linear constraint can be converted to linear equation
with the introduction of a slack and surplus variables and making allpositive. A linear
programming problem in which all constraints are in the form of equations is called a
Standard Linear Programming Problem.
NB: Row operations play a significant role in applying simplex method, so please recall
back the techniques of row operations first.
Example 5.9
Step 1:
Note that we add 0s1+0s2=0 to the objective function and s1+0s2= s1 to constraint one
and 0s1+s2 = s2 to constraint two. In other word, s1 and s2 should appear in the objective
function with coefficient zero, s 1 with coefficient 1 and s2 with zero coefficients in the
first constraint, ands1 with zero coefficient and s2 with coefficient 1 in the second
constraints.
Step 2:
We write the initial augmented matrix ignoring the non-negativity constraints and the
symbol Z1 but considering remaining number coefficients of the equations.
x1 x2 x3 s1 s2 bi ratio
2 1 3 1 0 36 36/3=12
1 2 1 0 1 42 42/1=42
-1 -4 -5 0 0 0 0
Step 3:
The next step involves the activity of determining pivot column, pivot row and pivot
entry. We see that the negative number with the largest absolute value in the objective
row is -5. The column containing the largest negative in absolute value is termed as the
pivot column.
The intersection of the pivot row and pivot column determines the pivot element of the
augmented matrix. Thus, in the above matrix the pivot element is 3.
Step 4:
The next step in the general procedure of simplex method is termed as pivoting.This
consists of several row operations. Divide the pivotal row by the pivot (key entry) and
then add suitable multiples of this row to each of the other rows so that each entry except
the pivot (1) in the pivotal row becomes zero.
x1 x2 x3 s1 s2 bi Ratio ratio
operation
2/3 1/3 1 1/3 0 12 r=1/3 r1 12*3=36
1/3 5/3 0 -1/3 1 30 r=r2-r1 30*3/5=18
7/3 -7/3 0 5/3 0 60 r=r3+5r1 60*3/726
This denotes the matrix in the second step of the simplex approach. The solution 12, 30,
and 60 is not optimal solution since the objective function row has the negative element,
which is -7/3.
Step 5:
Thus, procedurally we need to repeat step 3 and 4 until the objective row contains non
negative elements. Since -7/3 is the only negative element in the last row, x2, column is
the pivotal column. Again, since the ratio30*3/5=18 is least, the second row is the pivotal
row and 5/3, which is the intersection of pivotal column and row is the pivot element.
We see that the objective row (last row) contains no negative entries and hence this is the
final optimal simplex matrix.
Step 6:
Now to find the value of each variable for which z is maxima we proceed as follows. If
in a column of the final simplex matrix one element is 1 and the other elements are all
zeros, then the last entry in the row containing 1 is the value of the corresponding
variable. Otherwise the value of the variable is zero. Thus, x1 =0, x2=18, x3=6, s1=0, s2 =
0, and the Maximum value of z is 102.
Example 5.10
Solution:
Introducing slack variables S1, S2 and S3 we convert the given inequalities into equations
and rewrite the constraints and the objective functions as follows:
The initial augmented simplex matrix of the above linear programming problem is
x1 x2 s1 s2 s3 bi ratio
x1 x2 s1 s2 s3 bi Ratio
operation
0 7/2 1 -1/4 0 5 r=r1-r2
1 1/2 0 1/4 0 3 r=1/4r2
0 2 0 -1/2 1 8 r=r3-2r2
0 1/2 0 5/4 0 15 r=r4+5r2
We see that the objective row contains no negative entries. Hence, this is the final
optimal simplex for the above linear programming problem given and the maximum
value of the objective function is z=15. This maximum value is obtained for x1=3, x2=0,
s1=5, s2=0, and s3=8.
i. x1 column (1st column) consists all zero entries except the 2 nd row which is 1, then
value of x1 is obtained in the constant column (bi) corresponding to 2nd row, i.e., x1=3
ii. x2=0, since the entries of the 2nd column doesn’t satisfy the condition
iii. s1 = 5, since all entries except the first row (1) are zeros’
iv. s2=0, because it does not satisfy the condition
v. s3 =8, since all entries except the third row (1) are zeros. Z=5(3)+2(0)
Example 5.11
Solution:
3 4 1 1 0 2 2/4=1/2
1 3 2 0 1 1 1/3
-3 -6 -2 0 0 0 0
The last row is the objective row clearly 2 nd column is the pivotal column and the entry 3
corresponding to the least ratio is a pivot entry.
Pivoting this matrix we get the following simplex matrix
x1 x2 x3 s1 s2 bi Ratio ratio
operation
5/3 0 -5/3 1 -4/3 2/3 r=r1-4r2 2/3*3/5=2/5
1/3 1 2/3 0 1/3 1/3 r=1/3r2 1/3*3/1=1
-1 0 2 0 2 2 r=r3+6r2 2/1=2
In the above simplex matrix, first column is the pivotal column and the entry 5/3
corresponding to the least ratio 2/5 is a pivot entry and since the last row contains a
negative entry, the procedure continues.
We see that the last row (objective row) contains no negative entries. Thus, the matrix
reaches at its optimal stage. Accordingly, the maximum value of the objective function is
z =12/5 which is obtained for x1=2/5, x2=1/5, x3=0, s1=0,and s2=0.
Activity 5.6
Solution:
Clearly to minimize z = x1-2x2+8 is to means maximize –z= -x1+2x2-8(Multiplying both
sides by -1). Introducing slack variables s1, s2 and s3 we can rewrite the constraints as
follows:
1 1 1 0 0 7 7/1=7
-1 1 0 1 0 1 1/1=1
1 0 0 0 1 5
1 -2 0 0 0 -8
Clearly the second column is the pivotal column and the entry 1 is the pivot entry.
We see that the objective row except the last entry contains no negative entries. Hence,
this is the final simplex matrix and the maximum value of the objective function z=-3
which is obtained for x1=3, x2=4, s1=0, s2=0, s3=2. Hence, the minimum value of z =
Max. Value of –z = 3
Activity 5.7
The method discussed in the earlier section cannot be used here. In such a situation we
transform the given linear programing problem to a new linear programming problem as
under:
Where i= 1, 2, 3. . . n
This new linear programming problem is called dual to the first linear programming
problem. The former is called primal to the latter. The dual can now be solved by means
of the simplex method described earlier.
Theorem: Primal has optimal solution if and only if dual has optimal solution and further
minimum z = maximum. Using the duality principle, we can, by means of simplex
method, solve linear programming problems of minimization with “>” constraints.
Example 5.13
using the simplex method we can solve the dual linear programming problem and use the
original variables x1 and x2 as slack variables of the dual problem.
2 1 1 1 0 2 2/1=2
1 3 3 0 1 4 4/31.34
-14 -12 -18 0 0 0
Hence, the optimal value for the dual linear programming problem is Max = 136/5
which obtained at y1=2/5, y2 = 0 and y3 =6/5 or it is obtained at x1=24/5 and x2=22/5.
Example 5.14
Solution:
Dual of the above linear programming problem will be
Accordingly, the initial simplex matrix of the given dual linear programming problem is
y1 y2 x1 x2 x3 bi ratio
1 3 1 0 0 2 2/1=2
4 1 0 1 0 9 9/42.25
2 2 0 0 1 1 ½=0.5
-5 -4 0 0 0 0
We can see that this is the final simplex matrix. Hence, the optimal value for the dual
linear programming problem is Max = 5/2 which obtained at y1=1/2 and y2 = 0 or it is
obtained at x1=3/2, x2=7 and x3=0.
Review Exercise
b) A factory uses three different resources for the manufactures of two different
products. 20 units of the resource A,12 units of B and 16 unit of C being
available 1 unit of the first product requires 2,2 and 4 units of the respective
resources and 1 unit of the second product requires 4,2 and 0 units of the
respective resources. It is known that the first product gives a profit of $2 per
unit and the second $3. Formulate the linear programming problem. How
many units of each product should be manufactured for maximizing the
profit? Solve it graphically.
c) A farmer has 100 acres of land on which he can grow corn, wheat or bean.
Each acre of corn costs birr 100 for preparation, requires 7 man days of work
and yields a profit of birr 30. An acre of wheat costs birr 120 to prepare,
requires 10 man days of work and yields a profit of birr 40. An acre of bean
costs birr 70 to prepare, requires 8 man day of work and yields profit of birr
20. If the farmer has birr 100,000 for preparation and can count on 8000 man-
days work, how many acres should be allocated to each crop to maximize the
total profit?(Answer: corn= 250 acres, wheat 625 acres, bean 0 acres and
profit = 32500).
d) A television company has three major departments for its manufacture of two
models A and B.
Per unit time requirements (hours)
Model A Model B Model C
Department I 4.1 2.0 1,600
Linear Algebra for Economists Lecture note, Wollega University, 115
Department of Economics
By:Kumadebis Tamiru
Department II 2.5 1.0 1,200
Department III 4.5 1.5 1,600
The Marginal profit of model A is birr 400 each and that of model B is birr
100 each. Assuming that the company can sell any quantity of either product
due to favorable market conditions, determine the optimum output for both
models and highest possible profit for this month. (Answer: 800/3 units of
both A and B. Maximum profit is birr 1333.3)
e) Food x contains 6 units of vitamin A per gram and 7 units of vitamin B per
gram and cost 12 birr per gram. Food y contains 8 units of vitamin A per
gram and 12 units of vitamin B per gram and cost 20 birr per gram. The daily
minimum requirements of vitamin A and vitamin B are 100 units and 120
units respectively. Find the dual problem and the minimum cost of the
product mix. (Answer: Food x = 15 units, Food Y= 5/4 units and minimum
cost = birr 2.05)
Reference
Monga, G.S., (1972), Mathematics And Statistics For Business And Economics,
Vicas Publishing House.