ALIPURDUAR GOVERNMENT ENGINEERING AND MANAGEMENT

COLLEGE
Rank nullity theorem

Name : Suman Kharia

Sem – 1 /CA -1
ROLL – 38700324008
Reg No. – 243870110192
Dept- ECE
 Contents
Topic
Page No.

Definitions: Rank and Nullity 01

Rank-Nullity Theorem 02
Statement
Geometric Interpretation 03-04

Proof of Rank-Nullity 05
Theorem
Applications of Rank- 06-08
Nullity Theorem
Column Space and Null 09
Space
example 10-12
Rank-Nullity Theorem 13
and Matrix
Transformations
Conclusion and Key 14
 Definitions: Rank and
Nullity
 Here are the definitions of
Rank and Nullity related to
linear algebra:

Rank:  Nullity:
The rank of a matrix AA is the The nullity of a matrix AA is the dimension
dimension of the column space (or of the null space (kernel) of AA. It is the
number of solutions to the homogeneous
row space) of AA. It is the
equation Ax=0 Ax=0 apart from the trivial
maximum number of linearly solution.
independent columns (or rows) in Mathematically:
the matrix. In other words, it is the Nullity(A)=dim(Nul(A)),Nullity(A)=dim(Nul(
number of pivots in the matrix A)),where Nul(A)Nul(A) is the null space
when it is reduced to its row of AA.
echelon form. Rank-Nullity Theorem:
Mathematically: For a matrix AA of size m×n ,m×n:
Rank(A)=dim(Col(A)),Rank(A)=dim( Rank(A)+Nullity(A)=n,Rank(A)
+Nullity(A)=n,where nn is the number of
Col(A)),where Col(A)Col(A) is the
columns of AA.
column space of AA.
Rank-Nullity Theorem
Statement
1. Dimension of 2. Equation
Domain
Formally, Rank(A) +
The dimension of the Nullity(A) =
domain of a linear Dimension(V), where A is
transformation is equal to a matrix representing the
the sum of its rank and transformation and V is
nullity. the vector space of the
domain.
 Geometric Interpretation
 Vector Space
A vector space is a mathematical structure composed of a set of
vectors, along with rules for adding two vector
together and multiplying a vector by a scalar, satisfying specific axioms
(for instance, associativity, distributivity, and the existence of a zero
vector).
 Column Space
Two sentence about Column Space
The column space of a matrix is the vector space generated by its columns in any linear combination,
giving a subspace of the original matrix. It describes what values of the corresponding linear
transformation map to zero; and determines for which solution the matrix equation
A*X=B;
 NULL SPACE
The null space of a matrix is the set of all vectors that satisfy
Ax = 0, where A is the matrix and x is the vector. It is the
subspace of the domain consisting of all vectors that are
mapped to the zero vector under the associated linear
transformation.
Proof of Rank-Nullity Theorem
 1. Basis for Null Space

 2. Extend to Basis for Domain

 3. Relationship to Column Space

 4. Conclusion: Rank + Nullity = Dimension

 Applications of Rank-Nullity Theorem

Computer Graphics
The Rank-Nullity Theorem has important applications in computer graphics, especially in transformations
and rendering processes:

 Geometric Transformations:
In transformations such as scaling, rotation, or projection, the rank-nullity theorem guarantees that the
space of possible inputs (domain) is divided into the image (rank) and the null space (nullity). For example,
when projecting 3D points onto a 2D plane, the nullity is the dimension of the lost depth information.

. Solving Linear Systems

The rank-nullity theorem will help figure out whether a system has only one solution (full rank) or an
infinite number of solutions (non-trivial null space). This determines whether the rendered images from
different viewpoints should be exactly the same, or how animations can be optimized without being too
realistic.
Engineering

The Rank-Nullity Theorem has numerous applications in engineering, especially in solving systems of
equations and analyzing systems:

 Structural Engineering:
In the analysis of truss structures, the rank-nullity theorem helps to compute the number of independent
equilibrium equations (rank) and the degree of indeterminacy (nullity), thus identifying if a structure is
stable, unstable, or statically indeterminate.

 Control Systems:
The theorem is applied in the study of the controllability and observability of linear systems. From the
rank of the controllability matrix, all the states of a system can be controlled, and from the nullity, which
of the modes are uncontrollable.

 Electrical Engineering:
In circuit analysis, rank-nullity theorem is used to determine independent loops and nodes, thus helping
simplify circuit equations using techniques such as Kirchhoff's laws.

 Signal Processing:
Understanding the dimensionality of signal spaces, especially in signal decompositions that utilize
independent components, analyzing redundancy or compression in data representation.
Data Analysis

The Rank-Nullity Theorem has several applications in data analysis, including dimensionality reduction, feature
selection, and solving systems of equations:

Dimensionality Reduction:
Techniques such as PCA make use of the rank-nullity theorem in understanding the relationship between the original
data space and the reduced feature space. The rank of the data matrix indicates the number of independent
features, and the nullity shows the dimensionality of the null space, which is usually filled with irrelevant or
redundant features.

Solving Linear Systems:

Data analysts often solve systems of linear equations in regression models, optimization problems, or machine
learning algorithms. Rank-nullity theorem helps to determine whether the solutions are consistent and unique. Lower
rank than expected may point to multicollinearity or dependence between variables and hence will affect the
model's accuracy.

Sparse Data Analysis:

In sparse matrices, common in recommender systems or large-scale data sets, the rank-nullity theorem can identify
the effective dimensionality of the data and help optimize algorithms for better storage and faster computation.
 Column Space and Null Space

 Column Space
 Null Space
The column space (or range) of a matrix is the set of all
The null space (or kernel) is the set of all vectors that
possible linear combinations of its columns. This
are mapped to the zero vector under the
represents the output space of a linear transformation.
transformation. This set represents the set of input
vectors that do not contribute to the transformation's
output..
Rank-Nullity Theorem and
Matrix Transformations
 Linear Transformation
The Rank-Nullity Theorem helps us understand how a linear
transformation transforms a vector space by relating the rank and
nullity of the transformation.

 Dimensionality
The theorem helps determine the dimensionality of the
transformed space, revealing how the input vector space is
compressed or expanded by the transformation.

 Kernel and Range

The theorem relates the kernel (null space) and range (column
space) of the transformation, providing insights into the properties
of the transformation.
Conclusion and Key Takeaways
The Rank-Nullity Theorem is a fundamental concept in linear algebra that helps us understand the relationship
between the rank, nullity, and dimension of vector spaces. It offers a powerful tool for analyzing linear
transformations and their properties.