Introduction to Linear Algebra (original) (raw)

Last Updated : 18 Apr, 2026

Linear Algebra is the branch of mathematics that studies vectors, matrices, and linear equations and how they interact.

It’s about solving systems like the following:

\begin{cases}2x + y = 5 \\x - y = 1\end{cases}

and understanding them in a structured, geometric, and algebraic way.

Types of Linear Algebra Study

Linear Algebra is divided into different branches based on the difficulty level of topics, which are,

Foundations of Linear Algebra

Elementary linear algebra introduces the foundational concepts that form the building blocks of the subject. It covers basic operations on matrices, solving systems of equations, and understanding vectors.

elementary_linear_algebra

**Scalars – Quantities with magnitude only (e.g., speed, mass, volume, etc.).
**Vectors – Quantities with both direction and magnitude, elements of a vector space (e.g., velocity, weight, friction, etc).
**Vector Space – A collection of vectors that can be added and scaled by scalars.
**Matrix – A rectangular array of numbers arranged in rows and columns.
**Matrix Operations – Arithmetic operations like addition, multiplication, and transposition.

Abstract Linear Algebra

Advanced/Abstract linear algebra mostly covers all the advanced topics related to linear algebra, such as Linear function, Linear transformation, Eigenvectors, and Eigenvalues.

advanced_linear_algebra

**Linear Transformations

A linear transformation is a special kind of function between vector spaces that preserves the operations of

In other words, if T is a linear transformation, then for any vectors u and v and scalar c:

T(u + v) = T(u) + T(v)

T(cu) = cT(u)

Eigenvalues and Eigenvectors

Eigenvalues and eigenvectors are fundamental concepts in linear algebra.

An eigenvector is a vector whose direction doesn’t change when a matrix is applied.
The eigenvalue is the factor by which that vector is scaled.

Mathematically:

A\mathbf{v} = \lambda \mathbf{v}

\mathbf{v} = eigenvector

\lambda = eigenvalue

Singular Value Decomposition

Singular Value Decomposition (SVD) is a powerful mathematical technique used in signal processing, statistics, and machine learning.

It decomposes a matrix into three other matrices, where one represents the rotation, another the scaling, and the third the final rotation.
It's essential for identifying the intrinsic geometric structure of data.

Practical Linear Algebra

In Applied Linear Algebra, the topics covered are generally the practical implications of Elementary and advanced linear Algebra topics such as the Complement of a matrix, matrix factorization, norm of vectors, etc.

applied_linear_algebra

Linear Programming

Linear programming is a method to achieve the best outcome in a mathematical model whose requirements are represented by linear relationships.

It is widely used in business and economics to maximize profit or minimize cost while considering constraints.
This is a technique for optimizing (maximizing or minimizing) a linear objective function, subject to linear equality and inequality constraints.
It's like planning the best outcome under given restrictions.

Linear Equation Systems

Systems of linear equations involve multiple linear equations that share the same set of variables.

The solution to these systems is the set of values that satisfy all equations simultaneously, which can be found using various methods, including substitution, elimination, and matrix operations.

Gaussian Elimination

Gaussian elimination is a systematic method for solving systems of linear equations.

It involves applying a series of operations to transform the system's matrix into its row echelon form or reduced row echelon form, making it easier to solve for the variables.
It is a step-by-step procedure to simplify a system of linear equations into a form that's easier to solve.

Important Linear Algebra Topics

Solved Examples

**Example 1: Find the sum of the two vectors \overrightarrow{\rm A} = 2i + 3j + 5k$ and \overrightarrow{\rm B} = -i + 2j + k$.

**Solution:

\overrightarrow{\rm A} + \overrightarrow{\rm B} = (2-1)i + (2 + 3)j + (5 + 1)k = i + 5j + 6k

**Example 2: Find the dot product of \overrightarrow{\rm P} = -2i + j + 3k and \overrightarrow{\rm Q} = i - 2j + k

**Solution:

\overrightarrow{\rm P}.\overrightarrow{\rm Q} = -2i(i - 2j + k) + j(i - 2j + k) + 3k(i - 2j + k)

= -2i -2j + 3k

**Example 3: Find the solution of x + 2y = 3 and 3x + y = 5

**Solution:

From x + 2y = 3 we get x = 3 - 2y

Putting this value of x in the second equation we get

3(3 - 2y) + y = 5
⇒ 9 - 6y + y = 5
⇒ 9 - 5y = 5
⇒ -5y = -4
⇒ y = 4/5

Putting this value of y in 1st equation we get

x + 2(4/5) = 3
⇒ x = 3 - 8/5
⇒ x = 7/5

**Example 4: Matrix Multiplication, Find the product of the matrices:

\:A=\left(\begin{matrix}\mathbf{1}&\mathbf{2}\\\mathbf{3}&\mathbf{4}\\\end{matrix}\right),\ \ \ \ B=\left(\begin{matrix}\mathbf{5}&\mathbf{6}\\\mathbf{7}&\mathbf{8}\\\end{matrix}\right)

**Solution:

AB=\left(\begin{matrix}1\bullet5+2\bullet7&1\bullet6+2\bullet8\\3\bullet5+4\bullet7&3\bullet6+4\bullet8\\\end{matrix}\right)=\left(\begin{matrix}5+14&6+16\\15+28&18+32\\\end{matrix}\right)=\left(\begin{matrix}19&22\\43&50\\\end{matrix}\right)

**Example 5: Eigenvalues of a Matrix. Find the eigenvalues of the matrix:

A=\left(\begin{matrix}\mathbf{3}&\mathbf{8}\\\mathbf{0}&\mathbf{6}\\\end{matrix}\right)

**Solution:

1. Write the characteristic equation:

A\ -\ \lambda I

2. Find the determinant (det) of characteristic equation:

\left|A - \lambda I\right|=\left|\begin{matrix}\mathbf{3}-\lambda&\mathbf{8}\\\mathbf{0}&\mathbf{6}-\lambda\\\end{matrix}\right|=(\mathbf{3}-\lambda)(\mathbf{6}-\lambda)-\mathbf{8}\bullet\mathbf{0}=(\mathbf{3}-\lambda)(\mathbf{6}-\lambda)

3. Equate the determinant with Zero "0":

(\mathbf{3}-\lambda)(\mathbf{6}-\lambda)=0 \Rightarrow \lambda=3,6

Therefore, the eigenvalues are 3, 6.

Practice Problems

**Question 1: Solve the system of equations:

x + y + z = 6
2x + 3y + 5z = 4
4x + 3y + z = 2

**Question 2: Find the eigenvalues and eigenvectors of the matrix:

\left(\begin{matrix}\mathbf{5}&\mathbf{0}\\\mathbf{7}&\mathbf{8}\\\end{matrix}\right)

**Question 3: Find the determinant of the matrix:

\left(\begin{matrix}\mathbf{3}&\mathbf{6}\\\mathbf{4}&\mathbf{8}\\\end{matrix}\right)

**Question 4: Find the product of the matrices:

A=\left(\begin{matrix}\mathbf{1}&\mathbf{2}\\\mathbf{6}&\mathbf{4}\\\end{matrix}\right),\ \ \ \ B=\left(\begin{matrix}\mathbf{5}&\mathbf{4}\\\mathbf{0}&\mathbf{2}\\\end{matrix}\right)