Matrix Reference Manual: Special Matrices (original) (raw)

Go to: Introduction, Notation, Index


Antisymmetric

see skew-symmetric .


Bidiagonal

A is upper bidiagonal if _a(i,j)=_0 unless _i=j_or _i=j-_1.
A is lower bidiagonal if _a(i,j)=_0 unless i=j or_i=j+_1

A bidiagonal matrix is also tridiagonal, triangular and Hessenberg.


Bisymmetric

A[n#_n_] is bisymmetric if it is symmetric about both main diagonals, i.e. ifA=A_T_=JAJ where J is the exchange matrix.

WARNING: The term persymmetric is sometimes used instead of bisymmetric. Also bisymmetric is sometimes used to mean centrosymmetric and sometimes to meansymmetric and perskewsymmetric.


Block Diagonal

A is block diagonal if it has the form [A 0 ...0; 0 B ... 0;...;0 0 ... Z] where A,B, ..., Z are matrices (not necessarily square).


Centrohermitian

A[m#_n_] is centrohermitian if it is rotationally hermitian symmetric about its centre, i.e. ifA_T_=JA_H_J where J is theexchange matrix.


Centrosymmetric

A[m#_n_] is centrosymmetric (also called perplectic) if it is rotationally symmetric about its centre, i.e. if A=JAJ where J is the exchange matrix. It is centrohermitian ifA_T_=JA_H_J and centroskew-symmetric if A= -JAJ.


Circulant

A circulant matrix, A[n#n_], is aToeplitz matrix in which ai,j is a function of {(i-j)_ modulo n}. In other words each column ofA is equal to the previous column rotated downwards by one element.

WARNING: The term circular is sometimes used instead of circulant.


Circular

A Circular matrix, A[n#_n_], is one for which AAC = I.

WARNING: The term circular is sometimes used for a circulant matrix.


Companion Matrix

If p(x) is a polynomial of the form a(0) + a(1)*x +a(2)*x_2 + ... +a(n)*xn_ then the polynomial's companion matrix is n#n and equals [0 I; -a(0:n-1)/a(n)] whereI is _n_-1#_n_-1. For _n_=1, the companion matrix is [-a(0)/a(1)].

The rows and columns are sometimes given in reverse order [-a(_n_-1:0)/a(n) ; I 0].


Complex

A matrix is complex if it has complex elements.

Complex to Real Isomporphism

We can associate a complex matrix C[m#n_]with a corresponding real matrix R[2_m#2_n_]by replacing each complex element, z, of C by a 2#2 real matrix [z R -zI; zI z _R_]=|z|×[cos(t) -sin(t); sin(t) cos(t)] where _t_=arg(z). We will writeC <=> R for this mapping below.

Vector mapping: Under the isomorphism a complex vector maps to a real matrix: z[n_] <=>Y[2_n#2]. We can also define a simpler mapping, <->, from a vector to a vector as z[_n_]<-> x[2_n_] = z ⊗ [()R; ()_I_] = Y [1; 0]

In the results below, we assume z[_n_] <->x[2_n_] , w[_n_] <->u[2_n_] and C <=> R:

To relate the martrix and vector mappings, <-> and <=>, we define the following two block-diagonal matrices: E =I[n#_n_] ⊗ [0 1; 1 0] and N = I[n#_n_] ⊗ [1 0; 0 -1]. We now have the following properties (assuming z[_n_] <->x[2_n_] and C <=>R):


Convergent

A matrix A is convergent if Ak tends to0 as k tends to infinity.

See also: Stability


Cyclic Permutation Matrix

The n#n cyclic permutation matrix (or cyclic shift matrix), C, is equal to [0n_-1_T 1;In_-1#n_-1 0n_-1]. Its elements are given by_ci,j = δ_i,1+(j mod_n) where δ_i_,j is the Kronecker delta.


Decomposable

A matrix, A, is fully decomposable (or reducible) if there exists a permutation matrix P such that PTAP is of the form [B C; 0 D] where B and D are square.
A matrix, A, is partly-decomposable if there exist permutation matrices P and Q such thatPTAQ is of the form [B C; 0 D] where B and D are square.
A matrix that is not even partly-decomposable isfully-indecomposable.


Defective[!]

A matrix, X:n#n, is defective if it does not have_n_ linearly independent eigenvectors, otherwise it is simple.


Derogatory

An n*n square matrix is derogatory if its minimal polynomial is of lower order than n.


Diagonal

A is diagonal if a(i,j)=0 unless i=j.

The functions DIAG(x) and diag(X) respectively convert a vector into a diagonal matrix and the diagonal of a square matrix into a vector. The function sum(X) sums the rows of X to produce a vector. In the expression below, • denotes elementwise (a.k.a. Hadamard) multiplication.


Diagonalizable or Diagonable or Simple or Non-Defective

A matrix, X, is diagonalizable (or, equivalently, simple or diagonable or non-defective) if it is similar to a diagonal matrix otherwise it is defective.


Diagonally Dominant

A square matrix An#n is diagonally dominant if the absolute value of each diagonal element is greater than the sum of absolute values of the non-diagonal elements in its row. That is if for each i we have |ai,i| > sum_j_!= i(|ai,j|) or equivalentlyabs(diag(A)) > ½ABS(A)1n#1.


Discrete Fourier Transform

The discrete fourier transform matrix,F[n#n_], has_fp,q = exp(-2_j_π(_p_-1) (_q_-1) _n_-1).


Doubly-Stochastic

A real non-negative square matrix A is doubly-stochasticif its rows and columns all sum to 1.

See under stochastic for properties.


Essential

An essential matrix, E, is the product E=US of a 3#3 orthogonal matrix, U, and a 3#3 skew-symmetric matrix, S = SKEW(s). In 3-D euclidean space, a translation+rotation transformation is associated with an essential matrix.


Exchange

The exchange matrix J[_n#n_] is equal to [en e_n_-1 …e2 e1] whereei is the _i_th column of I. It is equal to I but with the columns in reverse order.


Givens Reflection

[_Real_]: A Givens Reflectionis an n#n matrix of the form PT[Q 0 ; 0 I]P where P is any permutation matrix andQ is a matrix of the form [cos(x) sin(x); sin(x) -cos(x)].


Givens Rotation

[_Real_]: A Givens Rotation is an n#n matrix of the form PT[Q 0 ; 0 I]Pwhere P is a permutation matrix and Qis a matrix of the form [cos(x) sin(x); -sin(x) cos(x)].


Hadamard [!]

An n*n Hadamard matrix has orthogonal columns whose elements are all equal to +1 or -1.


Hamiltonian

A real 2_n*2_n matrix, A, is Hamiltonian ifKA is symmetric where K = [0 I; -I 0].

See also: symplectic


Hankel

A Hankel matrix has constant anti-diagonals. In other words_a(i,j)_ depends only on (i+j).


Hermitian

A square matrix A is Hermitian if A =AH, that isA(i,j)=conj(A(j,i))

For real matrices, Hermitian and symmetricare equivalent. Except where stated, the following properties apply to real symmetric matrices as well.

See also: Definiteness, Loewner partial order


Hessenberg

A Hessenberg matrix is like a triangular matrix except that the elements adjacent to the main diagonal can be non-zero.
A is upper Hessenberg if A(i,j)=0 whenever i>j+1. It is like an upper triangular matrix except for the elements immediately below the main diagonal.
A is lower Hessenberg if _a(i,j)_=0 whenever_i<j_-1. It is like a lower triangular matrix except for the elements immediately above the main diagonal.


Hilbert

A Hilbert matrix is a square Hankel matrix with elements_a(i,j)_=1/(_i+j_-1).


Homogeneous

If we define an equivalence relation in which X ~ Y iff X = cY for some non-zero scalar c, then the equivalence classes are called homogeneous matrices and homogeneous vectors.


Householder

A Householder matrix (also called Householder reflection or transformation) is a matrix of the form**(I-2vv**H) for some vector v with ||v||=1.

Multiplying a vector by a Householder transformation reflects it in the hyperplane that is orthogonal to v.

Householder matrices are important because they can be chosen to annihilate any contiguous block of elements in any chosen vector.


Hypercompanion

The hypercompanion matrix of the polynomial_p_(x)=(x-a)n is an n#n_upper bidiagonal matrix, H, that is zero except for the value a along the main diagonal and the value 1 on the diagonal immediately above it. That is, hi,j = a if_j=i, 1 if j=i+1 and 0 otherwise.

If the real polynomial_p_(x)=(x_2_-ax-b)n with_a_2+4_b_<0 (i.e. the quadratic term has no real factors) then its Real hypercompanion matrix is a 2_n_#2_n_ tridiagonal matrix that is zero except for a_at even positions along the main diagonal, b at odd positions along the sub-diagonal and 1 at all positions along the super-diagonal. Thus for odd_i, hi,j = 1 if j=i+1 and 0 otherwise while for even i, hi,j = 1 if j=i+1, a if_j=i_ and b if _j=i_-1.


Idempotent [!]

P matrix P is idempotent if P2 =P . An idempotent matrix that is also hermitianis called a projection matrix.

WARNING: Some people call any idempotent matrix a projection matrix and call it an orthogonal projection matrix if it is also hermitian.


Identity[!]

The identity matrix , I, has _a(i,i)_=1 for all i and_a(i,j)_=0 for all i !=j


Impotent

A non-negative matrix T is impotent if min(diag(Tn)) = 0 for all integers _n_>0 [seepotency].


Incidence

An incidence matrix is one whose elements all equal 1 or 0.


Integral

An Integral matrix is one whose elements are all integers.


Involutary (also written Involutory)

An Involutary matrix is one whose square equals the identity.


Irreducible

see under Reducible


Jacobi

see under Tridiagonal


Monotone

A matrix, A, is monotone iff A-1is non-negative, i.e. all its entries are >=0.

In computer science a matrix is monotone if its entries are monotonically non-decreasing as you move away from the main diagonal along either a row or column.


Nilpotent [!]

A matrix A is nilpotent to index k ifAk = 0 but A_k-_1 != 0.


Non-negative

see under positive


Normal

A square matrix A is normal ifAHA = AAH


Orthogonal [!]

A real square matrix Q is orthogonal if Q'Q =I. It is a proper orthogonal matrix if det(Q)=1 and an_improper orthogonal_ matrix if det(Q)=-1.

For real matrices, orthogonal and unitary mean the same thing. Most properties are listed under unitary.

Geometrically: Orthogonal matrices in 2 and 3 dimensions correspond to rotations and reflections.


Permutation

A square matrix P is a permutation matrix if its columns are a permutation of the columns of I.


Persymmetric

A matrix A[n#_n_] is persymmetricif it is symmetric about its anti-diagonal, i.e. ifA=JATJ where J is the exchange matrix. It is perhermitian ifA=JAHJ and perskewsymmetric if A= -JATJ.

WARNING: The term persymmetric is sometimes used for a bisymmetric matrix.


Polynomial Matrix

A polynomial matrix of order p is one whose elements are polynomials of a single variable x. ThusA=A(0)+A(1)x+...+A(p)_xp_where the A(i) are constant matrices and A(p) is not all zero.

See also regular.


Positive

A real matrix is positive if all its elements are strictly > 0.
A real matrix is non-negative if all its elements are >= 0.


Positive Definite

see under definiteness


Primitive

If k is the eigenvalue of a matrix An#n having the largest absolute value, then A is primitive if the absolute values of all other eigenvalues are < |k|.


Projection

A projection matrix (or orthogonal projection matrix) is a square matrix that is hermitian and idempotent: i.e.P_H_=P2=P.

WARNING: Some people call any idempotentmatrix a projection matrix and call it an _orthogonal projection_matrix if it is also hermitian.


Quaternion

Quaternions are a generalization of complex numbers. A quaternion consists of a real component and three independent imaginary components and is written as r+xi+yj+zk where_i_2=_j_2=_k_2=ijk_=-1. It is approximately true that whereas the polar decomposition of a complex number has a magnitude and 2-dimensional rotation, that of a quaternion has a magnitude and a 3-dimensionl rotation (see below). Quaternions form a_division ring rather than a field because although every non-zero quaternion has a multiplicative inverse, multiplication is not in general commutative (e.g. ij=-ji=k). Quaternions are widely used to represent three-dimensional rotations in computer graphics and computer vision as an alternative to orthogonal matrices with the following advantages: (a) more compact, (b) possible to interpolate, (c) does not suffer from "gimbal lock", (d) easy to correct for drift due to rounding errors.

We can represent a quaternion either as a real 4-vectorq_R_=[_r x y z_]T or a complex 2-vector q_C_=[_r+jy x+jz_]T. This gives r+xi+yj+zk = [1 _i j k_]qR = [1_i_]qC. We can also represent it as a real 4#4 matrix Q_R_=[r -x -y -z; x r -z y; y z r -x; _z -y x r_] or a complex 2#2 matrixQ_C_=[r+jy -x+jz; _x+jz r-jy_]. Both the real and the complex quaternion matrices obey the same arithmetic rules as quaternions, i.e. the quaternion matrix representing the result of applying +, -, * and / operations to quaternions is the same as the result of applying the same operations to the corresponding quaternion matrices. Note thatq_R_=Q_R_[1 0 0 0]T andq_C_=Q_C_[1 0]T; we can also define the inverse functionsQ_R_=QUATR(qR) andQ_C_=QUATC(qC). Note that the real and complex representations given above are not the only possible choices.

In the following,P_R_=QUATR(pR),Q_R_=QUATR(qR),K=DIAG([-1 1 1 1]) and q_R_=[_r x y z_]_T_=[r; w].PC,pC,Q_C_and qC are the corresponding complex quantities; the subscripts R and C are omitted below for results that apply to both real and complex representations.


Rank-one

A non-zero matrix A is a rank-one matrix iff it can be decomposed as A=xyT.


Reducible

A matrix An#n is reducible (or fully decomposable) if if there exists a permutation matrix P such thatPTAP is of the form [B C; 0 D] where B and D are square. As a special case01#1 is regarded as reducible. A matrix that is not_reducible_ is irreducible.

WARNING: The term reducible is sometimes used to mean one that has more than one block in its Jordan Normal Form.


Regular

A polynomial matrix, A, of order _p_is regular if det(A) is non-zero.


Rotation Matrix

[_Real_]: A Rotation matrix,R, is an n*n matrix of the form R=U [Q 0 ; 0 I]UT where U is any orthogonal matrix and Q is a matrix of the form [cos(x) -sin(x); sin(x) cos(x)]. Multiplying a vector by R rotates it by an angle x in the plane containingu and v, the first two columns of U. The direction of rotation is such that if _x_=90 degrees, u will be rotated tov.


Shift Matrix

A shift matrix, or lower shift matrix, Z, is a matrix with ones below the main diagonal and zeros elsewhere.
ZT has ones above the main diagonal and zeros elsewhere and is an upper shift matrix.


Signature

A signature matrix is a diagonal matrix whose diagonal entries are all +1 or -1.


Simple

An n*n square matrix is simple (or, equivalently,diagonalizable or diagonalizable or_non-defective_) if all its eigenvalues are regular, otherwise it isdefective.


Singular

A matrix is singular if it has no inverse.


Skew-Hermitian

A square matrix K is Skew-Hermitian (or_antihermition_) if K = -KH, that is_a(i,j)_=-conj(a(j,i))

For real matrices, Skew-Hermitian and skew-symmetric are equivalent. The following properties apply also to real skew-symmetric matrices.


Skew-Symmetric[!]

A square matrix K is skew-symmetric (or_antisymmetric_) if K = -KT, that is_a(i,j)_=-a(j,i)

For real matrices, skew-symmetric and Skew-Hermitian are equivalent. Most properties are listed under skew-Hermitian .


Sparse

A matrix is sparse if it has relatively few non-zero elements.


Stability

A Stability or Stable matrix is one whose eigenvalues all have strictly negative real parts.
A semi-stable matrix is one whose eigenvalues all have non-positive real parts.

See also: Convergent


Stochastic

A real non-negative square matrix A isstochastic if all its rows sum to 1.!. If all its columns also sum to 1 it is Doubly Stochastic.


Sub-stochastic

A real non-negative square matrix A issub-stochastic if all its rows sum to <=1.


Subunitary

A is subunitary if ||AAHx|| = ||AHx|| for all x. A is also called a_partial isometry_.

The following are equivalent:

  1. A is subunitary
  2. AHA is a projection matrix
  3. AAHA = A
  4. A+ = AH

Symmetric[!]

A square matrix A is symmetric if A =AT, that is a(i,j) = a(j,i).

Most properties of real symmetric matrices are listed under Hermitian .

See also Hankel.


Symmetrizable

A real matrix, A, is symmetrizable ifATM = MA for some positive definite M.


Symplectic

A matrix, A[2_n_#2_n_], issymplectic if AHKA=K where Kis the antisymmetric orthogonal matrix [0 I; -I 0].

See also: hamiltonian


Toeplitz

A toeplitz matrix, A, has constant diagonals. In other words ai,j depends only on i-j.We defineA=TOE(b[m+_n_-1])[m#_n_]to be the m#n matrix with ai,j =b _i_-j+n. Thus, b is the column vector formed by starting at the top right element of A, going backwards along the top row of A and then down the left column of A.
In the topics below, J is the exchangematrix.

Some special cases of this are:


Triangular

A is upper triangular if a(i,j)=0 whenever_i>j._ A is lower triangular if _a(i,j)_=0 whenever i<j.
A is triangular iff it is either upper or lower triangular.
A triangular matrix A is strictly triangular if its diagonal elements all equal 0.
A triangular matrix A is unit triangular if its diagonal elements all equal 1.


Tridiagonal or Jacobi

A is tridiagonal or Jacobi if A(i,j)=0 whenever |i-j|>1. In other words its non-zero elements lie either on or immediately adjacent to the main diagonal.


Unitary

A complex square matrix A is unitary ifAHA = I. A is also sometimes called an isometry.

A real unitary matrix is called orthogonal .The following properties apply to orthogonal matrices as well as to unitary matrices.


Vandermonde

An Vandermonde matrix, V[_n#n_], has the form [1 x x•2 …x•n-1] for some column vector x. (wherex•2 denotes elementwise squaring). A general element is given by v(i,j) = (xi)_j_-1. All elements of the first column of the matrix equal 1. Vandermonde matrices arise in connection with fitting polynomials to data.

WARNING: Some authors define a Vandermonde matrix to be either the transpose or the horizontally flipped version of the above definition.


Vectorized Transpose Matrix

The vectorized transpose matrix, TVEC(m,n), is the mn#mn permutation matrix whose i,_j_th element is 1 if_j_=1+m(_i_-1)-(_mn_-1)floor((_i_-1)/n) or 0 otherwise.

For clarity, we write Tm,n =TVEC(m,n) in this section.


Zero

The zero matrix, 0, has a(i,j)=0 for all i,j


This page is part of The Matrix Reference Manual. Copyright © 1998-2022 Mike Brookes, Imperial College, London, UK. See the file <gfl.html> for copying instructions. Please send any comments or suggestions to "mike.brookes" at "imperial.ac.uk".
Updated: Id:special.html112912021−01−0518:26:10ZdmbId: special.html 11291 2021-01-05 18:26:10Z dmb Id:special.html112912021010518:26:10Zdmb