

Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
This handout provides definitions, theorems, and correlations related to matrices and vectors, including matrix equality, addition and subtraction, scalar multiplication, transpose, inverse, rank, eigenvectors, quadratic forms, and linear transformations. It also covers linear equations and matrix calculus.
Typology: Study notes
1 / 3
This page cannot be seen from the preview
Don't miss anything!


Notation: Capital letters denote matrices. Small bold letters denote vectors. Small unbold letters denote scalars. Unprimed small bold letters denote column vectors, primed small bold letters denote row vectors.
Things which you should know about matrices and vectors.
Matrix, column vector, row vector, square matrix, diagonal matrix, scalar matrix, identity matrix, matrix equality, matrix addition and subtraction, scalar multiplication, matrix multiplication,
A' = the transpose of A A-1^ = the inverse of A (AB)' = B'A' assuming that A and B are conformable for multiplication. (AB)-1^ = B-1A-1^ assuming both inverses exist. (A')-1^ = (A-1)'
DEF: a square matrix which has an inverse is said to be nonsingular DEF: A is symmetric if A = A' DEF: A is idempotent if AA = A DEF: The trace of a square matrix is the sum of the diagonal elements.
DEF: Two vectors x and y are said to be orthogonal if
DEF: a set of vectors x 1 , x 2 , ... xn is said to be linearly dependent if there exists a set of scalars a 1 , a 2 , ... an, not all zero, such the a 1 x 1 + a 2 x 2 + ... + anxn = 0. Otherwise the set of vectors is said to linearly independent.
DEF: The rank of a matrix is the maximum number of linearly independent rows or columns. (Note: Given an n x m matrix A, rank(A) minimum of n and m.)
Thm: For any matrix A, rank(A) = rank(A') = rank(A'A)
DEF: let A be a square matrix. A non-zero vector x is said to be an eigenvector of A if there exists a
DEF: x'Ax is called a quadratic form. (Note: any quadratic form can be expressed as a quadratic form with a symmetric matrix.)
DEF: A is positive definite if x'Ax > 0 for every
DEF: A is positive semidefinite if for every
Thm: If A is symmetric and idempotent then i) rank(A) = trace(A) ii) A is positive semidefinite
Thm: Trace(AB) = trace (BA)
Corr: trace(ABC) = trace(CAB) = trace(BCA)
Thm: If A is positive definite then A is nonsingular
Thm: A is positive definite if and only if all its eigenvalues are positive
Thm: Trace(A) = sum of the eigenvalues of A
DEF: A set of vectors V which is closed under addition and multiplication by a scalar is called a vector space.
DEF: Given a set of vectors S, the set of all the vectors which can be expressed as a linear combination of the vectors in S is a vector space. It is called the space spanned by the set of vectors in S.
DEF: A linearly independent set of vectors in a vector space which spans the whole space is called a basis of the vector space.
DEF: The dimension of a vector space is the number of vectors in any basis.
Note: The rank of a matrix is the dimension of the vector space spanned by its column vectors (or row vectors.)
DEF: A linear transformation is a transformation T such that for any vectors x and y and any scalars a and b T(ax + by) = aT(x) + bT(y). A linear transformation can always be represented by a matrix.
DEF: A linear transformation represented by a matrix P is a projection if and only if P is symmetric and idempotent.
Linear equations: Let A be an n x m matrix. Let y be a known vector and x be an unknown vector. Then the matrix equation Ax = y would represent m equations in n unknowns. A solution exists if and only if the vector y lies in the space spanned by the column vectors of A.
Matrix calculus: (See Gujariti, Appendix B.6.)