Matrix Theory and Linear Algebra: Definitions, Theorems, and Applications, Study notes of Econometrics and Mathematical Economics

This handout provides definitions, theorems, and correlations related to matrices and vectors, including matrix equality, addition and subtraction, scalar multiplication, transpose, inverse, rank, eigenvectors, quadratic forms, and linear transformations. It also covers linear equations and matrix calculus.

Typology: Study notes

Pre 2010

Uploaded on 08/16/2009

koofers-user-mnp
koofers-user-mnp 🇺🇸

10 documents

1 / 3

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Econ310
Handout # 1 Some Useful Matrix Results
Notation: Capital letter s denote matrices. Small bold letters denote vectors. Small unbold letters denote
scalars. Unprimed small bold letters denote column vectors, primed small bold letters denote row vectors.
Things which you should know about matrices and vectors.
Matrix, column vector, row vector, square matrix, diagonal matrix, scalar matrix, identity
matrix, matrix equality, matrix addition and subtraction, scalar multiplication,
matrix multiplication,
A' = the transpose of A
A-1 = the inverse of A
(AB)' = B'A' assuming that A and B are conformable for multiplication.
(AB)-1 = B-1A-1 assuming both inverses exist.
(A')-1 = (A-1)'
DEF: a square matrix which has an inverse is said to be nonsingular
DEF: A is symmetric if A = A'
DEF: A is idempotent if AA = A
DEF: The trace of a square matrix is the sum of the diagonal elements.
DEF: Two vectors x and y are said to be orthogonal if
DEF: a set of vectors x1, x2, ... xn is said to be linearly dependent if there exists a set of scalars a1, a2, ...
an, not all zero, such the a1x1 + a2x2 + ... + anxn = 0. Otherwise the set of vectors is said to linearly
independent.
DEF: The rank of a matrix is the maximum number of linearly independent rows or columns. (Note:
Given an n x m matrix A, rank(A) minimum of n and m.)
Thm: For any matrix A, rank(A) = rank(A') = rank(A'A)
DEF: let A be a square matrix. A non-zero vector x is said to be an eigenvector of A if there exists a
scalar : such that A: = :x. : is called an eigenvalue of the matrix A.
DEF: x'Ax is called a quadratic form. (Note: any quadratic form can be expressed as a quadratic form
with a symmetric matrix.)
DEF: A is positive definite if x'Ax > 0 for every
DEF: A is positive semidefinite if for every
Thm: If A is symmetric and idempotent then
i) rank(A) = trace(A)
ii) A is positive semidefinite
pf3

Partial preview of the text

Download Matrix Theory and Linear Algebra: Definitions, Theorems, and Applications and more Study notes Econometrics and Mathematical Economics in PDF only on Docsity!

Econ

Handout # 1 Some Useful Matrix Results

Notation: Capital letters denote matrices. Small bold letters denote vectors. Small unbold letters denote scalars. Unprimed small bold letters denote column vectors, primed small bold letters denote row vectors.

Things which you should know about matrices and vectors.

Matrix, column vector, row vector, square matrix, diagonal matrix, scalar matrix, identity matrix, matrix equality, matrix addition and subtraction, scalar multiplication, matrix multiplication,

A' = the transpose of A A-1^ = the inverse of A (AB)' = B'A' assuming that A and B are conformable for multiplication. (AB)-1^ = B-1A-1^ assuming both inverses exist. (A')-1^ = (A-1)'

DEF: a square matrix which has an inverse is said to be nonsingular DEF: A is symmetric if A = A' DEF: A is idempotent if AA = A DEF: The trace of a square matrix is the sum of the diagonal elements.

DEF: Two vectors x and y are said to be orthogonal if

DEF: a set of vectors x 1 , x 2 , ... xn is said to be linearly dependent if there exists a set of scalars a 1 , a 2 , ... an, not all zero, such the a 1 x 1 + a 2 x 2 + ... + anxn = 0. Otherwise the set of vectors is said to linearly independent.

DEF: The rank of a matrix is the maximum number of linearly independent rows or columns. (Note: Given an n x m matrix A, rank(A) minimum of n and m.)

Thm: For any matrix A, rank(A) = rank(A') = rank(A'A)

DEF: let A be a square matrix. A non-zero vector x is said to be an eigenvector of A if there exists a

scalar : such that A: = :x. : is called an eigenvalue of the matrix A.

DEF: x'Ax is called a quadratic form. (Note: any quadratic form can be expressed as a quadratic form with a symmetric matrix.)

DEF: A is positive definite if x'Ax > 0 for every

DEF: A is positive semidefinite if for every

Thm: If A is symmetric and idempotent then i) rank(A) = trace(A) ii) A is positive semidefinite

Thm: Trace(AB) = trace (BA)

Corr: trace(ABC) = trace(CAB) = trace(BCA)

Thm: If A is positive definite then A is nonsingular

Thm: A is positive definite if and only if all its eigenvalues are positive

Thm: Trace(A) = sum of the eigenvalues of A

DEF: A set of vectors V which is closed under addition and multiplication by a scalar is called a vector space.

DEF: Given a set of vectors S, the set of all the vectors which can be expressed as a linear combination of the vectors in S is a vector space. It is called the space spanned by the set of vectors in S.

DEF: A linearly independent set of vectors in a vector space which spans the whole space is called a basis of the vector space.

DEF: The dimension of a vector space is the number of vectors in any basis.

Note: The rank of a matrix is the dimension of the vector space spanned by its column vectors (or row vectors.)

DEF: A linear transformation is a transformation T such that for any vectors x and y and any scalars a and b T(ax + by) = aT(x) + bT(y). A linear transformation can always be represented by a matrix.

DEF: A linear transformation represented by a matrix P is a projection if and only if P is symmetric and idempotent.

Linear equations: Let A be an n x m matrix. Let y be a known vector and x be an unknown vector. Then the matrix equation Ax = y would represent m equations in n unknowns. A solution exists if and only if the vector y lies in the space spanned by the column vectors of A.

Matrix calculus: (See Gujariti, Appendix B.6.)