Math 171B Homework Assignment 1: Linear Algebra and Calculus Review, Assignments of Mathematics

A homework assignment for math 171b: mathematical programming, instructed by michael holst during the spring quarter 2005. The assignment covers topics from linear algebra, such as matrices, eigenvalues, and eigenvectors, and calculus, including continuity, differentiation, and taylor series. Students are required to complete several exercises, some of which involve using matlab.

Typology: Assignments

Pre 2010

Uploaded on 03/28/2010

koofers-user-561
koofers-user-561 🇺🇸

10 documents

1 / 2

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Math 171B: Mathematical Programming
Instructor: Michael Holst
Spring Quarter 2005
Homework Assignment #1
Due Friday April 1, 2005
Our goal in this homework is to review some basic concepts from linear algebra and from calculus of real and mul-
tivariate functions. In particular, from linear algebra we will need matrices, eigenvalues and eigenvectors, singular
values, and related concepts. From calculus, we will need to recall the definitions of continuity and differentiation, in
the cases of both real-valued and vector-valued functions of one and many variables. Key tools throughout the course
will be Taylor series and the Taylor Remainder Theorem. We will do a couple of simple implementation problems to
start us off using Matlab. This homework covers mainly material from Chapter 1 of the textbook, and is mainly a
review of things you (should) already know.
The starred exercises are those that require the use of Matlab. You MUST do the Matlab problems to get
credit for the homework.
Exercise 1.1. If xis an eigenvector of A, show that βx is also an eigenvector for any β6= 0. What is the associated
eigenvalue? Use this result to show that the unit vector x/kxkformed from an eigenvector xis also an eigenvector
of Acorresponding to the same eigenvalue as that of x.
Exercise 1.2. Let (x, y) : V7→ Rbe an inner-product on a vector space Vwith associated scalar field R. We know
that (x, y) must satisfy the three properties of an inner-product:
1. (x, x)0,xV, (x, x) = 0 iff x= 0.
2. (x, y) = (y, x),x, y V.
3. (αx +βy, z ) = α(x, z) + β(y, z),α, β R,x, y, z V.
Use these three properties to show that the induced norm kxk= (x, x)1/2satisfies the three properties of a norm:
1. kαxk=|α| kxk,αR,xV.
2. kxk 0,xV, kxk= 0 iff x= 0.
3. kx+yk kxk+kyk,x, y V.
Hint: Showing the first two properties is very easy; to show the last property (triangle inequality), assume the
Cauchy-Schwarz inequality holds: |(x, y)| kxk kyk.
Exercise 1.3. Let F(x) denote a twice-differentiable function of one variable. Assuming only the mean-value theo-
rem of integral calculus: F(b) = F(a) + Rb
aF0(t)dt, derive the following variants of the Taylor-series expansion with
integral remainder:
(a) F(x+h) = F(x) + Rx+h
xF0(t)dt.
(b) F(x+h) = F(x) + hR1
0F0(x+ξh).
(c) F(x+h) = F(x) + hF 0(x) + hR1
0[F0(x+ξh)F0(x)] .
(d) F(x+h) = F(x) + hF 0(x) + h2R1
0F00(x+ξh)(1 ξ) . (Hint: Try expanding F0(x+h) using a formula like
part (b) and then differentiate with respect to husing the chain rule.)
pf2

Partial preview of the text

Download Math 171B Homework Assignment 1: Linear Algebra and Calculus Review and more Assignments Mathematics in PDF only on Docsity!

Math 171B: Mathematical Programming

Instructor: Michael Holst

Spring Quarter 2005

Homework Assignment # Due Friday April 1, 2005

Our goal in this homework is to review some basic concepts from linear algebra and from calculus of real and mul- tivariate functions. In particular, from linear algebra we will need matrices, eigenvalues and eigenvectors, singular values, and related concepts. From calculus, we will need to recall the definitions of continuity and differentiation, in the cases of both real-valued and vector-valued functions of one and many variables. Key tools throughout the course will be Taylor series and the Taylor Remainder Theorem. We will do a couple of simple implementation problems to start us off using Matlab. This homework covers mainly material from Chapter 1 of the textbook, and is mainly a review of things you (should) already know. The starred exercises are those that require the use of Matlab. You MUST do the Matlab problems to get credit for the homework.

Exercise 1.1. If x is an eigenvector of A, show that βx is also an eigenvector for any β 6 = 0. What is the associated eigenvalue? Use this result to show that the unit vector x/‖x‖ formed from an eigenvector x is also an eigenvector of A corresponding to the same eigenvalue as that of x.

Exercise 1.2. Let (x, y) : V 7 → R be an inner-product on a vector space V with associated scalar field R. We know that (x, y) must satisfy the three properties of an inner-product:

  1. (x, x) ≥ 0 , ∀x ∈ V, (x, x) = 0 iff x = 0.
  2. (x, y) = (y, x), ∀x, y ∈ V.
  3. (αx + βy, z) = α(x, z) + β(y, z), ∀α, β ∈ R, ∀x, y, z ∈ V.

Use these three properties to show that the induced norm ‖x‖ = (x, x)^1 /^2 satisfies the three properties of a norm:

  1. ‖αx‖ = |α| ‖x‖, ∀α ∈ R, ∀x ∈ V.
  2. ‖x‖ ≥ 0 , ∀x ∈ V, ‖x‖ = 0 iff x = 0.
  3. ‖x + y‖ ≤ ‖x‖ + ‖y‖, ∀x, y ∈ V.

Hint: Showing the first two properties is very easy; to show the last property (triangle inequality), assume the Cauchy-Schwarz inequality holds: |(x, y)| ≤ ‖x‖ ‖y‖.

Exercise 1.3. Let F (x) denote a twice-differentiable function of one variable. Assuming only the mean-value theo-

rem of integral calculus: F (b) = F (a) +

∫ (^) b a F^

′(t) dt, derive the following variants of the Taylor-series expansion with

integral remainder:

(a) F (x + h) = F (x) +

∫ (^) x+h x F^

′(t) dt.

(b) F (x + h) = F (x) + h

0 F^

′(x + ξh) dξ.

(c) F (x + h) = F (x) + hF ′(x) + h

0 [F^

′(x + ξh) − F ′(x)] dξ.

(d) F (x + h) = F (x) + hF ′(x) + h^2

0 F^

′′(x + ξh)(1 − ξ) dξ. (Hint: Try expanding F ′(x + h) using a formula like part (b) and then differentiate with respect to h using the chain rule.)

2 Mathematics 171B

Exercise 1.4. Find the gradient vector F (x) = ∇f (x) of the following functions, and then find the Jacobian matrix of F (x). (The Jacobian matrix of F (x) = ∇f (x) is the same as the Hessian matrix ∇^2 f (x) of f (x)).

(a) f (x) = 2

x 2 − x^21

x 1 − 3

(b) f (x) = (2x 1 + x 2 )^2 + 4(x 2 − x 3 )^4.

Exercise 1.5. Find f ′(x), ∇f (x) and ∇^2 f (x) for the following functions of n variables.

(a) f (x) = 12 xTHx, where H is an n × n constant matrix.

(b) f (x) = bTAx − 12 xTATAx, where A is an m × n constant matrix and b is a constant m-vector.

(c) f (x) = ‖x‖ =

n i=1 x

2 i

Exercise 1.6.∗^ Create a Matlab m-file of the form:

function [F,J] = D(x) F = [ a ; b ]; J = [ c d ; e f ];

where the expressions for a, b, c, d, e, f are chosen so that the function returns the 2 × 1-vector-valued function F (x) and the 2 × 2 Jacobian matrix J(x) for the function F (x) from part (a) of Problem 1.4. Use this m-file to compute F and J at x = (1, 0)T^ ; and x = (1, 1)T^. Capture the output from the computation and turn it in with the homework.