

Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
A homework assignment for math 171b: mathematical programming, instructed by michael holst during the spring quarter 2005. The assignment covers topics from linear algebra, such as matrices, eigenvalues, and eigenvectors, and calculus, including continuity, differentiation, and taylor series. Students are required to complete several exercises, some of which involve using matlab.
Typology: Assignments
1 / 2
This page cannot be seen from the preview
Don't miss anything!


Instructor: Michael Holst
Spring Quarter 2005
Homework Assignment # Due Friday April 1, 2005
Our goal in this homework is to review some basic concepts from linear algebra and from calculus of real and mul- tivariate functions. In particular, from linear algebra we will need matrices, eigenvalues and eigenvectors, singular values, and related concepts. From calculus, we will need to recall the definitions of continuity and differentiation, in the cases of both real-valued and vector-valued functions of one and many variables. Key tools throughout the course will be Taylor series and the Taylor Remainder Theorem. We will do a couple of simple implementation problems to start us off using Matlab. This homework covers mainly material from Chapter 1 of the textbook, and is mainly a review of things you (should) already know. The starred exercises are those that require the use of Matlab. You MUST do the Matlab problems to get credit for the homework.
Exercise 1.1. If x is an eigenvector of A, show that βx is also an eigenvector for any β 6 = 0. What is the associated eigenvalue? Use this result to show that the unit vector x/‖x‖ formed from an eigenvector x is also an eigenvector of A corresponding to the same eigenvalue as that of x.
Exercise 1.2. Let (x, y) : V 7 → R be an inner-product on a vector space V with associated scalar field R. We know that (x, y) must satisfy the three properties of an inner-product:
Use these three properties to show that the induced norm ‖x‖ = (x, x)^1 /^2 satisfies the three properties of a norm:
Hint: Showing the first two properties is very easy; to show the last property (triangle inequality), assume the Cauchy-Schwarz inequality holds: |(x, y)| ≤ ‖x‖ ‖y‖.
Exercise 1.3. Let F (x) denote a twice-differentiable function of one variable. Assuming only the mean-value theo-
rem of integral calculus: F (b) = F (a) +
∫ (^) b a F^
′(t) dt, derive the following variants of the Taylor-series expansion with
integral remainder:
(a) F (x + h) = F (x) +
∫ (^) x+h x F^
′(t) dt.
(b) F (x + h) = F (x) + h
′(x + ξh) dξ.
(c) F (x + h) = F (x) + hF ′(x) + h
′(x + ξh) − F ′(x)] dξ.
(d) F (x + h) = F (x) + hF ′(x) + h^2
′′(x + ξh)(1 − ξ) dξ. (Hint: Try expanding F ′(x + h) using a formula like part (b) and then differentiate with respect to h using the chain rule.)
2 Mathematics 171B
Exercise 1.4. Find the gradient vector F (x) = ∇f (x) of the following functions, and then find the Jacobian matrix of F (x). (The Jacobian matrix of F (x) = ∇f (x) is the same as the Hessian matrix ∇^2 f (x) of f (x)).
(a) f (x) = 2
x 2 − x^21
x 1 − 3
(b) f (x) = (2x 1 + x 2 )^2 + 4(x 2 − x 3 )^4.
Exercise 1.5. Find f ′(x), ∇f (x) and ∇^2 f (x) for the following functions of n variables.
(a) f (x) = 12 xTHx, where H is an n × n constant matrix.
(b) f (x) = bTAx − 12 xTATAx, where A is an m × n constant matrix and b is a constant m-vector.
(c) f (x) = ‖x‖ =
n i=1 x
2 i
Exercise 1.6.∗^ Create a Matlab m-file of the form:
function [F,J] = D(x) F = [ a ; b ]; J = [ c d ; e f ];
where the expressions for a, b, c, d, e, f are chosen so that the function returns the 2 × 1-vector-valued function F (x) and the 2 × 2 Jacobian matrix J(x) for the function F (x) from part (a) of Problem 1.4. Use this m-file to compute F and J at x = (1, 0)T^ ; and x = (1, 1)T^. Capture the output from the computation and turn it in with the homework.