
Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
Material Type: Assignment; Class: NONLINEAR OPTIMZTN; Subject: Mathematics; University: University of Washington - Seattle; Term: Unknown 1989;
Typology: Assignments
1 / 1
This page cannot be seen from the preview
Don't miss anything!

(1) Find the local and global minimizers and maximizers of the following functions. (a) f (x) = x^2 + 2x (b) f (x) = x^2 e−x 2 (c) f (x) = x^2 + sin x (d) f (x) = x^3 − x (2) Recall that a function f : Rn^ → R is said to be differentiable at a point x ∈ Rn^ if there is a vector g ∈ Rn^ such that f (y) = f (x) + gT^ (y − x) + o(‖y − x‖). The vector g is called the gradient of f at x and is denoted g = ∇f (x). Note that, when defined, the relation x 7 → ∇f (x) is a mapping from Rn^ to Rn, i.e. ∇f : Rn^ → Rn. We say that f is continuously differentiable at x ∈ Rn^ if the mapping ∇f is continuous at x. When f is continuously differentiable at x ∈ Rn, then ∇f (x) is easily computed as the vector of partial derivatives of f at x, i.e.
∇f (x) =
∂f ∂x ∂f 1 (x) ∂x 2 (x) .. . ∂f ∂xn (x)
Compute the gradient of the following functions. (a) f (x) = x^31 + x^32 − 3 x 1 − 15 x 2 + 25 : f : R^2 → R (b) f (x) = x^21 + x^22 − sin(x 1 x 2 ) f : R^2 → R (c) f (x) = ‖x‖^2 =
∑n j=1 x
2 j :^ f^ :^ R n (^) → R
(d) f (x) = e‖x‖
2
(e) f (x) = x 1 x 2 x 3 · · · xn : f : Rn^ → R (f) f (x) = − log(x 1 x 2 x 3 · · · xn) for xj > 0 , j = 1,... n, and undefined otherwise: f : Rn^ → R. Compute ∇f (x) for xj > 0 , j = 1,... n. (3) Let Rn×n^ denote the set of real n × n square matrices A function f : Rn^ → R is said to be twice differentiable at a point x ∈ Rn^ if is differentiable at x and there is a matrix H ∈ Rn×n^ such that
f (y) = f (x) + ∇f (x)T^ (y − x) +
(y − x)T^ H(y − x) + o(‖y − x‖^2 ).
The matrix H is called the Hessian of f at x and is denoted ∇^2 f (x). Note that, when defined, the relation x 7 → ∇^2 f (x) is a mapping from Rn^ to Rn×n, i.e. ∇^2 f : Rn^ → Rn. We say that f is twice continuously differentiable at x ∈ Rn^ if the mapping ∇^2 f is continuous at x. It can be shown that if f is twice continuously differentiable at a point x ∈ Rn, then the matrix ∇^2 f (x) is symmetric, i.e. ∇^2 f (x) = ∇^2 f (x)T^ , in which case ∇^2 f (x) is the matrix of second partial derivatives of f at x:
∇^2 f (x) =
∂^2 f ∂x 1 ∂x 1 (x)^
∂^2 f ∂x 2 ∂x 1 (x)^...^
∂^2 f ∂xn∂x 1 (x) ∂^2 f ∂x 1 ∂x 2 (x)^
∂^2 f ∂x 2 ∂x 2 (x)^...^
∂^2 f ∂xn∂x 2 (x) .. .
∂^2 f ∂x 1 ∂xn (x)^
∂^2 f ∂x 2 ∂xn (x)^...^
∂^2 f ∂xn∂xn (x)
Compute the Hessian of the functions given in problem (2) above.
1