3 Problems on Nonlinear Optimization - Assignment 1 | MATH 408, Assignments of Mathematics

Material Type: Assignment; Class: NONLINEAR OPTIMZTN; Subject: Mathematics; University: University of Washington - Seattle; Term: Unknown 1989;

Typology: Assignments

Pre 2010

Uploaded on 03/10/2009

koofers-user-obw
koofers-user-obw 🇺🇸

10 documents

1 / 1

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Math 408 Homework Set 1
(1) Find the local and global minimizers and maximizers of the following functions.
(a) f(x) = x2+ 2x
(b) f(x) = x2ex2
(c) f(x) = x2+ sin x
(d) f(x) = x3x
(2) Recall that a function f:RnRis said to be differentiable at a point xRnif there is a vector
gRnsuch that
f(y) = f(x) + gT(yx) + o(kyxk).
The vector gis called the gradient of fat xand is denoted g=f(x). Note that, when defined, the
relation x7→ f(x) is a mapping from Rnto Rn, i.e. f:RnRn. We say that fis continuously
differentiable at xRnif the mapping fis continuous at x. When fis continuously differentiable
at xRn, then f(x) is easily computed as the vector of partial derivatives of fat x, i.e.
f(x) =
∂f
∂x1(x)
∂f
∂x2(x)
.
.
.
∂f
∂xn(x)
.
Compute the gradient of the following functions.
(a) f(x) = x3
1+x3
23x115x2+ 25 : f:R2R
(b) f(x) = x2
1+x2
2sin(x1x2)f:R2R
(c) f(x) = kxk2=Pn
j=1 x2
j:f:RnR
(d) f(x) = ekxk2
(e) f(x) = x1x2x3· · · xn:f:RnR
(f) f(x) = log(x1x2x3· · · xn) for xj>0, j = 1,...n, and undefined otherwise: f:RnR.
Compute f(x) for xj>0, j = 1,...n.
(3) Let Rn×ndenote the set of real n×nsquare matrices A function f:RnRis said to be twice
differentiable at a point xRnif is differentiable at xand there is a matrix HRn×nsuch that
f(y) = f(x) + f(x)T(yx) + 1
2(yx)TH(yx) + o(kyxk2).
The matrix His called the Hessian of fat xand is denoted 2f(x). Note that, when defined, the
relation x7→ 2f(x) is a mapping from Rnto Rn×n, i.e. 2f:RnRn. We say that fis twice
continuously differentiable at xRnif the mapping 2fis continuous at x. It can be shown that
if fis twice continuously differentiable at a point xRn, then the matrix 2f(x) is symmetric,
i.e. 2f(x) = 2f(x)T, in which case 2f(x) is the matrix of second partial derivatives of fat x:
2f(x) =
2f
∂x1∂x1(x)2f
∂x2∂x1(x). . . 2f
∂xn∂x1(x)
2f
∂x1∂x2(x)2f
∂x2∂x2(x). . . 2f
∂xn∂x2(x)
.
.
..
.
.....
.
.
2f
∂x1∂xn(x)2f
∂x2∂xn(x). . . 2f
∂xn∂xn(x)
.
Compute the Hessian of the functions given in problem (2) above.
1

Partial preview of the text

Download 3 Problems on Nonlinear Optimization - Assignment 1 | MATH 408 and more Assignments Mathematics in PDF only on Docsity!

Math 408 Homework Set 1

(1) Find the local and global minimizers and maximizers of the following functions. (a) f (x) = x^2 + 2x (b) f (x) = x^2 e−x 2 (c) f (x) = x^2 + sin x (d) f (x) = x^3 − x (2) Recall that a function f : Rn^ → R is said to be differentiable at a point x ∈ Rn^ if there is a vector g ∈ Rn^ such that f (y) = f (x) + gT^ (y − x) + o(‖y − x‖). The vector g is called the gradient of f at x and is denoted g = ∇f (x). Note that, when defined, the relation x 7 → ∇f (x) is a mapping from Rn^ to Rn, i.e. ∇f : Rn^ → Rn. We say that f is continuously differentiable at x ∈ Rn^ if the mapping ∇f is continuous at x. When f is continuously differentiable at x ∈ Rn, then ∇f (x) is easily computed as the vector of partial derivatives of f at x, i.e.

∇f (x) =

∂f ∂x ∂f 1 (x) ∂x 2 (x) .. . ∂f ∂xn (x)

Compute the gradient of the following functions. (a) f (x) = x^31 + x^32 − 3 x 1 − 15 x 2 + 25 : f : R^2 → R (b) f (x) = x^21 + x^22 − sin(x 1 x 2 ) f : R^2 → R (c) f (x) = ‖x‖^2 =

∑n j=1 x

2 j :^ f^ :^ R n (^) → R

(d) f (x) = e‖x‖

2

(e) f (x) = x 1 x 2 x 3 · · · xn : f : Rn^ → R (f) f (x) = − log(x 1 x 2 x 3 · · · xn) for xj > 0 , j = 1,... n, and undefined otherwise: f : Rn^ → R. Compute ∇f (x) for xj > 0 , j = 1,... n. (3) Let Rn×n^ denote the set of real n × n square matrices A function f : Rn^ → R is said to be twice differentiable at a point x ∈ Rn^ if is differentiable at x and there is a matrix H ∈ Rn×n^ such that

f (y) = f (x) + ∇f (x)T^ (y − x) +

(y − x)T^ H(y − x) + o(‖y − x‖^2 ).

The matrix H is called the Hessian of f at x and is denoted ∇^2 f (x). Note that, when defined, the relation x 7 → ∇^2 f (x) is a mapping from Rn^ to Rn×n, i.e. ∇^2 f : Rn^ → Rn. We say that f is twice continuously differentiable at x ∈ Rn^ if the mapping ∇^2 f is continuous at x. It can be shown that if f is twice continuously differentiable at a point x ∈ Rn, then the matrix ∇^2 f (x) is symmetric, i.e. ∇^2 f (x) = ∇^2 f (x)T^ , in which case ∇^2 f (x) is the matrix of second partial derivatives of f at x:

∇^2 f (x) =

∂^2 f ∂x 1 ∂x 1 (x)^

∂^2 f ∂x 2 ∂x 1 (x)^...^

∂^2 f ∂xn∂x 1 (x) ∂^2 f ∂x 1 ∂x 2 (x)^

∂^2 f ∂x 2 ∂x 2 (x)^...^

∂^2 f ∂xn∂x 2 (x) .. .

∂^2 f ∂x 1 ∂xn (x)^

∂^2 f ∂x 2 ∂xn (x)^...^

∂^2 f ∂xn∂xn (x)

Compute the Hessian of the functions given in problem (2) above.

1