Stochastic Optimization Assignment 1 (Revision) - Convexity and Expectation, Assignments of Systems Engineering

The revision of assignment 1 for the stochastic optimization course (isye 6664) offered in fall 2007. The assignment includes four problems related to convexity, expectation, and decision making under uncertainty. Students are required to show that integration preserves convexity, compare the objective functions of deterministic and stochastic optimization, and find the supremum and infimum of a function over two sets.

Typology: Assignments

Pre 2010

Uploaded on 08/05/2009

koofers-user-zfu
koofers-user-zfu 🇺🇸

10 documents

1 / 2

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
ISyE 6664 Stochastic Optimization
Fall 2007
Assignment 1 (Revision)
Issued: August 21, 2007
Due: August 28, 2007
Problem 1
Integration Preserves Convexity: Consider a function G:→ R,whereXis a vec-
tor space. Suppose G(x, ω)isconvexinxfor each ωΩ. Let Pbe any probability
distribution on Ω. Assume that the necessary measurability conditions hold. Show that
g(x):=EP[G(x, ω)] is convex in x. (If you need additional assumptions for the result to
hold, then state those assumptions and motivate why the assumptions are needed.)
Problem 2
Consider a function G:→ R,whereΩ=Rnfor some n. Suppose G(x, ω)isconvex
in ωfor each x∈X.LetPbe any probability distribution on Ω. Assume that the necessary
measurability conditions hold and that EP[ω] is finite. Show that G(x, EP[ω]) EP[G(x, ω)]
for each x∈X. That is, the objective function G(x, EP[ω]) of the deterministic optimiza-
tion problem minx∈X G(x, EP[ω]) that replaces ωwith its mean is a biased estimate of the
objective function EP[G(x, ω)] of the stochastic optimization problem minx∈X EP[G(x, ω)].
(If you cannot prove the result for = Rn, then prove the result for = R.Forbonus
points, give a counterexample for the assertion above for a function G:→ R∪{+∞},
where is a vector space.)
Problem 3
Consider a function g:X1×X
2→ R, with decisions x1∈X
1and x2∈X
2.
1. Show that
sup
x1∈X1
sup
x2∈X2
g(x1,x
2) = sup
x2∈X2
sup
x1∈X1
g(x1,x
2) = sup
(x1,x2)∈X1×X2
g(x1,x
2)
2. Show that
sup
x1∈X1
inf
x2∈X2
g(x1,x
2)inf
x2∈X2
sup
x1∈X1
g(x1,x
2)
3. Give an example of a function g(x1,x
2) such that
sup
x1∈X1
inf
x2∈X2
g(x1,x
2)<inf
x2∈X2
sup
x1∈X1
g(x1,x
2)
pf2

Partial preview of the text

Download Stochastic Optimization Assignment 1 (Revision) - Convexity and Expectation and more Assignments Systems Engineering in PDF only on Docsity!

ISyE 6664 Stochastic Optimization

Fall 2007

Assignment 1 (Revision)

Issued: August 21, 2007

Due: August 28, 2007

Problem 1 Integration Preserves Convexity: Consider a function G : X × Ω → R, where X is a vec- tor space. Suppose G(x, ω) is convex in x for each ω ∈ Ω. Let P be any probability distribution on Ω. Assume that the necessary measurability conditions hold. Show that g(x) := EP [G(x, ω)] is convex in x. (If you need additional assumptions for the result to hold, then state those assumptions and motivate why the assumptions are needed.)

Problem 2 Consider a function G : X × Ω → R, where Ω = Rn^ for some n. Suppose G(x, ω) is convex in ω for each x ∈ X. Let P be any probability distribution on Ω. Assume that the necessary measurability conditions hold and that EP [ω] is finite. Show that G(x, EP [ω]) ≤ EP [G(x, ω)] for each x ∈ X. That is, the objective function G(x, EP [ω]) of the deterministic optimiza- tion problem minx∈X G(x, EP [ω]) that replaces ω with its mean is a biased estimate of the objective function EP [G(x, ω)] of the stochastic optimization problem minx∈X EP [G(x, ω)]. (If you cannot prove the result for Ω = Rn, then prove the result for Ω = R. For bonus points, give a counterexample for the assertion above for a function G : X × Ω → R ∪ {+∞}, where Ω is a vector space.)

Problem 3 Consider a function g : X 1 × X 2 → R, with decisions x 1 ∈ X 1 and x 2 ∈ X 2.

  1. Show that

sup x 1 ∈X 1

sup x 2 ∈X 2

g(x 1 , x 2 ) = sup x 2 ∈X 2

sup x 1 ∈X 1

g(x 1 , x 2 ) = sup (x 1 ,x 2 )∈X 1 ×X 2

g(x 1 , x 2 )

  1. Show that sup x 1 ∈X 1

inf x 2 ∈X 2

g(x 1 , x 2 ) ≤ inf x 2 ∈X 2

sup x 1 ∈X 1

g(x 1 , x 2 )

  1. Give an example of a function g(x 1 , x 2 ) such that

sup x 1 ∈X 1

inf x 2 ∈X 2 g(x 1 , x 2 ) < inf x 2 ∈X 2 sup x 1 ∈X 1

g(x 1 , x 2 )

ISyE 6664 · Fall 2007 · Assignment 1 2

  1. Suppose two decision makers compete in the following way. Decision maker 1 chooses x 1 ∈ X 1 with the objective to maximize g(x 1 , x 2 ), and decision maker 2 chooses x 2 ∈ X 2 with the objective to minimize g(x 1 , x 2 ). Decision maker 1 chooses first, and decision maker 2 chooses second. Is the outcome given by

sup x 1 ∈X 1

inf x 2 ∈X 2 g(x 1 , x 2 )

or by inf x 2 ∈X 2

sup x 1 ∈X 1

g(x 1 , x 2 )

Is it better to choose first or to choose second?

Problem 4 Consider a function G : X × Ω → R, with decision x ∈ X , and ω ∈ Ω, and probability distribution P on Ω. Show that

sup x∈X

EP [G(x, ω)] ≤ EP

[

sup x∈X

G(x, ω)

]