Expected Value & Standard Deviation of Random Variables, Study notes of Calculus

When we assign a number to the outcome of a random process, we call this a random variable. For example, flipping a coin once is a random process, ...

Typology: Study notes

2022/2023

Uploaded on 03/01/2023

sheetal_101
sheetal_101 🇺🇸

4.8

(17)

234 documents

1 / 4

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Expected Value & Standard Deviation of Random Variables
Stacey Hancock
1 Definition of Random Variable
When we assign a number to the outcome of a random process, we call this a random variable. For
example, flipping a coin once is a random process, and we could define the random variable Xto take
on the value 0 if the coin lands on tails and 1 if the coin lands on heads. Examples of other random
variables include:
1. The amount of claims (in hundreds of dollars) an insurance company has to pay out to its clients
in a randomly selected month.
2. The time (in hours) a randomly chosen MSU student spends studying for final exams.
3. The number of girls in the next three births at the Bozeman hospital.
4. The number of heads in nine tosses of a coin.
Not only are questions about the distribution of a random variable, or its probabilities, of interest, but
we may want to determine the “average” or expected value of a random variable as well as how far it
tends to vary from its expected value, or its standard deviation. We will only study expected value
and standard deviation for discrete random variables which are random variables whose set of possible
values form a countable list of distinct values. For example, the number of girls in the next three births
at the Bozeman hospital is a discrete random variable since it can only take on the values 0, 1, 2, or
3. Discrete random variables can take on an infinite number of possible values, as long as we can list
them in an ordered list. For example, the number of tosses of a coin until the first head appears is a
discrete random variable with possible values 1, 2, 3, 4, .. . . Random variables that can take on any
value in an interval (e.g., time, length, interest rates, height) are called continuous random variables.
We will use the following notation to specify a probability for a possible outcome of a discrete
random variable:
X= the random variable (e.g., number of girls in the next three births)
k= a possible value of the random variable (e.g., 2)
P(X=k) = the probability that the random variable Xequals the value k
2 Expected Value: What is the average value over many observations
of the random variable?
If we know the probabilities of each of the possible values of a discrete random variable, then we can
calculate the long-run average of the variable, or its mean value over an infinite number of observations
of the random variable. We call this its expected value. Suppose the random variable Xcan take
on possible values k1,k2,k3,... Then we define the expected value of Xas
Mathematical definition:
E(X) = k1×P(X=k1) + k2×P(X=k2) + k3×P(X=k3) + ...
= sum of “value×probability” summed over all possible values
1
pf3
pf4

Partial preview of the text

Download Expected Value & Standard Deviation of Random Variables and more Study notes Calculus in PDF only on Docsity!

Expected Value & Standard Deviation of Random Variables

Stacey Hancock

1 Definition of Random Variable

When we assign a number to the outcome of a random process, we call this a random variable. For example, flipping a coin once is a random process, and we could define the random variable X to take on the value 0 if the coin lands on tails and 1 if the coin lands on heads. Examples of other random variables include:

  1. The amount of claims (in hundreds of dollars) an insurance company has to pay out to its clients in a randomly selected month.
  2. The time (in hours) a randomly chosen MSU student spends studying for final exams.
  3. The number of girls in the next three births at the Bozeman hospital.
  4. The number of heads in nine tosses of a coin.

Not only are questions about the distribution of a random variable, or its probabilities, of interest, but we may want to determine the “average” or expected value of a random variable as well as how far it tends to vary from its expected value, or its standard deviation. We will only study expected value and standard deviation for discrete random variables which are random variables whose set of possible values form a countable list of distinct values. For example, the number of girls in the next three births at the Bozeman hospital is a discrete random variable since it can only take on the values 0, 1, 2, or

  1. Discrete random variables can take on an infinite number of possible values, as long as we can list them in an ordered list. For example, the number of tosses of a coin until the first head appears is a discrete random variable with possible values 1, 2, 3, 4,.... Random variables that can take on any value in an interval (e.g., time, length, interest rates, height) are called continuous random variables. We will use the following notation to specify a probability for a possible outcome of a discrete random variable:
    • X = the random variable (e.g., number of girls in the next three births)
    • k = a possible value of the random variable (e.g., 2)
    • P (X = k) = the probability that the random variable X equals the value k

2 Expected Value: What is the average value over many observations

of the random variable?

If we know the probabilities of each of the possible values of a discrete random variable, then we can calculate the long-run average of the variable, or its mean value over an infinite number of observations of the random variable. We call this its expected value. Suppose the random variable X can take on possible values k 1 , k 2 , k 3 ,... Then we define the expected value of X as

Mathematical definition:

E(X) = k 1 × P (X = k 1 ) + k 2 × P (X = k 2 ) + k 3 × P (X = k 3 ) + ...

= sum of “value×probability” summed over all possible values

Interpretation: The expected value of X, E(X), is the mean value that would be obtained from an infinite number of observations of the random variable, or its long-run average.

Example: Suppose that in a gambling game, it costs $1 to play, and you win $2 with probability 0. or $10 with probability 0.02 (otherwise you lose your dollar). Let X be the net amount won. Then the probability distribution of X is

X = net amount won $9 $1 −$ Probability 0.02 0.37 1 − 0. 37 − 0 .02 = 0. 61

If you were to play this game a large number of times, how much money would you win per game on average?

The expected net amount won is

E(X) = 9(0.02) + 1(0.37) − 1(0.61) = − 0. 06.

That is, in the long-run, you can expect to lose about $0.06 per game, on average.

3 Standard Deviation: About how far away from the expected value

does the random variable lie in the long run?

Mathematical definition:

SD(X) =

(k 1 − E(X))^2 × P (X = k 1 ) + (k 2 − E(X))^2 × P (X = k 2 ) + ...

= square root of the sum of “(value − expected value) squared ×probability” summed over all possible values Interpretation: The standard deviation of X, SD(X), is the approximate average distance we would expect an observation of the random variable to be away from its mean in an infinite number of observations of the random variable.

Example (continued): Consider the gambling game from the previous example. On average, how far away from −$0.06 are your net winnings per game in the long run?

The standard deviation of the net amount won per game is

SD(X) =

(9 − (− 0 .06))^2 × 0 .02 + (1 − (− 0 .06))^2 × 0 .37 + (− 1 − (− 0 .06))^2 × 0 .61 = 1. 6113.

Thus, in the long run, the net winnings per game are about $1.61 away from −$0.06.

4 Expected value and standard deviation of a random variable versus

sample mean and standard deviation

A population is the entire collection of all individuals about which information is desired. Often it is infeasible to measure every individual in the population, so we take a sample, or subset, of individuals from the population, and use measurements on the sample to infer information about the larger population. The expected value (mean) and standard deviation defined above are for a

5 References

  • Diez, D. M., Barr, C. D., & Cetinkaya-Rundel, M. (2014). Introductory Statistics with Random- ization and Simulation, Appendix A. Creative Commons license, openintro.org.
  • Tintle, N. L., Chance, B. L., Cobb, G. W., Rossman, A. J., Roy, S., Swanson, T. M., & Vander- Stoep, J. L. (2016). Introduction to Statistical Investigations. Hoboken, NJ: Wiley.
  • Utts, J. M., & Heckard, R. F. (2015). Mind on Statistics, 5th ed., Chapters 7 and 8. Stamford, CT: Cengage Learning.