Module 7: The Central Limit Theorem

Using the Central Limit Theorem

Barbara Illowsky & OpenStax et al.

Learning Objectives

It is important for you to understand when to use the central limit theorem. If you are being asked to find the probability of the mean, use the clt for the mean. If you are being asked to find the probability of a sum or total, use the clt for sums. This also applies to percentiles for means and sums.

Note: If you are being asked to find the probability of an individual value, do not use the clt. Use the distribution of its random variable.

 

Examples of the Central Limit Theorem

Law of Large Numbers

The law of large numbers says that if you take samples of larger and larger size from any population, then the mean [latex]displaystyleoverline{{x}}[/latex] must be close to the population mean μ. We can say that μ is the value that the sample means approach as n gets larger. The central limit theorem illustrates the law of large numbers.

Central Limit Theorem for the Mean and Sum Examples

A study involving stress is conducted among the students on a college campus. The stress scores follow a uniform distribution with the lowest stress score equal to one and the highest equal to five. Using a sample of 75 students, find:

  1. The probability that the mean stress score for the 75 students is less than two.
  2. The 90th percentile for the mean stress score for the 75 students.
  3. The probability that the total of the 75 stress scores is less than 200.
  4. The 90th percentile for the total stress score for the 75 students.

Let X = one stress score.

Problems a and b ask you to find a probability or a percentile for a mean. Problems c and d ask you to find a probability or a percentile for a total or sum. The sample size, n, is equal to 75.

Since the individual stress scores follow a uniform distribution,
X ~ U(1, 5) where a = 1 and b = 5.

[latex]displaystyle{mu}_{X}=frac{{a+b}}{{2}}=frac{{1+5}}{{2}}={3}[/latex][latex]displaystyle{sigma}_{X}=sqrt{frac{{{(b-a)}^{2}}}{{12}}}=sqrt{frac{{({5-1)}^{2}}}{{12}}}[/latex]= 1.15

For problems 1. and 2., let [latex]displaystyleoverline{X}[/latex] = the mean stress score for the 75 students. Then,

[latex]displaystyleoverline{X}sim{N}({3},frac{{1.15}}{{sqrt{75}}})text{ where } {n}={75}[/latex].

Example

  1. Find P([latex]displaystyleoverline{x}{<}{2}[/latex]). Draw the graph.
  2. Find the 90th percentile for the mean of 75 stress scores. Draw a graph.
  3. Find P(Σx < 200). Draw the graph.
  4. Find the 90th percentile for the total of 75 stress scores. Draw a graph.

Solution:

  1. P( < 2) = 0 The probability that the mean stress score is less than two is about zero.
    This is a normal distribution curve over a horizontal axis. The peak of the curve coincides with the point 3 on the horizontal axis. A point, 2, is marked at the left edge of the curve.

normalcdf [latex]displaystyle{({1},{2},{3},frac{{1.15}}{sqrt{{75}}})}={0}[/latex]
Remember that the smallest stress score is one.

2. Let k = the 90th percentile.Find
k, where P( < k) = 0.90. k = 3.2
This is a normal distribution curve. The peak of the curve coincides with the point 3 on the horizontal axis. A point, k, is labeled to the right of 3. A vertical line extends from k to the curve. The area under the curve to the left of k is shaded. The shaded area shows that P(x-bar < k) = 0.90.

The 90th percentile for the mean of 75 scores is about 3.2. This tells us that 90% of all the means of 75 stress scores are at most 3.2, and that 10% are at least 3.2.invNormFor problems c and d, let
ΣX = the sum of the 75 stress scores. Then, [latex]displaystylesum{X}{sim}{N}{[{({75})}{({3})},{(sqrt{{75}})}{({1.15})}]}[/latex]

3. The mean of the sum of 75 stress scores is (75)(3) = 225The standard deviation of the sum of 75 stress scores is
[latex]displaystyle{(sqrt{{75}})}[/latex](1.15) = 9.96
P(Σx < 200) = 0
This is a normal distribution curve over a horizontal axis. The peak of the curve coincides with the point 225 on the horizontal axis. A point, 200, is marked at the left edge of the curve.

The probability that the total of 75 scores is less than 200 is about zero.normalcdf (75,200,(75)(3),[latex]displaystyle{(sqrt{{75}})}[/latex](1.15)).
Remember, the smallest total of 75 stress scores is 75, because the smallest single score is one.

4.  Let k= the 90th percentile. Find k where P(Σx < k) = 0.90. k = 237.8
This is a normal distribution curve. The peak of the curve coincides with the point 225 on the horizontal axis. A point, k, is labeled to the right of 225. A vertical line extends from k to the curve. The area under the curve to the left of k is shaded. The shaded area shows that P(sum of x < k) = 0.90.

The 90th percentile for the sum of 75 scores is about 237.8. This tells us that 90% of all the sums of 75 scores are no more than 237.8 and 10% are no less than 237.8.invNorm(0.90,(75)(3),[latex]displaystyle{(sqrt{{75}})}[/latex](1.15)) = 237.8

Try it

Use the information in “Central Limit Theorem for the Mean and Sum Examples“, but use a sample size of 55 to answer the following questions.

  1. Find [latex]displaystyle{P}{(overline{{x}}{<}{7})}[/latex].
  2. Find [latex]displaystyle{P}{(sum{x}{>}{170})}[/latex].
  3. Find the 80th percentile for the mean of 55 scores.
  4. Find the 85th percentile for the sum of 55 scores.

Solutions:

  1. [latex]0.0265[/latex]
  2. [latex]0.2789[/latex]
  3. [latex]3.13[/latex]
  4. [latex]173.84[/latex]

Example

Suppose that a market research analyst for a cell phone company conducts a study of their customers who exceed the time allowance included on their basic cell phone contract; the analyst finds that for those people who exceed the time included in their basic contract, the excess time used follows an exponential distribution with a mean of 22 minutes.

Consider a random sample of 80 customers who exceed the time allowance included in their basic cell phone contract.

Let X = the excess time used by one INDIVIDUAL cell phone customer who exceeds his contracted time allowance.

[latex]displaystyle{X}{sim}{E}{x}{p}{(frac{{1}}{{22}})}[/latex]. From previous chapters, we know that μ = 22 and σ = 22.

Let [latex]displaystyleoverline{{X}}[/latex] = the mean excess time used by a sample of n = 80 customers who exceed their contracted time allowance.

[latex]displaystyleoverline{{X}}{sim}{N}{({22},frac{{22}}{{sqrt{{80}}}})}[/latex] by the central limit theorem for sample means

  1. Using the clt to find probability. Find the probability that the mean excess time used by the 80 customers in the sample is longer than 20 minutes. This is asking us to find [latex]displaystyle{P}{(overline{{x}}{>}{20})}[/latex]. Draw the graph.
  2. Using the clt to find probability. Suppose that one customer who exceeds the time limit for his cell phone contract is randomly selected. Find the probability that this individual customer’s excess time is longer than 20 minutes. This is asking us to find P(x > 20).
  3. Using the clt to find probability. Explain why the probabilities in parts 1 and 2 are different.
  4. Using the clt to find percentiles. Find the 95th percentile for the sample mean excess time for samples of 80 customers who exceed their basic contract time allowances. Draw a graph.

Solution:

  1. Find: [latex]displaystyle{P}{(overline{{x}}{>}{20})}[/latex][latex]displaystyle{P}{(overline{{x}}{>}{20})}={0.79199}[/latex] using normalcdf
    [latex]displaystyle{({20},{1}text{E99},{22},frac{{22}}{sqrt{{80}}})}[/latex]The probability is 0.7919 that the mean excess time used is more than 20 minutes, for a sample of 80 customers who exceed their contracted time allowance. This is a normal distribution curve. The peak of the curve coincides with the point 22 on the horizontal axis. A point, 20, is labeled to the left of 22. A vertical line extends from 20 to the curve. The area under the curve to the right of k is shaded. The shaded area shows that P(x-bar data-verified=
  2. Remember, 1E99 = 1099 and –1E99 = –1099. Press the EE key for E. Or just use 1099 instead of 1E99.
  3. Find P(x > 20). Remember to use the exponential distribution for an individual: [latex]displaystyle{X}~{E}{x}{p}{(frac{{1}}{{22}})}[/latex].[latex]displaystyle{P}{({x}{>}{20})}={e}^{{{(-{({122})}{({20})})}}}{quadtext{or}quad}{e}^{{{(-{0.04545}{({20})})}}}={0.4029}[/latex]
  4. [latex]displaystyle{P}{({x}{>}{20})}={0.4029}text{ but } {P}{(overline{{x}}{>}{20})}={0.7919}[/latex].  (1) The probabilities are not equal because we use different distributions to calculate the probability for individuals and for means. (2)  When asked to find the probability of an individual value, use the stated distribution of its random variable; do not use the clt. (3) Use the clt with the normal distribution when you are being asked to find the probability for a mean.
  5. Let k = the 95th percentile. Find k where [latex]displaystyle{P}{(overline{{x}}{<}{k})}={0.95}[/latex]
    k = 26.0 using invNorm = 26.0
    This is a normal distribution curve. The peak of the curve coincides with the point 22 on the horizontal axis. A point, k, is labeled to the right of 22. A vertical line extends from k to the curve. The area under the curve to the left of k is shaded. The shaded area shows that P(x-bar < k) = 0.95.

The 95th percentile for the sample mean excess time used is about 26.0 minutes for random samples of 80 customers who exceed their contractual allowed time.Ninety five percent of such samples would have means under 26 minutes; only five percent of such samples would have means above 26 minutes.

 

Try it

Use the information in Example 2, but change the sample size to 144.

  1. Find [latex]displaystyle{P}{({20}{<}overline{{x}}{<}{30})}[/latex].
  2. Find P(Σx is at least 3,000).
  3. Find the 75th percentile for the sample mean excess time of [latex]144[/latex] customers.
  4. Find the 85th percentile for the sum of [latex]144[/latex] excess times used by customers.

Solution:

  1. [latex]0.8623[/latex]
  2. [latex]0.7377[/latex]
  3. [latex]23.2[/latex]
  4. [latex]3,441.6[/latex]

Example

In the United States, someone is sexually assaulted every two minutes, on average, according to a number of studies. Suppose the standard deviation is 0.5 minutes and the sample size is 100.

  1. Find the median, the first quartile, and the third quartile for the sample mean time of sexual assaults in the United States.
  2. Find the median, the first quartile, and the third quartile for the sum of sample times of sexual assaults in the United States.
  3. Find the probability that a sexual assault occurs on the average between 1.75 and 1.85 minutes.
  4. Find the value that is two standard deviations above the sample mean.
  5. Find the IQR for the sum of the sample times.

Solution:

  1. We have, [latex]displaystyle{mu}_{x}={mu}={2}{text{and}}{sigma}_{x}=frac{{sigma}}{{sqrt{n}}}=frac{{0.5}}{{10}}=0.05[/latex],  Therefore: (1) 50th percentile = μx = μ = 2 , (2) 25th percentile = invNorm(0.25,2,0.05) = 1.97, (3) 75th percentile = invNorm(0.75,2,0.05) = 2.03
  2. We have[latex]displaystyle{mu}_{sum{x}}=n{mu}_{x}={100}({2})= 200text{and}{sigma}_{mu{x}}=({sigma})_{x}=10(0.5)=5[/latex]. Therefore: (1) 50th percentile = [latex]displaystyle{mu}_{sum{x}}=n{mu}_{x}[/latex]=100(2)=200, (2) 25th percentile = invNorm(0.25, 200, 0.05) = 196.63, (3) 75th percentile = invNorm(0.75, 200, 0.05) = 203.37
  3. [latex]displaystyle{P}{(1.75{<}{overline{x}}{<}{1.85})}[/latex]=normalcdf(1.75,1.85,2,0.05) = 0.0013
  4. Using the z-score equation, [latex]displaystyle{z}=frac{{overline{x}-{mu}_{overline{x}}}}{{{sigma}_{overline{x}}}}[/latex].  Solving for x, we have x = 2(0.05) + 2 = 2.1
  5. The IQR is 75th percentile – 25th percentile = 203.37 – 196.63 = 6.74

try it

Based on data from the National Health Survey, women between the ages of [latex]18[/latex] and [latex]24[/latex] have an average systolic blood pressures (in mm Hg) of [latex]114.8[/latex] with a standard deviation of [latex]13.1[/latex]. Systolic blood pressure for women between the ages of [latex]18[/latex] to [latex]24[/latex] follow a normal distribution.

  1. If one woman from this population is randomly selected, find the probability that her systolic blood pressure is greater than [latex]120[/latex].
  2. If [latex]40[/latex] women from this population are randomly selected, find the probability that their mean systolic blood pressure is greater than [latex]120[/latex].
  3. If the sample were four women between the ages of [latex]18[/latex] to [latex]24[/latex] and we did not know the original distribution, could the central limit theorem be used?
  1. P(x > 120) =normalcdf(120,99,114.8,13.1) = 0.0272. There is about a 3%, that the randomly selected woman will have systolics blood pressure greater than [latex]120[/latex].
  2. P( > 120) = normalcdf.
    There is only a 0.6% chance that the average systolic blood pressure for the randomly selected group is greater than [latex]120[/latex].
  3. The central limit theorem could not be used if the sample size were four and we did not know the original distribution was normal. The sample size would be too small.

Example

A study was done about violence against prostitutes and the symptoms of the post-traumatic stress that they developed. The age range of the prostitutes was 14 to 61. The mean age was 30.9 years with a standard deviation of nine years.

  1. In a sample of 25 prostitutes, what is the probability that the mean age of the prostitutes is less than 35?
  2. Is it likely that the mean age of the sample group could be more than 50 years? Interpret the results.
  3. In a sample of 49 prostitutes, what is the probability that the sum of the ages is no less than 1,600?
  4. Is it likely that the sum of the ages of the 49 prostitutes is at most 1,595? Interpret the results.
  5. Find the 95th percentile for the sample mean age of 65 prostitutes. Interpret the results.
  6. Find the 90th percentile for the sum of the ages of 65 prostitutes. Interpret the results.

Solution:

  1. P( < 35) = normalcdf(-E99,35,30.9,1.8) = 0.9886
  2. P( > 50) = normalcdf(50, E99,30.9,1.8) ≈ 0. For this sample group, it is almost impossible for the group’s average age to be more than 50. However, it is still possible for an individual in this group to have an age greater than 50.
  3. P(Σx ≥ 1,600) = normalcdf(1600,E99,1514.10,63) = 0.0864
  4. P(Σx ≤ 1,595) = normalcdf(-E99,1595,1514.10,63) = 0.9005. This means that there is a 90% chance that the sum of the ages for the sample group n = 49 is at most 1595.
  5. The 95th percentile = invNorm(0.95,30.9,1.1) = 32.7. This indicates that 95% of the prostitutes in the sample of 65 are younger than 32.7 years, on average.
  6. The 90th percentile = invNorm(0.90,2008.5,72.56) = 2101.5. This indicates that 90% of the prostitutes in the sample of 65 have a sum of ages less than 2,101.5 years.

try it

According to Boeing data, the 757 airliner carries 200 passengers and has doors with a mean height of 72 inches. Assume for a certain population of men we have a mean of 69.0 inches and a standard deviation of 2.8 inches.

  1. What mean doorway height would allow 95% of men to enter the aircraft without bending?
  2. Assume that half of the 200 passengers are men. What mean doorway height satisfies the condition that there is a 0.95 probability that this height is greater than the mean height of 100 men?
  3. For engineers designing the 757, which result is more relevant: the height from part 1 or part 2? Why?
  4. We know that μx = μ = 69 and we have σx = 2.8. The height of the doorway is found to beinvNorm(0.95,69,2.8) = 73.61
  5. We know that μx = μ = 69 and we have σx = 0.28. So,invNorm(0.95,69,0.28) = 69.49
  6. When designing the doorway heights, we need to incorporate as much variability as possible in order to accommodate as many passengers as possible. Therefore, we need to use the result based on part 1.

Historical Note: Normal Approximation to the Binomial

Historically, being able to compute binomial probabilities was one of the most important applications of the central limit theorem. Binomial probabilities with a small value for n(say, 20) were displayed in a table in a book. To calculate the probabilities with large values of n, you had to use the binomial formula, which could be very complicated. Using the normal approximation to the binomial distribution simplified the process. To compute the normal approximation to the binomial distribution, take a simple random sample from a population. You must meet the conditions for a binomial distribution:

  • there are a certain number n of independent trials
  • the outcomes of any trial are success or failure
  • each trial has the same probability of a success p

Recall that if X is the binomial random variable, then X ~ B(n, p). The shape of the binomial distribution needs to be similar to the shape of the normal distribution. To ensure this, the quantities np and nq must both be greater than five (np > 5 and nq > 5; the approximation is better if they are both greater than or equal to 10). Then the binomial can be approximated by the normal distribution with mean μ = np and standard deviation . Remember that q = 1 – p. In order to get the best approximation, add 0.5 to x or subtract 0.5 from x (use x + 0.5 or x – 0.5). The number 0.5 is called the continuity correction factor and is used in the following example.

Example

Suppose in a local Kindergarten through 12th grade (K – 12) school district, 53 percent of the population favor a charter school for grades K through 5. A simple random sample of 300 is surveyed.

  1. Find the probability that at least 150 favor a charter school.
  2. Find the probability that at most 160 favor a charter school.
  3. Find the probability that more than 155 favor a charter school.
  4. Find the probability that fewer than 147 favor a charter school.
  5. Find the probability that exactly 175 favor a charter school.

Let X = the number that favor a charter school for grades K trough 5. X ~B(n, p) where n = 300 and p = 0.53. Since np > 5 and nq > 5, use the normal approximation to the binomial. The formulas for the mean and standard deviation are μ = np and . The mean is 159 and the standard deviation is 8.6447. The random variable for the normal distribution is Y. Y ~ N(159, 8.6447).

For part a, you include 150 so P(X ≥ 150) has normal approximation P(Y ≥ 149.5) = 0.8641.

normalcdf(149.5,10^99,159,8.6447) = 0.8641.

For part b, you include 160 so P(X ≤ 160) has normal approximation P(Y ≤ 160.5) = 0.5689.

normalcdf(0,160.5,159,8.6447) = 0.5689

For part c, you exclude 155 so P(X > 155) has normal approximation P(y > 155.5) = 0.6572.

normalcdf(155.5,10^99,159,8.6447) = 0.6572.

For part d, you exclude 147 so P(X < 147) has normal approximationP(Y < 146.5) = 0.0741.

normalcdf(0,146.5,159,8.6447) = 0.0741

For part e, P(X = 175) has normal approximation P(174.5 < Y < 175.5) = 0.0083.

normalcdf(174.5,175.5,159,8.6447) = 0.0083

Because of calculators and computer software that let you calculate binomial probabilities for large values of n easily, it is not necessary to use the the normal approximation to the binomial distribution, provided that you have access to these technology tools. Most school labs have Microsoft Excel, an example of computer software that calculates binomial probabilities. Many students have access to the TI-83 or 84 series calculators, and they easily calculate probabilities for the binomial distribution. If you type in “binomial probability distribution calculation” in an Internet browser, you can find at least one online calculator for the binomial.

For Example 3, the probabilities are calculated using the following binomial distribution: ( n = 300 and p = 0.53). Compare the binomial and normal distribution answers.

P(X ≥ 150) :1 - binomialcdf(300,0.53,149) = 0.8641

P(X ≤ 160) :binomialcdf(300,0.53,160) = 0.5684

P(X > 155) :1 - binomialcdf(300,0.53,155) = 0.6576

P(X < 147) :binomialcdf(300,0.53,146) = 0.0742

P(X = 175) :(You use the binomial pdf.)binomialpdf(300,0.53,175) = 0.0083

try it

In a city, 46 percent of the population favor the incumbent, Dawn Morgan, for mayor. A simple random sample of 500 is taken. Using the continuity correction factor, find the probability that at least 250 favor Dawn Morgan for mayor.

0.0401

 

References

Data from the Wall Street Journal.

“National Health and Nutrition Examination Survey.” Center for Disease Control and Prevention. Available online at http://www.cdc.gov/nchs/nhanes.htm (accessed May 17, 2013).

Concept Review

The central limit theorem can be used to illustrate the law of large numbers. The law of large numbers states that the larger the sample size you take from a population, the closer the sample mean gets to μ.

License

Icon for the Creative Commons Attribution 4.0 International License

Using the Central Limit Theorem Copyright © 2018 by Barbara Illowsky & OpenStax et al. is licensed under a Creative Commons Attribution 4.0 International License, except where otherwise noted.

Share This Book