Overview
Sampling distributions are fundamental for the understanding of
statistics.
For a parent population with finite variance σ² the central limit theorem
tells us that in the limit of large sample size (n) the sampling distribution
of the mean will approach a normal distribution with the same mean as the
parent population, and variance σ²/n.
The standard deviation of the
sample mean, that is the width of the sampling distribution of the mean,
is σ/√n.
A good rule of thumb is that a sample size of 30 ensures that the sampling
distribution is “close” to normal.
For a long-tailed parent population without finite variance the central limit theorem
does not apply.
Experiment with different populations, including various continuous
distributions that have finite variance (uniform, exponential, normal,
power-law with exponent 3.5), distributions without finite variance
(power-law with exponent 2.5, Cauchy), a discrete
distribution (±1), or your own custom distribution.