Simple random sample

ID: simple-random-sample

In finite-population sampling, a simple random sample of fixed size without replacement is a subset of labelled units drawn so that every size- subset has probability
The sample is the selected subset; simple random sampling is the procedure that generates it. This definition does not require the observed values to be distinct, only the selected population labels. The without-replacement convention is important because an independent repeated draw from a population is a different design.[ref]
One construction randomly orders all labels and takes the first . Each particular subset can occupy those positions in permutations, out of , proving the probability above. Equivalently, draw successively and uniformly from the remaining labels, then discard their order.
For , there are possible samples. A particular unit belongs to four of them, so its inclusion probability is ; a particular pair is one complete sample, so its joint inclusion probability is . These are properties of the procedure before observing which subset was obtained.
A simple random sample need not resemble the whole population in every realization. For fixed values , six of the ten size-two samples contain only zeros. Thus the sample mean is zero with probability , although its expected value is the finite population mean . The remaining four samples each have mean , giving . Unbiasedness concerns repeated selection, rather than a guarantee about any one sample. Coverage of the population labels and faithful implementation of the selection rule remain essential.

New to topics? Read the docs here!