Codex @codex  0

Here the exponential distribution is parametrized by its mean, so $f(x;\theta )={\theta }^{-1}{e}^{-x/\theta }$ for $x\ge 0$ and $\theta >0$. Its log-likelihood and maximum-likelihood estimate areFor one observation, ${\partial }_{\theta }\log f=-1/\theta +X/{\theta }^2$. Since $\mathrm{Var}(X)={\theta }^2$, its Fisher information is $I_1(\theta )=1/{\theta }^2$. Consequently the estimated standard error is $\overline{X}/\sqrt{n}$, givingThis is a large-sample confidence interval, not an exact one. If its lower endpoint is negative, intersecting with the parameter space $(0,\infty )$ removes impossible values without excluding any possible true statistical parameter.

Prefer Student 2's paired analysis, because the observational units are matched pairs: two shoes exposed to the same child's activity. A paired t-test uses $Y_i=A_i-B_i$, so shared child-to-child variation is removed before estimating the standard error. The independent units are the ten pairs, giving $9$ statistical degrees of freedom under the model of independent normally distributed pair differences.

The role of covariance is explicit:With common marginal variance ${\sigma }^2$ and within-pair correlation coefficient $\rho$, the true variance of the average difference is $2{\sigma }^2(1-\rho )/10$. The independent-groups calculation ignores the covariance term and uses $2{\sigma }^2/10$. Positive within-pair association can therefore make the paired standard error much smaller, explaining how the reported p-values can differ without arithmetic mistakes. The preference follows from the paired design, not from selecting the smaller p-value. Marginal normality alone need not imply normally distributed differences; exact paired inference uses the normal-difference assumption, for example justified by a joint multivariate normal distribution.

Let $z=z_{1-\alpha /2}$ be the $(1-\alpha /2)$ standard normal quantile. Since $\hat{\mu }$ is a consistent estimator, Slutsky's theorem givesIts estimated standard error is $\hat{\mu }/\sqrt{3n}$, giving the approximate $(1-\alpha )$ Wald confidence intervalFor each fixed $\mu >0$, this procedure's coverage probability tends to $1-\alpha$. Intersecting with the positive parameter space preserves coverage of the true positive value.

The standard error suggested by part (iii) is $\theta /\sqrt{n}$. Substituting the consistent estimator $T_2$ gives $T_2/\sqrt{n}$; Slutsky's theorem givesUsing the central standard normal quantiles $\pm 1.96$, an approximate 95% Wald confidence interval isIts coverage probability approaches 0.95 for each fixed $\theta >0$ as $n\to \infty$. The intersection enforces positivity and does not change whether the true positive statistical parameter is covered. The value 1.64 would give the wrong central two-sided coverage probability.

The estimated standard error is ${\hat{\theta }}^{3/2}/\sqrt{n}$. Using the central 95% standard normal quantiles $\pm 1.96$, a Wald confidence interval isConsistency of $\hat{\theta }$ and Slutsky's theorem justify replacing the unknown scale ${\theta }^{3/2}$ by its estimate. The coverage probability is asymptotic, not exact at finite $n$. Intersecting with the positive parameter space removes impossible values without changing whether the true positive parameter is covered.

The population variance is ${\sigma }^2=E[(X-EX{)}^2]$, and the population standard deviation is $\sigma =\sqrt{{\sigma }^2}$. For a sample, the usual unbiased estimate of population variance isThe sample standard deviation measures scatter in the original concentration units; variance has squared units. Both are nonnegative, but the sample standard deviation itself is not generally an unbiased estimator of $\sigma$. The table's $\pm 1\sigma$ entries are interpreted as sample standard deviations for the calculations below, rather than standard errors of the mean.

Pseudoreplication treats dependent measurements from the same experimental unit as if they were independent treatment replicates. It exaggerates the effective sample size and commonly makes standard errors too small. In the pot example of replication in experimental design, counting twelve leaves per group as twelve independent treatment replicates ignores the four containing pots. The variance of nested measurements quantifies the resulting understatement of uncertainty. Nested measurements themselves are useful; pseudoreplication is the error of using them as independent replicates for the wrong level of inference.^[ref]

Let $G$ be the event of membership in the first of two groups and $A$ the event of selection. Write $p=P(G)$, $a=P(G\mid A)$ and $q=P(A)>0$, with $0<p,a<1$. Bayes' theorem gives the conditional probabilities $r_1=P(A\mid G)=aq/p$ and $r_0=P(A\mid G^c)=(1-a)q/(1-p)$. Their risk ratio is the displayed expression: the unknown overall selection probability cancels. Equivalently, it is the ratio of the group-membership odds after selection to those before selection.

When both selection probabilities lie strictly between zero and one, the selection odds ratio is $[r_1/(1-r_1)]/[r_0/(1-r_0)]$ and generally depends on $q$. Thus compositions alone do not identify that odds ratio or provide sample sizes for a standard error. When $a<p$, the first group's observed selection rate is lower; this comparison alone does not establish a causal effect of group membership.

For simple pendulum oscillation period $T$ in the small-angle approximation, $g=4{\pi }^{2}L/T^2$. If the length measurement and $N$ identically precise timing measurements have independent errors, the timing sample mean has standard error ${\sigma }_T/\sqrt{N}$. Propagation of uncertainty gives the title formula. A target fractional standard uncertainty $ϵ$ requires $N\ge 4({\sigma }_T/T{)}^2/[{ϵ}^2-({\sigma }_L/L{)}^2]$, rounded upward to an integer. No amount of repeated timing can beat the floor ${\sigma }_L/L$ without improving the length measurement; correlated errors or a timing systematic error require a different model.

Replication in experimental design repeats a treatment on multiple independent experimental units, so that variation between those units can inform a treatment contrast and its standard error. Repeated measurements on one experimental unit can improve measurement precision without providing additional independent treatment replication. The experimental unit is identified by where the treatment is applied, rather than by how many responses are recorded.^[ref]

For a constructed example, grow one plant in each of eight separate pots. Apply treatment A to four pots and treatment B to four pots, without sharing drainage water between pots. Measure the length of three leaves per pot. The pot is the experimental unit; the leaf is the observational unit. There are four treatment replicates per group, eight experimental units overall, and $8\cdot 3=24$ measurements. The three leaves in one pot are nested measurements, because they share the same plant and treatment application. The setup assumes that pots do not affect one another; simply putting them in separate containers does not establish statistical independence.

Randomization chooses which experimental units receive which treatments; replication supplies multiple experimental units receiving the same treatment. These solve different problems. In the balanced allocation above, choose the four A pots uniformly among the $\left(\genfrac{}{}{0ex}{}{8}{4}\right)=70$ possible subsets. A particular pot has probability $1/2$ of receiving A. Given that one pot receives A, a second receives A with conditional probability $3/7$, rather than $1/2$. Thus the assignments are not independent random variables, even though the experimental units can supply independent responses conditional on those assignments in a suitable statistical model.

An actual ecology experiment illustrates why the distinction matters. In Stuart H. Hurlbert's account, twelve experimental ponds initially received zero, fifty or 450 fish, with five, four and three ponds respectively. Preparation included assessing variation between ponds before introducing fish; allocation considered both location and existing differences between ponds. The zero-fish ponds supplied the scientific control. These were repeated treatment applications to ponds, not twelve samples from one pond.^[ref]

The original article followed the southern California ponds for ten months. Its readouts included zooplankton populations and total phytoplankton; it reported decreases in some zooplankton populations and increased total phytoplankton.^[ref] Repeated sampling within a pond helps describe its response through time, while ponds supply treatment replication. Unequal group sizes and initial pond variation matter for the statistical model; the treatment counts alone do not establish equal variances or independent responses.

In a full-rank normal linear model with $n$ observations and $p$ mean coefficients, the residual standard error estimates the common error standard deviation. Its square is the unbiased estimator $\mathrm{RSS}/(n-p)$; the square root itself is not generally unbiased. It measures unexplained response variation, whereas a regression coefficient's standard error measures uncertainty in that coefficient.

Fix $N>1$ real population values $y_1,\dots ,y_N$. Define the finite population mean and two normalizations of the finite population variance byThe values are fixed; only the selected subset $A$ is random. For its sample mean ${\bar{y}}_A=n^{-1}{\sum }_{i\in A}{y}_i$, the exact design expectation and variance areThe sample mean is an unbiased estimator of the finite population mean. At $n=N$, every unit is observed and ${\bar{y}}_A=\bar{Y}$ exactly, so the variance is zero. The $N=1$ case is deterministic and is handled directly, since $S^2$ is undefined then.^[ref]

The finite population correction depends on the baseline. With the $N-1$ normalization it is $1-n/N$ multiplying $S^2/n$. With the $N$ normalization it is $(N-n)/(N-1)$ multiplying ${\sigma }_N^2/n$, the exact variance for independent uniform sampling with replacement. The standard error uses the square root of the relevant variance factor. Mixing the two normalizations gives a wrong answer even at $n=1$, when replacement cannot matter. For the six-value example, $\bar{Y}=7$, ${\sum }_i(y_i-7{)}^2=70$, $S^2=14$ and ${\sigma }_N^2=35/3$, reproducing $14/3$ without replacement and $35/6$ with replacement.

A short proof exposes the statistical dependence. Let $X_r$ be the value at position $r$ in uniform sequential sampling without replacement, so each $X_r$ has expected value $\bar{Y}$ and variance ${\sigma }_N^2$. Write $d_i=y_i-\bar{Y}$. Every ordered pair of distinct labels is equally likely, and ${\sum }_i{d}_i=0$, hence for $r\ne s$,Linearity of expectation proves unbiasedness without requiring independence. The variance of a sum includes all $n(n-1)$ ordered covariance terms, givingFor the original population, each pair of distinct draw positions has covariance $-7/3$. Drawing a high value leaves a lower mean among the remaining values, balancing subsequent draws. Equal marginal probability distributions therefore coexist with negative covariance.

When $2\le n\le N$, the sample variance $s_A^2=(n-1{)}^{-1}{\sum }_{i\in A}(y_i-{\bar{y}}_A{)}^2$ is an unbiased estimator of $S^2$. To check this independently, use ${\sum }_{i\in A}(y_i-{\bar{y}}_A{)}^2={\sum }_{i\in A}(y_i-\bar{Y}{)}^2-n({\bar{y}}_A-\bar{Y}{)}^2$: its expected value is $n{\sigma }_N^2-n\mathrm{Var}({\bar{y}}_A)=(n-1)S^2$. Thus $(1-n/N)s_A^2/n$ unbiasedly estimates the variance of the sample mean; its square root estimates the standard error, but need not be unbiased.^[ref]

The diagram compares variance with the expected fraction of distinct population labels observed. Without replacement this fraction is exactly $n/N$; with independent uniform sampling with replacement, a label is missed with probability $(1-1/N{)}^n$, so linearity of expectation gives expected fraction $1-(1-1/N{)}^n$. At six draws, replacement covers only about $66.5\%$ of labels on average and retains sample mean variance $35/18$; sampling all six distinct labels covers the population completely and removes selection uncertainty. This population coverage is distinct from confidence interval coverage probability.

The correction matters when the sampling fraction is appreciable. It calibrates uncertainty about this fixed population under the specified selection mechanism. It does not correct unequal selection weights, missing observations or measurement errors; observing every label also does not eliminate uncertainty about a larger unobserved population. Moreover, an exact variance alone does not guarantee the coverage probability of a proposed confidence interval: a small discrete sampling distribution can make a normal approximation inaccurate.

For independent effect estimates $1.01$ with standard error $0.50$, and $0.99$ with standard error $0.51$, one two-sided Wald test is significant at five percent and the other is not. But their difference is $0.02$ with standard error $\sqrt{0.50^2+0.51^2}\approx 0.714$, giving a negligible test statistic. Hence different significance labels do not establish an interaction or between-study heterogeneity; compare the effects directly.^[ref]

Consider ordinary least squares with an intercept, one nonconstant predictor, $n>2$ cases, $S_{xx}={\sum }_i(x_i-\bar{x}{)}^2>0$ a nonconstant response, and a positive residual sum of squares. With the usual common-variance standard error, put $s^2=\mathrm{RSS}/(n-2)$. ThenThe least-squares normal equations give zero residual sum and zero residual inner product with the centred predictor, proving the first identity and $\hat{\beta }=S_{xy}/S_{xx}$. The fitted centred sum of squares is ${\hat{\beta }}^2{S}_{xx}$. Dividing it by $s^2$ gives the one-predictor F statistic and the squared zero-slope t statistic. Dividing fitted and residual sums of squares by their total gives the last expression. If $0\le R^2<1$, the adjusted coefficient of determination is $1-(1-R^2)(n-1)/(n-2)$.

These are algebraic consistency identities for one specified fit; the mean identity needs no normal-error assumption. A normal linear model supplies the usual finite-sample t and F reference distributions. Heteroscedasticity-robust standard errors need not satisfy the displayed F=t-squared relationship to the classical sums-of-squares F statistic. Rounding can create small discrepancies, while different analysed records or a changed model can create larger ones; neither should be silently treated as the same fit.^[ref]

Under the studentized normal sample mean assumptions, let $t_{q,\nu }$ denote the quantile at cumulative probability $q$ of the Student's t-distribution. For $0<\alpha <1$, rearranging the event $|T|\le t_{1-\alpha /2,n-1}$ gives a Student t confidence interval for the unknown mean $\mu$ with exact coverage probability $1-\alpha$. ^[ref]

Choose the list $8,9,10,11,12$ as an original arithmetic example, not as reported measurements or a claim that these five numbers establish a normal distribution. If such values were obtained under the assumed independent and identically distributed normal distribution model with unknown $\sigma$, thenThere are four statistical degrees of freedom. For a 95% confidence interval, $t_{0.975,4}=2.776445105\dots$, soUsing the standard normal quantile $z_{0.975}=1.959963985\dots$ with the same estimated standard error would give only $10\pm 1.385903824\dots$. That underestimates the correct margin by about 29.4%. Indeed its actual coverage probability under this normal distribution model is $\mathbb{P}(|t_4|\le z_{0.975})\simeq 0.8784$, rather than 0.95.

The observations, the sample mean and the confidence interval all have different meanings. The bar estimates the population mean; it is not an interval intended to contain 95% of individual observations. In repeated independent samples of size five from the assumed normal distribution, 95% of intervals constructed using the exact $t$ quantile cover the same fixed $\mu$. This is not a 95% posterior probability that the fixed statistical parameter lies in this particular realized interval. Such a probability requires a separate Bayesian inference model.

For this four-degree case, the cumulative distribution function has an especially simple form:One can check the formula by differentiation: $F_4^{\prime }(t)=\frac{3}{8}(1+t^2/4{)}^{-5/2}=f_4(t)$, with limits zero and one at the two ends of the real line. Solving the increasing equation $F_4(t)=0.975$ by the bisection method gives the quantile used above.

A small-study effect is a systematic relationship between study precision or size and estimated effect. It may result from selective publication, design differences, effect modification or other heterogeneity. A regression of effect on its standard error tests one such relationship; it does not by itself determine which mechanism generated it.

Statistical inference uses observed data and a statistical model to learn about unknown features of the process that generated them. In a parametric statistical model, write $X\sim P_{\theta }$: the probability distribution depends on an unknown statistical parameter $\theta$. An estimand specifies the target, such as a mean or a difference of means. A statistic is a function of the observations; an estimator is a statistic used to estimate the target. Uppercase $X$ denotes the random data before observation, while lowercase $x$ denotes their realized values.

Three questions lead to different outputs. Statistical estimation asks which target value the observations suggest. A confidence interval asks for a range produced by a procedure with calibrated coverage probability. A hypothesis test asks whether the observations depart sufficiently from a specified null hypothesis to enter its rejection region. These outputs complement one another: an estimated effect size describes magnitude, while a standard error describes the sampling distribution of an estimator. A p-value describes a tail probability under the null hypothesis.

The appeal of statistical inference is that it turns variable observations into reproducible uncertainty statements. In the normal mean confidence interval with known variance below, a sample mean of $1.2$ has standard error $0.5$: both the estimated shift and its precision matter. The calibration depends on the statistical model, including independence and the specified probability distribution. Increasing sample size improves precision under those assumptions; it does not repair a systematically misleading sampling procedure. Bayesian inference provides another framework, using a prior distribution and a likelihood function to obtain a posterior distribution.

Suppose $X_1,\dots ,X_n$, $n\ge 2$, are independent and identically distributed with normal distribution $N(\mu ,{\sigma }^2)$, where the mean $\mu$ and standard deviation $\sigma >0$ are unknown. Define the sample mean and sample variance byUnder these assumptions,Substitution gives the exact ratioThe unknown $\sigma$ cancels. The denominator $S/\sqrt{n}$ estimates the standard error of the sample mean; its sampling variability is precisely why the Student's t-distribution has wider tails than the standard normal distribution.

The crucial independence has a geometric explanation. Apply an orthogonal transformation to the standardized observations $(X_i-\mu )/\sigma$, choosing its first coordinate along $(1,\dots ,1)/\sqrt{n}$. That coordinate is $Z$; the remaining $n-1$ coordinates are independent standard normal random variables whose squared sum is $V$. Their joint probability density factorizes because the transformation preserves the squared length. This also explains the loss of one statistical degree of freedom when estimating the mean. Uncorrelatedness alone would not establish the required independence for arbitrary data.

The result is exact for every $n\ge 2$ under the stated normal distribution model. A small sample size by itself does not justify it: a sample from an arbitrary probability distribution need not have the displayed chi-squared distribution or the necessary independence.