Past exam of the statistics course of the University of Oxford / 2021 / 1

For the beta distribution with parameters $(\theta ,1)$, the Euler beta function gives $B(\theta ,1)=1/\theta$. Its probability density function is therefore $\theta x^{\theta -1}$ on $(0,1)$. Direct integration gives the raw momentsIn particular, its mean is $\mu (\theta )=\theta /(\theta +1)$. Equating this to the sample mean and rearranging givesThe observations lie strictly between zero and one with probability one, so $0<\bar{X}<1$ and this method of moments estimator is well defined and positive. This is an instance of estimation of a beta shape parameter.

Using the raw moments from part (i), the variance of one observation isThe central limit theorem for the independent statistical sample givesFor $g(x)=x/(1-x)$, its derivative at the mean is $g^{\prime }(\mu )=(1-\mu {)}^{-2}=(\theta +1{)}^2$. The delta method therefore givesEquivalently, the large-sample normal approximation isHere $v$ denotes the leading asymptotic variance, rather than an assertion about an exact finite-sample variance.

Write $A=-{\sum }_i\log X_i>0$, with $\log$ the natural logarithm. The likelihood function and log-likelihood function areThe score function is ${\ell }^{\prime }(\theta )=n/\theta -A$ and the second derivative is ${\ell }^{\prime \prime }(\theta )=-n/{\theta }^2<0$. Thus the log-likelihood function is strictly concave, its stationary point is the unique global maximum, and the maximum-likelihood estimator isThe one-observation Fisher information is $I(\theta )=1/{\theta }^2$. The support of a probability distribution here is independent of $\theta >0$, so the regular asymptotic normality of a maximum likelihood estimator givesThere is also a direct check: $U_i=-\log X_i$ has an exponential distribution with rate $\theta$, since $\mathbb{P}(U_i>u)=\mathbb{P}(X_i<e^{-u})=e^{-\theta u}$ for $u>0$. Its mean and variance are $1/\theta$ and $1/{\theta }^2$. Apply the central limit theorem to $A/n$ and the delta method to $h(u)=1/u$ to obtain the same result.

The specified asymptotic relative efficiency isFor every fixed $\theta >0$ this lies strictly between zero and one. Prefer $T_2$ on grounds of asymptotic precision: it has the smaller leading asymptotic variance and attains the inverse Fisher information. Both are consistent estimators, by the law of large numbers and the continuous mapping theorem applied respectively to $\bar{X}$ and $A/n$. The efficiency approaches zero as $\theta \downarrow 0$ and one as $\theta \to \infty$.

This preference is an asymptotic comparison. In particular, it does not assert that $T_2$ is an unbiased estimator: since $A$ has a gamma distribution of shape $n$ and rate $\theta$, $\mathbb{E}{T}_2=n\theta /(n-1)$ for $n>1$.

The standard error suggested by part (iii) is $\theta /\sqrt{n}$. Substituting the consistent estimator $T_2$ gives $T_2/\sqrt{n}$; Slutsky's theorem givesUsing the central standard normal quantiles $\pm 1.96$, an approximate 95% Wald confidence interval isIts coverage probability approaches 0.95 for each fixed $\theta >0$ as $n\to \infty$. The intersection enforces positivity and does not change whether the true positive statistical parameter is covered. The value 1.64 would give the wrong central two-sided coverage probability.

Put $A=-{\sum }_i\log x_i>0$, $B=-{\sum }_j\log y_j>0$, and $N=n+m$. The two independent statistical samples give the joint likelihood functionThe unrestricted maximum-likelihood estimators are $\hat{\theta }=n/A$ and $\hat{\tau }=m/B$. Under the null hypothesis, the common statistical parameter $\eta$ has log-likelihood function $N\log \eta -(\eta -1)(A+B)$, maximized at $\hat{\eta }=N/(A+B)$. With the likelihood ratio defined as the null maximum divided by the unrestricted maximum,The statistic in the paper is $T=A/(A+B)$, since both original sums of natural logarithms are negative. HenceIt has maximum one at $T=n/N$, corresponding to equal fitted rates. This is the likelihood-ratio test for equality of beta shape parameters.

A likelihood-ratio test rejects for small $\lambda$. The derivative of the natural logarithm of its variable factor isThus $t^n(1-t{)}^m$ increases up to $n/(n+m)$ and decreases thereafter, tending to zero at both endpoints. Every nontrivial lower level set of $\lambda$ therefore consists of two tails. For a prescribed test size $0<\alpha <1$, the exact critical region isWriting $F_{n,m}$ for the cumulative distribution function of the beta distribution with parameters $(n,m)$, the required two equations areThe first makes both cutoffs have the same likelihood ratio; the second calibrates the null hypothesis rejection probability. Equivalently, the second left-hand side isAs the common likelihood ratio threshold increases from zero to one, this probability increases continuously and strictly from zero to one; hence the equations determine unique cutoffs. The two tail probabilities need not each equal $\alpha /2$ when $n\ne m$. Exact calibration holds for every common rate because the given null distribution of $T$ is independent of that rate. Boundary equalities have zero probability.