The prior mean, posterior mean, and maximum-likelihood estimate areFor , the last follows by maximizing . At or , use the usual binomial likelihood convention that admits the endpoints and as maximum-likelihood estimates; if the parameter domain is strictly , these are boundary suprema rather than attained maxima. The posterior mean remains interior in all cases.
TakinggivesSince and , . Thus the posterior mean is a convex combination of the prior mean and observed binomial proportion, with larger prior weight when is large relative to .
Set and . Conditional independence of the binomial distribution observations gives the likelihood functionThe prior distribution is the beta distribution with parameters . By Bayes' theorem, multiplying the prior density by the likelihood function gives a posterior density proportional toRecognizing and normalizing this beta distribution givesfor . This is Beta-binomial conjugacy; the original binomial coefficients cancel in the normalization because they are independent of .
Condition on the total of 400 complaints. Assume each complaint independently has the same probability of being received on Monday; in particular, repeated complaints from one incident must not create material dependence. The Monday count then has a binomial distribution with parameters . Test against , rejecting for large as suggested by the monotone likelihood ratio.
Under the null hypothesis, and . Both expected successes and expected failures are large, so the central limit theorem gives a suitable normal approximation:Using the paper's supplied rounded table, the upper-tail p-value is approximatelyA more accurate evaluation of the standard normal distribution cumulative distribution function gives about 0.0062. For example, choose significance level 0.05 before examining the data; the supplied upper 5% standard normal quantile is approximately 1.6, and . Reject at 5%, and also at 1%, using this approximation. The observed binomial proportion is , providing evidence that the Monday probability exceeds 0.2 under the sampling assumptions.
If applying a continuity correction, approximate by ; this gives the same 5% and 1% conclusions. The uncorrected value 0.005 is approximate, so a decision exactly at the 0.5% boundary is not warranted by the supplied rounded table.
For any fixed , the alternative-to-null likelihood ratio iswhich is strictly increasing in for . Consequently the Neyman-Pearson lemma selects the same upper-tail ordering for every such alternative hypothesis. At the null hypothesis value,Thereforeis a uniformly most powerful test of the required exact test size. Its power function is . At its statistical power is one, so including that boundary alternative preserves the conclusion.
Let , which has a binomial distribution with parameters . For , the alternative-to-null likelihood ratio of the independent Bernoulli trials isSince , this is strictly decreasing in . A threshold on large is therefore a lower-tail likelihood-ratio test, and a threshold between and gives the stated critical region . The Neyman-Pearson lemma also proves it is a most powerful test at its attained test size.
Using the binomial probability mass, its test size and statistical power are respectivelyThe associated power function is . These formulas hold for positive integer ; when the test always rejects and has size one. If the boundary value is admitted, all alternative probability is at ; the same test still has statistical power one and can be represented using a threshold with ties in the likelihood ratio.
False. For the test associated with a p-value, reject at significance level when . Here , so do not reject at level 0.05. The p-value is neither the posterior probability of the null hypothesis nor the probability of a Type I error conditional on these observed data.
True, with the test's rejection rule fixed. If its rejection region in the space of the test statistic is , its statistical power against the specified simple hypothesis isThus the probability distribution of under the alternative hypothesis determines the statistical power of this test. The null distribution is used to choose a rule with the desired test size, but statistical power is evaluated under the alternative hypothesis. Different rejection rules can have different statistical power even for the same probability distribution of .
False. A test size constrains the probability of rejection conditional on the null hypothesis being true:for an exact size- test of a simple hypothesis. It does not assign a posterior probability to that statistical hypothesis after observing nonrejection. In the frequentist interpretation, the statistical parameter is fixed and the data are random. Nonrejection can occur even when the alternative hypothesis is true; for example, it is particularly likely for an alternative against which the test has low statistical power. A posterior probability would require a prior distribution and a Bayesian model.
A likelihood-ratio test rejects for small . The derivative of the natural logarithm of its variable factor isThus increases up to and decreases thereafter, tending to zero at both endpoints. Every nontrivial lower level set of therefore consists of two tails. For a prescribed test size , the exact critical region isWriting for the cumulative distribution function of the beta distribution with parameters , the required two equations areThe first makes both cutoffs have the same likelihood ratio; the second calibrates the null hypothesis rejection probability. Equivalently, the second left-hand side isAs the common likelihood ratio threshold increases from zero to one, this probability increases continuously and strictly from zero to one; hence the equations determine unique cutoffs. The two tail probabilities need not each equal when . Exact calibration holds for every common rate because the given null distribution of is independent of that rate. Boundary equalities have zero probability.
Put , , and . The two independent statistical samples give the joint likelihood functionThe unrestricted maximum-likelihood estimators are and . Under the null hypothesis, the common statistical parameter has log-likelihood function , maximized at . With the likelihood ratio defined as the null maximum divided by the unrestricted maximum,The statistic in the paper is , since both original sums of natural logarithms are negative. HenceIt has maximum one at , corresponding to equal fitted rates. This is the likelihood-ratio test for equality of beta shape parameters.
The standard error suggested by part (iii) is . Substituting the consistent estimator gives ; Slutsky's theorem givesUsing the central standard normal quantiles , an approximate 95% Wald confidence interval isIts coverage probability approaches 0.95 for each fixed as . The intersection enforces positivity and does not change whether the true positive statistical parameter is covered. The value 1.64 would give the wrong central two-sided coverage probability.
The specified asymptotic relative efficiency isFor every fixed this lies strictly between zero and one. Prefer on grounds of asymptotic precision: it has the smaller leading asymptotic variance and attains the inverse Fisher information. Both are consistent estimators, by the law of large numbers and the continuous mapping theorem applied respectively to and . The efficiency approaches zero as and one as .
This preference is an asymptotic comparison. In particular, it does not assert that is an unbiased estimator: since has a gamma distribution of shape and rate , for .
Write , with the natural logarithm. The likelihood function and log-likelihood function areThe score function is and the second derivative is . Thus the log-likelihood function is strictly concave, its stationary point is the unique global maximum, and the maximum-likelihood estimator isThe one-observation Fisher information is . The support of a probability distribution here is independent of , so the regular asymptotic normality of a maximum likelihood estimator givesThere is also a direct check: has an exponential distribution with rate , since for . Its mean and variance are and . Apply the central limit theorem to and the delta method to to obtain the same result.
Using the raw moments from part (i), the variance of one observation isThe central limit theorem for the independent statistical sample givesFor , its derivative at the mean is . The delta method therefore givesEquivalently, the large-sample normal approximation isHere denotes the leading asymptotic variance, rather than an assertion about an exact finite-sample variance.
For the beta distribution with parameters , the Euler beta function gives . Its probability density function is therefore on . Direct integration gives the raw momentsIn particular, its mean is . Equating this to the sample mean and rearranging givesThe observations lie strictly between zero and one with probability one, so and this method of moments estimator is well defined and positive. This is an instance of estimation of a beta shape parameter.
For one Bernoulli random variable,Its variance is , so the expected Fisher information and Jeffreys prior areThe normalizer is . ThereforeThis Jeffreys prior for a Bernoulli parameter is proper despite its integrable endpoint singularities. It is the arcsine distribution. It replaces the specified prior distribution in part (a) when the Jeffreys prior rule is chosen; it is not one of those restricted priors.
The Jeffreys prior is invariant under smooth one-to-one reparameterization. This means that applying the rule directly in a new parameter gives the same prior distribution as first constructing the rule for and then transforming its prior density by the change-of-variable formula.
More explicitly, for a differentiable invertible change of parameter with nonzero derivative,Thus and represent the same measure, up to the normalization constant. Invariance concerns the measure: the numerical values of the prior densities need not be equal in the two coordinates. The same change of variables then makes the posterior distributions agree. This is the reparameterization invariance of Jeffreys prior.
For a scalar statistical parameter in a regular model with probability mass function , define the one-observation expected Fisher information byThe Jeffreys prior is the prior density specified, up to a factor independent of , byFor independent observations the Fisher information is , so the factor does not change this prior distribution. If is finite, divide by this integral to normalize; otherwise the rule defines an improper prior.
Put and as in part (a), and let be the cumulative distribution function of the beta distribution . The two endpoint equations areThe first equation fixes the posterior probability, and the second makes the two endpoint posterior densities equal. Their admissible ordering isTo justify sufficiency and uniqueness, the derivative of the logarithm of the posterior density iswhich is positive below and negative above it. Thus the posterior density increases strictly to its unique mode and decreases strictly thereafter, vanishing at both ends. Each density threshold between zero and the maximum determines exactly one endpoint on each side of . The probability between these endpoints decreases continuously and strictly from one to zero as increases, so exactly one threshold gives 0.95. This is the beta highest posterior density endpoint characterization.
For a specified posterior probability , an interval is a highest posterior density interval ifand every included point has posterior density at least as large as every excluded point, apart from boundary and null-set choices. Equivalently, is a level set , with possible choices on its boundary, whose posterior probability is .
This selects the most densely supported values of the statistical parameter. When the relevant level set is one interval and has no plateau of positive probability, it is the shortest credible interval of that posterior probability. With several separated peaks, the corresponding highest density region can instead be disconnected, so an interval need not exist. The definition is in the stated parameter coordinate: posterior density ordering can change under a nonlinear change of parameter.
There are unlisted articles, also show them or only show them.