No. A permitted counterexample is with all observed counts zero. Then and the posterior distribution is an exponential distribution with rate , whose density decreases strictly from the left boundary. Its equal-tailed credible interval isHere . This excludes values just above zero whose posterior density is larger than that of retained values near , violating the highest-density criterion. The actual highest posterior density interval starts at the support boundary and solves :Writing zero as the endpoint causes no problem because a single point has zero posterior probability. Thus even within the gamma family the two intervals need not agree. More generally, for an interior unimodal gamma distribution, highest-density endpoints have equal densities, whereas equal-tailed endpoints need not.
Continuity and strict increase make the quantile function well-defined on . The endpoints of the uniform distribution occur with probability zero and do not affect the construction. For every real ,Thus each has cumulative distribution function . Applying a fixed measurable function separately to independent random variables preserves their independence; explicitly, joint lower-tail probabilities factor asConsequentlyThis is inverse transform sampling. Since preserves order, it also sends the central order statistic to the central order statistic, justifying .
For a Bernoulli distribution with fixed , the mean and variance are and . The odds transformation has derivative . Applying the delta method from part (ii),More precisely, converges to a normal distribution of mean zero and variance , after defining the statistic arbitrarily on . That exceptional event has probability , so this extension does not change the limit. The unextended ratio is undefined there and has no finite exact variance if interpreted as infinite. At it is zero almost surely; at the denominator is always zero. This is the delta method for Bernoulli odds.
For , the central limit theorem givesIf is differentiable at , the delta method applies to the first-order expansionwhere the remainder notation means that its product with tends to zero in probability. HenceThe useful nondegenerate normal approximation requires . When , the first-order limit is zero and a higher-order expansion may be needed.
Put , and . The normal distribution model givesand, up to a constant independent of , its log-likelihood function isThe score function and its zero equation areFor , this quadratic equation has exactly one positive root, giving the maximum-likelihood estimatorThe numerator of the score function is positive between its negative and positive roots and negative above its positive root. Thus the likelihood function increases up to and decreases afterwards: this is its unique global maximum on . Also, at both ends. The all-zero observation vector has probability zero; on that exceptional vector and there is no attained maximum.
The second derivative and the relevant moments areTherefore the expected Fisher information isThe support of a probability distribution is the whole real line, independent of the positive statistical parameter. The law of large numbers gives and in probability, so the displayed maximum-likelihood estimator is a consistent estimator. The regular asymptotic normality of a maximum likelihood estimator now yieldsThus the requested leading asymptotic variance on the unscaled estimator's scale is . The normal mean proportional to standard deviation model provides a reusable version of this calculation.
The Neyman-Pearson lemma concerns a simple hypothesis against another simple hypothesis . For a continuous statistical sample, put for the joint probability density functions, . A randomized statistical test is a measurable , the conditional probability of rejection after observing . Its test size is and its statistical power is .
Choose and boundary randomization so thatThen is most powerful among all tests of size at most . Thus one rejects for sufficiently large alternative-to-null likelihood ratio. If the equality set has zero probability under , the test needs no randomization. Continuous observations alone do not guarantee that their likelihood ratio has a continuous probability distribution.
For the proof, let be any competing test with . At every ,Indeed, on the first factor is ; on it is ; and on equality the product is zero. Integration giveswhich proves the claimed optimality. Moreover, when , equality of statistical power forces equality of test size and forces almost everywhere where : otherwise the nonnegative integrand would have positive integral. This proves the usual necessity assertion as well, up to equality sets and sets of zero probability under both hypotheses.
Under the null hypothesis, the full model has two free positive statistical parameters and the constrained model has one. The Wilks theorem therefore givesas both sample sizes tend to infinity, with tending to a number strictly between zero and one. For the observed , calculateThe large-sample p-value is the upper-tail probabilitywhere is the cumulative distribution function of the standard normal distribution. The last equality uses the fact that the square of a standard normal random variable has a chi-squared distribution with one statistical degree of freedom. Values of on either side of are already included by the transformation to .
Conditional on , the future Bernoulli random variable is independent of the observed statistical sample and has success probability . Its posterior predictive probability is therefore the posterior mean of . Put and . Thenusing the beta-gamma identity and the Gamma function recurrence. HenceThe whole posterior predictive distribution of is the Bernoulli distribution with this success probability.
Put and as in part (a), and let be the cumulative distribution function of the beta distribution . The two endpoint equations areThe first equation fixes the posterior probability, and the second makes the two endpoint posterior densities equal. Their admissible ordering isTo justify sufficiency and uniqueness, the derivative of the logarithm of the posterior density iswhich is positive below and negative above it. Thus the posterior density increases strictly to its unique mode and decreases strictly thereafter, vanishing at both ends. Each density threshold between zero and the maximum determines exactly one endpoint on each side of . The probability between these endpoints decreases continuously and strictly from one to zero as increases, so exactly one threshold gives 0.95. This is the beta highest posterior density endpoint characterization.
For a specified posterior probability , an interval is a highest posterior density interval ifand every included point has posterior density at least as large as every excluded point, apart from boundary and null-set choices. Equivalently, is a level set , with possible choices on its boundary, whose posterior probability is .
This selects the most densely supported values of the statistical parameter. When the relevant level set is one interval and has no plateau of positive probability, it is the shortest credible interval of that posterior probability. With several separated peaks, the corresponding highest density region can instead be disconnected, so an interval need not exist. The definition is in the stated parameter coordinate: posterior density ordering can change under a nonlinear change of parameter.
For the beta distribution with parameters , the Euler beta function gives . Its probability density function is therefore on . Direct integration gives the raw momentsIn particular, its mean is . Equating this to the sample mean and rearranging givesThe observations lie strictly between zero and one with probability one, so and this method of moments estimator is well defined and positive. This is an instance of estimation of a beta shape parameter.
A likelihood-ratio test rejects for small . The derivative of the natural logarithm of its variable factor isThus increases up to and decreases thereafter, tending to zero at both endpoints. Every nontrivial lower level set of therefore consists of two tails. For a prescribed test size , the exact critical region isWriting for the cumulative distribution function of the beta distribution with parameters , the required two equations areThe first makes both cutoffs have the same likelihood ratio; the second calibrates the null hypothesis rejection probability. Equivalently, the second left-hand side isAs the common likelihood ratio threshold increases from zero to one, this probability increases continuously and strictly from zero to one; hence the equations determine unique cutoffs. The two tail probabilities need not each equal when . Exact calibration holds for every common rate because the given null distribution of is independent of that rate. Boundary equalities have zero probability.
False. For the test associated with a p-value, reject at significance level when . Here , so do not reject at level 0.05. The p-value is neither the posterior probability of the null hypothesis nor the probability of a Type I error conditional on these observed data.
False. A test size constrains the probability of rejection conditional on the null hypothesis being true:for an exact size- test of a simple hypothesis. It does not assign a posterior probability to that statistical hypothesis after observing nonrejection. In the frequentist interpretation, the statistical parameter is fixed and the data are random. Nonrejection can occur even when the alternative hypothesis is true; for example, it is particularly likely for an alternative against which the test has low statistical power. A posterior probability would require a prior distribution and a Bayesian model.
Condition on the total of 400 complaints. Assume each complaint independently has the same probability of being received on Monday; in particular, repeated complaints from one incident must not create material dependence. The Monday count then has a binomial distribution with parameters . Test against , rejecting for large as suggested by the monotone likelihood ratio.
Under the null hypothesis, and . Both expected successes and expected failures are large, so the central limit theorem gives a suitable normal approximation:Using the paper's supplied rounded table, the upper-tail p-value is approximatelyA more accurate evaluation of the standard normal distribution cumulative distribution function gives about 0.0062. For example, choose significance level 0.05 before examining the data; the supplied upper 5% standard normal quantile is approximately 1.6, and . Reject at 5%, and also at 1%, using this approximation. The observed binomial proportion is , providing evidence that the Monday probability exceeds 0.2 under the sampling assumptions.
If applying a continuity correction, approximate by ; this gives the same 5% and 1% conclusions. The uncorrected value 0.005 is approximate, so a decision exactly at the 0.5% boundary is not warranted by the supplied rounded table.
Let , which has a binomial distribution with parameters . For , the alternative-to-null likelihood ratio of the independent Bernoulli trials isSince , this is strictly decreasing in . A threshold on large is therefore a lower-tail likelihood-ratio test, and a threshold between and gives the stated critical region . The Neyman-Pearson lemma also proves it is a most powerful test at its attained test size.
Using the binomial probability mass, its test size and statistical power are respectivelyThe associated power function is . These formulas hold for positive integer ; when the test always rejects and has size one. If the boundary value is admitted, all alternative probability is at ; the same test still has statistical power one and can be represented using a threshold with ties in the likelihood ratio.
The prior mean decreases as increases. More strongly, its cumulative distribution function and upper-tail probability areFor every fixed , that upper-tail probability decreases with . The statistician increasingly favors smaller values of ; as , the prior distribution concentrates near zero. For , its variance also decreases. This is concentration of a beta prior near zero.
With the data fixed, the derivatives areThus the prior weight increases and the posterior mean decreases. Their limits are and . Both the changing prior mean and the increasing weight contribute to the change in the posterior mean.
Put and . Under the null hypothesis, maximizing over the nuisance mean gives . The unrestricted normal mean and variance maximum-likelihood estimators are , . Thus, for ,The likelihood-ratio test statistic is consequentlyThe usual model assumes . The event has probability zero under a nondegenerate normal distribution; at that observation the unrestricted likelihood is unbounded as the variance tends to zero, and the ratio has limiting value zero. This is the likelihood-ratio test for a normal variance with unknown mean.
Use the corrected piecewise-deterministic Markov process from part (b). For a smooth test function , its time-dependent infinitesimal generator isIndeed, over an interval of length , deterministic motion contributes , while a jump has probability and changes the conditional mean of by . Terms involving both drift and a jump contribute only to the remainder. Thus .
The Dynkin formula, or this infinitesimal expansion integrated against the current probability distribution, gives the weak evolution identityTake , so integration by parts has no boundary contribution. Assuming the displayed jump integrals are finite, Fubini's theorem givesConsequently the forward equation of a piecewise-deterministic Markov process isHere is the formal adjoint operator acting on probability density functions. Its terms are transport, loss from , and incoming mass from every . In particular, the incoming rate is , evaluated at the departure state. The operator denoted in the source is generally time-dependent. Because , the gain and loss integrals cancel; with vanishing transport flux at infinity, .
The deterministic initial state in part (b) does not actually yield an everywhere smooth full density. For finite times the no-jump contribution is the positive measurewhere is the Dirac measure at . Smooth jump destination probability density functions cannot remove this positive atom. The density equation above is therefore conditional on the extra density hypothesis, for example with a suitable random initial probability density function. For the specified fixed initial state, write for the whole probability measure and use insteadThis weak measure evolution includes both the atom and any continuous component. It becomes the displayed partial differential equation whenever with the assumed regularity. It does not describe the literal hidden-reset construction without the correction in part (b).
For a partition , approximate the integral by , using left endpoints. The defining independent Brownian increment of Brownian motion make this a centered Gaussian variable with variance . As the mesh tends to zero, that variance tends to .
The stochastic integral is the mean-square convergence of these sums. mean-square convergence implies convergence in distribution, while the characteristic function converge to . HenceThe probability is exactly one half because this centered nondegenerate normal distribution is symmetric and has no atom at zero.
