The derivative of the log ratio is , so increases from zero to one on and decreases to zero on . Rejecting for a sufficiently small ratio therefore gives two tails with .
Under , Cochran's theorem gives the exact sampling distribution , independently of the unknown mean. Writing for its cumulative distribution function, the two cutoffs are determined by
The first equation calibrates the exact size of a statistical test. The second is , so both tails belong to one likelihood ratio cutoff. Hence the exact critical region is . Its two tail probabilities are not generally equal: equal-tailed chi-squared cutoffs give a different test.
The full parameter space has dimension two and the null space dimension one. The regular Wilks theorem therefore gives under as . If denotes the cumulative distribution function of the chi-squared distribution with one degree of freedom, the approximate size- rejection region is
The corresponding approximate p-value is
The one degree of freedom here describes the large-sample likelihood-ratio test statistic; it is different from the exact residual degrees of freedom in the next part.
Put and . Under the null hypothesis, maximizing over the nuisance mean gives . The unrestricted normal mean and variance maximum-likelihood estimators are , . Thus, for ,
The likelihood-ratio test statistic is consequently
The usual model assumes . The event has probability zero under a nondegenerate normal distribution; at that observation the unrestricted likelihood is unbounded as the variance tends to zero, and the ratio has limiting value zero. This is the likelihood-ratio test for a normal variance with unknown mean.
The estimated standard error is . Using the central 95% standard normal quantiles , a Wald confidence interval is
Consistency of and Slutsky's theorem justify replacing the unknown scale by its estimate. The coverage probability is asymptotic, not exact at finite . Intersecting with the positive parameter space removes impossible values without changing whether the true positive parameter is covered.
Expanding the exponent, the log-likelihood function is
where is independent of . Its score function and second derivative are
The first is positive below and negative above it, so the unique maximum-likelihood estimator is
Using , the one-observation Fisher information is . The support does not depend on the interior parameter , and the regular asymptotic normality of a maximum likelihood estimator gives
This is Inverse Gaussian mean estimation with known shape one. Equivalently, the Inverse Gaussian distribution has variance , so the same result follows directly from the central limit theorem applied to its sample mean.
Put . As a linear combination of independent normal random variables under the posterior distribution,
The shortest 95% credible interval is
Here is the standard normal distribution cumulative distribution function. To justify shortest length, consider all intervals of a fixed length . If is this normal distribution posterior density, the interval probability has derivative with respect to . The normal distribution is symmetric and its density strictly decreases with distance from its mean, so this probability is uniquely maximized when the midpoint is . The centered interval can therefore attain 95% posterior probability with the least length. It is both an equal-tailed credible interval and a highest posterior density interval.
The target is the experiment's mean at . A posterior predictive distribution for a new noisy observation would instead have variance ; that extra observation variance does not belong in the requested interval.
Let , , and . The independent observations in the normal linear model give
The centered design condition removes the term:
The stated prior density factors into independent normal distributions for the regression intercept and regression coefficient . Multiplication by the likelihood function therefore leaves separate quadratic expressions in the two coefficients. Define the positive posterior variances
and the posterior means
By completing the square, the joint posterior density is
Equivalently,
This is Gaussian conjugacy for a normal linear model. Each posterior precision parameter is the sum of its data and prior precision parameters. The formulas remain valid when : all are then zero, so the posterior distribution of equals its prior distribution.
The prior mean decreases as increases. More strongly, its cumulative distribution function and upper-tail probability are
For every fixed , that upper-tail probability decreases with . The statistician increasingly favors smaller values of ; as , the prior distribution concentrates near zero. For , its variance also decreases. This is concentration of a beta prior near zero.
With the data fixed, the derivatives are
Thus the prior weight increases and the posterior mean decreases. Their limits are and . Both the changing prior mean and the increasing weight contribute to the change in the posterior mean.
The prior mean, posterior mean, and maximum-likelihood estimate are
For , the last follows by maximizing . At or , use the usual binomial likelihood convention that admits the endpoints and as maximum-likelihood estimates; if the parameter domain is strictly , these are boundary suprema rather than attained maxima. The posterior mean remains interior in all cases.
Taking
gives
Since and , . Thus the posterior mean is a convex combination of the prior mean and observed binomial proportion, with larger prior weight when is large relative to .
Set and . Conditional independence of the binomial distribution observations gives the likelihood function
The prior distribution is the beta distribution with parameters . By Bayes' theorem, multiplying the prior density by the likelihood function gives a posterior density proportional to
Recognizing and normalizing this beta distribution gives
for . This is Beta-binomial conjugacy; the original binomial coefficients cancel in the normalization because they are independent of .
Condition on the total of 400 complaints. Assume each complaint independently has the same probability of being received on Monday; in particular, repeated complaints from one incident must not create material dependence. The Monday count then has a binomial distribution with parameters . Test against , rejecting for large as suggested by the monotone likelihood ratio.
Under the null hypothesis, and . Both expected successes and expected failures are large, so the central limit theorem gives a suitable normal approximation:
Using the paper's supplied rounded table, the upper-tail p-value is approximately
A more accurate evaluation of the standard normal distribution cumulative distribution function gives about 0.0062. For example, choose significance level 0.05 before examining the data; the supplied upper 5% standard normal quantile is approximately 1.6, and . Reject at 5%, and also at 1%, using this approximation. The observed binomial proportion is , providing evidence that the Monday probability exceeds 0.2 under the sampling assumptions.
If applying a continuity correction, approximate by ; this gives the same 5% and 1% conclusions. The uncorrected value 0.005 is approximate, so a decision exactly at the 0.5% boundary is not warranted by the supplied rounded table.
For any fixed , the alternative-to-null likelihood ratio is
which is strictly increasing in for . Consequently the Neyman-Pearson lemma selects the same upper-tail ordering for every such alternative hypothesis. At the null hypothesis value,
Therefore
is a uniformly most powerful test of the required exact test size. Its power function is . At its statistical power is one, so including that boundary alternative preserves the conclusion.
Let , which has a binomial distribution with parameters . For , the alternative-to-null likelihood ratio of the independent Bernoulli trials is
Since , this is strictly decreasing in . A threshold on large is therefore a lower-tail likelihood-ratio test, and a threshold between and gives the stated critical region . The Neyman-Pearson lemma also proves it is a most powerful test at its attained test size.
Using the binomial probability mass, its test size and statistical power are respectively
The associated power function is . These formulas hold for positive integer ; when the test always rejects and has size one. If the boundary value is admitted, all alternative probability is at ; the same test still has statistical power one and can be represented using a threshold with ties in the likelihood ratio.
False. For the test associated with a p-value, reject at significance level when . Here , so do not reject at level 0.05. The p-value is neither the posterior probability of the null hypothesis nor the probability of a Type I error conditional on these observed data.
True, with the test's rejection rule fixed. If its rejection region in the space of the test statistic is , its statistical power against the specified simple hypothesis is
Thus the probability distribution of under the alternative hypothesis determines the statistical power of this test. The null distribution is used to choose a rule with the desired test size, but statistical power is evaluated under the alternative hypothesis. Different rejection rules can have different statistical power even for the same probability distribution of .
False. A test size constrains the probability of rejection conditional on the null hypothesis being true:
for an exact size- test of a simple hypothesis. It does not assign a posterior probability to that statistical hypothesis after observing nonrejection. In the frequentist interpretation, the statistical parameter is fixed and the data are random. Nonrejection can occur even when the alternative hypothesis is true; for example, it is particularly likely for an alternative against which the test has low statistical power. A posterior probability would require a prior distribution and a Bayesian model.
A likelihood-ratio test rejects for small . The derivative of the natural logarithm of its variable factor is
Thus increases up to and decreases thereafter, tending to zero at both endpoints. Every nontrivial lower level set of therefore consists of two tails. For a prescribed test size , the exact critical region is
Writing for the cumulative distribution function of the beta distribution with parameters , the required two equations are
The first makes both cutoffs have the same likelihood ratio; the second calibrates the null hypothesis rejection probability. Equivalently, the second left-hand side is
As the common likelihood ratio threshold increases from zero to one, this probability increases continuously and strictly from zero to one; hence the equations determine unique cutoffs. The two tail probabilities need not each equal when . Exact calibration holds for every common rate because the given null distribution of is independent of that rate. Boundary equalities have zero probability.
Put , , and . The two independent statistical samples give the joint likelihood function
The unrestricted maximum-likelihood estimators are and . Under the null hypothesis, the common statistical parameter has log-likelihood function , maximized at . With the likelihood ratio defined as the null maximum divided by the unrestricted maximum,
The statistic in the paper is , since both original sums of natural logarithms are negative. Hence
It has maximum one at , corresponding to equal fitted rates. This is the likelihood-ratio test for equality of beta shape parameters.
The standard error suggested by part (iii) is . Substituting the consistent estimator gives ; Slutsky's theorem gives
Using the central standard normal quantiles , an approximate 95% Wald confidence interval is
Its coverage probability approaches 0.95 for each fixed as . The intersection enforces positivity and does not change whether the true positive statistical parameter is covered. The value 1.64 would give the wrong central two-sided coverage probability.
The specified asymptotic relative efficiency is
For every fixed this lies strictly between zero and one. Prefer on grounds of asymptotic precision: it has the smaller leading asymptotic variance and attains the inverse Fisher information. Both are consistent estimators, by the law of large numbers and the continuous mapping theorem applied respectively to and . The efficiency approaches zero as and one as .
This preference is an asymptotic comparison. In particular, it does not assert that is an unbiased estimator: since has a gamma distribution of shape and rate , for .

Pinned article: Introduction to the OurBigBook Project

Welcome to the OurBigBook Project! Our goal is to create the perfect publishing platform for STEM subjects, and get university-level students to write the best free STEM tutorials ever.
Everyone is welcome to create an account and play with the site: ourbigbook.com/go/register. We belive that students themselves can write amazing tutorials, but teachers are welcome too. You can write about anything you want, it doesn't have to be STEM or even educational. Silly test content is very welcome and you won't be penalized in any way. Just keep it legal!
We have two killer features:
  1. topics: topics group articles by different users with the same title, e.g. here is the topic for the "Fundamental Theorem of Calculus" ourbigbook.com/go/topic/fundamental-theorem-of-calculus
    Articles of different users are sorted by upvote within each article page. This feature is a bit like:
    • a Wikipedia where each user can have their own version of each article
    • a Q&A website like Stack Overflow, where multiple people can give their views on a given topic, and the best ones are sorted by upvote. Except you don't need to wait for someone to ask first, and any topic goes, no matter how narrow or broad
    This feature makes it possible for readers to find better explanations of any topic created by other writers. And it allows writers to create an explanation in a place that readers might actually find it.
    Figure 1.
    Screenshot of the "Derivative" topic page
    . View it live at: ourbigbook.com/go/topic/derivative
  2. local editing: you can store all your personal knowledge base content locally in a plaintext markup format that can be edited locally and published either:
    This way you can be sure that even if OurBigBook.com were to go down one day (which we have no plans to do as it is quite cheap to host!), your content will still be perfectly readable as a static site.
    Figure 5. . You can also edit articles on the Web editor without installing anything locally.
    Video 3.
    Edit locally and publish demo
    . Source. This shows editing OurBigBook Markup and publishing it using the Visual Studio Code extension.
  3. https://raw.githubusercontent.com/ourbigbook/ourbigbook-media/master/feature/x/hilbert-space-arrow.png
  4. Infinitely deep tables of contents:
    Figure 6.
    Dynamic article tree with infinitely deep table of contents
    .
    Descendant pages can also show up as toplevel e.g.: ourbigbook.com/cirosantilli/chordate-subclade
All our software is open source and hosted at: github.com/ourbigbook/ourbigbook
Further documentation can be found at: docs.ourbigbook.com
Feel free to reach our to us for any help or suggestions: docs.ourbigbook.com/#contact