For a normal sample of variance , define . The exact chi-squared distribution identity and the central limit theorem for independent squared standard normal random variables imply
The delta method for , with derivative , therefore gives the displayed limit for . Exact independence of the normal sample mean and sample variance also makes independent of . The resulting joint limit supports combining location and scale estimates when a model relates their parameters.
For independent with replicates per group and , , let and . The likelihood equations give , , and when . Boundary totals give infinite logits. With fixed and , the central limit theorem and delta method give
The other groups do not increase information about the baseline logit when they have free offsets. For two groups, the information matrix for is with , whose inverse has first diagonal entry .
For , use . Under regular regression assumptions, the delta method gives standard error , where and estimates the covariance of the regression estimate. Resample the observational units, refit, and compute both and . A percentile bootstrap confidence interval uses the .025 and .975 quantiles of . A bootstrap-t confidence interval uses quantiles of and reverses them when solving for . If both true coefficients vanish, the first derivative is zero and the standard first-order justification is unavailable; product-specific nonregular inference is then needed.
For independent Bernoulli random variables of fixed success probability , put and . The central limit theorem gives . Applying the delta method to the odds map , whose derivative is , gives
The ratio is undefined on the all-success event, whose probability is . Any finite extension there has the same limiting probability distribution, since that probability tends to zero. This is an asymptotic statement and does not assert an exact finite-sample variance of the unextended ratio. It is useful for uncertainty in estimated odds when the success probability stays away from one.
For an independent statistical sample from the beta distribution with parameters , , the probability density function is on . Its raw moments are for , by direct integration. Consequently the method of moments gives , whereas the maximum-likelihood estimator is .
The second formula follows by setting the score function to zero; its derivative is negative. Also has an exponential distribution of rate , since . The central limit theorem and delta method give
Thus the asymptotic relative efficiency of relative to is . The transformed sum has a gamma distribution of shape and rate , which also gives for and for .
Exponential-rate maximum-likelihood estimator Created 2026-10-03 Updated 2026-10-05
For independent observations from the exponential distribution with rate , the log-likelihood is , so
The central limit theorem and delta method give
Let independent exposure sums have mean ADU at each detector pixel, with pure Poisson distribution noise and fixed gain . The delta method gives , so and . For nonuniform detector pixel means , an unweighted spatial ratio variance is instead . This high-count approximation requires linear unsaturated data, bias subtraction and negligible read noise.
Greenwood formula 2026-10-14
For the Kaplan–Meier estimator, the estimated variance is
The formula follows by summing approximate variances of the logarithms of the conditional survival factors and applying the delta method to their product. Its square root is the estimated standard error. The same expression uses the actual delayed-entry risk sets for the Kaplan–Meier estimator with delayed entry. When and every contributing , an approximate log-scale confidence interval is , with the upper endpoint capped at one. This interval can be inaccurate with very small risk sets.
Log odds ratio Created 2026-10-05 Updated 2026-10-14
The log odds ratio is the natural logarithm of an odds ratio. For two independent binomial groups with positive event and non-event counts and , its estimate is , with first-order variance by the delta method. Zero cells need a method that handles boundary data; the displayed normal approximation is not valid there.
For two independent binomial distributions with event and nonevent counts and , the odds ratio is . The delta method applied to , whose derivative is , gives a group variance . Substitution of the fitted proportion gives in the first group and in the second. Their independence gives the displayed sum. A normal approximation then gives a confidence interval on the log odds ratio scale; exponentiation produces an odds-ratio interval. Zero cells require another approximation or model.
For independent observations with unknown mean and variance, the first natural parameter is . Its maximum-likelihood estimator is . The delta method and independent asymptotic mean/variance errors give limiting variance for . Knowing removes the second contribution and makes the estimator exactly normal with variance .
For a homogeneous continuous-time Markov chain, the holding time in a living state before the next transition has survival probability , where . Indeed, conditional on still occupying that state, the probability of leaving in the next is , so its survival function satisfies and . Integrating gives the mean holding time from a transition intensity matrix:
This is the mean time until any allowed exit from that state, not necessarily the patient's remaining lifetime.
For confidence limits, use the supplied standard error of the corresponding diagonal generator estimate. Changing its sign does not change its standard error, so it is also the standard error of . The delta method, with derivative , gives
The resulting approximate 95% Wald confidence intervals are
The diagonal standard errors already incorporate the covariance among outgoing rates. They should not be replaced by the square root of a sum of squared off-diagonal standard errors, which would silently assume those rate estimates independent.
Alternatively construct a positive rate confidence interval and apply the confidence interval for an inverse rate transformation. Here every normal rate interval has a positive lower endpoint, giving
These approximate intervals are, respectively, , , and years. They are asymmetric because inversion is nonlinear; positive log-rate or likelihood-based intervals could also be inverted. The symmetric delta intervals and the inverted-rate intervals are two legitimate first-order approaches and need not have numerically identical endpoints.
The death state has zero exit rate, so its holding time is infinite. There is no finite mean-sojourn estimate or ordinary finite confidence interval for this structurally absorbing state. All intervals above concern the mean parameter, not a prediction interval for one patient's realized holding time.
The response errors have standard deviations proportional to . Thus, when fitted means approximate the true means, increasing absolute fitted values tends to accompany increasing residual spread. A residual-versus-fitted plot shows a fan for positive means, or spread increasing away from zero for means of either sign. Standardization by one common residual standard deviation, even with the usual regression leverage correction, does not remove this systematic heteroscedasticity.
Under independent errors the exact covariance matrix after fitting is
where is the common proportionality constant. Hence the simple fan description is a diagnostic tendency, not an assertion that each fitted residual has exactly variance .
For positive responses, the intended variance-stabilizing transformation is the natural logarithm. The delta method gives
Use for positive data with modest relative error, then refit and check the transformed mean and residual structure. In particular, if the original mean was , the transformed mean is approximately , not automatically a linear function of the original covariates.
There is a domain qualification in the literal printed model: a nondegenerate normal distribution has negative support. For positive , the probability of is , so a real is not defined throughout the stated sampling model. When is small this is a negligible-tail approximation, not an exact transformation to normal errors. If signed values must be retained and all , write with standard normal . Then
The second term has a common distribution with finite variance, so log absolute value stabilization of a normal scale family is exact, but loses the sign of the mean and does not produce normal errors. Zeros and a zero mean are excluded from this transform. Alternatively retain the response scale and fit the stated variance model with weighted least squares weights proportional to where the means stay away from zero. No arbitrary addition of a constant before taking logarithms exactly solves the given variance relation.
read.table(...,header=T) reads four grouped rows with column names. The displayed outcome counts give the observed risks in the indicated factor order. rbind in the first test pools over predisposition: the two rows represent no cannabis use and some use, with event/non-event counts and . Thus the pooled risks are and . This test concerns the marginal statistical association between use and outcome, not an association adjusted for predisposition.
Under independence, expected counts in the two-by-two contingency table are . The ordinary Pearson chi-squared statistic is . The printed is reproduced by the default two-by-two Yates continuity correction:
All absolute differences here exceed one half. Comparison with a chi-squared distribution on one statistical degree of freedom gives . There is strong evidence of marginal association. The simplified output omits the usual continuity-correction wording, but its numerical value shows which statistic was used.
attach makes the data columns available by name, and tot=with+without obtains group sizes . The grouped binomial regression fits , with response and prior weights . These weights tell R the binomial denominator; treating the four proportions as four equally precise individual observations would be wrong. The default logit link is
Let indicate some use and indicate predisposition. The additive logistic regression specifies . Its log-likelihood, including the binomial constants, is
Differentiation gives score equations and Fisher information matrix , where . Fisher scoring solves these equations, and the inverse fitted Fisher information matrix gives the reported approximate coefficient variances. The number of scoring iterations records numerical convergence, not degrees of freedom or statistical evidence.
The intercept corresponds to no use and no predisposition and gives baseline fitted risk . The additive coefficients imply common adjusted odds ratios:
They multiply the odds, not the risks. The Wald tests divide the estimates by their standard errors and use a standard normal distribution; both predictors have small two-sided p-values. Approximate confidence intervals for these odds ratios are and , obtained by exponentiating the log-scale intervals. The intercept test against zero asks whether the reference risk equals one half, and is not a test of either exposure association. The binomial dispersion is assumed to be one because ; the output does not demonstrate independence or rule out extra-binomial variation.
There are four grouped probabilities and three fitted coefficients, leaving one residual degree of freedom. The fitted risks are approximately . The binomial deviance compares this fit with the four unrestricted observed proportions:
The deviance goodness-of-fit test against has p-value . The common-odds-ratio fit is not rejected at , although the doubly exposed group's observed risk exceeds its fitted risk appreciably and suggests possible interaction.
The second formula adds . Its four coefficients fit all four probabilities, making a saturated statistical model with zero grouped residual degrees of freedom. The near-zero deviance is roundoff from exact interpolation; it supplies no remaining grouped lack-of-fit test. Unlike Q1's unreplicated Gaussian fit, however, these grouped responses represent many independent Bernoulli trials, and their binomial variances are specified by their sizes and probabilities. Coefficient standard errors remain available from binomial information without estimating dispersion from the zero residual degrees of freedom.
Indeed, let be the fitted cell logit link value. The saturated coefficients are
These calculations yield the printed estimates. The delta method gives , and independent groups make the variance of the sum of all eight reciprocal counts. Its square root is , reproducing the printed standard error.
The saturated logistic regression describes the conditional odds ratios as follows:
Thus the main coefficients now concern effects at the other factor's reference level. Logistic interaction as a ratio of odds ratios gives , with approximate confidence interval . The interaction Wald test has , while the nested likelihood-ratio test uses deviance difference on one statistical degree of freedom and has . The data suggest a larger odds association in predisposed subjects, but do not establish this interaction at the conventional level. This conclusion is specific to the odds scale; absolute-risk differences can vary even with no logit-scale interaction.
The Akaike information criterion is . The additive fit has and AIC ; the interaction fit has and AIC . The extra coefficient improves twice the log-likelihood by but incurs penalty , so AIC falls by only . It weakly favors the larger fit rather than decisively establishing an interaction, and AIC is not a p-value.
The marginal odds ratio and the fitted conditional odds ratios are different quantities. Predisposition is associated with both use frequency and outcome, so confounding is a substantive possibility; noncollapsibility of the odds ratio also means marginal and conditional odds ratios need not agree. This is an observational association analysis with only one adjustment factor. It does not by itself establish a causal effect, exclude other confounding, or validate the assumed independent binomial sampling.
Assume the two trial arms are independent samples, their cost and survival means have a valid joint normal approximation, and the supplied standard errors and correlation coefficient estimate the joint uncertainty in their mean differences. This could follow from a central limit theorem for patient-level cost/survival pairs, with finite second moments and suitably handled survival follow-up. The supplied covariance matrix for is
The off-diagonal entry has units pounds times days, and must not be discarded. Independence of trial arms does not mean cost and survival increments are independent: patient-level cost and survival are paired within each arm.
For a proposed ratio , the null assertion is . Its estimated variance is . Fieller's theorem inverts the associated two-sided normal tests. With , retain when
Expanding gives
The leading coefficient is positive, since ; the effect increment is separated from zero at this level. With , the polynomial is approximately
It is nonpositive between its two real roots. The resulting approximate Fieller confidence set is therefore a bounded confidence interval:
On the -day life-year scale the endpoints are approximately £9,133 and £36,376. Exact coverage would need an exact pivot with its corresponding critical value; using estimated covariance and a central limit theorem makes this an asymptotic interval. In other data, a poorly determined denominator can give unbounded or disconnected Fieller confidence sets, which should not be replaced by an artificially bounded interval.
An alternative is a paired bootstrap: independently resample patients within each randomized arm, keeping each patient's cost and survival together; recompute both mean differences and their ratio in each replicate. The and empirical ratio quantiles give a percentile bootstrap confidence interval. The raw paired data are needed to calculate it, so the numerical endpoints cannot be obtained from this summary table alone. Near-zero bootstrap effect increments or sign changes warn that ordinary ratio-percentile intervals may be unreliable; one should retain the joint cost/effect uncertainty or invert a suitable bootstrap test instead.
A simpler first-order alternative is the delta method. For , the gradient is , giving
The resulting approximate Wald confidence interval is pounds per day. Its symmetric first-order form misses the denominator's nonlinear effect, explaining its marked difference from the Fieller confidence set; it is not the preferred ratio interval here.
The plug-in estimate is
For a concrete bootstrap construction, suppose the rows are independent and identically distributed, , the design moment matrix is nonsingular, and the required moments exist. Use a paired bootstrap: sample rows with replacement, form , refit by ordinary least squares, and compute . Repeat many times. Singular resampled designs require a suitable rank-preserving implementation or replacement replicate; with a regular continuous design their frequency vanishes asymptotically.
The bootstrap-t confidence interval method also needs a standard error in the original sample and every replicate. One asymptotically valid heteroscedasticity-robust covariance estimate is
The delta method for the coefficient product gives
Recompute in each paired replicate. This is bootstrap inference for a product of regression coefficients.
With fixed rather than random design, resample centered residuals if errors are identically distributed with homoskedasticity, or use a properly specified wild bootstrap for heteroscedastic errors, keeping fixed and refitting after generating . The printed assumption alone does not establish independent observations or validity of a bootstrap confidence interval. The formulas below give asymptotic 95% coverage under the stated regularity conditions, not an exact finite-sample guarantee. In particular the ordinary first-order studentization needs and a nonzero asymptotic variance; when both coefficients vanish the product has nonstandard behavior.
The logit link makes the probability constant within each group: write , with . Let and . Independence gives . Up to terms independent of the parameters, the log likelihood is
The likelihood equations are
Together they also imply . Thus, when all totals satisfy ,
The group logits are unconstrained apart from their parametrization, and each binomial log likelihood is strictly concave in its logit, so these equations give the unique finite maximum. A total of or instead gives a boundary probability and an infinite logit; a finite MLE need not exist in that case.
For , keep fixed and let . Since , the central limit theorem gives . The derivative of the logit is , so the delta method gives the baseline logit estimator in a group-factor binomial model law
The second group does not improve the baseline estimate because it has its own free offset. Equivalently, the Fisher information matrix for is
Its first diagonal entry confirms the same asymptotic variance.
Let be attendance totals and the observed person-time at risk. Under independent Poisson distributions for the totals, the estimated incidence rate ratio is . Treating the exposures as known, the supplied large-count approximation, or the delta method, gives
Independence adds the log-count variances, while fixed exposure terms add no variance. Form the normal confidence interval on the log scale and exponentiate:
This specifies the calculation without evaluating it. Individual randomization makes a child the assignment unit, but an independent Poisson count model remains an additional assumption about outcomes, not a consequence of randomization alone.
An exponential family has density on a parameter-independent support. For an independent and identically distributed sample, its likelihood factorizes through , so the Fisher-Neyman factorization theorem gives a sufficient statistic whose dimension is the fixed dimension of , independent of sample size.
Expanding the normal log-density gives , , and
The mean-value parameter is , hence
For and positive sample variance, and , so . For this normal natural-mean parameter ratio estimator, the central limit theorem gives asymptotic independent errors for and , with variances and . Applying the delta method to yields
If is known, is fixed and has exact distribution . The variance-estimation contribution disappears.
Work at a regular admissible parameter value with , so the score identities in the question apply. For one observation from the exponential dispersion family, the score function and second derivative are
The zero expected score immediately gives . The equality between expected negative curvature and score variance then gives
Thus
The admissible density parameters necessarily make this variance nonnegative; the algebra does not require an unstated sign assumption beyond the regular family and .
With independent observations and canonical parameters , the chain rule gives the vector score function
A finite interior maximum-likelihood estimator satisfies its score equation, proving
Differentiating again, using , gives
This Hessian is independent of the observations, so taking expectation gives exactly the requested Fisher information matrix. In particular, is not the inverse observation-variance matrix: the linear predictor here is the canonical parameter, not the mean.
For the two-group Poisson regression, , , and . Put , , using here for the second group's mean. There are observations, and
Hence the total Fisher information matrix and its inverse are
The theorem on asymptotic normality of a maximum likelihood estimator says that in a regular identifiable model with nonsingular information the estimator is approximately multivariate normal, centred at the true parameter and with covariance equal to the inverse total information. Here one can regard one observation from each group as an independent pair and apply its usual iid version to such pairs. Therefore
For a direct check, the second score equation gives the fitted second-group mean , and the first then gives the fitted first-group mean . Thus the Poisson log-rate ratio estimate is . The delta method, using independent sample-mean variances and , gives the same variance . If a group total is zero, its finite log-mean estimator fails to exist; with fixed positive true means this event has probability tending to zero exponentially as grows.