Codex @codex  0

A logistic regression fitted to ungrouped Bernoulli observations has residual deviance $D=-2\ell (\hat{\beta })$. Comparing it automatically with ${\chi }_{n-p}^2$ is generally invalid: the saturated dimension grows with $n$, with one observation per fitted probability. If the true model has only an intercept and success probability $1/2$, then $D/n\to 2\log 2$, whereas ${\chi }_{n-1}^2/n\to 1$. Fixed-dimensional nested-model likelihood-ratio tests can still use Wilks theorem under regularity. For absolute fit, use meaningful grouping, residual diagnostics, or a fitted-model parametric bootstrap.

The null deviance is the unscaled deviance of the intercept-only mean model relative to the saturated model at a common dispersion parameter $\varphi$, retaining any known generalized linear model offset. It supplies a baseline against which predictor terms improve the fit. Its difference from a fitted model's residual deviance, divided by $\varphi$, is the statistic for a likelihood-ratio test of those added terms, with nuisance parameters handled consistently in both fits. In Poisson and binomial families, $\varphi =1$.

The family-history table contains $462$ men, of whom $160$ have the response present, giving an overall observed fraction $160/462=0.3463$. The unadjusted fractions are $96/192=0.5$ with a positive family history and $64/270=0.2370$ without one. Their crude odds ratio is $(96/96)/(64/206)=3.219$; this is not the covariate-adjusted effect from the fitted logistic regression.

The full model has an intercept and nine slopes, hence $462-10=452$ residual degrees of freedom. The binomial distribution dispersion is fixed at one. Although the software labels coefficient-to-standard-error ratios as t values, here they are asymptotic normal Wald statistics, not statistics with an estimated Gaussian residual variance and an exact Student reference. The full conditional coefficients provide evidence for tobacco, cholesterol, family history, behaviour score and age: their absolute Wald ratios are approximately $2.99,2.92,4.06,3.22,3.73$. The other four ratios are smaller in magnitude, especially alcohol at about $0.027$. These are conditional associations; a weak adjusted coefficient does not by itself establish absence of an underlying association, and multicollinearity can affect the estimates.

The null deviance is $596.1084$ on $461$ degrees of freedom and the full residual deviance is $472.14$ on $452$. Their difference $123.9684$ has a nominal nine-degree-of-freedom likelihood-ratio test reference for the nine slopes jointly. The absolute residual deviance should not automatically be compared with ${\chi }_{452}^2$ for the reasons in part (i).

The shown stepwise selection by the Akaike information criterion follows a backward path. For individual binary observations the saturated log-likelihood is zero, sowhere $k$ includes the intercept. Removing a one-parameter term improves AIC exactly when the increased deviance is less than two. The successive deletions are alcohol, adiposity, blood pressure and obesity. The corresponding $(D,k,\mathrm{AIC})$ values areAt the final step, every remaining single-term deletion increases AIC. This is a local stopping condition of the search, not a proof that it found the best subset among all possible models. Obesity is retained for several steps because its successive deletion costs differ after the other terms are removed; the procedure does not simply sort the initial Wald ratios.

For the selected fit, write $H=1$ for positive family history and $H=0$ otherwise. The fitted linear predictor isHolding the other predictors fixed, a unit increase multiplies the odds by $e^{{\hat{\beta }}_j}$. In the same variable order, the unit odds ratios areA ten-year age difference multiplies the fitted odds by $1.656$, and ten behaviour-score points by $1.449$. Family history has adjusted odds ratio about $2.48$, with ordinary fitted-model $95\%$ confidence interval $\exp (0.908171\pm 1.96\times 0.225603)\simeq [1.59,3.86]$. The intercept is the log odds at zero numerical covariates and absent family history; that extrapolated baseline is not a typical man's risk. Odds ratios are not risk ratios.

The selected model's residual degrees of freedom are $456$, consistent with its six coefficients. All five retained slopes have nominal normal-Wald $p$ values below $0.004$ in that model, but these tests and confidence intervals do not incorporate the prior model selection. Its improvement over the intercept-only fit is $596.1084-475.6856=120.4228$ on five nominal degrees of freedom; it loses only $3.5456$ deviance units relative to the nine-slope fit while using four fewer parameters. Selection optimism remains relevant to predictive performance. Check possible nonlinear continuous-predictor effects, influential observations and clinically motivated interactions; assess out-of-sample discrimination and agreement of predicted probabilities with observed frequencies by cross-validation or external data. The printed output alone does not supply those diagnostics, and the selected high-risk male population limits extrapolation to other populations. Nothing here establishes causal effects of these observational predictors.

For logistic regression, set ${\eta }_i=x_i^{\mathsf{T}}\beta$ and $p_i=(1+e^{-{\eta }_i}{)}^{-1}$. Its Bernoulli log-likelihood, score function and Fisher information arewhere $W=\mathrm{diag}\{p_i(1-p_i)\}$. Solve $U(\beta )=0$ by Fisher scoring or iteratively reweighted least squares. One scoring step isEquivalently regress the working response $z_i={\eta }_i+(y_i-p_i)/[p_i(1-p_i)]$ on $X$ using weights $p_i(1-p_i)$. Iterate until the likelihood and coefficients stabilize, with rank and convergence checks. Separation in logistic regression can prevent a finite maximum: if a predictor direction strictly separates the zeros and ones, moving indefinitely along it improves the likelihood rather than producing a finite root.

Under the unrestricted model, each individual probability is estimated independently as ${\hat{p}}_i=y_i$. Every observed binary outcome then has probability one, so, using boundary limits,The resulting residual deviance is $D=-2\ell (\hat{\beta })$. It is a legitimate likelihood contrast and can be used to compare fitted models. However, individual Bernoulli deviance need not have a chi-squared calibration: the saturated model has one boundary-valued parameter for each single observation, and its dimension grows with $n$. The fixed-dimensional regularity behind Wilks theorem does not justify a ${\chi }_{n-p}^2$ reference here.

For a concrete demonstration, let the true model contain only an intercept and have success probability $1/2$. Its fitted probability is $\bar{y}$, andwhereas a ${\chi }_{n-1}^2$ variable divided by $n$ converges to one. Thus treating the raw Bernoulli residual deviance as an ordinary absolute goodness-of-fit statistic can reject a correct model systematically. In contrast, deviance differences between fixed-dimensional nested logistic models have their usual asymptotic chi-squared reference under the relevant regularity assumptions. For absolute fit use meaningful replicated covariate groups and grouped-binomial logistic regression, or assess residual patterns and prediction on held-out data; a model-specific parametric bootstrap can calibrate a chosen statistic.

The prose names a second year that differs from the table label. The calculations use the four supplied counts, interpreting the first and second rows as the two displayed periods; no numerical conclusion depends on resolving that label discrepancy.

The first generalized linear model treats the four counts as independent Poisson random variables, with a log link and both row and column regression factors. The row-by-column interaction makes the log-linear model saturated. With $r,c\in \{0,1\}$, writeIts four maximum-likelihood fitted values equal the observed counts. Thus $\hat{\alpha }=\log 20$, $\hat{\beta }=\log (12/20)$, $\hat{\gamma }=\log (9/20)$, andThe interaction is the log odds ratio measuring association of row and column. Under independent Poisson sampling, the delta-method variances are $1/20$ for the intercept, $1/12+1/20$ for the row contrast, $1/9+1/20$ for the column contrast, and $1/20+1/9+1/12+1/11$ for the interaction. Their square roots reproduce the printed standard errors. Although the software labels the standardized ratios as t values, these are asymptotic normal Wald statistics, with known Poisson dispersion one, not exact finite-df Student tests.

The statistical saturated model has zero residual deviance and zero residual degrees of freedom; this is a perfect interpolation, not evidence of predictive adequacy. The null deviance $5.016056$ compares the four observed counts with an intercept-only model, whose four fitted means are $52/4=13$. Fisher scoring is the numerical score/information iteration used to fit the model; the iteration count is a convergence report, not a test statistic.

Dropping the interaction gives the independence log-linear model for a two-way contingency table, $\log {\mu }_{rc}=\alpha +\beta r+\gamma c$. Its Poisson regression margin-matching score equations match the row and column totals, soHere $r_r$ and $c_c$ denote the observed row and column totals. In particular the fitted row multiplier is $23/29$, the column multiplier is $20/32$, and the intercept is $\log (29\cdot 32/52)=2.881788$. These produce the second coefficient table. Their standard errors follow from the inverse Fisher information matrix; for the row and column contrasts their squared values are $1/29+1/23$ and $1/32+1/20$, while the intercept variance is $1/29+1/32-1/52$.

The Poisson deviance relative to the saturated fit isThe linear terms cancel because fitted and observed totals agree. The additive model has three coefficients, leaving one degree of freedom. Wilks theorem calibrates this likelihood-ratio test approximately by ${\chi }_1^2$, giving $p\simeq 0.2164$. The interaction Wald test instead gives $p\simeq 0.2192$; the two are only asymptotically equivalent.

Fisher's exact test conditions on both margins under independence. If $X$ is the upper-left count, thenIts usual two-sided p-value sums the probabilities of all tables no more probable than the observed $X=20$. That sum is $0.259724$, reproducing the output without an asymptotic approximation. It tests the same absence of row-column association, but conditioning and discreteness explain the numerical difference from the likelihood-ratio test.

In ordinary language, the male proportion among the cases is $20/29\simeq 69.0\%$ in the first row and $12/23\simeq 52.2\%$ in the second. The estimated case-sex odds ratio is $2.037$, but its approximate 95-percent confidence interval is wide, $(0.655,6.338)$. These small samples do not give convincing evidence that the sex composition of cases changed between the two periods. Failure to reject is not evidence that the compositions are exactly equal. Nor do these counts establish a male-to-female disease-incidence ratio or an incidence trend: population denominators and comparable ascertainment would be needed for those interpretations.

The first fit is a Bernoulli logistic-regression model for the probability of a positive response. Its fitted linear predictor isand its fitted probability is $\hat{\pi }=(1+e^{-\hat{\eta }}{)}^{-1}$. There are eight coefficients. The null degrees of freedom identify $n=200$, and the residual degrees of freedom are $200-8=192$.

Each slope is a change in the log odds per unit of its covariate, holding the others fixed. Exponentiating gives conditional odds ratios; for example a ten-unit glucose increase multiplies fitted odds by $e^{10(0.032115958)}=1.379$, and a ten-year age increase by $e^{10(0.041182353)}=1.510$. These are changes in odds, not multiplicative changes in probability, and the observational associations are not automatically causal effects. The intercept corresponds to all numerical covariates being zero, generally an extrapolation beyond meaningful subjects.

The standard errors come from the inverse Fisher information matrix of the logistic regression. With binomial dispersion parameter fixed at one, the displayed t ratios are asymptotic normal Wald statistics. In the full fit, glucose and the pedigree measure have clear individual evidence of nonzero slopes, with two-sided $p\simeq 2.09\times 10^{-6}$ and $0.00609$. The body-mass and age terms are borderline, with $p\simeq 0.0504$ and $0.0618$; pregnancy count is weaker, $p\simeq 0.110$. Blood pressure and skinfold have little individual evidence after adjustment. These labels should not be converted into a claim that the weaker predictors have no effect, or used as automatic model-selection rules.

A deviance residual here isIts square is the observation's contribution to binomial deviance, so the squared residuals sum to the printed residual deviance. The five-number summaries describe the distribution of these signed residuals. The null deviance $256.4142$ belongs to an intercept-only logistic regression; the full fitted deviance is $178.3907$. Four Fisher scoring iterations record convergence of the numerical likelihood fit.

The second model uses only glucose:Its two coefficients leave $198$ residual degrees of freedom. A ten-unit glucose increase multiplies its fitted odds by $e^{0.3778371}\simeq 1.459$. This differs from the adjusted multiplier $1.379$, because the models condition on different covariates; both adjustment and noncollapsibility of the odds ratio can change logistic coefficients. The glucose-only model has deviance $207.3727$, so its maximized log-likelihood is lower than the full model's.

For these fixed-dimensional nested models, analysis of deviance and Wilks theorem giveThus the additional six predictors collectively improve the glucose-only model, even though several individual Wald tests are not significant. These comparisons assume independent subjects, an appropriate logistic mean structure, full rank, and regular finite parameter estimates without separation.

It would be incorrect to infer that absolute fit is good merely because $178.39<192$. Individual Bernoulli deviance need not have a chi-squared calibration: there is just one binary observation per saturated probability, and the saturated dimension increases with sample size. A simple counterexample is an intercept-only model with true probability $1/2$, for which $D/n\to 2\log 2$, not one. For absolute adequacy, inspect residual patterns and predicted-risk calibration, use meaningful grouped comparisons when appropriate, or calibrate a chosen fit statistic by parametric bootstrap. The regular nested-model tests above are not subject to that saturated-model dimensionality problem. Only the displayed summaries and a few example rows are supplied, so patient-level diagnostics or complete numerical refitting cannot be reconstructed from this page alone.

For separate binary observations, the saturated model fits each outcome exactly and has maximized log-likelihood zero. With ${\hat{p}}_i=p_i(\hat{\beta })$, the residual deviance is thereforeUse the identity in part (b) to replace $y_i$ by ${\hat{p}}_i$ in its first term:Thus the deviance is twice the sum of the fitted binary information entropies. A deviance goodness-of-fit test against ${\chi }_{n-p}^2$ is unreliable for individual ungrouped binary observations: there is only one trial per saturated-model parameter, so the usual large-cell-count approximation fails. Deviance differences between fixed-dimensional nested logistic regression models can still support a likelihood-ratio test, subject to its usual regularity assumptions.

The three tree models are respectively $\mathrm{logit}{p}_i={\beta }_0$, $\mathrm{logit}{p}_i={\beta }_0+{\beta }_1{\log }_2{T}_i$, and $\mathrm{logit}{p}_i={\beta }_0+{\beta }_1{\log }_2{T}_i+{\beta }_2{S}_i$, with independent Bernoulli random variables conditional on the covariates. Testing the additional severity effect givesUnder $H_0:{\beta }_2=0$, its reference distribution is asymptotically ${\chi }_1^2$. The $p$-value is approximately $1.21\times 10^{-21}$, giving overwhelming evidence that severity improves the fitted model. Holding severity fixed, doubling $T$ increases ${\log }_{2}T$ by one and multiplies the odds byThis is an odds ratio, not a multiplication of the event probability itself.

There are 23 independent vial responses. The intercept-only fit has 22 residual statistical degrees of freedom and deviance 33.631. Adding two day indicators removes two statistical degrees of freedom and reduces the residual deviance by $33.631-33.358=0.273$. Adding the two species indicators then reduces it by $33.358-14.646=18.712$. Thus the six replacements, in their printed order, are $22,33.631,2,0.273,18.712,14.646$.

The residual deviance statistical degrees of freedom are $23-1=22$, $23-3=20$, and $23-5=18$. These sequential analysis-of-deviance rows compare nested generalized linear models in the displayed order. In an unbalanced design, the first day row does not test day after controlling for species.

Compare the species-only model against the additive day-and-species model. The null hypothesis is $H_0:d_2=d_3=0$, with the alternative that at least one is nonzero. The likelihood-ratio statistic is the reduction in residual deviance,Under the null hypothesis, regular binomial likelihood asymptotics give $G^2\stackrel{\mathrm{approx}}{\sim }{\chi }_2^2$, because the larger model has two additional parameters. For this chi-squared distribution the upper-tail probability is $\exp (-0.341/2)\simeq 0.843$. There is no evidence of a day effect after controlling for species, and the species-only model is a reasonable simpler choice. The sequential day-only statistic 0.273 from the preceding table answers a different question and must not replace this comparison.

The Quasi-Poisson regression retains the same conditional mean but permitsThis is a mean–variance function specification through quasi-likelihood; it does not assign a full probability distribution to each count. For independent observations, the quasi-score equation is proportional to ${\sum }_i{x}_i(Y_i-{\mu }_i)=0$, so the mean statistical parameter estimates equal those from Poisson regression. The output estimates $\hat{\varphi }=3.515351$ through the Pearson dispersion estimator, and inflates the standard errors by approximately $\sqrt{\hat{\varphi }}=1.875$.

The large residual deviance relative to 728 residual statistical degrees of freedom also signals substantial overdispersion. Daily weather, traffic and other omitted conditions may produce greater count variation than a homogeneous Poisson distribution allows. The Quasi-Poisson regression accounts for that extra marginal variance. It still requires a correct conditional mean and an appropriate independence assumption; a common dispersion parameter alone does not repair serial correlation.

The residual deviance is $290.93$ on $98$ residual degrees of freedom. Under a suitable Poisson deviance goodness-of-fit test approximation it is compared with ${\chi }_{98}^2$, whose supplied 95th percentile is $122.1$. Since $290.93$ is much larger, the chosen Poisson model does not provide a satisfactory absolute fit, despite being preferred among the three candidates.

The ratio $290.93/98\approx 2.97$ suggests substantial overdispersion or mean-model misspecification. It is a deviance ratio, not the exact Pearson dispersion estimator, which cannot be computed from the excerpt. Check residual patterns, nonlinear effects, unusual rivers and dependence. A Quasi-Poisson regression could adjust uncertainty under an estimated dispersion, and a negative binomial regression could model extra count variation; a more adequate mean model may also be needed. The nominal Poisson tests in part (a) should be interpreted in light of this failure, rather than treated as a validated final analysis.

The first model's residual deviance is $671.27$ on $197$ residual degrees of freedom, a ratio of about $3.41$. This is far above the scale expected from a well-fitting dispersion-one grouped binomial regression. It suggests an inadequate mean function, overdispersion, or both. The linear age and exposure restrictions may miss nonlinear associations; the generalized additive model allows those shapes to be estimated through penalized cubic regression splines rather than assumed.

The very small exposure Wald p-value in the first fit suggests an association, but does not establish that a linear logit effect is adequate. Nor does the nonsignificant linear age term exclude every possible nonlinear age effect. Allowing estimated scale also addresses the excessive residual variation, which can arise from clustered data because several births belong to the same woman. The second model's estimated scale $3.3506$ confirms that permitting smooth means has not removed all extra variation. The reason to proceed is poor initial fit and possible nonlinear effects, with dispersion-aware inference, not merely the wish to obtain more significant tests. These observational fits alone do not establish causation by the disaster.