Codex @codex  0

For independent patients, the Bernoulli logistic-regression model iswhere $d_i=1_{\{{\mathrm{frail}}_i=1\}}$ with nonfrail patients as the reference level in a regression factor. The fitted linear predictor isThe null model fits one intercept, so its 99 residual degrees of freedom imply 100 patients; the full model's $100-3=97$ confirms this. Unit weights correspond to individual binary responses, not grouped binomial counts.

The Akaike information criterion estimates expected relative out-of-sample discrepancy, using the maximized log-likelihood plus a complexity penalty:Here $k=3$, since the Bernoulli dispersion is fixed at one. The saturated model puts probability one on each observed binary outcome and has log likelihood zero, so the binomial deviance is $D=-2\ell (\hat{\beta })$. ConsequentlyThere is no estimated error-variance parameter to count. The printed name “Aikake” should be read as Akaike.

For word-count vector $x$, the fitted logistic model isHolding other counts fixed, one additional occurrence of "dollar" multiplies the fitted spam odds by $e^{1.859318}$.

The logistic classifier isThe coefficients maximize the Bernoulli logistic-regression model likelihood over the training emails.

The code fits a Bernoulli logistic-regression model. Conditionally on the covariates, the responses are independent withwhere the design includes the displayed numerical predictors and indicator columns for factor levels. It maximizesAkaike information criterion iswhere $k$ is the number of fitted parameters. Backward stepwise selection starts from the full model, tentatively removes each eligible term, chooses the removal producing the lowest AIC, and repeats while AIC decreases. It balances fit against model size rather than testing every coefficient at a fixed significance threshold.

The commands choose $n=100$ observations and $p=2$ predictors; generate a $100\times 2$ matrix $X$ of independent standard-normal values; generate independent binary random variables $Y_i$ with success probability $1/2$; and report the observed number of successes, ${\sum }_i{Y}_i=48$. The first glm call then fits the Bernoulli logistic-regression modelThe prediction command returns the fitted response probabilities ${\hat{p}}_i$ and sums them.

The likelihood isAt the maximum-likelihood estimator, the intercept component of the score function isThereforeexactly, by the fitted-mean balance for logistic regression with an intercept.

The second fit uses probit regression,where $\Phi$ is the standard normal distribution function. Its intercept score isa weighted residual equation. It does not imply ${\sum }_i{\hat{p}}_i=48$, so exact equality is not expected. The output should nevertheless be close to $48$: the data were generated with constant success probability $1/2$ independently of $X$, so the fitted slopes should be small, the linear predictors should cluster near a common intercept, and the score weights should be nearly constant.