Allow each subject to have a separate baseline and slope through a correlated random-intercept and random-slope model:
The subject random effects are independent of all measurement errors, and subjects are independent. The within-person covariance between times is , with an additional when the same reading is used twice.
Prefer the model with a random slope. The maximum likelihood estimation refits improve twice the log-likelihood by while adding two covariance statistical parameters. Both the Akaike information criterion ( to ) and Bayesian information criterion ( to ) strongly favour it. The printed nominal likelihood-ratio test is overwhelming. The usual reference chi-squared distribution with two statistical degrees of freedom is not an exact regular calibration, since zero slope variance is a boundary and the intercept–slope correlation is then unidentified; a design-specific parametric bootstrap could calibrate it. This qualification does not undermine the substantial descriptive improvement shown by both information criteria.
The preferred fit estimates population mean baseline strength kg and weekly gain kg/week. The between-person baseline standard deviation is kg, and the between-person slope standard deviation is kg/week. Their estimated correlation is weakly positive, giving random-effect covariance about kg/week; its uncertainty is not supplied. The measurement-error standard deviation is kg. The printed instead describes the correlation between the estimated fixed effects, not between the subject random effects. These statistical parameter estimates come from restricted maximum likelihood; the model comparison uses the separate maximum likelihood estimation fits.
The population mean fitted trajectory is kg. Hence
Using the reported slope standard error, an approximate 95% confidence interval for the population mean gain is kg; a Student t confidence interval with 499 statistical degrees of freedom is almost identical.
Successful individuals can improve far more than the average. Their latent ten-week gains have fitted normal distribution
A clear estimate for an upper-performing group uses a between-person slope quantile: the 95th percentile is kg, and the 97.5th percentile is about kg. The upper 5% of fitted underlying gains begin around 73 kg. These are person-to-person performance quantiles, not confidence intervals for the population mean. Identifying the best observed trainee would require that person's data or fitted subject random effects; the aggregate output cannot identify a literal maximum. If performance means the observed difference of endpoint readings, add the measurement-error variance to the latent gain variance.
Let be each trial's estimated log risk ratio, with estimated sampling variance . A fixed-effect meta-analysis models the independent estimates as , with one common true log risk ratio . Differentiating the Gaussian log-likelihood, or minimizing , gives inverse-variance weights and
The variance follows directly by adding independent variances of the weighted estimates: .
Using the printed rounded estimates and standard errors, , so
The pooled risk ratio is about . An interval using the same quantile two is on the log scale, so it includes no effect. Recomputing all trial estimates from the event counts would change the last digits because the printed log estimates and errors are rounded.
The key assumptions are independent trials, a common true treatment effect on this chosen log scale, approximately unbiased and approximately normal trial estimates, and suitable sampling-variance estimates. The common-effect assumption is stronger than merely studying the same named treatment: systematic population, treatment or design differences may produce genuine heterogeneity. For an unbiased interpretation of the pooled evidence, inclusion of studies must also not depend selectively on their results. Treating the plug-in variances as fixed is the usual approximation in the displayed variance formula.
Choose candidate variables from subject-matter knowledge, measurement quality and the target question before screening on outcomes. For an adjusted-effect analysis, retain prespecified confounders and essential design variables even when their individual values are large. For prediction, consider reliable predictors available at the intended prediction time; do not include future information. Handle missingness transparently, using a justified multiple imputation strategy where appropriate rather than changing the analyzed population unpredictably as variables enter.
Encode a categorical variable with indicators relative to a stated reference category, and assess it as a group. Check multicollinearity, sparse categories and plausible interactions. The relevant information is chiefly the number and distribution of events, not merely the number of enrolled subjects: hundreds of correlated or rarely varying predictors cannot be supported by a small event count.
Compare prespecified nested models by a likelihood-ratio test based on the partial log-likelihood and the change in parameter dimension. Penalized methods such as ridge regression or Lasso regression applied to the Cox likelihood can stabilize many-variable models; choose tuning by suitable validation and account for mandatory variables. The Akaike information criterion or a limited, documented model-selection procedure can help balance fit and complexity. Unrestricted stepwise searches and repeated univariable screening invite unstable choices, omit joint confounding effects, and make naive post-selection intervals misleading. Prefer a defensible, validated covariate set to a collection chosen only for small values.
The Type II maximum likelihood estimator maximizes the Bayesian model evidence after integrating out the breed parameters:
For positive sample sizes define . Up to an additive constant, the log-likelihood is
Differentiation gives the interior score equation
Also . If , the derivative decreases from infinity to , so a unique finite maximum exists. When all sample sizes equal , the equation becomes , giving
For no finite maximum exists. Plugging this hyperparameter estimate into the breed posterior distributions is an Empirical Bayes method.
Positivity means almost everywhere, since the real logarithm must belong to . A positivity-preserving operator gives . For fixed , the scalar shifted Poisson data fidelity is , with
Composition with the linear operator proves convexity in , and strict convexity holds along pairs whose forward images differ on a set of positive measure. The admissible class itself is convex: the concavity of the logarithm gives , controlling its negative part, while controls its positive part.
Because and , the Jensen inequality gives the requested bound:
The final equality uses nonnegativity and the unit area. Since , this controls the forward-image norm on energy sublevels.
The printed strictly positive problem has no minimizer. This is nonattainment under strict positivity for shifted Poisson fidelity, rather than a failure of the coercivity calculation. Indeed, with and , implies . Also cannot vanish identically for a strictly positive . To see this, let . If , positivity and give . But in and continuity of would imply , contradicting the hypothesis. Thus every admissible has positive fidelity and hence positive total energy.
Conversely, the constants are admissible, have zero total variation, and satisfy
Their logarithms are integrable for each , but the limit is excluded. Therefore
A bounded minimizing sequence and bounded-variation compactness do not repair a nonclosed positivity/logarithm constraint. In particular, a literal existence or uniqueness proof for that domain is impossible.
The natural correction is to minimize over with , omitting the unnecessary condition: the fidelity only contains , which is already integrable. Here is the full existence for nonnegative shifted Poisson regularization argument, also valid for any bounded nonnegative data . Let , , and take a minimizing sequence of energy at most . The displayed bound gives and . Write . The Poincaré inequality for total variation and mean control for positive imaging operators yield
The denominator is nonzero, so the full norm is bounded. Bounded-variation compactness gives in along a subsequence, with . Continuity gives in . On , , so the fidelity converges in the integral; lower semicontinuity of variation completes the direct method in the calculus of variations.
For the actual printed data , the corrected problem has the unique minimizer , even if is not injective. Zero attains energy zero. Any other zero-energy candidate would have both and ; on the connected square, zero variation makes a nonnegative constant, and forces that constant to vanish. For general positive bounded data, an injective is a sufficient uniqueness condition, because its fidelity is strictly convex; injectivity is not a necessary condition in every instance.
In the finite-dimensional interpretation, let . Independent Poisson observations with these intensities have negative log-likelihood . Removing the constant gives precisely the stated fidelity. Thus the model is Poisson counting noise with a unit background intensity, or an approximate version of it for rescaled/continuous grey values. Literal Poisson counts are integers; the constraint is a grey-value normalization, not a literal unscaled count sample.
For independent identically distributed observations , the likelihood function and log-likelihood are
A maximum-likelihood estimator is a measurable choice , when a maximizer exists. It need not be unique. The one-observation score function is , and the Fisher information matrix is
Under the regularity assumptions, differentiation beneath the integral gives . Differentiating again gives the second information identity. Independent observations have total Fisher information .
Assume fixed parameter dimension, an interior true parameter , a positive-definite matrix , the standard differentiability and integrability conditions, and statistical consistency of . Then the asymptotic normality of a maximum likelihood estimator is
Here is the information per observation. Thus the leading covariance matrix of the estimator itself is .
To prove this, statistical consistency places the estimator in an interior ball about with probability tending to one, where its score function vanishes. Write and use the integral first-order Taylor formula for a vector map:
This integral matrix is needed in a vector problem; one does not have to assert a common scalar mean-value point for every score component. Put
The regular local uniform law of large numbers, continuity of the expected Hessian matrix, and statistical consistency give . The multivariate central limit theorem gives
The limiting information matrix is nonsingular, so . Solving the Taylor identity and applying the Slutsky theorem proves the displayed normal limit, since . Boundary parameters or singular information are outside this regular theorem.
For the normal linear model, the log-likelihood is
The full column rank of the design matrix makes invertible. Differentiating in gives the normal equations . With the minimized residual sum of squares substituted, differentiation in gives
These are the maximum-likelihood estimators almost surely; almost surely when and . The linear transformation of the multivariate normal distribution yields
Define the hat matrix . The fitted values are , the regression residuals are , and . The orthogonal projection has rank and annihilates . By Cochran's theorem,
Consequently , with bias . The unbiased estimator is
Its square root, the reported residual standard error, estimates ; the assertion of unbiasedness applies to the variance, not generally to its square root.
For the paper-strength analysis, let be the measured percentage and . Both normal linear models use independent errors of common variance . Their mean functions are for lm1, and for lm2, with separately fitted coefficients. The reported residual standard errors are and , respectively.
For lm1, the estimated conditional expectation at a new percentage is
The original data mean must be used for centering the new percentage; its numerical value is not supplied in the excerpt. Because , the two columns of this design matrix are orthogonal, and . Hence the coefficient standard errors in the output give
This estimates uncertainty in the mean. Predicting an individual future batch would additionally require the new-error variance, estimated by .
To compare the nested normal linear models, test against within the quadratic model. The Student t-test statistic is
Its two-sided p-value is . Equivalently is a partial F-test statistic with null distribution . Reject the linear restriction and prefer lm2 at the 5% level. Its residual spread is much smaller; the increase in the coefficient of determination from to supports the same conclusion, although the test is the relevant complexity-adjusted comparison.
For regression diagnostics, inspect regression residuals against fitted means and hardwood percentage for omitted curvature, a scale-location plot for nonconstant variance, and a quantile-quantile plot against the normal distribution for departures from the error assumption. Check unusual observations using regression leverage and Cook's distance, and examine residuals in collection or batch order if dependence is plausible. Independence and a common variance require substantive justification as well as these plots; a small p-value for a polynomial term does not itself check the error model.
Introduce a latent indicator for a structural zero. In this parametrization , and conditional on the response has a Poisson distribution with mean . The zero-inflated Poisson regression uses
Its observed probability mass function is at zero and at a positive count. The zero-mixing probability here is explicitly ; it is distinct from the weight of the count component.
For the expectation-maximization algorithm, start with positive and . At iteration , the E-step computes
This distinguishes structural zeros from Poisson-generated zeros. Up to terms independent of the new parameters, the expected complete-data log-likelihood is
It separates into a fractional-response logistic fit and a weighted Poisson fit. Because treatment is binary, each component is saturated over its two treatment groups, so the M-step has closed forms.
For , let , , , and . The M-step score equations give
Here , since every positive count has . The explicit coefficient updates are
Iterate the E- and M-steps until the observed log-likelihood and parameter estimates stabilize. This is the EM algorithm for zero-inflated Poisson regression with explicit binary-group updates; merely naming two regression routines would not supply these expressions. Both treatment groups must be represented for both contrasts to be identifiable. Zero fitted group means or endpoint mixing probabilities are boundary solutions, interpreted through limits of the log or logit coefficients. As with other mixture models, multiple starts help distinguish competing stationary solutions; EM increases the likelihood but does not guarantee a global maximum from an arbitrary start.
The Bradley-Terry model assigns comparison probability to each observed edge. Up to factors independent of the parameters, its likelihood function is
The comparison graph is a path graph, hence a tree. After fixing , its edge ratios are unconstrained positive coordinates: every collection determines uniquely .
For a convenient strict-concavity calculation, use the edge log-ratios in a Bradley-Terry comparison tree . The log-likelihood separates as
Each derivative is , where is the logistic function of , and each second derivative is . Because , there is a unique finite global maximum at
Converting back gives the Bradley-Terry maximum-likelihood estimate on a path:
Equivalently, recurse backwards using . All estimates are finite and positive. The sample size changes the curvature of the likelihood but not this maximizer; absence of comparison cycles is what permits every empirical edge proportion to be fitted simultaneously.
For a finite Gaussian mixture with a common variance, introduce independent latent labels with probabilities , , and conditional responses , with common . The observed density and log-likelihood are
The expectation-maximization algorithm replaces the difficult log of sums by an expected complete-data objective. Choose positive initial weights and variance and separated initial means. At iteration , the E-step computes the mixture responsibilities
The common normalizing factor cancels. For numerical stability the probabilities can be evaluated by subtracting the largest log weight before exponentiating.
With the old responsibilities held fixed, the expected complete-data log-likelihood, up to irrelevant constants, is
Let . A Lagrange multiplier for , weighted least squares for the means, and differentiation in the common variance give the M-step:
The variance update uses the new means and old responsibilities, with denominator , not a residual degrees-of-freedom adjustment: this is maximum likelihood estimation. Repeat the E- and M-steps until the observed log-likelihood and parameters stabilize.
By EM likelihood monotonicity, exact updates do not decrease the observed likelihood. They need not reach its global maximum, so use several starting configurations and keep the best converged fit, checking for empty or nearly empty components and vanishing variance. The labels are interchangeable; sorting means after fitting supplies an interpretable labeling. Distinct starting means do not guarantee that all fitted components remain distinct. With a common variance and the usual fixed small relative to distinct observations the model avoids the individual-component variance-collapse pathology of unrestricted Gaussian mixtures, but degenerate data or too many components still require attention.
The statistician first models the age- and gender-dependent mean by linear regression. Its fitted value is . At fixed gender, a year of age is associated with a decrease of BMI units; the group coded gender has a fitted mean units above the group coded at the same age. This question does not state which gender receives which code. The intercept refers to age zero in the reference group, outside a typical adult-patient range, so its substantive interpretation is limited. Both slope Student t-tests have small p-values, and the overall F-test supports an age/gender-dependent mean. The coefficient of determination is only , leaving considerable individual variation to investigate.
The residual diagnostics check whether mean adjustment is plausible and whether a single normal error law is adequate. The residual-versus-fitted plot has no strong curved mean trend, although its smooth curve is not perfectly flat. The scale-location plot suggests some decline in spread as fitted BMI increases, so common residual variance is a working approximation rather than an established fact. The normal Q-Q plot has systematic departures, notably shorter tails than the normal reference, suggesting the residual law is not exactly normal. The regression leverage plot does not display an obviously extreme leverage point, but the marked observations and Cook's distance should still be checked for influence. Independence between patients cannot be diagnosed from these four plots alone.
Next the statistician extracts the regression residuals and fits an intercept-only normal model as a baseline residual distribution. With an intercept in the original ordinary least squares model, the residuals sum to zero by the normal equation; the near-zero fitted residual mean and its are therefore automatic, not new evidence of good fit. The standard error in this refit uses degrees of freedom, whereas the original uses after estimating three regression coefficients. The reported log-likelihood for the single-normal residual model is .
The histogram suggests a shape worth exploring beyond one normal density, with broad shoulders and some asymmetry, without showing unambiguous separated clusters. The statistician fits two- and three-component finite Gaussian mixtures with a common variance by the expectation-maximization algorithm, starting from separated means and positive weights. Successive likelihoods increase and the displayed final iterations stabilize, as expected from EM likelihood monotonicity. This is evidence of numerical convergence from those starts, not proof of a global maximum.
The two-component fit assigns weights , residual means and common variance . The three-component fit assigns weights , residual means and common variance . The code correctly passes the square roots of those variances to dnorm and overlays the resulting weighted densities. Both curves broadly follow the histogram and are very similar. In particular, a two-component mixture need not have two distinct visible modes.
These fits explore residual mixture clustering: groups differ in BMI relative to the same age/gender-adjusted mean, rather than simply in raw BMI. Membership can be summarized by the fitted mixture responsibilities, retaining uncertainty instead of asserting a certain label for each patient. The common-variance assumption is economical, but should be checked; the common regression slope assumption and constancy of mixture proportions across age and gender are also substantive. A residual mixture alone does not establish genuine biological subpopulations; a flexible continuous distribution, missing predictors, nonlinear mean effects or heteroscedasticity could explain a similar marginal shape.
There is also a two-stage residual mixture fitting limitation. Fitted regression residuals are not exactly independent identically distributed observations: even under a normal regression, their covariance matrix is , and estimating the mean adjustment introduces uncertainty. With subjects and three initial regression coefficients, treating them as independent is a useful approximation for exploring shape, but ordinary mixture likelihoods omit the first-stage uncertainty. A joint mixture regression with shared slopes, or a suitable bootstrap of the whole analysis, would give a firmer basis for parameter uncertainty and cluster selection. Examine component membership versus age/gender and repeat the algorithm from multiple starts before making substantive clustering claims.
The three-component finite Gaussian mixture with a common variance has the largest displayed maximized log-likelihood, but it also has more fitted parameters. For components there are free weights, means and one common variance, making residual-distribution parameters. Applying the nominal Akaike information criterion and Bayesian information criterion to the three residual fits gives
Both criteria favour the two-component model. It improves the likelihood substantially over one normal component; the third component gains only in log-likelihood at a cost of two further parameters. The Akaike information criterion difference between two and three components is small, about , so that criterion alone gives only a slight preference; the Bayesian information criterion preference for two is stronger. Their nearly indistinguishable overlaid curves also support retaining the simpler two-component fit.
These calculations are model-selection aids, not an exact test. Ordinary chi-squared calibration of a likelihood-ratio test for the number of mixture components is invalid in general: under a smaller-component null, some weights lie on the boundary and extra-component parameters are unidentified. This is nonregular mixture model selection. A parametric bootstrap or predictive cross-validation is preferable for a formal comparison, and should account for the mean-adjustment stage. The table uses the provided residual likelihoods and their nominal parameter counts; first-stage regression uncertainty and possible local EM maxima remain qualifications. On the supplied evidence, select two components without claiming that two distinct biological groups have been established.
With the onset means defined by the discrete back-calculation of infection incidence, the independent Poisson observation model yields the product likelihood
For positive means its log-likelihood is . A zero mean assigns probability one to a zero count and zero to a positive count. Any unknown pre-observation infection history must be parameterised or supplied as well; it cannot silently be excluded merely because the observation series starts at .
For , the binomial log-likelihood is plus a constant. Its maximizer, including endpoints, is . For , the Fisher information is
This follows either from the expected negative second derivative or the variance of . At the usual regular score formula does not apply; the interior information diverges as an endpoint is approached.
For a symmetric Beta distribution prior , conjugacy gives , with posterior mean . All three priors below are instances of this calculation.
Writing for the observed counts, independence of the Poisson distributions gives the log-likelihood
Its score function and negative second derivative are
Unless all vanish, , so the log-likelihood is strictly concave. Use Newton method, starting from a finite , with
Stop when the score function or the change in is small; a reduced step can ensure that the log-likelihood increases. Any finite zero of the score function is the unique maximum-likelihood estimator.
Existence needs a qualification. If the nonzero include both signs, decreases from to , so a finite root exists. If all nonzero are positive, a finite root exists exactly when ; otherwise the supremum is approached as . The corresponding condition for all negative is , with a supremum at otherwise. When all , the parameter is unidentifiable. These cases explain when the iterative algorithm actually has a finite estimate to find.