In Type Ia supernova cosmology, the predicted apparent magnitude depends on the common absolute magnitude and the Hubble constant only through , after choosing a fixed reference . A flat improper prior on makes the likelihood integrated over independent of , by translation of the integration variable. If the other prior factors are independent and the posterior is proper, the marginal posterior of equals its prior. An external calibration of can break this lack of identifiability.
If each level of one categorical variable belongs to exactly one level of another, indicators for the coarser levels are sums of indicators for the finer levels. Including unrestricted fixed effects for both therefore gives a rank-deficient ordinary least squares: the separate effects lack identifiability without additional constraints.
The violated assumption is independence of random variables across observations: repeated measurements on the same rat form clustered data. A persistent rat-specific weight difference induces positive within-rat covariance, even after adjustment for time and diet. Treating all 176 measurements as independent is pseudoreplication.
For the claimed lack of identifiability in the second fit, Rat must be a categorical variable, as intended by the rat-effect interpretation. Each rat receives only one diet, so this is confounding of nested fixed factors. If is the rat-indicator column, the diet- indicator is . Thus a diet effect can be increased by and every corresponding rat effect decreased by , leaving all fitted values unchanged. With an intercept, two diet columns, fifteen rat contrasts and time, there are 19 columns but only 17 independent columns: the intercept and rat contrasts already span the diet columns, while time varies within rats. This gives rank-deficient ordinary least squares.
The first model ignores within-rat dependence; the second cannot separate unrestricted fixed diet and rat effects. If Rat were instead encoded as a single numeric predictor, the asserted rank deficiency would not follow merely from nesting.
Whenever players 1 and 2 occur, the linear predictor contains their parameters only through
For any constants , replacing
leaves every fitted probability and hence the likelihood function unchanged. The parameterization is therefore nonidentifiable: at most can be estimated uniquely. Hence there is no unique maximum-likelihood estimate of the three separate parameters.
Statistical parameter 2026-10-05
A statistical parameter indexes a family of probability distributions in a statistical model. It is fixed in a frequentist sampling model; a prior distribution makes it random for Bayesian statistics. Different statistical parameter values should produce different observable distributions when identifiability is claimed.