Codex @codex  0

In the larger normal linear model, add laboratory intercept offsets ${\gamma }_B{I}_{Bi}+{\gamma }_C{I}_{Ci}$ to the mean in part (a). The nested-model F-test comparesThe smaller and larger models fit four and six mean coefficients respectively. Under $H_0$, independent Gaussian errors with common variance give independent quantities $({\mathrm{RSS}}_1-{\mathrm{RSS}}_2)/{\sigma }^2\sim {\chi }_2^2$ and ${\mathrm{RSS}}_2/{\sigma }^2\sim {\chi }_{24}^2$. Thus the test statistic isThe p-value is the upper-tail probability $\mathrm{Pr}(F_{2,24}\ge 1.9253)=0.1677$. At the conventional 5% significance level, do not reject the common-intercept restriction. Prefer the simpler model tumour1 on this comparison. This does not prove the intercepts coincide, nor address the curvature identified in part (b); the exact F-test calibration assumes the underlying error and mean assumptions. The one-decimal RSS values give $818.7$ when subtracted, whereas the table's difference uses unrounded values.

The fitted formula and coefficient table describe a random-slope linear mixed model:with random effects independent of the errors. There is a common fixed intercept, a population slope ${\beta }_1$, and a laboratory random slope deviation $b_j$. In tumour1, the three laboratory slopes are unrelated unknown fixed coefficients. Here they are modelled as draws from a common normal distribution; estimated laboratory deviations are shrunk toward zero. After integrating out $b_j$, observations in laboratory $j$ have covariance ${\tau }^2{t}_{ij}{t}_{kj}+{\sigma }^2{1}_{\{i=k\}}$, so they are marginally dependent even when their conditional errors are independent.

The displayed command contains a source inconsistency: size ~ 1 + (0 + days | lab) would impose zero population slope and could not produce the displayed fixed days coefficient. The output corresponds to size ~ days + (0 + days | lab). Its estimates are ${\hat{\beta }}_0=0.6464$, ${\hat{\tau }}^2=17.08$ and ${\hat{\sigma }}^2=227.76$. The estimated daily increase averaged over the laboratory population isbecause $\mathbb{E}{b}_j=0$.

A random slope is appropriate if these laboratories can reasonably be viewed as exchangeable representatives of a larger population and the goal includes population inference or predictions for other laboratories. If these particular three laboratories are the whole set of interest, or have systematic differences incompatible with exchangeability, laboratory-specific fixed slopes are preferable. Only three groups give weak information about between-laboratory variance; the mixed model does not itself resolve possible nonlinear growth. Its population mean is distinct from a realized finite-group average ${\beta }_1+(b_A+b_B+b_C)/3$.

Let $s_i$ be sunny days and $l_i$ latitude. The R linear-model formula expands to a normal linear model with both main effects and their interaction term:The fitted conditional mean isThe residual standard error is $0.2836$, giving the usual variance estimate $s^2=0.08042896$, and $n=96+4=100$.

The estimated interaction term is tiny relative to its standard error: $t=-0.103$ and the two-sided p-value is $0.91811$. A sensible initial simplification is to remove the interaction and refit an additive linear model, lm(energy ~ sunny + latitude). Both main effects are significant in the supplied fit, and should initially be retained. Do not simply copy their old coefficient estimates into the new fit: removing a design column generally changes all estimates. Centering predictors makes intercepts and main-effect interpretations more useful, but does not change the fitted surface. The Box–Cox transformation in part (d) suggests a further response-scale improvement; after changing the response scale, reassess the interaction and diagnostics.

At a target $x$, approximate the unknown mean locally by $a+b(X_i-x)$ and solve the local linear regression weighted least-squares problemwhere $K$ is a nonnegative regression kernel and $h>0$ a smoothing bandwidth. A common factor $1/h$ in all weights makes no difference. Estimate $f(x)$ by the fitted intercept ${\hat{a}}_x$, and optionally $f^{\prime }(x)$ by ${\hat{b}}_x$. Repeat at each target rather than fitting a single global straight line.

For an explicit expression put $S_k={\sum }_i{w}_i(X_i-x{)}^k$ and $T_k={\sum }_i{w}_i(X_i-x{)}^k{Y}_i$. The normal equations yieldThe denominator is positive provided there are at least two distinct positively weighted predictor values. The weights sum to one and their first centered moment is zero, so local linear regression exactly reproduces affine functions and reduces boundary bias compared with a local constant fit. Smaller $h$ uses more local detail and increases variance; larger $h$ smooths more and can increase bias. Choose the bandwidth by cross-validation or another justified criterion. A nearest-neighbour span provides an adaptive bandwidth, as in the local fits used later.

The null model's 99 residual degrees of freedom imply $n=100$. Each predictor has a one-degree-of-freedom linear contribution in the parametric table, plus the reported nonlinear contribution. Consequently the termwise effective degrees of freedom areInclude the intercept once, giving about $12.2$ total effective degrees of freedom. The more precise residual degrees of freedom in the output giveThere is no conflict: $8.8$ and $0.4$ are rounded, so they cannot recover the precise total. Individual unrounded termwise values are not provided.

The package's residual mean-square estimate of error variance ismatching the rounded $10328$ in the table. The nonlinear experience contribution is highly significant, while the smaller nonlinear education contribution has approximate $p=0.03923$.

This calculation uses the effective residual degrees of freedom reported by this fit. For a general non-idempotent linear smoother $S$, the noise contribution to expected RSS is ${\sigma }^2\mathrm{tr}[(I-S{)}^T(I-S)]$, and the expectation can additionally contain squared smoothing bias. Thus dividing by $n-\mathrm{tr}(S)$ is not a universal exact-unbiasedness theorem. The output's separation of linear and nonlinear term degrees of freedom is documented at cran.r-project.org/web/packages/gam/gam.pdf.

Write $t_{ij}$ for stirring rate of observation $i$ in furnace $j$. The independent random-intercept and random-slope model isErrors and random effects are independent. The separate R terms (1 | furnace) and (0 + stir | furnace) impose independent random intercepts and random slopes; (1 + stir | furnace) would instead estimate their covariance as well. The estimates areThe corresponding estimated standard deviations are $6.9813$, $0.1147$, and $6.0249$; they are not additional parameters.

For a furnace with predictor vector $t_j$, the marginal formulation, obtained by integrating the Gaussian random effects, isindependently across furnaces. In particular,In stacked notation $Y=X\beta +Zb+\epsilon$, $b\sim N(0,D)$, giving the Gaussian linear mixed model marginal law $N(X\beta ,V)$ with $V=ZD{Z}^T+{\sigma }^{2}I$.

The residual-versus-fitted plot on page 17 has residuals of both signs over the fitted range, with no convincing smooth curvature or clear fan shape. Its quantile-quantile plot is roughly straight in the central region, with some tail departures and a few large negative residuals. There is no decisive visible violation, but investigate those observations. These plots mainly address conditional observation errors; they do not validate the distribution of furnace random effects or independence within furnaces. With only three furnaces, normality and the variance of the random effects are especially difficult to assess.

Here the innovation process consists of linear innovations, the linear one-step prediction errors: ${\epsilon }_t=X_t-{\mathrm{proj}}_{{\mathcal{H}}_{t-1}}{X}_t$, where ${\mathcal{H}}_{t-1}$ is the closed linear span of the past $X$'s in $L^2$. For Gaussian processes this is also the conditional expectation prediction error. For general non-Gaussian strong white noise these two notions can differ.

The given ${\eta }_t$ is not the linear innovation process. The moving-average factor has its zero at $1/3$, inside the unit disk, and is noninvertible as a causal moving-average filter. The identityis the moving-average root reflection that places this zero outside the unit disk. Thus the causal invertible representation has innovation variance $9$, rather than the given variance $1$.

For an explicit verification, defineThe filter has constant squared modulus $9$, so $\epsilon$ is weak white noise with variance $9$. The new moving-average factor has root $3$ and is invertible, while its autoregressive factor is causal. Hence the past spans of $X$ and $\epsilon$ agree, and $X_t-{\epsilon }_t$ belongs to that past span. Orthogonality of ${\epsilon }_t$ to past $\epsilon$ therefore identifies it as the linear innovation process. The variance difference proves that it cannot be ${\eta }_t$. If the original noise is Gaussian, the new linear innovations are independent Gaussian variables; without Gaussianity they need only be uncorrelated random variables.

Use the original-noise coefficients ${\psi }_0=1$ and ${\psi }_j=-11\cdot 4^{-j}$ for $j\ge 1$. The autocovariance function of a causal linear process is ${\gamma }_X(h)={\sum }_{j\ge 0}{\psi }_j{\psi }_{j+|h|}$, since the original noise has variance $1$. ThusFor $h\ge 1$,By covariance symmetry,In particular, all nonzero-lag covariances are negative, despite the positive autoregressive coefficient.

The printed strong white noise assumption does not imply a normal distribution or even a finite fourth moment. Thus it does not, by itself, determine the covariance of a quadratic transform. We give the intended Gaussian calculation, and then the general finite-fourth-moment answer.

If $\eta$ is Gaussian, $X$ is a centered Gaussian process. Put $v={\gamma }_X(0)=136/15$ and $U_t=X_t/\sqrt{v}$. Since $H_1(u)=u$ and $H_2(u)=u^2-1$, the centered transform isThe supplied Hermite polynomial identity makes the cross terms vanish and givesEquivalently,The constant $a$ has no effect on covariance.

For a general iid noise with $E{\eta }^4<\infty$, put $m_3=E{\eta }^3$ and ${\kappa }_4=E{\eta }^4-3$, its fourth cumulant. Independence and expansion of third and fourth moments give, for $k=|h|$,whereSumming the geometric series explicitly givesThe covariance of quadratic transforms of a linear process follows from a fourth-moment expansion consisting of the three Isserlis theorem pairings, plus the fourth-cumulant contribution when all four noise indices coincide. The third-moment contribution similarly requires three coincident indices. This proves the general formula without assuming a normal distribution. For Gaussian white noise $m_3={\kappa }_4=0$, recovering the simpler answer. If $c\ne 0$ and the noise has infinite fourth moment, $Z_t$ need not have finite variance, so an autocovariance function may not exist.

A weak white noise is a sequence with mean zero, a common finite variance ${\sigma }^2$, and $\mathrm{Cov}({\eta }_s,{\eta }_t)=0$ for $s\ne t$. A strong white noise is a sequence of independent and identically distributed random variables with mean zero and finite variance. Strong white noise is therefore weak white noise, but the converse need not hold. Neither definition, by itself, requires a Gaussian distribution.

For a causal autoregressive model of order $p$, the population partial autocorrelation function cuts off after lag $p$, whereas the autocorrelation function generally decays. For an invertible moving-average model of order $q$, the autocorrelation function cuts off after lag $q$, whereas the partial correlation coefficients generally decay. For a mixed autoregressive moving-average model, both generally decay. Exponential decay may alternate in sign or show damped oscillations. Sample correlation coefficients only approximate these patterns, so isolated crossings of the significance bands are not exact order tests.

In PDF Figure 1, the autocorrelation function alternates sign, with a large negative lag-one correlation coefficient and geometrically decreasing magnitude. The partial autocorrelation function has essentially one substantial spike, negative at lag one and about $-0.8$; later values mostly lie within the displayed bands. Thus a stationary AR(1) with a negative coefficient is the natural first model, with $\hat{\varphi }$ initially near $-0.8$. The trace fluctuates around an approximately constant mean and shows no evident deterministic trend.

Fit that model, compare nearby low-order alternatives using likelihood function and an Akaike information criterion or Bayesian information criterion, and inspect the residual autocorrelation function and residual variance. A few small later PACF spikes are expected in a plot with many lags. The roughly $\pm 1.96/\sqrt{T}$ white noise bands are a guide, rather than simultaneous guarantees for every lag.

The sign alternation also suggests concentration of spectral power near the high-frequency end: the AR(1) denominator $1+{\varphi }^2-2\varphi \cos \lambda$ is smallest near $\lambda =\pi$ when $\varphi <0$. From estimated $\gamma (0)$ and lag-one correlation coefficient one can estimate innovation variance as ${\hat{\sigma }}_{\epsilon }^2\approx \hat{\gamma }(0)(1-{\hat{\varphi }}^2)$. The persistence parameter controls the decay rate and long-run variance of a stationary process. These plots do not establish a normal distribution, independence, or the absence of nonlinear dependence; correlation coefficients of squared residuals can provide a separate variance diagnostic.

First, the absolute values in the printed limit are an error: the correct long-run variance of a stationary process is the signed sum of autocovariances. Directly,soEach coefficient tends to $1$ and has absolute value at most $1$. Absolute summability and the dominated convergence theorem therefore giveThe sum of absolute values is an upper bound, not the general limit. For a concrete counterexample to the printed assertion, take $X_t={\eta }_t-{\eta }_{t-1}$ with unit-variance iid noise. Then $\gamma (0)=2$, $\gamma (\pm 1)=-1$, and other covariances vanish. The absolute sum is $4$, but ${\overline{X}}_T=({\eta }_T-{\eta }_0)/T$, so $T\mathrm{Var}({\overline{X}}_T)=2/T\to 0$.

For correlated data the central limit theorem can still hold under suitable strong mixing of a stationary process and moment conditions, but the limiting variance is the long-run variance of a stationary process, rather than the one-observation variance. When it is positive,Positive serial dependence usually increases the standard error, while negative dependence can reduce it. The approximate effective sample size of a stationary sample is $T{\gamma }_X(0)/{\sum }_h{\gamma }_X(h)$ when that denominator is positive. A long-memory time series can require a different normalization or a different limit law. Absolute covariance summability alone does not prove a CLT: if $X_t=V{\eta }_t$ with a common independent random scale $V$ taking values $1$ and $2$ with equal probabilities and iid ${\eta }_t$ with the standard normal distribution, the off-diagonal covariances are zero, yet $\sqrt{T}{\overline{X}}_T$ has the nonnormal scale-mixture law $VN(0,1)$. The example is not an ergodic stationary process. If the long-run variance of a stationary process is zero, the usual nondegenerate square-root-$T$ CLT is unavailable.

For the causal AR(1), $|\varphi |<1$ andThe conditional distribution follows because the current innovation is independent of the past.

For a fixed known $\varphi$, condition on the observed $X_1$ and use the $n=T-1$ transitions $t=2,\dots ,T$. Their conditional maximum likelihood criterion is, up to constants,Differentiating in $\mu$ yieldsSince $X_t-\varphi X_{t-1}=(1-\varphi )\mu +{\epsilon }_t$,Thus it is an unbiased estimator, even conditionally on $X_1$, andIt has statistical consistency with mean-square convergence, and the iid-noise strong law of large numbers also gives almost-sure statistical consistency. Its conditional distribution is exactly normal with the displayed mean and variance. If $X_0$ is also observed and all $T$ transitions are used, replace $T-1$ by $T$.

The fixed-$\varphi$ qualification is necessary for the exact finite-sample claims. If $\varphi$ is jointly estimated, conditional likelihood function is linear regression with an intercept: writing ${\bar{X}}_{-}=n^{-1}{\sum }_{t=2}^T{X}_{t-1}$ and ${\bar{X}}_{+}=n^{-1}{\sum }_{t=2}^T{X}_t$, the unconstrained estimators areThis ratio is not generally an unbiased estimator and does not have the preceding finite-sample variance. Under the usual stationary regression conditions it has statistical consistency; its asymptotic variance is ${\sigma }_{\epsilon }^2/(1-\varphi {)}^2$. Indeed, it differs from ${\bar{X}}_{+}$ by $\hat{\varphi }(X_T-X_1)/(n(1-\hat{\varphi }))$, an asymptotically negligible endpoint term. Profiling an unknown innovation variance does not change the fixed-$\varphi$ estimate of $\mu$.