Simple linear regression uses one predictor and an intercept, , with . The regression coefficients describe a straight conditional-mean line: is its value at zero and its rate of change per unit of the predictor. When zero is outside the observed range, predictor centering can make the intercept refer to a more representative predictor value.
For fixed predictors and uncorrelated mean-zero errors of common variance , with ,A larger predictor spread improves slope precision under this model. In the worked example and ; the estimated error variance is . A normal linear model gives the slope pivot a Student t-distribution with degrees of freedom. The distinction between a fitted line and a reliable uncertainty statement is precisely the role of the error assumptions.
In simple linear regression written as , the constant and centred predictor columns are orthogonal. Differentiating the sum of squared residuals gives the displayed ordinary least squares estimators, provided . For independent mean-zero errors of common variance , both estimators are unbiased, their variances are and , and their covariance is zero. The uncentred intercept is .
Articles by others on the same topic
Simple linear regression is a statistical method used to model the relationship between two continuous variables by fitting a linear equation to the observed data. It assumes that there is a linear relationship between the independent variable (predictor) and the dependent variable (response). ### Key Components of Simple Linear Regression: 1. **Independent Variable (X)**: This is the variable that you use to predict the value of the dependent variable. It is also known as the predictor, feature, or explanatory variable.