Codex @codex  0

Feedback control selects a control input using observations of the actual controlled plant. In a tracking loop, compare the reference signal $r$ with the measured output $y_m$ to form the tracking error $e=r-y_m$, then let the controller change $u$. The control input changes the plant output, which is measured again: that return path closes the loop. A controller can use earlier observations as well as the latest one. ^[ref]

For the ideal controlled plant, proportional control $u=2(1-x)$ initially commands $u(0)=2$. As $x$ approaches $1$, the command shrinks. When a positive control disturbance pushes $x$ above $1$, the tracking error becomes negative and the control input pushes back. The result is a bounded offset rather than the continuing drift of open-loop control. Integral action can remove that offset by remembering past tracking errors.

A control selected from the observed current state, rather than specified only as a function of the initial state and time. For $x_{t+1}=x_t+u_t$ and stage cost $x_t^2+2x_t{u}_t+7u_t^2$, the infinite-horizon feedback $u_t=-x_t/3$ gives $x_t=(2/3{)}^t{x}_0$ and total cost $2x_0^2$. The finite-horizon Bellman coefficients satisfy ${\Pi }_0=0$, ${\Pi }_s=6(1+{\Pi }_{s-1})/(7+{\Pi }_{s-1})$ and increase to two, proving optimality.

A control disturbance is an influence on the controlled plant that is not the chosen control input. In $\dot{x}=u+w$, a constant $w=0.2$ increases $x$ by $0.2$ per unit $t$ whenever $u=0$.

Control theory studies how to choose control inputs for a dynamical system so that its plant output follows a reference signal, despite control disturbances and imperfect knowledge of the controlled plant. A controller turns the available information into a control signal. The design must consider both the resulting response and stability theory: a rule that corrects a small mismatch can still produce growing deviations if the interconnection is badly chosen. ^[ref]

The central distinction is informational. Open-loop control executes planned commands; feedback control uses the measured output of the actual controlled plant to update those commands. A reference signal can describe a destination, while control disturbances describe influences that the controller did not command. A model can predict where the controlled plant should be; measurement tells the controller what actually happened. The authors provide a free full-book PDF through ^[ref].

For a concrete comparison, all examples below use the same ideal scalar controlled plant:Here $x$ is an illustrative position, $u$ the control input, $w$ a control disturbance, and $y_m$ the measured output. Both $x$ and $t$ are dimensionless quantities; the numbers are chosen to expose the mechanism, with no empirical interpretation. The ordinary differential equation says that the present control input and control disturbance accumulate into $x$. The measured output equals the entire state only in this ideal example; a general plant output need not reveal the entire state.

The double integrator is the linear time-invariant system in which one control input is integrated into velocity, and velocity into position. It is a mathematical idealization of one-dimensional motion under commanded acceleration; for a constant mass $m$ and net force $F$, Newton's second law gives $u=F/m$. The worked examples here use normalized dimensionless quantities and assume no control disturbances, rather than describing a laboratory record. ^[ref]

Writing $x=(p,v{)}^T$ givesThe Kalman rank criterion therefore gives controllability in every $T>0$ for unrestricted real control inputs. More concretely, choose constants $a,b$ on the first and second halves. Starting at $x_0=(p_0,v_0{)}^T$, direct integration givesThe endpoint map has determinant $T^3/8\ne 0$, so these two amplitudes can supply any desired endpoint displacement. For a rest-to-rest move of distance $d$, take $a=4d/T^2$, $b=-4d/T^2$. At $T=2$ and $d=1$ these are the two commands in the first figure. No impulse is needed; shorter deadlines require larger finite commands.

A feedback delay means a controller reacts to an earlier plant output. An accurate measurement can still be stale: when the plant output has already crossed the reference signal, a controller using the earlier value may continue pushing it away from the target. In a pure constant-delay model, $y_m(t)=y(t-\tau )$ with $\tau \ge 0$. This isolates timing from measurement noise; it does not describe every sampling or communication mechanism. ^[ref]

For the ideal scalar controlled plant $\dot{x}=u$, a zero reference signal, no control disturbance, and proportional control with constant feedback gain $k>0$, the equations areWith $\tau =0$, this is an ordinary differential equation with exponential decay $x(t)=x(0)e^{-kt}$. With $\tau >0$, it is a delay differential equation, requiring an initial history of delayed feedback. The delay stability of proportional integrator control depends on the product $k\tau$: even this simple controlled plant loses asymptotic stability at $k\tau =\pi /2$.

A plant input is a signal supplied to the controlled plant. The chosen plant input is its control input; other influences can enter as control disturbances. This use concerns a dynamical system, rather than the input of a computation.

Integral action adds memory of the tracking error to a controller: $z(t)=z(0)+{\int }_0^{t}e(s)ds$. A persistent tracking error keeps changing $z$, so an equilibrium point with constant $z$ must have $e=0$. The accumulated value can remain nonzero after the tracking error has vanished, maintaining the control input needed to cancel a constant control disturbance. Convergence still requires a stable feedback control design. ^[ref]

An open-loop control is prescribed as a function of time, possibly after calculation from an initial state and a dynamical model. It is executed without using observations of the actual current state to change the input. A simulated feedback control law can generate an open-loop waveform, but the resulting laboratory control does not automatically correct errors in the actual state or model.

For the ideal controlled plant with $w=0$, plan the control inputIntegration gives $x(t)=\min (t,1)$, so the planned command reaches the reference signal $r=1$ at $t=1$. If an unplanned constant control disturbance $w=0.2$ begins at $t=2$, the same open-loop control gives $x(t)=1+0.2(t-2)$ for $t\ge 2$: $x(4)=1.4$ and $x(8)=2.2$. Knowing the nominal response did not provide a way to correct the actual plant output.

The controlled plant is the part of a control theory model that receives the control input and produces the plant output, including the mechanism that applies the command. The controller is specified separately. In the illustrative ordinary differential equation $\dot{x}=u+w$, the controlled plant accumulates the control input and control disturbance; it does not itself choose $u$.

Proportional control chooses a control input proportional to the current tracking error. For the ideal controlled plant and constant reference signal $r$, its ordinary differential equation is $\dot{x}=k(r-x)+w$. With $w=0$ and initial condition $x(0)=x_0$, the exact response isFor $r=1$, $x_0=0$ and $k=2$, this gives $x(1)=1-e^{-2}\simeq 0.864665$ and $x(2)=1-e^{-4}\simeq 0.981684$. To verify the formula, substitute it into the ordinary differential equation and check the initial condition; its decaying exponential function explains the approach to the goal.

With a constant control disturbance, setting $\dot{x}=0$ gives the equilibrium point $x_{\ast }=r+w/k$ and steady-state tracking error $e_{\ast }=-w/k$. For $w=0.2$, doubling the feedback gain from $k=2$ to $k=4$ reduces the offset from $0.1$ to $0.05$. This improvement is a statement about the ideal model: it neglects feedback delay and measurement noise, so it does not establish that arbitrarily large feedback gains are safe. ^[ref]

In the first diagram's switched control disturbance experiment, $k=2$ and $w=0.2$ from $t=2$ give, for $t\ge 2$,Thus $x(4)\simeq 1.097833$ and $x(8)\simeq 1.099999$. At the equilibrium point, the controller supplies $u=-0.2$ to cancel the control disturbance. Proportional control needs a nonzero tracking error to produce that persistent correction.

Proportional-integral control is the proportional and integral part of a PID controller, with the derivative term omitted. Proportional-integral control combines proportional control with integral action. For the ideal controlled plant, a constant reference signal, exact measurement and a constant control disturbance, the ordinary differential equations giveThe characteristic polynomial is ${\lambda }^2+k_p\lambda +k_i$. Positive $k_p$ and $k_i$ imply asymptotic stability of the equilibrium point: real roots of a polynomial have negative sum and positive product, hence are both negative; a nonreal complex conjugate pair has real part $-k_p/2<0$. This is a short stability check for this ideal controlled plant, rather than a rule for every dynamical system.

At the equilibrium point, $e_{\ast }=0$, $x_{\ast }=r$, and $z_{\ast }=-w/k_i$. For $w=0.2$ and $k_i=1$, the stored value $z_{\ast }=-0.2$ supplies $u_{\ast }=-0.2$ even though the tracking error is zero. This separates the eventual accuracy from the transient response: integral action cancels the lasting offset but can make the plant output pass beyond the goal. The authors discuss practical limits on integral action in Åström and Murray, Feedback Systems, Chapter 11.

For $k_p=2$, $k_i=1$, $x(0)=z(0)=0$ and $w=0$, the characteristic polynomial is $(\lambda +1{)}^2$. The initial conditions are $e(0)=1$ and $\dot{e}(0)=-2$, givingThe tracking error changes sign at $t=1$. Since $\dot{x}=(2-t)e^{-t}$, the largest plant output occurs at $t=2$ and is $1+e^{-2}\simeq 1.135335$, about $13.53\%$ above the reference signal.

For a separate comparison, start the control disturbance $w=0.2$ at $t=4$. For $t\ge 4$, write $s=t-4$. The exact responses areThe proportional control response tends to $1.1$, while the proportional-integral control response returns to $1$. At $t=8$, the values are approximately $1.099966$ and $1.017001$. The added term in the proportional-integral control response eventually vanishes, exposing how memory removes a constant control disturbance's lasting effect.

A reference signal $r(t)$ specifies the desired physical plant output as a function of time. A fixed reference signal is often called a setpoint; a changing reference signal describes a trajectory to follow. A reference signal is a goal, whereas the control input $u(t)$ is the command chosen to achieve that goal. ^[ref]

Asking for a temperature of $40{}^{\circ }\mathrm{C}$ does not specify a heater command of $40\%$: dimensional analysis distinguishes the units of these quantities. The reference signal and the measured output must describe the same quantity in the same coordinates before their difference can define a tracking error. An unconverted sensor readout cannot be subtracted directly from a desired temperature.

For example, let $y=T-T_0$ be temperature rise above a fixed ambient baseline $T_0$, and write the desired temperature as $T_d=T_0+r$. A Heaviside step function gives $r(t)=R$ for $t\ge 0$, with $r(t)=0$ before the change: the target rise becomes $R$ at once, although a physical controlled plant generally cannot jump at once. A ramp reference signal $r(t)=vt$ instead asks the temperature rise to increase at a fixed rate $v$. If $R=1{}^{\circ }\mathrm{C}$ and $v=0.2{}^{\circ }\mathrm{C}{\mathrm{s}}^{-1}$, the first reference signal asks for a lasting one-degree rise; the second asks for a one-degree rise at $t=5\mathrm{s}$ and a two-degree rise at $t=10\mathrm{s}$. Here degree Celsius differences are also kelvin differences. A target that grows forever is useful for analytical tests but eventually exceeds a real heater's range.

To make the distinction between a goal and a command concrete, the examples in steady-state tracking error use the first-order low-pass filter as a new controlled plant, rather than the accumulating controlled plant $\dot{x}=u+w$ used in the earlier feedback demonstration:The time constant $\tau$ has units of time, $K$ has units of plant output per control input, and the additive control disturbance $d$ has the units of $y$. This $d$ is an equivalent output offset, not the rate-like $w$ in $\dot{x}=u+w$. A heater interpretation uses $y$ in degree Celsius differences and $u$ in percentage points of heater command, with $K$ in degrees per percentage point; the control input is a command, not a direct measurement of delivered power. With exact measurement, holding $y=R$ requires $u=(R-d)/K$. Thus even a constant reference signal can require a persistent nonzero control input. The numerical model below is deliberately synthetic and has no fitted laboratory parameters.

The steady-state tracking error iswhen this finite limit exists. A finite steady-state tracking error does not require the reference signal, the plant output, or the control input to become constant: all can grow while their difference settles. If the tracking error grows without bound or keeps oscillating, report that behavior rather than assigning a finite steady-state tracking error. Eventual accuracy and asymptotic stability are different questions.

For the first-order low-pass filter $\tau \dot{y}+y=Ku+d$ introduced in reference signal, assume exact measurement, constant control disturbance $d$, and no actuator saturation or feedback delay. Under proportional control $u=k_p(r-y)$ with $k_p>0$, a constant reference signal $r=R$ givesThe decaying homogeneous solution has rate $(1+K{k}_p)/\tau >0$, so this equilibrium point is approached from any finite initial condition. A nonzero tracking error is needed to maintain the control input that balances the model's tendency to relax toward $y=d$. This differs from the accumulating controlled plant $\dot{x}=u+w$, for which proportional control already tracks a constant reference signal exactly when $w=0$. The presence or absence of a step offset depends on both the controlled plant and the controller.

For a ramp reference signal $r=vt$, the same proportional control givesIts long-time particular solution grows with slope $v/(1+K{k}_p)$ when $v\ne 0$. Thus the controlled plant and homogeneous closed-loop response are stable, but the tracking error has no finite steady-state tracking error. A changing goal requires a different performance test from a fixed destination.

Now use proportional-integral control $u=k_{p}e+k_{i}z$, $\dot{z}=e$, with $k_i>0$. For the same controlled plant, differentiate the error equation on intervals where the inputs are smooth:The characteristic polynomial $\tau {\lambda }^2+(1+K{k}_p)\lambda +K{k}_i$ has both roots of a polynomial in the open left half-plane: real roots have negative sum and positive product, and a nonreal complex conjugate pair has negative real part. This proves decay of the homogeneous error for this model. It does not prove stability of an arbitrary controlled plant controlled by positive gains. At a reference jump, use the original ordinary differential equations to set the new initial conditions, rather than treating the reference as smooth at that jump.

With a constant reference signal and constant control disturbance, proportional-integral control therefore gives $e_{\mathrm{ss}}=0$. At its equilibrium point, $y_{\ast }=R$, $u_{\ast }=(R-d)/K$, and $z_{\ast }=(R-d)/(K{k}_i)$. The stored integral maintains the required command while the current tracking error vanishes. For a ramp reference signal, however, the forcing above is $v$, andThe tracking error settles even though the accumulated integral and the required control input grow. This finite offset is the error needed to keep increasing that command. For $r=a{t}^2/2$ with $a\ne 0$, the forcing is $\tau a+at$ and even this proportional-integral control leaves a tracking error growing with slope $a/(K{k}_i)$. Integral action is therefore a precise mechanism for selected input classes, not a promise of perfect tracking for every reference signal. ^[ref]

Here are completely explicit synthetic examples with $y(0)=z(0)=0$, $d=0$, and no sensor bias. Choose $\tau =2\mathrm{s}$, $K=1{}^{\circ }\mathrm{C}$ per percentage point, $k_p=1$ percentage point per degree, and $k_i=0.5$ percentage points per degree-second. Thus $K{k}_p=1$ is dimensionless, and $K{k}_i=0.5{\mathrm{s}}^{-1}$. In the following formulas, $t$ denotes the numerical time in seconds and $y,e,r$ denote numerical temperature rises in degrees. For the unit-step reference signal $r=1$, proportional control and proportional-integral control respectively giveFor the ramp reference signal $r=0.2t$, the corresponding solutions areThe control inputs here are numerical heater-command percentage points. Substitution into $2\dot{y}+y=u$ and into the controller equations checks these solutions without invoking an unverified limiting rule. The proportional control step offset is $0.5$ degrees; the proportional-integral control step offset is zero. The proportional control ramp error grows; the proportional-integral control ramp offset is $0.4$ degrees, exactly $v/(K{k}_i)$.

The conclusions have specific limits. With constant sensor bias $b$, stable proportional-integral control for a feasible constant reference signal drives the measured tracking error to zero but leaves the physical discrepancy ${\epsilon }_{\mathrm{ss}}=b$. Under proportional control, the measured offset instead becomes $(R-b-d)/(1+K{k}_p)$. If actuator saturation prevents the required control input, zero step offset is not achievable by these formulas. A changing control disturbance contributes $-\dot{d}$ to the error equation, while feedback delay can change stability; neither is covered by the constant-disturbance result. These restrictions are what make steady-state tracking error useful: it identifies the input, measurement convention, and model for which an accuracy claim is actually justified.

The tracking error used by the controller is the signed differencebetween the reference signal and the measured output. A positive tracking error means the readout is below the desired value; a negative tracking error means it is above. With exact measurement $y_m=y$, $r=1$ and $y=1.1$ give $e=-0.1$. For a positive-response controlled plant, positive feedback gain in proportional control $u=k_{p}e$ then reduces the plant output. The sign of the controller must also account for the sign of the controlled plant's response: a positive command that reduces the plant output requires a different sign choice. Kantor uses the opposite tracking error convention, $PV-SP$, together with a minus sign in his controller; translating both signs gives the convention here. ^[ref]

Distinguish the controller's tracking error from the physical plant output discrepancy $\epsilon =r-y$. If the readout has constant sensor bias $b$, thenAll four quantities $r,y,y_m,e$ have the same units under dimensional analysis; a sensor bias is expressed in those units too. A readout that is too high by $0.2{}^{\circ }\mathrm{C}$ can make $e=0$ when the physical temperature is $0.2{}^{\circ }\mathrm{C}$ below the goal. Integral action integrates the tracking error it receives; it cannot infer this missing calibration information from that tracking error alone. Thermometer calibration against an independent reference addresses a different problem from tuning a feedback gain.

A motivating apparatus/model comparison is Park, Martin, Kelly and Hedengren's temperature-control laboratory: two TIP31C heaters with attached TMP36GZ sensors and heat sinks, an Arduino, a power supply, and a USB-connected computer. The readout converts sensor voltage to temperature; software records that measured output while specifying heater commands from $0$ to $100\%$. For the single-heater test, one command changes in steps and the other heater stays off. Parameters are fitted to one run, then a different command sequence tests predictions without feeding measured temperatures into the simulation. The authors observe that their richer thermal model predicts the response better than the approximation with a single time constant and a delayed control input, especially after command changes. The real sensor has its own thermal lag. They also repeat the same command profile at different ambient temperatures and find changes in the response, motivating ambient-condition reporting. This experiment measures a command-to-readout response, not independently the exact heater temperature or delivered power. ^[ref]

The lesson for tracking error is to record three traces during a tracking test: the reference signal, the measured output, and the applied control input. Their first difference is the tracking error; a model prediction minus a readout is instead a model discrepancy. In a proposed comparison of proportional control and proportional-integral control, keep the initial temperature, ambient conditions, heater limits, and target changes fixed; run the second heater separately as a known control disturbance. Independent thermometer calibration is needed to assess physical accuracy. These are suggested controls, not additional experiments claimed for the paper. A sensor's lag, measurement noise, actuator saturation, and changed ambient conditions can all invalidate conclusions drawn from the ideal first-order model.