Planar rotation as a one-parameter subgroup 2026-10-14
Differentiate the planar rotation matrix at angle zero:The even and odd powers in the matrix exponential therefore giveThis exact formula gives the whole one-parameter subgroup. Taking means unit angular velocity: at , sends to , a counterclockwise quarter-turn. At , it equals ; at , it returns to . Choosing reaches the quarter-turn at . Changing the generator changes the speed, while preserving the circular path.
For a moving vector , the ordinary differential equation says its velocity is perpendicular to its position. The beautiful compression is that one constant matrix specifies every angle of this endless family of rotations.
Plant (control theory) 2026-10-13
The controlled plant is the part of a control theory model that receives the control input and produces the plant output, including the mechanism that applies the command. The controller is specified separately. In the illustrative ordinary differential equation , the controlled plant accumulates the control input and control disturbance; it does not itself choose .
Multiply the ordinary differential equation by and integrate. A solution approaching the positive equilibrium has : this follows from the equation and convergence of , since a nonzero limiting derivative or energy would preclude convergence. Its first integral is thereforeThe branch tending to at positive infinity obeys . Separation yieldsThe constant solution is . For this is a translated hyperbolic tangent; for it is a regular hyperbolic cotangent branch on . The condition excludes both an interior pole and a divergent value at the finite endpoint. The opposite sign in the first integral moves away from the positive equilibrium as increases, except at the constant solution.
A useful integral consequence isIndeed the integrand is , the negative of times the derivative of . An integral deficit can therefore fix the translation parameter uniquely, even when the differential equation and far value leave it free.
Proportional control 2026-10-14
Proportional control chooses a control input proportional to the current tracking error. For the ideal controlled plant and constant reference signal , its ordinary differential equation is . With and initial condition , the exact response isFor , and , this gives and . To verify the formula, substitute it into the ordinary differential equation and check the initial condition; its decaying exponential function explains the approach to the goal.
With a constant control disturbance, setting gives the equilibrium point and steady-state tracking error . For , doubling the feedback gain from to reduces the offset from to . This improvement is a statement about the ideal model: it neglects feedback delay and measurement noise, so it does not establish that arbitrarily large feedback gains are safe. [ref]
https://www.fbswiki.org/wiki/index.php/Introduction. Åström and Murray, Chapter 1: feedback benefits and drawbacks
In the first diagram's switched control disturbance experiment, and from give, for ,Thus and . At the equilibrium point, the controller supplies to cancel the control disturbance. Proportional control needs a nonzero tracking error to produce that persistent correction.
Proportional-integral control 2026-10-14
Proportional-integral control is the proportional and integral part of a PID controller, with the derivative term omitted. Proportional-integral control combines proportional control with integral action. For the ideal controlled plant, a constant reference signal, exact measurement and a constant control disturbance, the ordinary differential equations giveThe characteristic polynomial is . Positive and imply asymptotic stability of the equilibrium point: real roots of a polynomial have negative sum and positive product, hence are both negative; a nonreal complex conjugate pair has real part . This is a short stability check for this ideal controlled plant, rather than a rule for every dynamical system.
At the equilibrium point, , , and . For and , the stored value supplies even though the tracking error is zero. This separates the eventual accuracy from the transient response: integral action cancels the lasting offset but can make the plant output pass beyond the goal. The authors discuss practical limits on integral action in Åström and Murray, Feedback Systems, Chapter 11.
For , , and , the characteristic polynomial is . The initial conditions are and , givingThe tracking error changes sign at . Since , the largest plant output occurs at and is , about above the reference signal.
For a separate comparison, start the control disturbance at . For , write . The exact responses areThe proportional control response tends to , while the proportional-integral control response returns to . At , the values are approximately and . The added term in the proportional-integral control response eventually vanishes, exposing how memory removes a constant control disturbance's lasting effect.
Proportional control and integral action: arrival and disturbance rejection
. Left: the ideal controlled plant has reference signal and no control disturbance; proportional-integral control reaches a peak at . Right: a control disturbance begins at ; proportional control settles at , while proportional-integral control returns to . The generator uses the classical fourth-order Runge-Kutta method with step , splits the computation at , and checks both full responses and the stored memory against their exact formulas. All coordinates are dimensionless quantities. Details. Rate equation 2026-10-14
A reaction-rate equation is an ordinary differential equation for continuously varying species concentrations. Under the law of mass action, its reaction rates are monomials in those concentrations.
RC low-pass filter 2026-10-18
An RC low-pass filter places a resistor between input and output, with a capacitor from output to their common return. The ideal model prescribes the input electric potential difference and leaves the output unloaded. It is a first-order low-pass filter with unit eventual gain.[ref]
Lab 3: Filters by University of Colorado Boulder, Physics Undergraduate Labs. Lab 3: Filters, §5.4: RC topology and voltage transfer
For electrical resistance and capacitance , Ohm's law gives the electric current through the resistor as . The capacitor relation gives . Equating them by Kirchhoff's current law yields the ordinary differential equationThe time constant has units of time. A rapid change in electric potential difference requires a large electric current into the capacitor; the finite electrical resistance limits that rate. A slowly maintained voltage instead lets the capacitor approach the input voltage. The same equation therefore predicts both smoothing of sustained oscillations and a rounded response to a sudden change.
Reachability in control theory 2026-10-13
Reachability in control theory asks about a particular initial state and target : does some admissible control input make at the declared time , or at some allowed duration? Controllability requires this for every pair in the declared state space. This is a property of state evolution, distinct from graph reachability.
For a linear time-invariant system, solving the ordinary differential equation by a matrix exponential givesThe first term is the unforced endpoint. Reachability in control theory asks whether the control input can supply exactly the displacement . The timing matters because the same command is carried by different amounts of subsequent dynamics. [ref]
https://ee263.stanford.edu/archive/contr.pdf. Stephen Boyd, EE263: Controllability and state transfer, slide 18–3
Here is a contrasting mathematical example with one shared control input:The controllability matrix has rank of a matrix one. Since , the difference is invariant under every allowed control input. From the reachable set is the diagonal when input amplitudes are unrestricted: is reachable at using , while is impossible at every duration. Having a control input appear in both state equations did not give independent control of both states. This reachable set is pictured alongside the bounded double integrator below.
Recovery time of a stable equilibrium Created 2026-10-25 Updated 2026-10-31
For a scalar ordinary differential equation and an equilibrium point with , the linearization gives . Thus small perturbations decay like with . This is a local exponential recovery time. In several dimensions, the slowest decaying stable eigenvalue typically controls asymptotic recovery, subject to additional polynomial factors for nontrivial Jordan blocks.
Replicator equation Created 2026-10-14 Updated 2026-10-20
The replicator equation says that a strategy grows in frequency when its expected payoff exceeds the population's current mean payoff. It is an ordinary differential equation for a composition, rather than for total population size. The subtraction of the mean is what makes relative success matter: even a type growing in absolute number can shrink as a fraction if other types grow faster.
Let be the frequency of pure strategy , with available pure strategies andIn a symmetric bimatrix game, let the payoff matrix have entry equal to the payoff to strategy against . The other player's payoff in that encounter is : symmetry between player roles does not require . Uniform random encounters give the expected payoffs and their population meanAfter choosing the time unit so that the growth-rate scale is one, the continuous-time replicator equation isHere a payoff is measured on a scale proportional to net growth per unit time, not merely as an arbitrary preference ranking. More generally one can specify locally Lipschitz frequency-dependent payoffs directly; the same equation with then defines a unique frequency trajectory. The linear pairwise model and its reproductive interpretation are given in Taylor and Jonker (1978), sections 2–3; the formulas here also follow by the following direct normalization.
Suppose the number of type obeys , where the baseline is identical for all types. Set and . The quotient rule givesThus the common baseline cancels. Adding the same constant to every entry of leaves the replicator equation unchanged; multiplying by a positive constant changes only the speed along trajectories. The same payoff matrix can therefore describe frequency evolution at different growth-rate baselines and time scales.
The probability simplex is invariant in forward time. On ,Normalization alone would not exclude negative frequencies. Nonnegativity follows as well: along a solution,An absent type remains absent, and a positive frequency remains positive at every finite time. For the fixed payoff matrix model, bounded rates on the compact probability simplex give global forward solutions. Frequencies can still tend to zero as . Each face is invariant, so this model has no spontaneous introduction of new pure strategies; mutation or outside introductions would require additional terms. For two present types the logarithm of their frequency ratio satisfies , directly expressing the accumulated payoff advantage.
For two pure strategies, write the composition as , where is the frequency of strategy 1, and letTheir payoff difference and the resulting scalar ordinary differential equation areIn the interior , the sign of the payoff difference determines the direction of motion. The endpoints are always equilibrium points, and an additional interior equilibrium point exists precisely when the affine payoff difference has a zero strictly between them. At a simple interior zero , : a negative value gives asymptotic stability, a positive value gives instability. At the endpoints and , with stability understood relative to . A zero derivative requires examining the actual flow rather than this strict sign test.
For an original coordination game, imagine two conventions that reward matching, with convention 1 giving the larger matching reward. ChooseThe crossing is . Below it, convention 1 loses frequency; above it, convention 1 gains frequency. The endpoint equilibrium points and have one-sided asymptotic stability, while is unstable: the corresponding derivatives are and , respectively. Every initial tends to , every initial tends to , and exactly stays there. Even the convention with the larger matching reward can disappear if it starts below the threshold. This is bistability, not selection of a universally best convention.
Toy coordination model: an unstable frequency threshold separates attraction to the two pure conventions
. Details. The compositions giving a symmetric Nash equilibrium in this coordination game are the two pure conventions and the mixed composition . Both pure conventions are evolutionarily stable strategies because a mutant convention has strictly lower payoff against the pure resident. The mixed symmetric Nash equilibrium is not an evolutionarily stable strategy: against that resident both conventions tie, but after a pure convention-1 mutant is introduced its payoff advantage is . Equal payoffs at a symmetric Nash equilibrium need not provide resistance to invasion or asymptotic stability.
For an original coexistence model, choose payoffs making each convention advantageous when sufficiently rare:Here attracts every initial composition with both types present: below it and above it. The interior derivative is , while and make both endpoints unstable to introduction of the other type. The endpoints nevertheless remain stationary if the other type is exactly absent; the attraction statement excludes those boundary initial states.
Toy coexistence model: both rare types can invade, and every interior composition approaches frequency three quarters
. Details. The sole symmetric Nash equilibrium in this coexistence model is . It is also an evolutionarily stable strategy. For any different mixed strategy , the first comparison in the two-condition criterion for evolutionary stability ties because . Its second comparison is strictly positive:Thus restoring frequency feedback can protect a mixture even though all present types earn equal payoffs at the mixture. Coexistence here means different individuals using different pure strategies; it does not require every individual to randomize with a mixed strategy.
Frequency evolution need not increase the mean payoff. In the coexistence example , whose maximum occurs at , whereas the attracting composition is . For , the frequency increases while . Individual payoff advantages drive the equation; maximizing collective mean payoff is a different optimization problem.
More generally, a rest point only equalizes payoffs among present types: implies . A symmetric Nash equilibrium additionally requires for every absent type. All vertices are rest points even when an absent type could invade. For finite symmetric bimatrix games, a rest point with Lyapunov stability on the full probability simplex is a symmetric Nash equilibrium; an interior trajectory that converges has a symmetric Nash equilibrium as its limit. These are conditional results, not a convergence theorem for every trajectory. See Cressman and Tao (2014), Theorem 1.
The rock paper scissors payoff matrix gives an explicit obstruction to universal convergence:Since , , and in the interior . Thus is conserved. Its maximum on the probability simplex occurs only at , the unique symmetric Nash equilibrium, so an interior trajectory starting elsewhere cannot converge to that composition. Every other interior product level is a closed curve without a rest point, giving a periodic orbit. The existence of these cycles is also discussed in Cressman and Tao (2014), Example 1. The useful lesson is to inspect the specified payoff feedback and dynamical system, rather than infer convergence from the existence of an evolutionarily stable strategy or a Nash equilibrium.
Retarded delay differential equation Created 2026-10-18 Updated 2026-10-31
For a single constant delay , a retarded delay differential equation has the displayed form: delayed values of the unknown function enter, but delayed first derivatives do not. The unknown can also be a vector.[ref]
Delay-differential equations by Skip Thompson. Skip Thompson, Delay-differential equations, opening definition and equation (1): delayed values versus delayed derivatives
Here denotes time, and the rule applies for , with a right derivative at . On , the argument lies in the prescribed past. Once this interval is known, it supplies the delayed values for . This is the method of steps for a delay differential equation: solve successive ordinary differential equations with a known delayed input, keeping each new endpoint as the next initial condition. For a continuous function locally Lipschitz continuous in its two state arguments, locally uniformly in , this gives local existence and uniqueness for each continuous history function of a delay differential equation, while the solution of a differential equation remains in the domain of . A nonlinear rule can still produce finite-time blowup.
Reversible receptor phosphorylation model 2026-10-14
Protein kinase activity adds modification, while protein tyrosine phosphatase activity can remove it. An original one-site model shows why a receptor phosphorylation assay cannot determine either process from a single modified fraction. Let be the fraction of a fixed receptor population carrying one selected phosphotyrosine residue. Stipulate constant effective first-order rate constants , with ATP availability absorbed into , and no receptor synthesis, degradation or trafficking:Here is the steady state fraction and the time constant. The ordinary differential equation has the exponential function solutionThe balance equation and a single relaxation step give this result; it is an illustrative model, rather than a fit or a claim about every RTK.
With stipulated rate constants , and . Doubling both rate constants leaves but changes to . The balanced phosphate turnover per site,doubles from to . Identical steady state modification therefore permits different catalytic fluxes. Removing the addition term instead gives ; this illustrates why a perturbation that stops protein kinase activity can expose removal dynamics, subject to the model's unchanged-removal assumption. A maintained steady state with ongoing ATP consumption is not chemical equilibrium.
Riccati moment-explosion horizon 2026-10-07
The maximal time on which the coefficient solution of the exponential-quadratic transform stays finite. For , , the solution is and explodes at . Thus local solvability of the coefficient ordinary differential equations does not imply an unrestricted global moment formula. For payoff exponent , the Riccati forcing is nonpositive and a negative equilibrium bounds the solution.
Richardson extrapolation 2026-10-14
Richardson extrapolation improves an approximation by combining two resolutions so that their leading truncation errors cancel. The useful surprise is that the size of that leading error need not be known: its scaling under refinement is enough. This lets an existing finite difference method or quadrature rule produce a more accurate answer from two runs, without first deriving a new method from scratch.
Suppose approximates a fixed limit as the positive resolution parameter tends to zero, with an asymptotic expansionHere is known, is independent of , and denotes Big O notation. The same asymptotic expansion, with the same , must describe both and . Nested grids make it natural to reuse samples, although nesting itself does not establish this error model. Define the linear combinationThe weights sum to one, preserving , while . Thus Richardson extrapolation gives : the next available term in the asymptotic expansion determines the improved order. Justin Solomon's numerical analysis text develops this cancellation for finite differences and applies it to numerical integration.[ref]
https://people.csail.mit.edu/jsolomon/share/book/numerical_book.pdf. Justin Solomon, Numerical Algorithms, §14.3.3 and Exercise 14.9
Geometrically, regard the approximation as a function of . Its first two terms are a straight line . The two computed points lie at positive ; extending the line through them to gives . This is why the operation is extrapolation: it estimates a value outside the sampled parameter interval. The remaining curvature corresponds to the uncancelled terms of the asymptotic expansion.
Worked example: a centered derivative of sine. For the smooth function , the exact derivative at is . The centered difference quotient, a central finite difference, isThe Taylor series of sine gives the signed truncation errorThus , and . Halving divides the leading truncation error by four. Combining the two centered difference quotients with Richardson extrapolation givesIndeed, the coefficient becomes ; the coefficient vanishes. This is the even-power case of Richardson extrapolation discussed in Persson's authored lecture notes.[ref]
https://persson.berkeley.edu/math128a/lecture_notes/math128a_lecture_notes_chapter_4.html. Per-Olof Persson, Math 128A, Chapter 4, §§4.1–4.2
For and , the actual computations areThe absolute error drops from about for to for , an improvement by roughly a factor of 498. Refining again gives , whose absolute error is about . The refined truncation errors decrease by nearly four for and nearly sixteen for , reflecting their second and fourth orders.
Centered sine derivative errors: second order before Richardson extrapolation and fourth order after cancellation
. Source. Details. The logarithmic scale on each axis turns power laws into straight lines. The dashed reference curves are and , the magnitudes of the leading truncation errors. The plotted errors are computed with 70-digit decimal arithmetic, rather than clipped to a display floor; this isolates the asymptotic expansion from roundoff error.
Worked example: integrating an exponential. Approximate the definite integral of the exponential function on :For numerical integration, the composite trapezoidal rule adds the areas of trapezoids between successive samples; this is the quadrature use of the endpoint average that also occurs in the ODE trapezoidal rule. On equal intervals, with , defineSumming the geometric series gives . Expanding the exponential function near zero yieldsThe leading truncation error again has , . On the uniform nested grids with and intervals, Richardson extrapolation therefore givesThis linear combination is exactly composite Simpson's rule on the finer grid, whose spacing is . On each coarse panel, an old endpoint receives weight and the new midpoint weight ; shared old endpoints receive weight . These are the usual Simpson's rule weights multiplied by . The equivalence is explained directly in LeMesurier's university notes.[ref]
https://lemesurierb.people.charleston.edu/elementary-numerical-analysis-python/notebooks/definite-integrals-3-simpson-richardson.html. Brenton LeMesurier, MATH 375, §19.1: The Basic Simpson's Rule by Richardson Extrapolation
For two coarse panels and four fine panels,The absolute errors are about , and , respectively. Reusing the fine-grid samples makes Richardson extrapolation especially attractive here: the resulting Simpson's rule needs no samples beyond those already used by .
Exponential quadrature on nested grids: trapezoidal areas, reused sample nodes, and the fourth-order Simpson combination
. Source. Details. When the improvement is justified. Richardson extrapolation requires the stated asymptotic expansion and the correct positive . If the actual leading exponent is , its coefficient after combination is , so the leading truncation error generally remains. Merely knowing does not supply a common coefficient or a higher-order remainder. A discontinuity of a function, a singular endpoint, or unrelated changes between grids can invalidate the assumed asymptotic expansion; refinement alone does not guarantee improvement for every numerical problem.
Roundoff error and errors in the sampled values survive the cancellation of truncation error. If the coarse and fine values have absolute perturbations bounded by , the perturbation in is bounded by ; for this is . In floating-point arithmetic, a centered difference quotient can also amplify sample errors through division by , so an indefinitely smaller need not be more accurate. Persson's notes describe this balance between truncation error and roundoff error.[ref]
https://persson.berkeley.edu/math128a/lecture_notes/math128a_lecture_notes_chapter_4.html. Per-Olof Persson, Math 128A, Chapter 4, §4.1: Roundoff Error Instability
The same cancellation idea appears in step-doubling error estimation. For an order- one-step method for an ordinary differential equation, two half steps each contribute local truncation error of order , so their accumulated leading local error has ratio to one full step. This explains the denominator there; the appropriate exponent follows from that local error model, rather than automatically from a generic use of Richardson extrapolation.
Riemann's differential equation 2026-10-14
Riemann's differential equation is a second-order ordinary differential equation with three regular singular points, normalized to zero, one and infinity by a Möbius transformation. Its local characteristic exponents are encoded by the Papperitz symbol and constrained by the Fuchs relation.
Rough differential equation 2026-10-14
A rough differential equation interprets a differential equation using the higher-order data of its driving rough path. For , its local expansion includes , with a remainder controlled at order greater than one. For a smooth driver it is the usual controlled ordinary differential equation; for enhanced Brownian motion it is the corresponding Stratonovich equation.
Runge-Kutta method Created 2026-09-24 Updated 2026-10-31
A Runge-Kutta method advances an initial value problem , , by sampling its vector field at several trial states within one time step. These samples are Runge-Kutta stages; a weighted combination of their slopes produces the next state. The construction improves on the single tangent line used by the Euler method while requiring evaluations of , rather than explicit higher derivatives of the solution. It applies to scalar equations and systems of ordinary differential equations alike. The coefficient choices distinguish methods such as Heun's method, the classical fourth-order Runge-Kutta method and implicit Runge-Kutta methods.
For stages, write for the stage matrix, for relative time nodes and for output weights. A time step of length computesHere is a slope, with units of state per time; is a state increment. Another common convention writes , so its stage states are and its output is . These are equivalent conventions: including both inside and again in the output would count the time step twice. The textbook formulation uses the increment convention.[ref]
6.4 Runge-Kutta methods. Fundamentals of Numerical Computation, §6.4.3, equations 6.4.10–6.4.11: multistage recipe and tableau
Usually the Butcher tableau obeys , called internal consistency. Stage then combines slopes over an effective time . The second-order conditions with independent Runge-Kutta abscissae explain what changes when time nodes are specified independently. A Runge-Kutta stage is generally an auxiliary approximation, not a separate accepted solution value at its node. Several stages can even have the same time node but different state arguments, as in the classical fourth-order Runge-Kutta method.
The useful idea is to approximate the integral without knowing the intermediate exact trajectory. Trial states provide places to sample , and Butcher order conditions make the resulting combination agree with the exact Taylor expansion. More stages alone do not guarantee a higher order of a numerical method: their coefficients must satisfy the appropriate conditions. Embedded Runge-Kutta pairs reuse these same samples for a second output and a practical local error estimator.
Saturating positive feedback Created 2026-10-14 Updated 2026-10-20
Saturating positive feedback limits the reinforcing rate as activity increases. Here is an explicitly synthetic ordinary differential equation for normalized nonnegative input , response , and return strength :The return is an increasing, nonproportional function of , while removal is proportional to . Time and activities are dimensionless variables. At the vector field points into the nonnegative domain, and prevents unbounded growth there. This makes the toy useful for asking about a bounded switch; it supplies no molecular mechanism for the chosen rate law.
At an equilibrium point, . For a simple equilibrium point, the sign of the derivativedetermines local asymptotic stability. If , the maximum reinforcing slope is , so decreases strictly: every has one asymptotically stable equilibrium point despite positive feedback.
Three equilibrium points become possible only if the reinforcing slope exceeds removal's slope somewhere. Its maximum is , at . Consequently this toy requiresfor two distinct folds. This is a necessary threshold for a bistability interval in this toy, not a universal biochemical number. At a fold, both and , givingFor , the folds are at and . Between these input values there are two asymptotically stable equilibrium points separated by an unstable one. At , the three activities are approximately , and ; the low and high ones are stable.
A sufficiently slow increasing sweep follows the low branch to and then jumps upward. A decreasing sweep follows the high branch to and then jumps downward: hysteresis. These are limiting quasistatic thresholds, with relaxation between input changes and negligible perturbations that could cause earlier switching. Finite sweep rates and fluctuations can alter observed thresholds. A switchlike response with only one stable equilibrium point does not have this equilibrium hysteresis mechanism.
Scalar wave separation in Kerr spacetime Created 2026-10-06 Updated 2026-10-07
For the massless Klein-Gordon equation on a Kerr black hole, the covariant wave operator separates into radial and angular ordinary differential equations. With and angular separation constant , the radial equation is . The angular equation is . No extra radial factor is included in the displayed ansatz.
Second-order differential equation 2026-10-14
A second-order ordinary differential equation involves a second derivative as its highest derivative. In explicit form , introducing converts it into the first-order system , . Under local regularity and Lipschitz continuity in the dependent variables, an initial value problem is specified by both and . The linear case is a second-order linear differential equation.






