The order- B-splines active on a simple-knot cell form a basis of its degree- polynomials. To see this from Marsden's identity, use the dual polynomials . On the identity is . Evaluation of the dual polynomials at gives a triangular coefficient matrix with nonzero diagonal. They are independent, and comparison of coefficients of in the identity gives independence of the active splines. Consequently a spline vanishes on a whole open cell exactly when all its active coefficients vanish.
Matrix similarity invariants Created 2026-10-14 Updated 2026-10-25
Matrix similarity invariants are quantities unchanged by replacing with . Important examples are the characteristic polynomial, trace, determinant, matrix rank, and eigenvalues with their algebraic multiplicities. The characteristic polynomial convention here is , where is the identity matrix.[ref]
The short determinant proof works over any field: because , multiplicativity of the determinant gives
Thus its roots, the eigenvalues, retain their algebraic multiplicities in any field extension where the polynomial splits. Also . The cyclic property of the trace gives ; equivalently, the trace is determined by the coefficient of in the characteristic polynomial for an -by- matrix.[ref]
For the two matrices in the opening example,
Their entries differ, yet these quantities agree. Agreement is a useful necessary test for matrix similarity; it is not sufficient in general, as same eigenvalues do not imply similarity illustrates.
The relation also preserves repeated application. Adjacent factors cancel to give
For the opening example, matrix powers therefore have the explicit form
At , this is . Acting on gives , which reconstructs as . More generally for every polynomial , so the minimal polynomial is also unchanged. Multiplication by invertible matrices preserves matrix rank, giving another invariant without finding eigenvalues.
Modified Gram-Schmidt 2026-10-14
Modified Gram-Schmidt starts with and, for each retained orthonormal vector in order, replaces by . Each orthogonal projection coefficient uses the current remainder. In exact arithmetic, subtracting earlier orthogonal directions does not change the inner product with , so the final equals the Classical Gram-Schmidt remainder ; then divide by if it is nonzero.
Newton polynomial Created 2026-10-14 Updated 2026-10-18
The Newton polynomial expresses the interpolation polynomial in products that successively vanish at all previously used interpolation nodes. With , the coefficients are divided differences:
A triangular divided difference table computes all its coefficients using exactly divisions. The Newton polynomial and the Lagrange polynomial have the same polynomial degree bound and the same nodal values, hence are equal by uniqueness of polynomial interpolation.
For , , , the complete divided difference table is
The first divided differences are and , and their divided difference is . Reading the top entries gives
The initial term fits ; adding also fits ; adding fits while leaving the first two data values unchanged. This is the practical beauty of the Newton polynomial: each new correction respects all previous interpolation constraints.
If a new distinct interpolation node with value arrives, append one term:
For example, appending to the three-point data gives , hence . Changing the order of the interpolation nodes changes the Newton polynomial coefficients and products, but not the final interpolation polynomial in exact arithmetic.
The products also permit nested evaluation analogous to Horner's method. If , start with and work backwards by ; the answer is . The three-point example becomes , needing two multiplications for each evaluation. This organization is useful when adding observations incrementally or evaluating a stored Newton polynomial many times; the Runge phenomenon still depends on the interpolation nodes rather than on which representation is used.
To justify the update formula, its added product vanishes at every previous interpolation node. Choosing by the new residual forces agreement at , so uniqueness of polynomial interpolation identifies the result. For , has polynomial degree at most , and the added product has leading coefficient one. Thus the new coefficient is exactly . The initial state is , with the empty product interpreted as one.[ref]
Appending to the four-point example in divided difference table leaves the Newton polynomial unchanged: , so the new fourth divided difference is zero. If the appended value is instead , the new coefficient is
This polynomial still takes values at the original interpolation nodes, and now takes value at . A zero update is a valid completed step: adding another exact sample of the original polynomial need not increase the polynomial degree.
Newton's identities 2026-10-14
Newton's identities let two different summaries of the same polynomial roots talk to each other. Elementary symmetric polynomials record products of distinct root positions; power sums record sums of individual powers, . Either can be easier to obtain in a particular problem. The identities turn one into the other, often avoiding any need to find the individual polynomial roots.
Write and for . For every positive integer , the identity is
It is a polynomial identity over the integers, so it remains true on substitution in any commutative ring. To solve it for by division, however, must have a multiplicative inverse. Over a field of characteristic zero, the first power sums recover every elementary symmetric polynomial. The same recovery works when the positive characteristic of a field is greater than ; small characteristic needs care.[ref]
The first three relations are , , and . When division by two and three is permitted, this becomes
For the three roots , their power sums are , , and . The formulas give and , recovering the polynomial from aggregate data.
Figure 1.
Three power sums reconstruct a cubic without assigning names to its roots
. Left: exact contributions of the stipulated roots to the first three power sums. Middle: Newton's identities recover , , . Right: the resulting monic polynomial has its three roots of a polynomial at the original values. These are algebraic examples, not inferred experimental data. Details.
The beauty is that the summaries do not depend on the order of the polynomial roots. In symmetric polynomials, one can work with quantities that survive every relabeling; in linear algebra, traces of matrix powers give the same kind of aggregate information about eigenvalues. The identities convert those summaries into coefficients of a characteristic polynomial.
A short derivation packages the identities into a formal power series. Let . Since its constant coefficient is one, it has an inverse as a formal power series, and its formal derivative satisfies
Multiply by and compare the coefficient of . This gives Newton's identities without a convergence assumption or division by . The division issue arises only when using them to recover . The logarithmic-derivative approach is also developed in Newton's Identities (January 2019 notes) by Milan Mossé (§4, pp. 6–8).
The alternate name Newton-Girard identities recalls Albert Girard's earlier work. A modern historical account credits formulas through sixth powers to Albert Girard in 1629 and discusses their later appearance in Isaac Newton's Arithmetica universalis.[ref] This citation refers to that account; the original historical editions have not been inspected here.
Nonlinear ordinary differential equation Created 2026-09-25 Updated 2026-10-14
A nonlinear ordinary differential equation depends nonlinearly on the unknown function or its derivatives: it cannot be written in the form defining a linear differential equation. For example, contains a square of the unknown function, and is a logistic differential equation. A coefficient such as depending only on the independent variable does not make an ordinary differential equation nonlinear. This distinction concerns dependence on the unknown, rather than the shape of its function graph.
For a concrete initial value problem, consider , . Its solution of a differential equation is
Taking its derivative gives , and evaluating at zero checks the initial condition. The stated interval contains zero and ends at finite-time blowup: tends to positive infinity as approaches from below. Increasing the positive initial condition brings finite-time blowup closer. This is a simple mathematical example with dimensionless and , rather than a calibrated physical model.
Choose and , giving and . At they have values and , so their sum has value . On the common interval , both are valid solutions of a differential equation, but their sum fails the same ordinary differential equation:
Already at , and its derivative is , whereas would require . At , the defect is . The cross term explains the failure of the superposition principle, even though each individual solution of a differential equation is a smooth function.
Figure 1.
Two solutions of a differential equation for have a sum with a nonzero defect
. Details.
The first panel shows , and their invalid sum only up to , before either finite-time blowup. The second measures the defect in the ordinary differential equation, including the computed value at . For a homogeneous linear differential equation, the corresponding defect of a sum is zero. Nonlinear ordinary differential equations can describe state-dependent growth such as the logistic differential equation, whose negative quadratic term limits growth instead of accelerating it without bound. Recognizing the distinction tells us when we may assemble solutions of a differential equation from simpler pieces and when we must account for their interaction. See MIT's worked counterexample to nonlinear superposition.
The equality holds when an alternating unit-norm spline has as many ordered extremal sites as the dimension, and those sites satisfy the Schoenberg–Whitney theorem. For every admissible set, sampling has operator norm at most one, giving . At the alternating sites the checkerboard inverse of a totally nonnegative matrix identifies each inverse absolute row sum with the magnitude of the corresponding coefficient of . The Chebyshev spline coefficient and dual norm equality therefore gives equality. This minimizes amplification into B-spline coefficients; it does not by itself prove optimality for the distinct Lebesgue constant of interpolation.
Optimal truncation Created 2026-10-06 Updated 2026-10-14
Optimal truncation chooses how many terms to retain for a useful finite approximation. In a divergent asymptotic expansion, increasing the truncation order eventually makes the terms larger rather than smaller. Stopping near a smallest term often gives the best direct approximation, but the actual remainder must be checked. A small last term alone is not a universal error bound.[ref]
For a divergent factorial series can approximate a convergent integral, decreases while and increases while . Thus the useful cutoff is near , rather than at arbitrarily large order. At , are the two smallest terms. Retaining terms gives
The actual error is about . Retaining twenty terms instead gives , with error about : more work produces a worse answer.
Figure 1.
A divergent asymptotic series has a useful stopping region
. Original numerical errors for and . Each partial sum is compared with an independent evaluation of the positive integral. The dots mark the smallest errors among the displayed orders; they are not a claim of a universal stopping theorem. Details.
For this example the bound is explicit, so a requested tolerance can be tested before using a truncation. For a different integral, a nearby saddle point or simple pole can change the relevant remainder scale. This is why the smallest-term rule is a useful guide, rather than a replacement for remainder analysis.
The cutoff for factorial terms has . Better analysis can expose contributions smaller than every retained inverse power, linking optimal truncation to the Stokes phenomenon. Such contributions can be important even when many asymptotic coefficients agree. Directly summing ever more terms does not automatically recover them.
For scalar coefficients, leading symbols commute. If and , their product has leading coefficient , and their commutator has coefficient at order . Thus product order is at most , with equality when is not identically zero; commutator order is at most , with equality when its displayed coefficient is not identically zero. Constant-coefficient operators commute. Nonzero smooth functions with disjoint supports show why product orders need not add over .
Orthogonal polynomial Created 2026-09-24 Updated 2026-10-18
An orthogonal polynomial family chooses polynomials that do not overlap under a specified inner product. For real polynomials on an interval , use the weighted inner product
Assume , the weight is measurable and positive almost everywhere, and its absolute moments are finite for every integer . These conditions make the integrals finite and give every nonzero polynomial positive squared norm. A sequence is an orthogonal polynomial family when has real coefficients and polynomial degree exactly , and for .[ref]
Here and is the Kronecker delta. Orthogonality does not require : an orthonormal set is obtained only after replacing by . Multiplying each member by any nonzero real constant preserves orthogonality, but changes its norm and the corresponding expansion coefficient. The monic orthogonal polynomial convention instead fixes each leading coefficient to one.
The first four Legendre polynomials, named for Adrien-Marie Legendre, use on and the normalization :
Their orthogonality and squared norms are
Thus their Gram matrix has a positive diagonal and zero entries elsewhere, although their function graphs cross and overlap on the page. Orthogonality measures an integral of products, rather than separation of function graphs.[ref]
Figure 1.
The first four Legendre polynomials and their exact integral Gram matrix: orthogonal, with unequal squared norms
. Details.
For these four polynomials, a short verification expands each product and uses and . For example, and . The same calculation gives the diagonal entries . More generally, apply the Gram-Schmidt process to the monomial basis : at step , subtract projections onto the earlier polynomials. The result retains its leading term, has degree , and has positive norm, proving existence without a differential equation. Different degrees also give linear independence, so form a basis of the polynomials of degree at most .
This basis turns least-squares solutions for functions into independent scalar calculations, as the decoupled coefficients of orthogonal polynomial projections show. In a spectral method, increasing the degree enlarges the approximation space while keeping earlier projection coefficients fixed. Weighted integrals also connect the same orthogonal polynomials to Gaussian quadrature: its nodes are polynomial roots of a member of the family. The projection problem minimizes an integrated squared error; Gaussian quadrature uses the family to choose evaluation points for an integral.
The Young diagrams of partitions in a rectangle with at most rows and at most cells in each row correspond to the lattice paths in the lattice-path interpretation of Gaussian binomial coefficients. Read the shaded row lengths from top to bottom; the result is a nonincreasing list of nonnegative integers. This bijection preserves the number of cells.
In a two-by-two rectangle, the possibilities are the empty integer partition, , , , , and . Their sizes are , giving . In particular, there are two allowed diagrams of size two, explaining the middle coefficient.[ref]
Pascal's triangle Created 2026-10-06 Updated 2026-10-18
Row of Pascal's triangle consists of the binomial coefficients , beginning with row . Boundary entries are one, and Pascal's identity says each interior entry is the sum of the two entries above it. The hockey-stick identity evaluates sums along its diagonals.
The highlighted entry in the binomial coefficient illustration is . Split two-person teams according to whether they contain the fifth person: six choose both members from the other four, and four contain the fifth person together with one of those four. Thus . All entries can be generated by the same local rule, so a large table of counts needs no repeated enumeration of its subsets.
Reading row seven. Label the entries in each row from on the left through on the right. Rows zero through seven are shown below. The highlighted entry comes from and . Starting with row zero , the edges remain one and Pascal's rule determines every interior entry, so mathematical induction uniquely determines the whole array.
Figure 1.
Rows zero through seven of Pascal's triangle, with
. The index increases from left to right in each row; it counts north steps in the north-east lattice path interpretation. Each row index counts all steps. Details.
The triangular and rectangular layouts describe the same entries. For a north-east lattice path ending at , set and , so . The predecessor has indices , while has indices . Thus the grid's west and south arrivals are exactly the triangle's two parents. This change of indices explains why the north-east lattice path recurrence and Pascal's rule agree.
There is also a global check on the local construction: row sums to . Every subset of an -element set appears exactly once among the classes of sizes , and each element has two inclusion choices by the rule of product. In row seven, . Replacing every subset by its complement reverses the row, explaining . The binomial theorem packages the whole row as the coefficients of .
Blaise Pascal's Traité du triangle arithmétique, published in 1665, presents an arithmetic array and connects it to combinations, games of chance, and powers of binomial expressions. This makes the connection between a counting table and several applications visible in the original work. [ref] The University of Cambridge's account of the treatise explains its 1654 composition and the organization of these applications. [ref]
On an interval with , use the power-law ansatz . Substitution gives , whose roots are . Taking real and imaginary parts of gives
These two real solutions are linearly independent: their Wronskian is . They therefore span the solution space of the second-order linear ordinary differential equation on that interval.
For , replace by and by , with independent real constants on the negative interval. This follows equally by the change of variable , which turns the Cauchy-Euler equation into . The coefficient of vanishes at zero, so the general formula is stated separately on either side. Every nonzero mode has an unbounded oscillatory envelope as ; a continuous extension through zero requires the solution to vanish identically on both sides.
Divide by away from zero to obtain , with and . At zero, the quantities and are analytic. The pole in makes zero singular, so is a regular singular point. Its indicial equation is
At , both normalized coefficients are analytic functions, so is an ordinary point. These are the standard normalized-coefficient and indicial tests.[ref]
For infinity, set and . The chain rule gives and , so the transformed normalized equation is
The product of the first-derivative coefficient with still has a second-order pole at zero. Hence the criterion for a regular singular point fails and is an irregular singular point, including when . The primes on here refer to differentiation with respect to .
Seek a Frobenius series , with , on the positive side of zero. The lowest coefficient gives the indicial equation from part (a); the next gives . For either permitted indicial exponent, . Matching the subsequent powers gives
The two indicial exponents differ by a noninteger, so there are two independent Frobenius solutions without a logarithmic companion. Normalizing each leading coefficient to one, their forms are
Thus the general local solution is . The endpoint condition at zero forces . For a nontrivial solution, , so and , with the arbitrary nonzero amplitude understood.
The condition at one selects values of for which this branch also vanishes there; it does not change the selected local exponent. The zero solution, available for every , has no nonzero leading coefficient and is excluded when asking for a leading exponent. This is a direct application of the Frobenius method and the noninteger-separated-root case.[ref]
First classify nonzero polynomial solutions of the differential equation itself. If has degree and leading coefficient , the coefficient of is . Hence is necessary.
An analytic solution at zero belongs to the exponent-zero Frobenius branch. Its odd-power coefficients vanish, because and the recurrence relation preserves parity. For the even-power coefficients,
All denominators are nonzero for . With , the coefficients through are nonzero when , the next coefficient vanishes, and every subsequent coefficient vanishes. This proves sufficiency as well as the restriction to even polynomial degree:
For example, setting gives when , when , and when . A polynomial cannot instead begin with a positive integer power: its lowest power must have an indicial exponent, and the only integer indicial exponent is zero. This also proves that no odd-degree family was missed. The finite-series mechanism is a terminating Frobenius series.
If the additional endpoint conditions from part (b) are imposed on this part too, there is no nonzero polynomial solution: every nonzero polynomial just classified has . The displayed family and degree answer therefore concern the differential equation without those extra endpoint conditions.
Take . A root on the smaller scale has , giving . Put . Successive coefficients give and , hence . The real root is therefore
The other dominant balance is between the cubic and linear terms, requiring . Set ; the equation becomes . At the two nonzero roots are . With , the first correction satisfies , so and . Thus
The limiting roots in both rescalings are simple, so the implicit function theorem justifies these regular expansions in their respective small parameters. The fractional powers in the original variable are a fractional-power root expansion. The real derivative is strictly positive; the cubic therefore has exactly one real root. Its other roots are the displayed complex conjugate pair, accounting for all three roots. Their leading real corrections sum to , as required by the absence of a quadratic coefficient.
Label the polygon vertices of the nondegenerate triangle as , and put for its three edge midpoints. The six monomials form a basis of , so its dimension is six. Nondegeneracy matters: has nonempty interior, and a polynomial vanishing on that interior is the zero polynomial.
Let be the affine functions of the barycentric coordinate system, characterized by and . Define six quadratic polynomials
At , and all vanish. At , exactly and equal , while the third is zero. Thus every vanishes at all three edge midpoints, and is one for the matching unordered pair and zero otherwise.
These six polynomials have the cardinal property for the six point evaluation functionals. Evaluating any vanishing linear combination at the nodes forces each of its coefficients to vanish. They are therefore six linearly independent members of a six-dimensional vector space, hence a basis.
In particular, every has the unique expansion
This proves both existence and uniqueness for arbitrary six prescribed nodal values, which is precisely an unisolvent finite element. It also identifies the finite element degrees of freedom and shape functions of the quadratic Lagrange triangle explicitly.
Alexandre-Théophile Vandermonde presents a programme in elimination theory: remove unknowns from simultaneous polynomial equations in a way that works uniformly as the number of equations and their polynomial degrees vary. The immediate achievement is narrower than that programme: a general construction for linear equations. The academy year 1772 used in the exam is not the printing date of the memoir, which appeared in 1776. Its compact indices distinguished the equation containing a coefficient from the unknown it multiplied; they were not powers. That notational separation is crucial to interpreting the work.[ref][ref]
In modern language take a system of linear equations with unknowns. Its determinant is an alternating expression in the coefficients:
Each product selects one coefficient from each equation and each unknown's column. The sign of a permutation determines whether it is added or subtracted. This makes the number a genuine parameter of a general rule, rather than merely supplying separately memorised formulas for two or three unknowns. The notation here is modern, not a transcription of Alexandre-Théophile Vandermonde's symbols.
For two unknowns, multiply by and by , then subtract. Similarly eliminate . This gives
The same principle in arbitrary size is Cramer's rule. If is obtained by replacing column of by , then
An original verification uses the multilinearity of the determinant: replace by the column combination . Every resulting determinant vanishes through repeated columns except the term, which is . This explains how an elimination expression isolates one unknown.
The condition is substantive. If , multiplying by an expression which vanishes cannot justify division. For instance, and are inconsistent, whereas replacing by gives infinitely many solutions. Thus an elimination formula must distinguish exceptional coefficients and preserve the connection to the original system of linear equations. Nor does the displayed rule solve the much broader problem of arbitrary nonlinear equations.
The passage's importance is the move from particular elimination calculations towards a theory of alternating expressions. It would be misleading to turn this into the claim that the familiar Vandermonde determinant, formed from powers of variables, is what this extract displays. A positional upper index and an exponent have different meanings; the history of that eponym requires separate evidence. Likewise, modern matrix algebra is a useful explanatory language here, not the institutional or conceptual setting of an eighteenth-century memoir.[ref]
Joseph Fourier's Théorie analytique de la chaleur by Joseph Fourier (1822) makes trigonometric series instruments for solving problems of heat conduction. A prescribed temperature distribution need not be given by one power series: it may describe different heating on different parts of a body. The extract occurs in Chapter III, §233, where the earlier assumption of an odd-power expansion is relaxed. The innovation concerns both representation and what can count as a function in an analytical calculation.[ref]
Use a separate integration variable to unpack the printed notation. The proposed Fourier sine series has coefficients
The integral signs in the extract denote definite integrals over , not antiderivatives; the author explicitly supplies these bounds in the surrounding sentence. Their absent printed bounds are a notational convention, not permission to choose arbitrary constants of integration.
The key calculation is the orthogonality relation
The product-to-sum formulas prove this by integrating cosines of integer multiples of . If an expansion can be integrated term by term, multiplication by followed by integration selects exactly one coefficient. This derives the only possible coefficients, but does not by itself prove the expansion converges to the proposed function. That distinction is central to assessing the extract's claim.
For a revealing example take on . Direct integration gives , and therefore
Every term is zero at and , so the series cannot take the value at those endpoints. Its natural interpretation uses the odd extension followed by periodic extension; the endpoints become jump discontinuities. More generally, for a piecewise continuously differentiable function, the Fourier series converges at an interior jump to the average of the two one-sided limits, irrespective of an individually assigned value there. Changing one value also leaves the integrals unchanged. Consequently the unqualified assertion of representation for every arbitrary function cannot be a modern pointwise theorem. Dirichlet's theorem on Fourier series supplies sufficient conditions and the correct distinction between continuity points and jumps; its 1829 source explicitly addresses the proof problem.[ref]
The physical payoff is explicit. For a rod scaled to with zero end temperature, separation of variables in the heat equation produces
Each mode solves and the end boundary conditions; the Fourier sine coefficients encode the initial temperature. This rod is an explanatory example, distinct from the stationary rectangular-solid problem opening Joseph Fourier's Chapter III. The factor damps high modes rapidly for positive time. The representation of arbitrary data makes the physical solution possible; the proof of that representation remains a separate task.