Asymptotic equivalence Created 2026-09-24 Updated 2026-10-14
For functions with nonzero sufficiently near a specified limit,The same definition applies to sequences as . Equivalently, : replacing by has a relative error tending to zero, and the difference is in little o notation. The limit and reference scale are essential parts of the statement.
For example, because . Replacing the former by the latter gives absolute error , which grows without bound. Thus asymptotic equivalence controls a ratio, rather than requiring the absolute error to vanish. This distinction is crucial when approximating a rapidly growing factorial with Stirling's formula.
By contrast, and have the same order in big theta notation, but are not asymptotically equivalent: their ratio remains two. For positive functions, asymptotic equivalence gives both-sided constant bounds eventually, whereas constant bounds alone do not recover the leading coefficient.
For a local example with real , the exponential function obeys as . The Taylor theorem with Lagrange remainder givesThus for ,This states in big O notation, and division by shows that the relative difference measured against vanishes. The diagram uses positive ; the bound is valid on both sides of zero. At , the absolute error is approximately and the relative difference against is approximately .
Bernoulli number Created 2026-10-05 Updated 2026-10-13
The Bernoulli numbers are a sequence of rational numbers that turns integer power sums into exact polynomials. The same numbers describe corrections when a discrete summation is compared with an integral. For example, the sum of squares is : the leading term is an integral, while the last two terms repair the difference between area and sampled values.
We use throughout. The defining exponential generating function isHere is the exponential function and is a factorial; in particular, the coefficient of is , rather than . At the quotient has limiting value one. The identity can be read algebraically as a formal power series, or as a convergent series for .[ref]
NIST Digital Library of Mathematical Functions. Karl Dilcher, Chapter 24, §24.2(i), equation 24.2.1: defining generating function and convergence domain
To compute the numbers, multiply by and compare coefficients. The resulting recurrence relation, with binomial coefficients, isThus , , and give , , and . Continuing givesThe recurrence relation agrees with equation 24.5.3 after replacing its index by .[ref]
NIST Digital Library of Mathematical Functions. Karl Dilcher, Chapter 24, §24.5(i), equation 24.5.3; first values also in Table 24.2.1
Why do so many values vanish? Put . Direct substitution gives , so is an even function. Its odd power series coefficients vanish: for every positive integer . The exception matters. The alternative convention obtained from has and exactly the same other values. A formula copied between conventions must also retain its summation endpoints.
Historically, integer power sums were studied before the modern Bernoulli number notation. A historical study examines formulas published in 1631 and distinguishes those separate formulas from encoding all exponents using one sequence of constants. This is a useful motivation for the generating function, without assigning all discovery to a single moment. [ref]
Johann Faulhaber and sums of powers by Donald E. Knuth. Donald E. Knuth, Johann Faulhaber and sums of powers, 1992 preprint, pp. 2 and 14: the 1631 power-sum formulas and the uniform Bernoulli-number formula
Binary array sum by recursion 2026-10-18
Keep an array unchanged, and sum entries in the half-open integer interval of array indices . The precondition requires integers and exact, terminating integer addition. An empty range returns the empty sum zero; a one-entry range returns that entry. Every longer range splits at its middle array index:For the original array , call . The left half returns , the right half returns , and the original invocation returns . The right half's left endpoint increases from zero to two: what decreases is range length , not every argument. Negative entries affect the answer but do not affect algorithm termination.
S(A, l, r):
require integer indices with 0 <= l <= r <= length(A)
size = r - l
if size == 0:
return 0
if size == 1:
return A[l]
middle = l + floor(size / 2)
left_sum = S(A, l, middle)
right_sum = S(A, middle, r)
return left_sum + right_sumSeven calls compute an array sum with only three frames active at once
. Original binary tree of invocations for , with integer intervals labeling ranges and upward arrows labeling returned sums. Small numbers give the order in which invocations begin when the left child runs first. The highlighted graph path contains the three active stack frames while the entry is read; the result from the completed left sibling is retained by its parent. Details.For range length , the children have lengths and , both positive and strictly less than . The floor function chooses the split; the ceiling function gives the other length. Algorithm termination follows by this natural number measure. For algorithm correctness, apply mathematical induction on : the two base cases return the specified sum; for a larger range, the two disjoint child ranges cover every original array index exactly once, so addition of their correct sums gives the required sum.
For , the invocation tree is a full binary tree with leaves, one per array entry. If is its number of nonleaf vertices, counting edges gives , so . Thus the total invocation count is , and there are combining additions. Here gives seven calls and three combining additions. For , there is one call and no combining addition; for , there is also one call and no combining addition, but no entry leaf, so the formula does not apply.
The call stack holds the active branch, rather than the entire invocation tree. Execute the left child completely before the right child, retaining the left result in the parent stack frame. The maximum number of active stack frames is for , and one for . Balanced splitting therefore needs frames for , compared with the frames of the factorial recursive process. Assuming constant-cost array access, index operations and addition, its time complexity is and its auxiliary space complexity is machine words for , excluding the stored input. Pass the same array with different endpoints, rather than copying slices. These bounds require all stored indices and partial sums to fit in a constant number of machine words; exact unbounded integer addition and storage require a separate bit cost analysis.
Binomial coefficient Created 2026-09-24 Updated 2026-10-13
For nonnegative integers and , the binomial coefficientcounts the -element subsets of an -element set. To obtain the formula, first choose an ordered list of different members in ways. Each subset appears in exactly orders, so divide by that factorial. The cases and each have one selection, the empty set and the whole set. For integer outside , the combinatorial convention is .
For , , the calculation is . The left-hand panel lists all ten subsets of . Marking an included member with one and an excluded member with zero gives a bijection with length-five binary strings containing exactly two ones. More generally, this makes selection, binary encoding, and coefficients in a binomial theorem three descriptions of the same count.
For a uniformly chosen two-person team, a specified person belongs to four of the ten teams, so the probability of their inclusion is . Uniform selection of a -element subset similarly gives inclusion probability for each member when , as the double counting identity shows.
Boltzmann entropy of a two-box occupancy Created 2026-10-14 Updated 2026-10-18
Take distinguishable, labeled particles and two boxes of equal volume. Retain only whether each particle is in the left or right box: use a bit for left and for right. Each length-20 string is one coarse microstate of this toy model. Assume the labels make independent side choices with equal probability, so the strings are equiprobable. Equal volumes motivate these weights for noninteracting particles with no preference for either box; equal volumes alone would not establish them for an arbitrary interacting gas.
Now retain only the number in the left box as the macrostate. Choosing which labels are left gives a binomial coefficient, soThe factorials count assignments to labels; the probability of a macrostate sums the probabilities of its constituent microstates. This is the binomial distribution with parameters and . The same binomial coefficient appears in the counting of distinguishable two-level systems, although here the macrostate records occupancy rather than energy. [ref]
https://ocw.mit.edu/courses/8-333-statistical-mechanics-i-statistical-mechanics-of-particles-fall-2013/0cb99318c2ed889316cdcff839759e8d_MIT8_333F13_Lec12.pdf. Mehran Kardar, MIT 8.333 (2013), lecture 12, §IV.C, equations IV.17–18: binomial microstate counts
The largest binomial coefficient occurs at , the balanced macrostate. All-left means and supplies just one string. ThusThere are balanced strings for every all-left string, even though each individual string has the same probability. Exact balance has about of the total probability; equilibrium reasoning concerns the many macrostates near balance too, rather than certainty of exactly ten particles on each side. The diagram compares the counts with their natural logarithms.
Counts and Boltzmann entropies of the occupancy macrostates of twenty labeled particles
. Details. Four fair, independent coins give a smaller worked example with the same binomial distribution. If is the number of heads, the five macrostates contain respectively microstates. Their probabilities are respectively . In particular, two heads is one macrostate containing six ordered coin sequences, with Boltzmann entropy in this counting analogy. A prescribed ordered sequence has one realization. The next diagram enumerates the same sixteen strings as left/right assignments.
Comparison sorting lower bound 2026-10-14
Any deterministic comparison sort correct for all orders of distinct sort keys needs at least comparisons on some input. Here is a factorial, a logarithm, and the brackets denote the ceiling function. This is a worst-case requirement, not a requirement on every input.[ref]
For three distinct sort keys, the diagram has one leaf for each possible ordering of the original entries . Some paths need two comparisons, others three; two comparisons cannot distinguish all six orders.
For the proof outline, represent adaptive comparisons by a binary tree: distinct sort keys give only two outcomes per comparison. A leaf fixes an output permutation; one leaf cannot correctly handle two different strict orders. Hence there must be at least leaves. Maximum depth permits at most leaves, so gives the bound. Even a three-way comparator has only two reachable outcomes on this distinct-key family.
The growth follows without a precise approximation to the factorial. At least of its factors are at least , so for ,The brackets denote the floor function. This gives a constant times lower bound for large , matching the worst-case comparison growth of merge sort.
Distinct sort keys are essential to the counting argument. Identical sort keys do not create different strict orders. If all sort keys coincide, stable sorting returns the arrival order. This does not remove the worst-case bound for a comparison sort required to handle arbitrary distinct-key inputs.
Correlation function of a point process 2026-10-07
The th correlation function is the density of the th factorial moment measure: integrating a nonnegative test function against gives the expectation of its sum over ordered -tuples of distinct points. For exactly exchangeably labelled points with symmetric joint density , it is times the marginal density of labels. It is not normalized to have total mass one.
Cyclic permutation Created 2026-10-14 Updated 2026-10-20
A cyclic permutation, also called a permutation cycle, sends distinct elements and fixes every element outside this list. Its notation is . For example, is the permutation with image list : all four labels lie on one directed loop. In contrast,has two separate loops, exchanging with and with . It is a permutation composed of two transpositions, rather than a single cyclic permutation.
Two permutations on four labels: one cyclic permutation and two disjoint permutation cycles , with arrows showing every image
. Details. Starting at a different point of the same loop changes the written list but preserves the cyclic permutation: . Reversing the direction generally changes the permutation; it gives the inverse function, here . A transposition is a cyclic permutation of length two; a one-element permutation cycle records a fixed point. In a cycle decomposition of a permutation, one-element permutation cycles are usually omitted, with the underlying set understood.
The beauty of this representation is that repeated rearrangements become motion around independent loops. Applying four times returns every label to its start, while applying twice already does so. Disjoint permutation cycles commute under function composition, since each moves only labels the others fix. On labels, there are cyclic permutations whose single loop contains every label: fix as the first written entry and order the other labels freely, giving a factorial. This is also the count of cyclic orderings; choosing a starting position would otherwise count each loop times. Rotations are identified here, while reversing direction is allowed to give a different cyclic ordering.
Proof outline for decomposition. Starting at any label in a finite set, repeatedly apply the permutation. The pigeonhole principle forces a repeated label. If the first repetition were at a label other than the starting one, its two predecessors would be different labels with the same image, contradicting the injective function property. This produces a permutation cycle returning to the start. Start again at a label not yet visited; the new permutation cycle cannot meet an earlier one, since the bijection gives every label a unique predecessor. Continue until every label belongs to a loop. The resulting cycle decomposition of a permutation is unique up to the order of the disjoint permutation cycles and the starting point written in each one. [ref]
https://math.mit.edu/~fgotti/docs/Courses/C.%20Combinatorial%20Analysis/11.%20Permutations%20I/Permutations%20I.pdf. Felix Gotti, MIT 18.211, lecture 11, definitions 1–2 and the preceding argument
Double counting (proof technique) 2026-10-13
Double counting establishes an identity by computing the cardinality of the same finite set in two ways. The useful step is to identify exactly what the members of that collection are; an algebraic equality then records two legitimate ways to organize them.
Take the ordered pairs where is a -element subset of an -element set and is marked. Choosing first gives pairs. Choosing first leaves members to choose from the other , giving . HenceFor five people and two-person teams, both counts give : ten teams with two choices of a marked member, or five choices of that member with four choices of a teammate. The identity is explained by the bijection between these descriptions, rather than merely verified through factorials.
Empty product Created 2026-10-05 Updated 2026-10-06
A product over the empty set has value one, the identity for multiplication. This makes splitting a product into successive pieces valid even when one piece contains no factors. In particular, the factorial convention is .
Error bound for composite Simpson's rule 2026-10-18
Suppose has a fourth derivative that is a continuous function on the interval , and there. With , the signed quadrature error here is . Then, for some point ,In particular, a strictly positive fourth derivative makes : composite Simpson's rule overestimates the integral.[ref]
The bound's scale follows by adding the panel errors. A panel of width has signed quadrature error and absolute error at most . There are panels, so the triangle inequality gives . The intermediate value theorem for the continuous fourth derivative replaces the average of the panel values by a single value , giving the signed formula.
The underlying single-panel calculation can be seen through the Peano kernel theorem. On the interval , define the raw Peano kernel , where is integral minus Simpson's rule and is the positive part. Then for and for . It is strictly negative inside the interval and has integral . ThusThe uniform norm bounds the fourth derivative. The polynomial attains equality. Scaling to endpoint spacing multiplies the coefficient by , giving the sharp single-panel bound . The normalized Peano kernel is , so the external factorial must be omitted when using that normalization.
For the exponential function on , , so and the bound is . Its leading actual absolute error is , smaller than the bound because a uniform upper bound on the fourth derivative does not use its variation across the interval. The theorem bounds truncation error with exact function evaluations; sample errors and roundoff error are additional contributions, as described by noise sensitivity of a quadrature rule.
Euler evaluation of even zeta values Created 2026-10-13 Updated 2026-10-14
The Euler evaluation of even zeta values turns a family of series into exact expressions using Bernoulli numbers, factorials and powers of . For every positive integer ,Here is the Riemann zeta function, defined by its convergent series at these arguments, and the Bernoulli number convention is . The alternating sign combines with the sign of to give a positive sum.[ref]
Substituting , and givesThe first identity answers the Basel problem. It is surprising because the original series only mentions reciprocal squares of integers, while its exact sum involves the circle constant . The cotangent partial-fraction expansion supplies a connection between the two: trigonometric functions encode equally spaced integer poles, whose expansion brings the reciprocal powers into view.
For an original numerical comparison, the first ten terms give , while . The omitted positive terms still contribute approximately . For fourth powers, the ten-term partial sum is approximately , only below . Both are convergent series, but the second approaches its limit much faster.
Exact evaluation is useful beyond obtaining more digits. It supplies an independent check on a numerical summation, exposes how Bernoulli numbers organize infinitely many identities, and makes the remaining series truncation error measurable without knowing any omitted terms individually. The even integer condition is essential to this formula: putting into it is not a way to evaluate , since the required Bernoulli number index and factorial expression here are indexed by positive integers.
Historically, Leonhard Euler announced reciprocal-square and reciprocal-fourth-power evaluations in §2 of On the sums of series of reciprocals by Leonhard Euler. That paper was presented on 5 December 1735 and published in 1740, as the English translation's first-page note records. His §§3–8 develop a route through the sine power series and relationships between roots and coefficients. The cotangent calculation below is a concise modern presentation of the connection.[ref]
On the sums of series of reciprocals by Leonhard Euler. English translation, p. 1, §2 and publication note; pp. 3–4, §§3–8: sine series, roots and coefficients
Exponential generating function Created 2026-10-07 Updated 2026-10-20
An exponential generating function encodes a sequence using . For labelled counting, is the number of structures on a fixed set of distinct labels. Labels distinguish otherwise similar objects: changing which person belongs to a group can change the structure. Recover the count by coefficient extraction as . The raw coefficient is , not .
The factorial makes multiplication account automatically for distributing labels. To combine an -structure on labels and a -structure on the remaining , choose the first label subset in ways, then choose the two structures. The binomial coefficient counts how the two groups of labels interleave within the full label set. ThusThe normalization works because . This explains the usefulness of exponential generating functions for labelled counting: an ordinary Cauchy product would omit the choices of labels. See Peter Magyar, Math 482, notes for 2/7, labelled product principle.
For a concrete example, there is one undecorated set on any given collection of labels. Its exponential generating function is the exponential function . Combine a red set and a blue set, allowing either to be empty:Every label independently receives one of two colours, giving assignments by the rule of product. With three labels, the counts by number of red labels are , totalling eight. Choosing only the two group sizes would give the four possibilities ; it would forget which labels are red.
Indeed, the ordinary generating function for the constant sequence is the geometric series . Its square has coefficient , counting pairs of nonnegative sizes. Both encodings are correct for their respective questions. The decision is whether identity matters when objects are combined.
For unordered sets of labelled components of positive size, an exponential generating function becomes : the term forgets the ordering of components. The existing rooted-tree generating function develops the richer example . A labelled rooted tree consists of its root of a tree and an unordered set of smaller labelled rooted trees, connecting the same label-distribution mechanism to recursive counting.
Factorial Created 2026-09-24 Updated 2026-10-13
For a nonnegative integer , the factorial is the product of the positive integers from to , with the empty product equal to :Thus , , , and . The factorial counts the permutations of distinct objects: arranging gives exactly . The choice tree in permutation shows the three choices for the first position, two for the second, and one for the last.
The value has a counting explanation: the empty set has exactly one ordering, the empty list. Equivalently, it has exactly one bijection to itself, the empty function. There are no choices to make, and one completed outcome. The factorial therefore obeys the recurrence relationThe useful distinction is how many positions are filled. For integers , choosing and ordering distinct objects by sampling without replacement gives the falling factorial, while choosing an unordered -element subset gives the binomial coefficient:For five people, assigning captain and deputy gives outcomes; choosing a two-person team gives . Every team has exactly assignments of the two roles, explaining the division. When , both counts are one. The factorial is useful here because one count of full orderings yields both formulas by cancellation and by forgetting order. [ref]
https://openstax.org/books/college-algebra-2e/pages/9-5-counting-principles. OpenStax, College Algebra 2e, section 9.5: counting ordered selections and combinations
Distinctness matters. If the two copies of in are indistinguishable, the visible arrangements are just , numbering . Temporarily labelling them gives six permutations, but exchanging the two labels leaves each visible word unchanged, so every word was counted times.
Proof outline. For , choose the first object in ways, then order the remaining objects in ways. The rule of product gives the recurrence relation; repeated application gives the displayed product, starting from the one empty ordering. This explains why the factorial grows quickly: every additional distinct object introduces another multiplicative factor.
Factorial graph formula via remainder coding 2026-10-07
The graph of the factorial function has a fixed-length first-order formula in the language of ordered rings interpreted on the natural numbers. A remainder code records , , and for every . Uniqueness of remainders proves ; sufficiently large pairwise-coprime moduli and the Chinese remainder theorem supply a code for every input. Formula length is independent of the input variable's value, although substituting a numeral adds its encoding length.
Factorial number system 2026-10-20
A mixed-radix positional notation using factorials as place values: with . For lexicographic order on permutations, division by selects the next symbol when symbols remain; the remainder gives the rank within that block.
Factorial of a Poisson random variable Created 2026-10-25 Updated 2026-10-31
If has a Poisson distribution with parameter , then the ordinary factorial has finite expectation exactly when . Indeed, its nonnegative expectation series is , since cancels the denominator of the probability mass function. The geometric series gives the formula and proves divergence for . This differs from a falling-factorial moment of fixed order, which is finite for every finite Poisson distribution parameter.
Factorial recursion and returning frames 2026-10-18
For a natural number , the factorial satisfies and for . The following description includes the zero base case explicitly; a negative or nonintegral input is outside its precondition:For , the arguments on descent are . Each positive-argument invocation postpones one multiplication until its recursive call returns. At the deepest point, the call stack has five stack frames: four suspended callers and the active zero base case. The invocation at zero returns to the invocation at one, rather than finishing the entire computation. Returns then giveA stack frame retains the caller's argument and where to resume. When the invocation at three receives , it uses its own , obtains , and returns that value to the invocation at four. The recursive calls share a definition, but their local variables belong to separate invocations.
F(n):
require n is an integer and n >= 0
if n == 0:
return 1
child_result = F(n - 1)
return n * child_resultThe natural number measure decreases by one on every recursive call, so algorithm termination follows. For algorithm correctness, use mathematical induction: the zero base case returns ; assuming the child's answer is , the caller returns . This also explains why keeping the caller's matters.
There are exactly invocations and multiplications, including one invocation and no multiplications when . Ordinary execution of this recursive process uses at most active stack frames, hence frames for in Big O notation. If each test, call, subtraction and multiplication is counted as constant cost, its time complexity is . That is an arithmetic-operation model: exact arbitrary-length integer multiplication has growing cost, and neither the factorial output nor every stack frame's numeric contents occupies a universally fixed number of bits.
Gamma function Created 2026-09-24 Updated 2026-10-20
The Gamma function extends factorials to a continuous argument. Its defining Gamma integral iswhere uses the real natural logarithm for . The Gamma function recurrence gives its meromorphic continuation to the complex plane, with simple poles at and no zeros. See Gamma function residue at a nonpositive integer and Gamma function has no zeros for proof outlines.[ref]
For nonnegative integers , the factorial identity has a shift of one:Thus for positive integers . Half-integer arguments supply a different familiar constant:The first value follows from the Gaussian integral; the second follows from the Gamma function recurrence.[ref]
The Gamma function on the positive real axis passes through the factorial values 0! through 5! at arguments 1 through 6
. Details. The plot shows only positive real arguments; the gamma function also accepts complex numbers away from its poles. Matching the factorials alone does not select a unique interpolation, even if the Gamma function recurrence is imposed: has the same positive-integer values and the same recurrence relation. The Bohr-Mollerup theorem supplies the extra condition that selects the gamma function.
The useful idea is to replace a discrete product of numbers by an integral whose exponent varies continuously. The Gamma integral then evaluates whole families of integrals at once, provides the normalizing constant for the Gamma distribution in probability theory, and appears in physics, for example in the Bose integral. Its large-positive-argument growth reconnects this continuous description to factorials through Stirling's formula.[ref]
Historically, Leonhard Euler studied the interpolation of factorials in his paper E19, written in 1729 and published in 1738. His integral over becomes the Gamma integral after a change of variables, with the same one-step shift in the argument.[ref]
https://scholarlycommons.pacific.edu/euler-works/19/. Euler Archive, E19: original-paper record, dates, and integral construction
Generating function Created 2026-10-07 Updated 2026-10-14
A generating function packages a sequence into a series so that operations on objects become operations on their encodings. An ordinary generating function uses the power series ; in counting problems, the coefficient records the number of objects of size . The variable initially marks size: it need not be assigned a numerical value. Coefficient extraction writes this recovery as . One compact expression can therefore answer infinitely many counting questions, while explaining how their answers fit together.
Start with two contributions: choose from and from , with exactly one option at each allowed value. Their individual ordinary generating functions are the polynomials and . To count ordered pairs by total , multiply:The coefficients count the ways to obtain totals zero through three. For total two, the possibilities are and ; the two corresponding monomials both contribute . There are six ordered pairs altogether, agreeing with .
If the first contribution has two distinguishable choices when , replace by . Its product with becomes . The coefficients now carry multiplicities as well as possible totals; the exponent still records cost. This lets the same construction handle several actions with identical costs without losing their separate identities.
In general, the Cauchy product givesFor each split of the total size, the rule of product counts the choices of the two components; summing over those splits counts all possibilities. This requires each combined object to have a unique decomposition into the two components. The same idea works for costs, lengths, or other additive measures, not just the number of pieces. See MIT 18.310, generating functions, sections 1–2.
Now cover a board of length with tiles of lengths one and two, without gaps or overlaps. Let count these tilings. There is exactly one empty tiling, so , and . Removing the first tile leaves a board shorter by one or two, giving the recurrence relationThese are the Fibonacci numbers shifted by one index: under the convention , . Keeping the empty tiling is essential to both the counting rule and the resulting ordinary generating function.
Length-one and length-two tiles give five coverings of a length-four board and the Fibonacci recurrence
. Details. For , the empty board or a first tile followed by a remaining tiling givesEquivalently, : each factor chooses one tile, and counts pieces while the exponent of records total length. The same ordinary generating function counts ordered histories of two repeatable actions costing one and two units. Histories and differ despite having the same total cost. MIT's notes use dots and dashes with these costs, including the empty message. [ref]
These identities hold in formal power series algebra: each requested coefficient uses only finitely many contributions. The repeated-choice expansion is legitimate because has zero constant term; a zero-cost repeatable action would allow infinitely many histories of the same size. Numerical evaluation separately requires a convergent series. Here the radius of convergence is , the reciprocal of the golden ratio. At , the rational function equals , but the counting series diverges: that value cannot represent its sum.
Other generating functions change the encoding: an exponential generating function divides by factorials, while a Dirichlet series uses . A counting generating function also differs from a probability generating function, whose coefficients must be nonnegative and sum to one.










