Power law Created 2026-09-24 Updated 2026-10-13
A power law is a relation , with fixed constants and . For positive , any real number is allowed. Its useful feature is a simple scaling rule:
The same proportional change of input produces the same proportional change of output, independently of the starting value. The exponent controls that response; the coefficient fixes the magnitude.
For example, the area of a circle is . Doubling the radius multiplies its area by four, and tripling it multiplies the area by nine. The volume of a sphere is : the same changes multiply its volume by eight and twenty-seven. The distinction explains why similarly shaped objects do not preserve their ratio of surface area to volume when their size changes.
When the output is positive, a logarithm turns the power law into a straight-line relation. Using positive reference values and ,
These ratios are dimensionless quantities, so the formula also applies to physical measurements with units. Plotting both ratios on a logarithmic scale gives a line of slope . Changing a unit changes the numerical coefficient, while the exponent stays the same. Positive describes increasing values; negative describes decreasing values; gives a constant. The zero coefficient is a degenerate case with no useful logarithmic slope.
Exact scaling is stronger than regular variation. The function has a doubling ratio tending to four, but its logarithmic correction keeps growing. The diagram contrasts it with the exact power law .
Figure 1.
Exact quadratic scaling and a logarithmic correction have different finite doubling ratios, even though the correction leaves the limiting exponent unchanged
. Details.
A power law for a probability density and a power law for a tail probability have different exponents. For a Pareto distribution with and lower endpoint one,
The tail probability has exponent ; differentiating it and changing sign gives the probability density exponent . Confusing them changes the interpretation of a fitted exponent. The normalizing coefficient and lower endpoint also matter: a decreasing power law is not automatically a valid probability density over the entire positive real line.
The appearance of a line over a finite logarithmic range is evidence to investigate, rather than a proof of an exact power law or its mechanism. In their study of power-law distributions, Clauset, Shalizi and Newman combine maximum likelihood estimation, goodness-of-fit tests and comparisons with alternative models; their abstract explains why ordinary least-squares fitting can give misleading results for tail data. See Aaron Clauset, Cosma Rohilla Shalizi and M. E. J. Newman, Power-law distributions in empirical data, SIAM Review 51 (2009), 661–703. The scaling rule is mathematically exact when it defines a model; whether a dataset supports that model is a question of statistical inference.
For , the harmonic number exceeds . The finite Euler product over the primes at most contains every summand of this harmonic number. Taking logarithms and applying the geometric-series bound for the logarithmic remainder bounds the total remainder by , proving the displayed bound.
Suppose a consistent linear multistep method has a simple principal polynomial root and its analytic logarithm satisfies near zero, with real coefficients. If , then at the real part of is positive to leading order. The same remains true after giving a small negative real part of smaller magnitude than that leading term. Thus a growing amplification factor occurs inside the left half-plane, ruling out A-stability. For an order-three method with , choose .
For a fixed finite number of nonnegative terms and , use . The logarithm of , divided by the large-deviation speed, tends to zero, and a finite maximum commutes with the limit superior. If all individual logarithmic limits exist, the limit of the sum is their maximum.
Under the finite-alphabet, positive-reference, closed-convex set assumptions above, every feasible law satisfies
Thus a feasible law's excess relative entropy above the optimum is at least its relative entropy from the optimizer. The information projection supplies a quantitative comparison with every other feasible law, not merely the location of a minimum.[ref]
For affine expected value constraints, the result becomes a Pythagorean identity for relative entropy. In relative entropy minimization under a mean constraint, the logarithm of is an affine function of the outcome . Any feasible has the same normalization and mean as , making the residual in the three-point identity for relative entropy zero.[ref]
In bits, the quantum Pinsker inequality is
The trace-distance-preserving binary measurement converts the trace distance into classical total variation distance without loss. Apply the data-processing inequality for quantum relative entropy to that measurement, then classical Pinsker's inequality. The factor is omitted when relative entropy uses natural logarithms.
Rate-distortion function Created 2026-09-24 Updated 2026-10-14
Fix a finite source alphabet , a probability mass function , a finite reconstruction alphabet , and a nonnegative distortion measure . The information rate-distortion function is
The source probability distribution stays fixed; the conditional distribution of the reconstruction is what we optimize. Each feasible test channel must keep expected distortion at most . The objective is mutual information, measured in bits when the logarithms have base two. If no test channel satisfies the constraint, the infimum is .[ref]
Consider independent and identically distributed fair bits and Hamming distortion, which charges one for an incorrect bit. At zero expected distortion, every bit must be reconstructed correctly, and . If an average fraction of incorrect bits is allowed, the binary rate-distortion function gives
Here is binary entropy. This is an asymptotic limit for long block codes, rather than a claim that a single bit can be stored in physical bits. The three-bit lossy Hamming code gives a small, fully explicit version of the same tradeoff, with rate and expected distortion .
Figure 1.
Allowing more incorrect fair bits lowers the asymptotic information rate
. The curve is the exact binary rate-distortion function. The marked three-symbol code has rate at expected distortion ; its gap above the curve shows that a small explicit block code need not attain the asymptotic bound. Rates count bits per original source symbol. Details.
Rate-distortion theory separates the question of what is possible from the design of a practical encoder and decoder. It also forces the fidelity criterion to be explicit. Hamming distortion treats all symbol mismatches alike; mean squared error instead penalizes larger numerical errors more strongly. Those objectives can favor different reconstructions of the same data. An average error criterion does not by itself control the error on every individual input.
Claude Shannon's Coding Theorems for a Discrete Source With a Fidelity Criterion by Claude Shannon was published in 1959. Its formulation fixes a cost for replacing one source letter by another and studies the communication rate compatible with the allowed average cost. The important shift is to quantify which distinctions may be discarded, rather than requiring exact recovery of every letter.[ref]
Let be a joint probability distribution on a finite product alphabet, with marginals . Compare it with a product model , assuming wherever . Adding and subtracting the logarithm of gives
The first term is the unavoidable error from discarding dependence; the other terms are errors in the individual marginal probability distributions. Averaging a term that depends only on under is the same as averaging it under , which proves the identity directly.
Among product laws, the choice minimizes this relative entropy, leaving exactly total correlation. The related cross-entropy equals entropy plus relative entropy identity interprets this as extra average logarithmic loss from using the independent model. It is a statement about a specified joint law and loss function, not a claim that fitting a finite sample automatically recovers that law.
For , let contain the first terms, with . The remainder after those terms is
This is the exact absolute error. A convenient bound replaces the denominator by , giving through the triangle inequality. The exact denominator is preferable when the sign or complex phase of is known.
Figure 1.
The omitted fraction and the number of terms needed to capture 99 percent of a geometric sum
. Details.
For and , the omitted fraction of the entire sum is . Capturing at least percent therefore means . Taking logarithms and applying the ceiling function gives the smallest integer :
This gives and terms for and , respectively. The difference is a concrete reason to care about the common ratio, even when all four series converge.
An absolute target has a different scale. For , , and required absolute error at most , the total sum is and
The first acceptable term count is : the remainder is approximately , while at it is approximately . Counting terms and checking the tail avoids an ambiguous instruction to stop when a term merely looks small.
Replicator equation 2026-10-14
The replicator equation says that a strategy grows in frequency when its expected payoff exceeds the population's current mean payoff. It is an ordinary differential equation for a composition, rather than for total population size. The subtraction of the mean is what makes relative success matter: even a type growing in absolute number can shrink as a fraction if other types grow faster.
Let be the frequency of pure strategy , with available pure strategies and
In a symmetric bimatrix game, let the payoff matrix have entry equal to the payoff to strategy against . The other player's payoff in that encounter is : symmetry between player roles does not require . Uniform random encounters give the expected payoffs and their population mean
After choosing the time unit so that the growth-rate scale is one, the continuous-time replicator equation is
Here a payoff is measured on a scale proportional to net growth per unit time, not merely as an arbitrary preference ranking. More generally one can specify locally Lipschitz frequency-dependent payoffs directly; the same equation with then defines a unique frequency trajectory. The linear pairwise model and its reproductive interpretation are given in Taylor and Jonker (1978), sections 2–3; the formulas here also follow by the following direct normalization.
Suppose the number of type obeys , where the baseline is identical for all types. Set and . The quotient rule gives
Thus the common baseline cancels. Adding the same constant to every entry of leaves the replicator equation unchanged; multiplying by a positive constant changes only the speed along trajectories. The same payoff matrix can therefore describe frequency evolution at different growth-rate baselines and time scales.
The probability simplex is invariant in forward time. On ,
Normalization alone would not exclude negative frequencies. Nonnegativity follows as well: along a solution,
An absent type remains absent, and a positive frequency remains positive at every finite time. For the fixed payoff matrix model, bounded rates on the compact probability simplex give global forward solutions. Frequencies can still tend to zero as . Each face is invariant, so this model has no spontaneous introduction of new pure strategies; mutation or outside introductions would require additional terms. For two present types the logarithm of their frequency ratio satisfies , directly expressing the accumulated payoff advantage.
For two pure strategies, write the composition as , where is the frequency of strategy 1, and let
Their payoff difference and the resulting scalar ordinary differential equation are
In the interior , the sign of the payoff difference determines the direction of motion. The endpoints are always equilibrium points, and an additional interior equilibrium point exists precisely when the affine payoff difference has a zero strictly between them. At a simple interior zero , : a negative value gives asymptotic stability, a positive value gives instability. At the endpoints and , with stability understood relative to . A zero derivative requires examining the actual flow rather than this strict sign test.
For an original coordination game, imagine two conventions that reward matching, with convention 1 giving the larger matching reward. Choose
The crossing is . Below it, convention 1 loses frequency; above it, convention 1 gains frequency. The endpoint equilibrium points and have one-sided asymptotic stability, while is unstable: the corresponding derivatives are and , respectively. Every initial tends to , every initial tends to , and exactly stays there. Even the convention with the larger matching reward can disappear if it starts below the threshold. This is bistability, not selection of a universally best convention.
Figure 1.
Toy coordination model: an unstable frequency threshold separates attraction to the two pure conventions
. Details.
The compositions giving a symmetric Nash equilibrium in this coordination game are the two pure conventions and the mixed composition . Both pure conventions are evolutionarily stable strategies because a mutant convention has strictly lower payoff against the pure resident. The mixed symmetric Nash equilibrium is not an evolutionarily stable strategy: against that resident both conventions tie, but after a pure convention-1 mutant is introduced its payoff advantage is . Equal payoffs at a symmetric Nash equilibrium need not provide resistance to invasion or asymptotic stability.
For an original coexistence model, choose payoffs making each convention advantageous when sufficiently rare:
Here attracts every initial composition with both types present: below it and above it. The interior derivative is , while and make both endpoints unstable to introduction of the other type. The endpoints nevertheless remain stationary if the other type is exactly absent; the attraction statement excludes those boundary initial states.
Figure 2.
Toy coexistence model: both rare types can invade, and every interior composition approaches frequency three quarters
. Details.
The sole symmetric Nash equilibrium in this coexistence model is . It is also an evolutionarily stable strategy. For any different mixed strategy , the first comparison in the two-condition criterion for evolutionary stability ties because . Its second comparison is strictly positive:
Thus restoring frequency feedback can protect a mixture even though all present types earn equal payoffs at the mixture. Coexistence here means different individuals using different pure strategies; it does not require every individual to randomize with a mixed strategy.
Frequency evolution need not increase the mean payoff. In the coexistence example , whose maximum occurs at , whereas the attracting composition is . For , the frequency increases while . Individual payoff advantages drive the equation; maximizing collective mean payoff is a different optimization problem.
More generally, a rest point only equalizes payoffs among present types: implies . A symmetric Nash equilibrium additionally requires for every absent type. All vertices are rest points even when an absent type could invade. For finite symmetric bimatrix games, a rest point with Lyapunov stability on the full probability simplex is a symmetric Nash equilibrium; an interior trajectory that converges has a symmetric Nash equilibrium as its limit. These are conditional results, not a convergence theorem for every trajectory. See Cressman and Tao (2014), Theorem 1.
The rock paper scissors payoff matrix gives an explicit obstruction to universal convergence:
Since , , and in the interior . Thus is conserved. Its maximum on the probability simplex occurs only at , the unique symmetric Nash equilibrium, so an interior trajectory starting elsewhere cannot converge to that composition. Every other interior product level is a closed curve without a rest point, giving a periodic orbit. The existence of these cycles is also discussed in Cressman and Tao (2014), Example 1. The useful lesson is to inspect the specified payoff feedback and dynamical system, rather than infer convergence from the existence of an evolutionarily stable strategy or a Nash equilibrium.
Relative to the specified solid, favors dissolution if that solid is available; favors precipitation; equality marks saturation. These comparisons identify a driving direction favored by thermodynamics, not a reaction rate.[ref]
A proof outline comes from the reaction Gibbs free energy for dissolution:
Here is the molar gas constant and the absolute temperature. If , the logarithm is positive, making the reverse transfer into solid favorable. At equality the bulk driving difference vanishes. Equality can also occur at the boundary where the last solid disappears, but it is not a universal constraint on every solid-free chemical solution.
At an unramified irregular singular point with distinct leading eigenvalues, a sectorial fundamental solution is a fundamental matrix whose entries are holomorphic functions asymptotic to a prescribed formal matrix on a sector of the logarithm cover. For competing cubic exponentials, the usual construction uses six overlapping sectors with basic angle . A formal power series need not converge, and two sectorial realizations may differ by exponentially small terms across a sector boundary.
Separable differential equation Created 2026-09-28 Updated 2026-10-14
A first-order ordinary differential equation is separable if its explicit form factors as . On an interval where , write and take antiderivatives to obtain an implicit solution:
An initial condition determines and selects a branch and domain. The useful simplification is that the two integrals each involve only one variable, even when the original equation is nonlinear.
For Newton's law of cooling, division by gives . To keep the logarithm dimensionless, integrate relative to the initial excess temperature:
When , continuity preserves the sign of the excess temperature until any potential zero, giving . This formula never reaches zero at finite time. Taking its derivative verifies the ordinary differential equation, and substitution at verifies the initial condition.
Always check what division removed. Each zero gives a constant solution of a differential equation . Cooling therefore also has the equilibrium point , omitted by division but included in the final explicit formula. For the nonunique initial value problem , division by only describes the moving pieces: a valid solution may remain zero for an arbitrary time before joining one. Separation is a method for finding solutions, not a uniqueness theorem.
A steady state does not by itself give every fluctuating observable an entropy production symmetry. If the dimensionless total entropy production has the same-law finite relation and a large deviation principle with rate function for , then, on its common domain,
The first expression denotes leading exponential scaling; the second follows by taking the scaled logarithm of the probability ratio. A finite-state, autonomous Markov process with time-even states, positive bidirectional rates and a positive stationary distribution supplies a standard setting for a finite total-entropy production relation. The stochastic system entropy is then bounded, so its endpoint contribution does not change the long-time rate function of bath entropy production. [ref]
Unbounded state spaces can have endpoint fluctuations on the scale relevant to a large deviation principle. Dropping system entropy, changing the measured observable to heat, or changing the reverse preparation therefore requires a fresh argument. The exact finite integral fluctuation theorem, a same-law finite relation, and an asymptotic rate function symmetry are distinct claims.
Consider an unnamed model substance with molar latent heat and saturation pressure at . Stipulate the Ideal-vapor Clausius-Clapeyron approximation throughout , constant , and . These parameters define an illustrative model, not a measured dataset or a fit to water. At ,
At the reference state the gas molar volume is , and the local slope is . The tangent estimate is much lower than the integrated result: a local derivative should not be extrapolated over this whole interval. By contrast, over a small temperature increment, the fractional sensitivity is .
Stirling formula Created 2026-09-24 Updated 2026-10-14
Stirling's formula turns the long product defining a factorial into a short expression. For positive integers , put
Then as . This is asymptotic equivalence: , so the relative error tends to zero. It does not say that the absolute error tends to zero, and the formula is not an equality for finite . The Gamma function extends this approximation beyond integer inputs. [ref]
For ,
The leading estimate is about low. Multiplying by the first correction factor gives
which is about low. The Stirling correction by Gaussian moments explains why this factor is rather than an arbitrary numerical adjustment.
Figure 1.
Relative factorial errors shrink faster after the first Stirling correction
. For each integer , the curves compare and with the exact factorial. The vertical axis is the nonnegative relative error, on a logarithmic scale. Details.
The usefulness is in ratios as well as in enormous numbers. Applying Stirling's formula to the three factorials in a central binomial coefficient gives
This counts the ways to choose exactly half of objects. Equivalently, for independent fair coin tosses, the binomial distribution assigns probability to exactly heads. An exponentially large count becomes a simple probability scale after cancellation.
For numerical calculations, taking the natural logarithm yields
where . Computing a logarithm of a large factorial avoids representing the factorial itself. The Robbins bounds for Stirling's formula give a finite- interval for this logarithmic remainder, rather than only a limiting statement.
The factor is beautiful because a Gaussian integral lies behind a discrete product. The Gaussian peak behind Stirling's formula displays this connection through the Gamma integral and Laplace's method. A rigorous proof must also control the tails of the integral; the local expansion explains the geometry but is not by itself a complete proof.
James Stirling published Methodus differentialis in 1730, a treatise on summation and interpolation of infinite series. This setting connects the formula with a practical calculation problem: taking logarithms turns a long product into a sum, whose growth can be approximated. [ref]
A quantum vortex becomes energetically favourable in a rotating reference frame when . For a singly quantized vortex in a long radially Thomas–Fermi condensate, the cutoff-shell estimate is
Integrating the trapped number density against produces the logarithm and constant; integrating it against angular momentum per particle gives . Resolved-core corrections can alter the nonlogarithmic constant. This criterion compares equilibrium rotating-frame energies and does not remove a dynamical vortex-entry barrier.
Time complexity Created 2026-09-24 Updated 2026-10-14
The time complexity of an algorithm bounds its number of computation steps as a function of its input length.
Specify both the size parameter and the operations counted. For binary search, take to be the number of array entries and count a three-way comparison of the target with one entry as one operation. Code using separate equality and less-than tests may perform two primitive tests per inspected entry; this changes a constant factor. The input size in bits is a different parameter when entries have variable-length representations.
Worst-case time complexity maximizes the count over permitted inputs of size . An absent target forces comparisons in linear search. For binary search, the worst-case count is for , attained by a target larger than every entry. Both have a best case of one comparison when the first inspected entry matches.
In Big O notation, the worst-case bounds are and respectively. Here means that fixed constants exist with for all . It is an upper bound, so a logarithmic count is also ; the sharper bound communicates its scaling better. The base of the logarithm changes only a constant factor.
For , linear search can require comparisons, whereas binary search needs at most , since . Doubling adds just one to the worst-case binary search count. These are operation counts, not measured machine runtimes. Translating them into logarithmic execution time assumes constant-cost indexed access, comparison and index arithmetic. Long entries can make comparison expensive; a linked list does not provide constant-cost access to an arbitrary middle index. Building or sorting the array is additional work: merge sort can provide order for many subsequent searches, but its cost belongs in the analysis too.
Torsion balance 2026-10-13
A torsion balance measures a weak torque by suspending a body from a thin fiber and reading its twist angle. The fiber supports the body's gravitational weight while permitting rotation about the suspension axis. In the range of linear elasticity, a twist in radians, measured from the untwisted reference orientation, produces a restoring torque
The torsion constant sets the sensitivity. At static equilibrium with an applied torque and no other axial torque, . A perpendicular force at lever arm therefore gives . The torsion balance measures a turning effect: a force whose line of action passes through the suspension axis gives no axial torque. The Cavendish torsion balance is the gravitational application; Coulomb's law supplies an electrical one. [ref]
Figure 1.
Torsion balance readout: fiber twist, force geometry, and returning the body to a fixed angle
. Details.
The original schematic separates two ways of reading the same torque. In deflection operation the top attachment stays fixed and the body rotates. In null operation the experimenter rotates the top attachment by while returning the body's laboratory angle to its original value. If the initially untwisted configuration has , the fiber twist is , not alone. Thus
For a positive applied torque, holding requires . Keeping the body at the same angle keeps the lever arm and source geometry fixed, making comparison of different applied forces easier. Either readout still requires a calibrated torsion constant and a stable reference orientation.
An illustrative calculation shows the amplification: with , , and , the applied torque is and the equilibrium twist is . These are stipulated values, not measured data. Reducing the torsion constant tenfold increases this twist tenfold, provided the fiber remains in its calibrated linear elasticity range. The cost is a slower response, explained by the oscillation period in torsion constant.
A concrete laboratory experiment is PASCO's Coulomb balance: level its counterbalanced rod, discharge both conducting spheres, and set the unloaded zero. Charge the spheres at maximum separation; switch off the charging supply. Move the second sphere to a known center separation , then turn the suspension dial until the rod returns to its index mark. Record the dial change and , recharge, and repeat at several separations. The manual recommends a draft-free room, clean insulating supports, and recharging before each reading: leakage, especially in humid conditions, otherwise changes the electric charges during the sequence. At close separations the conducting spheres redistribute charge, so the point charge approximation needs correction. [ref]
For constant electric charges and a fixed perpendicular lever arm, the Coulomb's law prediction is . Plotting the logarithm of twist magnitude against the logarithm of separation gives , so the predicted slope is . Absolute force measurement additionally needs the torsion constant; comparing ratios can eliminate it if it remains stable. Repeating a reference separation between other settings distinguishes a separation effect from a changing signal. A declining reading at the reference separation would invalidate the assumption of unchanged electric charges, even if a distance plot looks smooth.
The historical electrical example is Coulomb's first memoir of 1785. His apparatus enclosed a suspended needle with a small ball and a second ball; an adjustable head twisted the suspension. After charging the balls by contact, he reported angular separations , , and with head settings , , and . The total twists were approximately , , and : fourfold restoring torque accompanied approximately halved separation. These are his reported observations, not data from our diagrams. [ref] A precise reconstruction must use center distances and the changing lever arm, rather than identify angular separation exactly with distance; Alberto A. Martínez's replication explicitly analyzes that geometry. [ref]
Sensitivity also exposes changes of the apparatus itself. Fleischer and colleagues' cryogenic torsion balance used a temperature-controlled enclosure to reduce vacuum-vessel top-plate temperature fluctuations to approximately , limiting changes in suspension geometry from thermal expansion. They used a mild bake-out near to speed initial fiber relaxation and reduce slow zero motion. Their optical readout compared the pendulum mirror with an internal reference mirror to reject shared optical motion. Room-temperature thermal radiation entering through the optical opening heated the pendulum; a cold filter reduced that load. The authors could not directly measure the pendulum's temperature without disturbing it, and explicitly distinguished the cold shield's temperature from the body's. Cooling therefore requires checking the actual noise and thermal environment, rather than assuming that the fiber and body share the shield's temperature. [ref]
A useful control strategy is to record unloaded readings and temperature before and after each signal sequence, recalibrate the torsion constant under the same conditions, and compare forward and reverse settings. The algebra of torsion balance zero drift shows precisely which offsets such comparisons can cancel. A fine angular scale alone does not establish a small measurement error.