Ising-chain decimation constant 2026-10-20
For a periodic even chain, eliminating alternate spins gives . Thus dimensionless free energy per original spin obeys . The exact solution satisfies this relation. The multiplicative constant cancels from normalized retained-spin probabilities but records eliminated-spin entropy; discarding it loses thermodynamics even if the interaction recursion is correct.
Ising model Created 2026-09-24 Updated 2026-10-18
The Ising model is a spin model with an Ising spin at every graph vertex . For a finite graph with vertex set and edge set , a uniform coupling and field parameter give the HamiltonianEach edge is counted once. Here is temperature, is the Boltzmann constant, and is inverse temperature; and have units of energy. For magnetic applications, includes the magnetic moment multiplying the applied magnetic field. The canonical ensemble assigns the Boltzmann distributionThe partition function makes the probabilities sum to one. Positive rewards equal neighboring Ising spins, modeling ferromagnetism; negative rewards opposite neighbors, giving an antiferromagnetic Ising model. Positive rewards , while negative rewards .[ref]
Statistical Physics by David Tong. §5.2, equations (5.192)–(5.194), nearest-neighbor energy, field convention and canonical partition function
A single local rule can organize a whole graph: rewarding agreement on each edge makes all-equal Ising spin patterns favorable even though no edge directly couples distant vertices. The four-spin Ising ring makes this visible with only sixteen microstates. It also separates three different questions: whether neighbors agree, whether the mean spin magnetization is nonzero, and how large its thermal fluctuations are.
A motivating experiment is the University of Colorado Boulder's Curie-temperature demonstration. An iron rod suspended from a twisting wire on a stand is initially held near a permanent magnet by ferromagnetism. A gas burner supplied from a propane cylinder heats the rod; the readout is its motion away from the magnet, followed by return as it cools. Repeated cooling supplies a reversible comparison on the same sample. The source explicitly calls for heating the rod while keeping the magnet cool, since heating the magnet can reduce its strength. The inference is that warming the sample weakens its magnetic attraction across the Curie temperature. This is a qualitative force readout, with no calibrated temperature or magnetization trace supplied: it motivates competition between alignment and thermal fluctuations, but does not identify , measure individual Ising spins, or realize a four-spin Ising ring.[ref]
Curie Temperature (University of Colorado Boulder Physics Undergraduate Labs). Curie Temperature, Purpose, apparatus Figure 1, and Magnet Positioning: suspended iron rod, propane burner, cooling return, and keeping the magnet cool
Ernst Ising's 1925 paper examined a linear chain of two-orientation magnetic elements with neighboring interactions. In its calculation for a large chain, the zero-field mean magnetization vanishes and the model has no spontaneous magnetization. The inspected English translation states this immediately after equation (8) in §2. This historical result concerns the chain; it does not establish the behavior of a two-dimensional Ising model.[ref]
Beitrag zur Theorie des Ferromagnetismus by Ernst Ising. Beitrag zur Theorie des Ferromagnetismus by Ernst Ising (1925), English translation, §2 The simple linear chain, energy (3′) and the paragraph immediately after equation (8)
Ising ring bond correlation 2026-10-18
The Ising ring bond correlation is the neighboring two-point correlation function in the four-spin Ising ring. All four edges are equivalent. At zero field each mean Ising spin is zero by spin inversion symmetry, so also equals the connected correlation function. Agreement gives bond product and disagreement ; thus .
Differentiating the finite partition function with respect to inserts the sum of four bond products. ThereforeHere is internal energy. At , the class-weight calculation gives and . The agreement probability for a selected bond is , despite the exactly zero mean spin magnetization.
A second derivative gives the energy variance, and hence the heat capacity at fixed and :To see the variance identity directly, a derivative of an expected value under weights inserts , where . The factor follows from . At the same exact example, . The heat capacity vanishes both as and as : at high temperature its dimensionless factor vanishes, while at low temperature excited microstates become exponentially rare.
Ising ring magnetization fluctuations 2026-10-18
Define the instantaneous spin magnetization . Global reversal sends to without changing the zero-field energy. Pairing every microstate with its reversed partner proves at every positive temperature, even when almost all probability lies on the two fully aligned patterns. A vanishing mean does not imply weak alignment: the limiting probability distribution is half at and half at .
The Ising ring magnetization fluctuations measure this distinction through variance. In the class, both patterns have . Among the patterns, eight have and four have ; the two patterns also have . ConsequentlyIt equals at , approaches for four independent fair Ising spins at , and approaches as . Unlike the energy variance, the spin magnetization variance remains large in the low-temperature symmetric mixture.
The same thermal fluctuation controls the field response. Allow to vary before setting it to zero; differentiating the Boltzmann distribution inserts , givingThis is a spin-normalized magnetic susceptibility with respect to the energy-valued parameter ; conversion to physical magnetization and magnetic field requires the magnetic moment and sample volume factors.
For finite , is a finite positive sum of exponential functions. Its free energy is a real analytic function for , so the smooth heat capacity peak here is not a critical phase transition. Spontaneous magnetization concerns the order of limits: first a thermodynamic limit, then removal of a symmetry-breaking field. The four-spin Ising ring alone establishes neither that limit nor any two-dimensional Ising model result.[ref]
Statistical Physics by David Tong. §5.2.3, paragraph beginning with the analytic finite partition sum: phase transitions require the thermodynamic limit
For the nonzero spectral decomposition , every pure-state quantum state ensemble of is specified by the displayed column linear isometry. To prove this, write . Positivity forces each into the support of , and the coefficients have orthonormal columns because . Conversely this column identity reconstructs ; the squared vector norms are the probabilities and sum to one. Complete the columns to unitary bases after adding zero ensemble vectors to obtain the usual unitary-mixing formulation.
Jacquard identity coefficients 2026-10-13
For two individuals carrying labelled copies and , condensed identity coefficients give the probabilities of nine identity by descent patterns, identifying states that differ only by exchanging the two homologues within either individual. They retain within-individual autozygosity, which three ordinary outbred sharing coefficients omit. One convention isEach block consists of copies identical by descent, and different blocks have distinct ancestral origins. For siblings whose parents are otherwise outbred first cousins, these coefficients are . This follows by conditioning on whether the parents share one ancestral copy and enumerating the four independent Mendelian segregation choices to their two children. The kinship coefficient is , here . Weir's discussion of identity states uses this convention.
Jensen's inequality 2026-10-14
Jensen's inequality says that applying a convex function to a weighted mean cannot exceed the same weighted mean of its outputs. For nonnegative weights with and inputs in a convex set,Nonnegative weights are essential: this is a convex combination, rather than an arbitrary affine combination. For two inputs it is precisely the defining inequality for a convex function; repeatedly grouping inputs gives the finite weighted version.
Take , weights and , and inputs and . Their weighted mean is , so the two sides areThe Jensen gap is . The inequality measures the effect of replacing distinct inputs by one representative input before applying a nonlinear function.
The probabilistic form uses an integrable random variable taking values in an interval where is a convex function. If is also an integrable random variable and belongs to that interval, thenThe direction reverses for a concave function. For a strictly convex function, equality in the finite weighted form requires all inputs having positive weight to be equal; in the probabilistic form it requires to be constant almost surely. An affine function gives equality for any admissible distribution. [ref]
https://stanford.edu/~boyd/cvxbook/bv_cvxslides.pdf. Boyd and Vandenberghe's slides, section 3.14, state the expectation form
.For the quadratic function and a random variable with a finite second moment, the difference between the two sides is exactly its variance:Consider two equally likely values and . Their expected value stays at as increases, but their variance is . Thus the expected value of the square grows from to . For the exponential function, the same two-point distribution gives , while . Both are examples of Jensen's inequality, but their Jensen gaps depend differently on the spread of the inputs.
Another useful choice is the concave function on positive inputs. Its version of Jensen's inequality gives . Applying the increasing exponential function shows that the weighted geometric mean cannot exceed the weighted arithmetic mean. For the equally weighted inputs and , these are and . This recovers the arithmetic-geometric mean inequality and illustrates how choosing one function can generate an entire family of bounds.
A short proof idea explains the probabilistic form. If has a subgradient at , the supporting affine function gives . Taking the expected value cancels the linear term because . This argument applies, for example, to finite convex functions on ; more general domains of a function need attention to endpoints and the existence of a subgradient.
Johan Jensen's 1906 paper “Sur les fonctions convexes et les inégalités entre les valeurs moyennes” is an early source for the connection between convex functions and inequalities for means. [ref]
https://zenodo.org/records/2371297. Jensen's original article and publication record, DOI 10.1007/BF02418571
. Joint entropy 2026-10-14
Joint entropy is the information entropy of an entire random vector, treating its coordinates together as one outcome. For random variables with finite alphabets and joint probability mass function ,It is measured in bits. The distinction from separate information entropies is whether shared uncertainty is counted once or repeatedly. Two copies of the same fair bit have joint entropy one bit, since only and can occur. Two independent fair bits have joint entropy two bits, since all four pairs are possible and equiprobable.
For a less symmetric example, assign probabilities to respectively. ThenHere is fair, while . Thus and bits, where is binary entropy. Adding the separate information entropies would give approximately bits, overcounting by the mutual information bits.
The chain rule for information entropy makes the shared information explicit:In this example is certain given and fair given , so its average conditional entropy is bit. Sending the first coordinate changes how much uncertainty remains in the second. A prefix code with codewords
0, 10, 11 for the three possible pairs has average length bits, exactly the joint entropy in this stipulated law.For finite alphabets,The lower bound follows because knowing the full random vector determines every coordinate; the upper bound follows from conditioning reduces entropy in the chain rule for information entropy. Equality in the upper bound means joint independence. The difference from that upper bound is total correlation, whose noisy parity total correlation example shows why separate pairwise comparisons need not find all the dependence.
For a proper prior distribution independent of coalescent times , let with and . Observing under an infinite sites mutation model gives posterior density , where is the prior predictive probability of . Multiplication by the conditional Poisson mass and normalization is an application of Bayes' theorem.
// Target: statistical-inference.bigb
Joint probability mass function Created 2026-10-14 Updated 2026-10-20
For discrete random variables , their joint probability mass function assigns a probability to each possible ordered pair. Its entries are nonnegative and sum to one. Marginalization gives the probability mass functions and . In a table with rows indexed by and columns by , these are the row and column totals. The joint probability distribution records how the coordinates occur together, while the marginal distributions describe each separately.
Joint red and green Poisson count formula 2026-10-14
For a finite-intensity set of mean , independent red marking with probability gives counts withDisjoint source sets give independent pairs of these counts. Refining overlapping test sets into disjoint cells then proves independence of the two whole Poisson point processes, not only their counts on one set.
Jump chain of a discrete-time Markov chain 2026-10-14
For , observe a discrete-time Markov chain only when its state changes. The probability that its next different state is is . Its holding times are finite geometric waiting times. This construction deletes self-transitions and differs from the existing continuous-time jump-chain concept.
Kaplan–Meier estimator Created 2026-09-24 Updated 2026-10-14
At distinct observed event times , let be the risk set size immediately before , and let count events at . The Kaplan–Meier estimator of the survival function isThe empty product is one. Each factor estimates a conditional survival probability among those still observed and event-free; their product joins the successive steps. This is nonparametric statistics: no specified shape for the survival distribution is imposed. Use independent censoring and the appropriate risk sets to interpret the result as an estimate for the intended population.
The Kaplan–Meier estimator is a right-continuous function with downward jumps at event times. Right censoring changes later denominators without causing a jump. A tick on the curve marks right censoring, rather than a failure. For a tied group of events, use the one factor ; subjects right-censored at that recorded time remain in for this factor. The fraction estimates a discrete hazard, not a continuous hazard function in inverse-time units. With no censoring, the factors telescope to the fraction of the original cohort whose observed survival times exceed , the complement of its empirical distribution function.
Edward L. Kaplan and Paul Meier published [ref]
https://doi.org/10.1080/01621459.1958.10501452. Nonparametric Estimation from Incomplete Observations, Journal of the American Statistical Association 53(282), 457–481 (1958)
. Their paper addresses lifetime estimation when observation ends before failure and explicitly calls attention to the assumption of independence between lifetime and potential observation loss. The date 1958 is the original publication year; the publisher's later online-posting date is not the discovery date.In his [ref]
https://garfield.library.upenn.edu/classics1983/A1983QS51100001.pdf. 1983 Citation Classic recollection
, Kaplan traces Meier's interest to cancer-duration data in 1952 and his own to the lifetimes of vacuum tubes in undersea telephone-cable equipment a year later. The journal encouraged them to combine their manuscripts. The shared mathematical question was how to estimate a survival function when some lifetimes are still running or disappear from observation. Kernel density estimation Created 2026-09-24 Updated 2026-10-14
Let be real independent and identically distributed random variables with unknown probability density function , let , and choose a nonnegative, unit-integral kernel for density estimation and a smoothing bandwidth . The kernel density estimator isPlace a bump at every observation and add their contributions. Each bump has area , so for every realized statistical sampleThe change of variables is . Summing the unweighted bumps would give area ; summing just would give area . Those raw sums do not have the normalization of a probability density function.
Unlike a histogram, the construction does not require choosing bin origins, and a Gaussian density kernel gives a smooth curve. Its appeal is that identical local contributions can combine into a probability density function with several peaks without first choosing their number. This makes kernel density estimation useful for exploring an unknown probability distribution and estimating interval probabilities, while the smoothing bandwidth controls how much detail is visible.
Before the statistical sample is observed, is a random function; afterwards it is a fitted probability density function. It is an estimator of the unknown , not the true probability distribution. For fixed , its expectation is the convolution , generally different from , and repeating the sampling changes the fitted curve. The exact mean integrated squared error of a kernel density estimator separates this smoothing bias of an estimator from sampling variance. Allowing signed kernels of order ell retains the formula but can lose nonnegativity.
Kinship coefficient 2026-10-13
The kinship coefficient is the probability that one randomly selected allele copy from each of is identical by descent. For a noninbred individual, , and more generally . For distinct individuals with parents , Mendelian segregation gives . The offspring's inbreeding coefficient equals the parents' kinship coefficient.
// Target: biology.bigb
Klein-Gordon step amplification 2026-10-20
For the outgoing negative-energy branch , matching the field and its spatial derivative gives these signed charge-current ratios. Their sum is one although reflection exceeds one. The ideal sharp step has a singular stationary matching denominator at in the supercritical range. It is not a finite single-particle probability prediction; wavepackets, source preparation and field quantization matter for its physical interpretation.
Klein paradox Created 2026-10-20 Updated 2026-10-20
In a sufficiently strong electrostatic step, the positive-energy incident channel overlaps a negative-kinetic-energy channel on the far side. For a charged scalar field the outgoing antiparticle branch has negative charge current, allowing reflected particle current larger than the incident current while signed charge is conserved. The external source supplies energy for particle-antiparticle creation. This requires a multiparticle interpretation; negative transmitted charge current is not a negative probability.
Kolmogorov axioms Created 2026-09-29 Updated 2026-10-14
The Kolmogorov axioms describe a consistent way to assign probabilities to events. Start with a sample space and an event sigma-algebra : it contains and is closed under complements and countable unions, hence also countable intersections. The probability measure is a function satisfyingThe triple is a probability space. The third axiom is countable additivity; the infinite series means the limit of a sequence of nonnegative partial sums. It applies to pairwise disjoint events, not to overlapping events and not to arbitrary uncountable unions.[ref]
The sigma-algebra specifies which questions have probabilities, while the axioms specify how those probabilities fit together. For a finite sample space one can take the entire power set; a continuous model commonly uses a Borel sigma-algebra. Nonnegativity and normalization do not require equally likely outcomes or independence: those are additional modelling choices.
For an exact six-outcome model, take , , and assign . The total is one because . Define the probability of an event by summing the weights of its outcomes. The disjoint events , and form a partition of a set withThis is a specified mathematical model, not measured die frequencies. The figure makes probability literal area: each region has the same height and a width proportional to its assigned mass. Regrouping disjoint events preserves their total area.
Several familiar rules are consequences, not further axioms. Finite additivity of a set function follows by appending empty events to the sequence in countable additivity; follows already by writing as a disjoint union. The complement rule of probability gives and therefore . Splitting larger events into a smaller event and a set difference shows .
For overlapping events, the inclusion-exclusion principle corrects double counting:In the six-outcome model, and give , agreeing with the weight of . This decomposition is useful because a complicated event can be assembled from simpler questions with known probabilities.
On a finite sample space, a family of pairwise disjoint events has only finitely many nonempty members, so finite additivity of a set function already handles every countable disjoint union. On an infinite sample space, the countable axiom additionally controls what is left beyond every finite stage. In the fair-coin waiting model of continuity of probability, the finite-stage calculations sum to through toss . Countable additivity makes the probability of a head at some finite toss equal to ; finite-stage sums alone do not justify that passage. For the continuous uniform distribution on , each singleton instead has probability zero, while their uncountable union has probability one. Countable, rather than unrestricted, additivity accommodates both models.
Historically, Kolmogorov's 1933 book Grundbegriffe der Wahrscheinlichkeitsrechnung established the influential axiomatic framework connecting probability theory with measure theory. The three conditions above are the modern presentation on a sigma-algebra. Shafer and Vovk's historical study explains that the original presentation began with finite additivity on an algebra of sets and added continuity for decreasing events with empty intersection, which supplies the countable extension.[ref]
Kolmogorov-Smirnov statistic 2026-10-14
For an empirical distribution function and a specified cumulative distribution function , the one-sample Kolmogorov-Smirnov statistic is their Kolmogorov distance:The displayed sum uses an indicator function. With this convention, is right-continuous. For distinct observations, its value and its left one-sided limit at the th order statistic are and .
For continuous , both jump sides matter. Define the two directional discrepancies byThus uses the empirical distribution function immediately after a jump, and uses its left one-sided limit.[ref] A supremum need not be attained.
For , on , and the stipulated order statistics , the complete calculation isThe last two columns give the signed directional gaps: , , and . In contrast, checking only gives and misses the largest gap approached as . At itself, the gap has already fallen to .
The finite formula follows from the behavior between jumps: the empirical distribution function is constant and the cumulative distribution function is monotone, so the largest directional gaps occur at the two interval ends, possibly as one-sided limits. The two tails introduce no larger gap. Checking every jump side therefore gives the exact supremum.
A common normalized Kolmogorov-Smirnov statistic is , which equals in this example. Its large-sample reference law comes from the Kolmogorov-Smirnov theorem. The unscaled remains the largest difference of cumulative probabilities, not a p-value.
There is a useful exact exception to the usual warning about fitting statistical parameters. Suppose independent and identically distributed observations have the uniform distribution on with unknown . Let and let be the label of its almost surely unique maximizing observation. Conditional on and , the surviving labelled observations are independent with the uniform distribution on ; after division by they are independent and identically distributed uniforms on . These are conditional distributions defined by probability density functions, since the event has probability zero.
To check this, the joint probability density function of and is for . Dividing the original joint probability density function by this factor gives the conditional survivor probability density functionThis factorization proves the claimed conditional independence; scaling removes . Keep the surviving labels in a fixed order, or apply an independent random permutation. The sorted survivors instead have the joint law of uniform order statistics and exhibit statistical dependence; sorting does not affect their empirical distribution function. Delete the maximum itself, which would otherwise become a forced value , and compute the Kolmogorov-Smirnov statistic using sample size and jump heights . This gives an exact conditional Kolmogorov-Smirnov test under the uniform-endpoint statistical model. It does not justify fitting an arbitrary endpoint or other statistical parameters and using the ordinary -sample calibration.
Kolmogorov-Smirnov test 2026-10-14
The one-sample Kolmogorov-Smirnov test checks goodness of fit by comparing an empirical distribution function with a specified cumulative distribution function . Its Kolmogorov-Smirnov statistic is the largest vertical gap anywhere between the two curves. Every threshold asks the same concrete question: what proportion of the observations are at or below it, and what probability does the proposed probability distribution assign there? A large discrepancy supplies evidence against the null hypothesis.
For example, four stipulated observations compared with the uniform distribution on give . Just before , only two observations have been counted, so the empirical distribution function approaches , while approaches . The Kolmogorov-Smirnov statistic section calculates every jump-side gap. These are exact illustrative numbers, not experimental measurements or a claim of statistical significance.
The ordinary one-sample calibration assumes independent and identically distributed real observations and a simple hypothesis , with a continuous function fixed before inspecting these observations. All statistical parameters of must be specified.[ref] Under that null hypothesis, the probability integral transform gives with the uniform distribution on , retaining independence. Consequently the sampling distribution of depends on the sample size , but not on the particular continuous . This is the useful sense in which the calibration is distribution-free.
For the exponential distribution of rate one, for . Take for the four stipulated above. The probability integral transform changes the horizontal coordinates but preserves both the order statistics and their cumulative heights, so the same Kolmogorov-Smirnov statistic appears on both scales. More generally, for continuous , the jump-side formulas depend only on . Strict increase everywhere is unnecessary: intervals on which is constant have probability zero under the null hypothesis. This explains the invariance without assuming a strictly positive probability density function.
The probability integral transform preserves the Kolmogorov-Smirnov gap on exponential and uniform scales
. The same four stipulated points are shown as on the left and on the right. Open circles indicate left limits of the empirical distribution function, filled circles its values. The gap is approached from below the third observation on both scales. Details.The observed Kolmogorov-Smirnov statistic is a discrepancy, whereas its p-value is a tail probability under the null hypothesis:Here is computed from a fresh sample of the same sample size. Choose a significance level before the test and reject when the calibrated p-value is at most . The value alone supplies neither a p-value nor a rejection decision. Failure to reject does not establish that the null hypothesis is true. A finite-sample calibration and the asymptotic Kolmogorov-Smirnov theorem are distinct; a cutoff for must be rescaled before use with .[ref]
Fitting statistical parameters on the tested observations replaces by the random . The resulting transformed observations need not be independent and identically distributed uniforms, so the ordinary reference law fails. The Lilliefors test addresses a particular fitted normal distribution. More general parametric bootstrap calibration must simulate from the fitted statistical model and repeat the fitting in every replicate; holding the fitted statistical parameters fixed during those comparisons calibrates a different procedure. Such a parametric bootstrap requires its own validity justification rather than inheriting exactness from the simple-null test.
For a discrete probability distribution, is generally not uniform. Equal observations also arise from rounding, so tied data require a calibration that accounts for the discrete probability distribution or the rounding rule. The discrepancy remains meaningful, but continuous-null p-values are not automatically valid. Statistical dependence likewise changes the reference law. The two-sample Kolmogorov-Smirnov test compares two empirical distribution functions and has a different calibration.[ref]





