Simple random walk Created 2026-09-24 Updated 2026-10-14
A simple random walk on a locally finite graph chooses each vertex in the current vertex's graph neighbourhood with equal probability, assuming there is at least one available neighbour. On the integer line there are two choices, one unit left or right, so each has probability . This is the one-dimensional simple symmetric random walk. Terminology varies: a simple random walk on the integer line is also often allowed unequal step probabilities, with “symmetric” specifying the fair case.
For a simple symmetric random walk starting at , each increment has the Rademacher distribution, with expected value zero and variance one. Thus linearity of expectation and the variance of a sum of independent random variables give
For example, after steps the expected value is zero, the variance is , and the standard deviation is . Doubling the typical distance scale takes four times as many steps. This square-root growth explains why a random walk can wander far even when there is no preferred direction.
Figure 1.
Four fair and two biased unit-step random-walk paths, with their expected values and bands one standard deviation wide on either side.
Details.
The colored curves are illustrative sample paths, not averages over all possible walks. The dashed curves show the expected values; the shaded bands show the expected value plus or minus one standard deviation at each time. These bands are a scale of spread, not confidence intervals, and give no guarantee that an entire sample path stays inside them.
Zero expected value does not make this a stationary process: its one-time probability distribution changes with , as the increasing variance already proves. It does have stationary increments and independent increments, because blocks of fresh steps have the same probability distribution at any starting time and disjoint blocks use independent random variables. This separation of position from increment is one reason the random walk is such a useful first example of a stochastic process.
Simple random walk on the integer line Created 2026-09-24 Updated 2026-10-14
A simple random walk on the integer line starts at and takes independent and identically distributed random variables as unit increments, with
The simple symmetric random walk has ; a biased random walk has . At or every step is deterministic, giving or respectively.
Count the rightward steps using indicator functions:
Thus the endpoint is a shifted and rescaled random variable with a binomial distribution. For a worked example, at the endpoint means exactly three rightward steps and one leftward step. There are possible orders, so its probability is , equal to in the fair case. More generally the binomial coefficient counts the orders, giving the exact probability mass function
In particular, the endpoint must have the same integer parity as : . For the support of a probability distribution is exactly . At only even integers in are reachable; at only odd integers are reachable. This restriction is easy to lose if one draws a smooth curve instead of discrete probability masses. The fair-walk counting argument is also presented in Grinstead and Snell, Introduction to Probability, section 12.1.
Figure 1.
Exact binomial endpoint probabilities for fair walks of 20 and 80 steps and a biased walk of 80 steps; only even endpoints are possible.
Details.
The endpoint identity and the binomial distribution give the expected value, variance, and standard deviation
A short direct check gives and , hence . Then apply linearity of expectation and the variance of a sum of independent random variables.
The absolute width and the width relative to the number of steps answer different questions. In the fair case the standard deviation grows from to , while shrinks from to . At , the standard deviation is , or times the fair width, and . Centering and dividing by each walk's own standard deviation gives, for ,
This rescaling equalizes the variances, not the entire probability distributions. The spacing between reachable endpoints is two, so its rescaled spacing is : approximately for the fair -step walk, for the fair -step walk, and for the biased -step walk.
The positions themselves are dependent. For , , where the second term is independent of . Their covariance is therefore
For example, in the fair case allows or , whereas allows or . Nevertheless the position process is a Markov chain: given its current position, the next fresh increment has no dependence on its past. Its transition probabilities are
These transition probabilities are the same at every time and every integer position: shifting both and by the same integer leaves unchanged. Thus the Markov property and independent increments coexist with dependent positions.
Simulated annealing Created 2026-10-14 Updated 2026-10-18
Simulated annealing accepts worse feasible solutions to escape a local minimum. Minimize an objective function , analogous to energy. Effective temperature has the same units as , absorbing the Boltzmann constant; it controls exploration, rather than a material's thermodynamic temperature.[ref]
Given current feasible point , draw from a proposal distribution . For a symmetric proposal distribution, , use the Metropolis–Hastings acceptance probability
Accept with this conditional probability; on rejection retain . Every downhill or equal-cost proposal is accepted. Draw a fresh uniform random variable on and accept if . The off-diagonal transition probability includes proposing .[ref]
For a maximization problem with objective function , set : every improving proposed neighbor is accepted, and a worsening move of loss has conditional probability of acceptance, under the same symmetry assumption. Likelihood-power annealing uses precisely this sign convention for a log-likelihood. Retain the best feasible solution seen, since the current state can worsen even after a global minimum has been visited.
If the proposal distribution is asymmetric, use the full Metropolis–Hastings acceptance probability, for ,
A missing reverse proposal gives zero acceptance. Even a downhill proposal need not be accepted with probability one in this case. Choosing uniformly among a variable number of neighbors is generally asymmetric: and give the correction , where is vertex degree.[ref]
The useful idea is to separate exploring from insisting on improvement: an uphill move can open a route to a better feasible solution. Its usefulness depends on the proposal distribution, the scale of the objective function, and the cooling schedule for simulated annealing. Finite practical schedules carry no general guarantee of finding a global minimum.
Fix a failure probability and assume an independent and identically distributed statistical sample. A finite-sample confidence band for its population cumulative distribution function is
Here is the natural logarithm. The DKW inequality implies
This is simultaneous coverage over the whole real line, valid at each fixed sample size.[ref]
To obtain the band, solve for the positive . Outside a failure event of probability at most , for every . Since a cumulative distribution function already lies in , clipping the endpoints to this interval preserves the coverage event. The guarantee is at least , and need not equal it.
Choose , giving at least simultaneous coverage under the stated model. For , respectively, the half-widths before clipping are
For the chosen five observations, the band at is , while at it is approximately . At the unclipped band would be , so clipping gives . The broad uncertainty is informative: five observations give a precise description of themselves, but a coarse bound for an unknown population cumulative distribution function.
Figure 1.
Finite-sample simultaneous uncertainty around an empirical distribution function
. Left: the chosen five observations give and its band clipped to , using . Right: theoretical half-widths for , with no additional samples constructed. The confidence band has coverage at least under independent and identically distributed sampling; the drawing illustrates the procedure and does not establish its coverage. Details.
A collection of pointwise confidence intervals only promises coverage separately at each preselected threshold; it does not promise coverage of an entire cumulative distribution function. Here the one simultaneous event permits inspecting any threshold after seeing the data. The probability refers to repeated sampling of the entire statistical sample, with fixed. It does not assign probability to a fixed after observing this particular band, and it is not a prediction interval for a future observation. The displayed comparison gives a guarantee for each fixed separately, not simultaneous validity over all sample sizes or an optional stopping rule. The chosen observations are an illustration; the coverage claim follows from the DKW inequality, not from their appearance or a simulation. Dependence or observations with different sampling laws require another argument.
At fixed , multiplying by divides the half-width by . Conversely, a desired half-width is ensured by , rounded up to an integer. For and , this sufficient sample size is . This makes the confidence band useful for planning how many observations are needed before estimating threshold probabilities to a chosen simultaneous accuracy.
Offer independent uniform edges of the complete graph per row and permit any one to be selected from each row. If a chosen graph has no graph component of order at least , the balanced component cut provides an empty cut whose sides both have at least vertices. Each candidate edge crosses that cut with probability at least , so a row can avoid crossing with probability at most . The union bound over at most cuts gives failure probability at most . Any fixed integer with suffices. The guarantee is simultaneous even for choices made after seeing every offered edge.
For coefficient weights and independent mean-zero sub-Gaussian random variables of parameter , put . Multiplying moment-generating-function bounds shows that the weighted noise has parameter . The exponential Markov inequality, optimized in its parameter, gives tail bound . At the displayed thresholds, a union bound over coefficients gives simultaneous control with probability at least . No coefficient independence is required. Integrated wavelet weights satisfy . Finite variance alone only supports the weaker Chebyshev choice .
For N independent equivalent ion channels with open probability and approximately Ohmic open-state electrical conductance , the mean electric current is . A numerical Electrical conductance cannot be inferred without the relevant reversal potential or driving voltage.
For an ideal open ion channel with constant electrical conductance , membrane potential and reversal potential , define outward electric current as positive:
This is an Ohm's law model of the open state, not a universal channel law or a rule for opening probability. In the synthetic figure, and . Because , the open-state electric currents at and are and . Zero electric current at the reversal potential does not imply a closed ion channel. Real ion channels can have nonlinear responses, so the straight line is an explicit idealization.
Consider a logistic choice rule with and fixed noise scale. At one positive offer , changes satisfying leave utility and acceptance probability unchanged. One offer therefore cannot identify reward gain and effort cost separately.
For example, and both give at . Their predictions differ at other offers. Independently varying reward and effort can identify the two coefficients within this model when the design has rank two and choice data are informative. If noise scale is also unknown, its tradeoff with the coefficients requires additional constraints.
If lies in the kernel of , then has no normalized quantum state. A request to produce that normalized vector with positive probability is consequently undefined. For example, on one qubit has distinct dyadic eigenvalues, but annihilates . The corrected filtering assertion requires ; it cannot be repaired by assigning a positive success probability to this input.
Site percolation Created 2026-09-24 Updated 2026-10-14
In independent site percolation with parameter , each vertex of a graph is open with probability , independently of the others. Retain those vertices and every original edge whose two endpoints are retained. This gives an induced subgraph, whose connected components of a graph are the percolation clusters. A closed vertex is absent from the usable network, whereas bond percolation keeps all vertices and instead removes individual edges.
A specified simple graph path of edges has distinct vertices. Its probability of being entirely open is therefore , including the starting vertex. Conditional on that vertex being open, it is by independence. For a two-edge graph path at , the unconditional probability is , compared with in bond percolation. This comparison concerns a fixed route; percolation critical probabilities require analysis of all possible routes on the specified infinite graph.
Under the studentized normal sample mean assumptions, let denote the quantile at cumulative probability of the Student's t-distribution. For , rearranging the event gives a Student t confidence interval for the unknown mean with exact coverage probability . [ref]
Choose the list as an original arithmetic example, not as reported measurements or a claim that these five numbers establish a normal distribution. If such values were obtained under the assumed independent and identically distributed normal distribution model with unknown , then
There are four statistical degrees of freedom. For a 95% confidence interval, , so
Using the standard normal quantile with the same estimated standard error would give only . That underestimates the correct margin by about 29.4%. Indeed its actual coverage probability under this normal distribution model is , rather than 0.95.
Figure 1.
Chosen five-value example: estimating the spread requires a wider t confidence interval
. Details.
The observations, the sample mean and the confidence interval all have different meanings. The bar estimates the population mean; it is not an interval intended to contain 95% of individual observations. In repeated independent samples of size five from the assumed normal distribution, 95% of intervals constructed using the exact quantile cover the same fixed . This is not a 95% posterior probability that the fixed statistical parameter lies in this particular realized interval. Such a probability requires a separate Bayesian inference model.
For this four-degree case, the cumulative distribution function has an especially simple form:
One can check the formula by differentiation: , with limits zero and one at the two ends of the real line. Solving the increasing equation by the bisection method gives the quantile used above.
Smoothing bandwidth Created 2026-10-05 Updated 2026-10-14
A smoothing bandwidth determines the scale over which a regression kernel averages data, or a kernel for density estimation spreads each observation. It has the same units as the observations. In kernel density estimation, changing changes the visible detail while preserving the total integral one. For a Gaussian density kernel, each bump has standard deviation and its individual contribution has peak height .
If the smoothing bandwidth is too small relative to the spacings in a statistical sample, the kernel density estimator shows narrow spikes tied to individual observations: apparent peaks may be sampling accidents. If it is too large relative to features of the unknown probability density function, it blurs distinct groups together and spreads fitted probability far from the observations. An intermediate smoothing bandwidth can reveal broad structure, but visual smoothness alone cannot establish accuracy.
Figure 1.
The same sample at three Gaussian bandwidths, and leakage below zero for a separate positive sample
. Details.
The first three panels use exactly with smoothing bandwidths , and , respectively. Every curve has area one; the two groups in the observed statistical sample become less distinct as increases. No true probability density function is specified in this illustration, so the middle panel is illustrative, not a certified optimal fit. The fourth panel uses and to illustrate boundary bias of a kernel density estimator.
For a fixed nonnegative kernel for density estimation with finite squared integral, a probability density function that is bounded and continuous at an interior point with , and a deterministic sequence , the pointwise sampling variance obeys
Thus decreasing the smoothing bandwidth increases the leading sampling variance while reducing interior smoothing bias of an estimator: this is a bias-variance tradeoff. The conditions and express two goals, increasingly fine resolution and enough observations contributing locally. Practical methods such as plug-in bandwidth selection use the data to choose ; pointwise optimal kernel bandwidth depends on local features of the unknown probability density function. The smoothing bandwidth remains a tuning choice in nonparametric statistics, and knowing the support of a probability distribution can require more than a width adjustment near a boundary.
A prescribed-velocity motor can attach only over a narrow displacement window, remain attached over a protected interval, then detach with constant rate. Converting time to displacement gives a rising attachment probability, a plateau , and an exponential tail with spatial length . Independent successive-site encounters require detachment before the next window, not merely a large geometric site separation. Earlier attachments can be retained in a periodic availability correction.
Where a nonzero wavefunction can be written as , and there is no vector potential, substituting into the Schrodinger probability current gives . The direction of probability flow is determined by the phase gradient rather than the slope of the real part. A plane wave and its complex conjugate have the same real part and density but opposite currents. In a vector potential the gauge-invariant kinetic momentum replaces .
Spin expectation value 2026-10-14
For spin one-half, choose the normalized spin eigenstates with . The spin one-half along an axis pure state in the plane is
Its norm is one because the two eigenstates are orthogonal and . Applying the Born rule to a projective measurement gives
Consequently the expectation value, second moment, and variance are
At , the outcome probabilities are and , the mean is , and the variance is . Every individual outcome remains . At , the mean is zero and the variance is maximal, . At either pole, one outcome has probability one and the variance vanishes.
Figure 1.
Spin expectation value between the two possible outcomes
. Original calculated Born rule distributions at three preparation angles. Bar heights are outcome probabilities; the dashed orange line marks the expectation value, whose horizontal position is usually not an allowed outcome. Spin values are expressed in units of the reduced Planck constant. No bars represent experimental observations. Source. Details.
The diagonal mixed state has the same probabilities, expectation value, and variance as . It is nevertheless a different quantum state for : the displayed pure state has , while has . A single component's mean does not reveal all relative quantum phases or establish purity of a density operator.
Spin measurement 2026-10-18
For a spin one-half system, an ideal projective measurement along a unit vector measures . Its eigenvalues are , corresponding to physical spin angular momentum components , and its orthogonal projections are . For density matrix , the Born rule and the Pauli matrix multiplication law give the displayed probabilities. Thus a spin measurement along one direction tests only that component of the Bloch vector; measurements along three independent directions determine the entire density matrix.
For a state initially -up and precessing about , measurement along has the displayed probabilities. eigenvectors can be chosen as and . Their phases must be retained when taking inner products. Full rotation changes their signs but leaves isolated-state probabilities unchanged.
Spin-one maximum-projection eigenvector Created 2026-10-20 Updated 2026-10-25
In the ordered z-projection basis , the normalized eigenvector of with eigenvalue is the displayed vector. It follows by a y-axis rotation of the maximum-weight state, or direct solution of the tridiagonal eigenvalue equation. Squaring its entries gives the three z-projection measurement probabilities.
Prepare the spin coherent state and evolve with Hamiltonian operator for time . In the descending- basis of the spin-one angular momentum matrices, the initial vector is and the evolved vector is , where . The orthonormal basis has vectors , and . Taking their inner products with the evolved vector gives probability amplitudes , and . Their squared moduli give the Born rule probabilities in the title. At integer half-turns , the outcome is deterministically .