Simulated annealing Created 2026-10-14 Updated 2026-10-18
Simulated annealing accepts worse feasible solutions to escape a local minimum. Minimize an objective function , analogous to energy. Effective temperature has the same units as , absorbing the Boltzmann constant; it controls exploration, rather than a material's thermodynamic temperature.[ref]
Optimization by Simulated Annealing by Scott Kirkpatrick and others. Printed pp. 672–673: effective temperature and cost as energy
Given current feasible point , draw from a proposal distribution . For a symmetric proposal distribution, , use the Metropolis–Hastings acceptance probabilityAccept with this conditional probability; on rejection retain . Every downhill or equal-cost proposal is accepted. Draw a fresh uniform random variable on and accept if . The off-diagonal transition probability includes proposing .[ref]
Optimization by Simulated Annealing by Scott Kirkpatrick and others. Printed p. 672: acceptance rule and rejected proposals
For a maximization problem with objective function , set : every improving proposed neighbor is accepted, and a worsening move of loss has conditional probability of acceptance, under the same symmetry assumption. Likelihood-power annealing uses precisely this sign convention for a log-likelihood. Retain the best feasible solution seen, since the current state can worsen even after a global minimum has been visited.
If the proposal distribution is asymmetric, use the full Metropolis–Hastings acceptance probability, for ,A missing reverse proposal gives zero acceptance. Even a downhill proposal need not be accepted with probability one in this case. Choosing uniformly among a variable number of neighbors is generally asymmetric: and give the correction , where is vertex degree.[ref]
The useful idea is to separate exploring from insisting on improvement: an uphill move can open a route to a better feasible solution. Its usefulness depends on the proposal distribution, the scale of the objective function, and the cooling schedule for simulated annealing. Finite practical schedules carry no general guarantee of finding a global minimum.
Fix a failure probability and assume an independent and identically distributed statistical sample. A finite-sample confidence band for its population cumulative distribution function isHere is the natural logarithm. The DKW inequality impliesThis is simultaneous coverage over the whole real line, valid at each fixed sample size.[ref]
To obtain the band, solve for the positive . Outside a failure event of probability at most , for every . Since a cumulative distribution function already lies in , clipping the endpoints to this interval preserves the coverage event. The guarantee is at least , and need not equal it.
Choose , giving at least simultaneous coverage under the stated model. For , respectively, the half-widths before clipping areFor the chosen five observations, the band at is , while at it is approximately . At the unclipped band would be , so clipping gives . The broad uncertainty is informative: five observations give a precise description of themselves, but a coarse bound for an unknown population cumulative distribution function.
Finite-sample simultaneous uncertainty around an empirical distribution function
. Left: the chosen five observations give and its band clipped to , using . Right: theoretical half-widths for , with no additional samples constructed. The confidence band has coverage at least under independent and identically distributed sampling; the drawing illustrates the procedure and does not establish its coverage. Details.A collection of pointwise confidence intervals only promises coverage separately at each preselected threshold; it does not promise coverage of an entire cumulative distribution function. Here the one simultaneous event permits inspecting any threshold after seeing the data. The probability refers to repeated sampling of the entire statistical sample, with fixed. It does not assign probability to a fixed after observing this particular band, and it is not a prediction interval for a future observation. The displayed comparison gives a guarantee for each fixed separately, not simultaneous validity over all sample sizes or an optional stopping rule. The chosen observations are an illustration; the coverage claim follows from the DKW inequality, not from their appearance or a simulation. Dependence or observations with different sampling laws require another argument.
At fixed , multiplying by divides the half-width by . Conversely, a desired half-width is ensured by , rounded up to an integer. For and , this sufficient sample size is . This makes the confidence band useful for planning how many observations are needed before estimating threshold probabilities to a chosen simultaneous accuracy.
Offer independent uniform edges of the complete graph per row and permit any one to be selected from each row. If a chosen graph has no graph component of order at least , the balanced component cut provides an empty cut whose sides both have at least vertices. Each candidate edge crosses that cut with probability at least , so a row can avoid crossing with probability at most . The union bound over at most cuts gives failure probability at most . Any fixed integer with suffices. The guarantee is simultaneous even for choices made after seeing every offered edge.
Simultaneous wavelet coefficient noise bound 2026-10-14
For coefficient weights and independent mean-zero sub-Gaussian random variables of parameter , put . Multiplying moment-generating-function bounds shows that the weighted noise has parameter . The exponential Markov inequality, optimized in its parameter, gives tail bound . At the displayed thresholds, a union bound over coefficients gives simultaneous control with probability at least . No coefficient independence is required. Integrated wavelet weights satisfy . Finite variance alone only supports the weaker Chebyshev choice .
Single-channel current-voltage relation 2026-10-14
For an ideal open ion channel with constant electrical conductance , membrane potential and reversal potential , define outward electric current as positive:This is an Ohm's law model of the open state, not a universal channel law or a rule for opening probability. In the synthetic figure, and . Because , the open-state electric currents at and are and . Zero electric current at the reversal potential does not imply a closed ion channel. Real ion channels can have nonlinear responses, so the straight line is an explicit idealization.
If lies in the kernel of , then has no normalized quantum state. A request to produce that normalized vector with positive probability is consequently undefined. For example, on one qubit has distinct dyadic eigenvalues, but annihilates . The corrected filtering assertion requires ; it cannot be repaired by assigning a positive success probability to this input.
Site percolation Created 2026-09-24 Updated 2026-10-14
In independent site percolation with parameter , each vertex of a graph is open with probability , independently of the others. Retain those vertices and every original edge whose two endpoints are retained. This gives an induced subgraph, whose connected components of a graph are the percolation clusters. A closed vertex is absent from the usable network, whereas bond percolation keeps all vertices and instead removes individual edges.
A specified simple graph path of edges has distinct vertices. Its probability of being entirely open is therefore , including the starting vertex. Conditional on that vertex being open, it is by independence. For a two-edge graph path at , the unconditional probability is , compared with in bond percolation. This comparison concerns a fixed route; percolation critical probabilities require analysis of all possible routes on the specified infinite graph.
Small normal sample mean confidence interval 2026-10-18
Under the studentized normal sample mean assumptions, let denote the quantile at cumulative probability of the Student's t-distribution. For , rearranging the event gives a Student t confidence interval for the unknown mean with exact coverage probability . [ref]
Choose the list as an original arithmetic example, not as reported measurements or a claim that these five numbers establish a normal distribution. If such values were obtained under the assumed independent and identically distributed normal distribution model with unknown , thenThere are four statistical degrees of freedom. For a 95% confidence interval, , soUsing the standard normal quantile with the same estimated standard error would give only . That underestimates the correct margin by about 29.4%. Indeed its actual coverage probability under this normal distribution model is , rather than 0.95.
The observations, the sample mean and the confidence interval all have different meanings. The bar estimates the population mean; it is not an interval intended to contain 95% of individual observations. In repeated independent samples of size five from the assumed normal distribution, 95% of intervals constructed using the exact quantile cover the same fixed . This is not a 95% posterior probability that the fixed statistical parameter lies in this particular realized interval. Such a probability requires a separate Bayesian inference model.
For this four-degree case, the cumulative distribution function has an especially simple form:One can check the formula by differentiation: , with limits zero and one at the two ends of the real line. Solving the increasing equation by the bisection method gives the quantile used above.
Smoothing bandwidth Created 2026-10-05 Updated 2026-10-14
A smoothing bandwidth determines the scale over which a regression kernel averages data, or a kernel for density estimation spreads each observation. It has the same units as the observations. In kernel density estimation, changing changes the visible detail while preserving the total integral one. For a Gaussian density kernel, each bump has standard deviation and its individual contribution has peak height .
If the smoothing bandwidth is too small relative to the spacings in a statistical sample, the kernel density estimator shows narrow spikes tied to individual observations: apparent peaks may be sampling accidents. If it is too large relative to features of the unknown probability density function, it blurs distinct groups together and spreads fitted probability far from the observations. An intermediate smoothing bandwidth can reveal broad structure, but visual smoothness alone cannot establish accuracy.
The same sample at three Gaussian bandwidths, and leakage below zero for a separate positive sample
. Details. The first three panels use exactly with smoothing bandwidths , and , respectively. Every curve has area one; the two groups in the observed statistical sample become less distinct as increases. No true probability density function is specified in this illustration, so the middle panel is illustrative, not a certified optimal fit. The fourth panel uses and to illustrate boundary bias of a kernel density estimator.
For a fixed nonnegative kernel for density estimation with finite squared integral, a probability density function that is bounded and continuous at an interior point with , and a deterministic sequence , the pointwise sampling variance obeysThus decreasing the smoothing bandwidth increases the leading sampling variance while reducing interior smoothing bias of an estimator: this is a bias-variance tradeoff. The conditions and express two goals, increasingly fine resolution and enough observations contributing locally. Practical methods such as plug-in bandwidth selection use the data to choose ; pointwise optimal kernel bandwidth depends on local features of the unknown probability density function. The smoothing bandwidth remains a tuning choice in nonparametric statistics, and knowing the support of a probability distribution can require more than a width adjustment near a boundary.
Spin expectation value 2026-10-14
For spin one-half, choose the normalized spin eigenstates with . The spin one-half along an axis pure state in the plane isIts norm is one because the two eigenstates are orthogonal and . Applying the Born rule to a projective measurement givesConsequently the expectation value, second moment, and variance areAt , the outcome probabilities are and , the mean is , and the variance is . Every individual outcome remains . At , the mean is zero and the variance is maximal, . At either pole, one outcome has probability one and the variance vanishes.
Spin expectation value between the two possible outcomes
. Original calculated Born rule distributions at three preparation angles. Bar heights are outcome probabilities; the dashed orange line marks the expectation value, whose horizontal position is usually not an allowed outcome. Spin values are expressed in units of the reduced Planck constant. No bars represent experimental observations. Source. Details.The diagonal mixed state has the same probabilities, expectation value, and variance as . It is nevertheless a different quantum state for : the displayed pure state has , while has . A single component's mean does not reveal all relative quantum phases or establish purity of a density operator.
Spin measurement 2026-10-18
For a spin one-half system, an ideal projective measurement along a unit vector measures . Its eigenvalues are , corresponding to physical spin angular momentum components , and its orthogonal projections are . For density matrix , the Born rule and the Pauli matrix multiplication law give the displayed probabilities. Thus a spin measurement along one direction tests only that component of the Bloch vector; measurements along three independent directions determine the entire density matrix.
Spin measurement in the yz plane 2026-10-20
For a state initially -up and precessing about , measurement along has the displayed probabilities. eigenvectors can be chosen as and . Their phases must be retained when taking inner products. Full rotation changes their signs but leaves isolated-state probabilities unchanged.
Spin-one maximum-projection eigenvector 2026-10-20
In the ordered z-projection basis , the normalized eigenvector of with eigenvalue is the displayed vector. It follows by a y-axis rotation of the maximum-weight state, or direct solution of the tridiagonal eigenvalue equation. Squaring its entries gives the three z-projection measurement probabilities.
Spin uncertainty state dependence Created 2026-10-14 Updated 2026-10-20
For a qubit, use the dimensionless Pauli matrices as observables , . Their Pauli matrix multiplication law givesThese observables have eigenvalues ; the physical spin components are , where is the reduced Planck constant, so their standard deviations acquire a factor .
In the computational basis, prepare , an eigenstate of with eigenvalue . Direct multiplication givesBoth Pauli measurements return and with equal probabilities, and the Robertson uncertainty principle is saturated: .
Instead prepare . Now the expectation values are , , so , . The Pauli measurement of is certain, and both sides of the bound vanish. The commutator is still nonzero as an operator: noncommuting observables do not guarantee a positive lower bound independent of the quantum state. This example is useful for distinguishing the algebra of the observables from the expectation values in a particular preparation.
Pauli standard deviations, their product, and the Robertson bound in two preparations: the same noncommuting observables give bounds of one and zero
. Details. Squared quantum fidelity 2026-10-14
This is the square of the unsquared quantum fidelity, another common convention for fidelity of quantum states. If one state is the normalized pure state , thenBy the Born rule, the squared quantum fidelity here is the probability that a measurement in quantum mechanics with acceptance orthogonal projector accepts . For two pure states it is : the comparison of with has acceptance probability and unsquared quantum fidelity .
For two general mixed states, neither quantum fidelity nor squared quantum fidelity is a probability that the states are equal. Equality of two specified density operators is a definite mathematical condition. The measurement characterization of quantum fidelity instead describes overlap between outcome probability distributions. The ensemble average used in reliable quantum source compression is normally the average squared quantum fidelity with the emitted pure state; the convention must be stated when comparing formulas.
Square-root bound for increasing events 2026-10-07
For two increasing events of equal probability under a product measure, positive association of their complements gives . Hence . For equal-probability increasing events, the same reasoning gives .
Squeezed-vacuum photon-number moments 2026-10-20
Here . The pair moment is . These expressions follow from the single-mode Bogoliubov transformation or by differentiating the even-occupation probability generating function .
Standardization of a normal random variable Created 2026-09-24 Updated 2026-10-14
If with , then has the standard normal distribution. The change-of-variables formula for a probability density gives , the standard normal density. Thus standardization of a normal random variable removes both parameters without changing the probabilities of corresponding events.
Standard normal distribution Created 2026-09-24 Updated 2026-10-14
The standard normal distribution is : the normal distribution with mean zero, variance one and standard deviation one. Its standard normal density integrates to one; its standard normal distribution function records the area accumulated from to a threshold. The distinction matters: , , and for a standard normal random variable .
For a toy measurement , leave the measurement unit unspecified. The standardization of a normal random variable converts into standard scores . Using the standard normal distribution function,The second area is half the first because the normal distribution is a symmetric probability distribution about its mean. The numerical heights differ: , yet the corresponding shaded areas are equal because in the change of variables.
Standard normal distribution function Created 2026-09-24 Updated 2026-10-14
The standard normal distribution function is the cumulative distribution function of a standard normal random variable :Here is the standard normal density and is the error function. The symmetric probability distribution gives and , while differentiation gives . For with , standardization of a normal random variable gives ; subtracting two values calculates an interval probability.





