Lagrange multiplier Created 2026-09-24 Updated 2026-10-13
For continuously differentiable functions on an open subset of , suppose is a local extremum of subject to , with . Then a real number , the Lagrange multiplier, satisfies
The nonzero gradient assumption excludes singular points of the optimization constraint. With several equality optimization constraints, require their gradients to be linearly independent; the gradient of is then a linear combination of them. These are necessary conditions, not automatic certificates of a global maximum or global minimum.
Why can the gradient be nonzero at an optimum? In unconstrained optimization, every direction is available at an interior local extremum, so all directional derivatives vanish and . On a regular equality feasible set, only directions in its tangent space are available to first order. The gradient of must be perpendicular to those directions, so it is parallel to the gradient of . In two dimensions this explains the tangency of their level sets. See MIT, Lagrange multipliers and contour geometry.
For the product example, set and use the optimization Lagrangian
Its partial derivatives give , , and . Hence . At , : increasing both inputs would help, but is infeasible. Along the allowed direction , the directional derivative is zero. The endpoints must still be checked because of the nonnegativity optimization constraints; completing the square establishes the unique global maximum.
The sign convention matters: writing instead gives . Neither equality Lagrange multiplier has a universal nonnegativity requirement. Also, the displayed is unbounded above along , so stationarity here does not meet the global hypothesis of the Lagrangian sufficiency theorem.
The Lagrange multiplier also measures the value of extra resources. For a positive budget , the optimizer is , the optimum value is , and . At , an extra units predicts a gain of ; the exact gain is . This is the envelope theorem in a computed sensitivity analysis: the multiplier translates a binding budget constraint into a marginal benefit.
The chosen quadratic objective function above gives more than an optimal allocation: its Lagrange multiplier predicts how much the best cost changes when the required total changes. For this example,
This is an explicit derivative of a constrained value function and an instance of the envelope theorem. At , one extra small unit of required output costs approximately units per unit of output, in the chosen normalized model. Increasing makes this equality-constrained minimization problem more expensive; it is not a gain from relaxing an upper resource limit. The sign and meaning depend on how the optimization constraint and optimization Lagrangian are written.[ref]
For an actual finite change , the cost difference is exactly
At , the linear approximation predicts , while the exact increase is . The extra comes from the squared term in this polynomial, rather than numerical error. A Lagrange multiplier gives a local sensitivity analysis; treating it as a constant price over a large change generally loses the change in the optimum itself.
Figure 1.
The multiplier is the slope of the optimal cost, with a computable finite-change correction
. Original calculations for . Left: the value function and its tangent at . Right: exact and first-order cost increases for nonnegative changes ; their gap is . The marked is a chosen example, not an observed price or a measured response. Details.
For a smooth optimizer of an equality problem , the short chain rule calculation explains the result: and imply . The differentiability and stationarity assumptions matter: an optimizer can fail to be unique or vary smoothly. The envelope theorem records when this interpretation is justified.
Parametric optimization 2026-10-06
A parametric optimization problem has objective or constraints depending on input data. Its optimizer set is a solution map of a parametric optimization problem. Sensitivity analysis asks how this map changes as the data vary.
Partial derivative Created 2026-09-24 Updated 2026-10-14
A partial derivative measures the local response of a function to one input while its other inputs stay fixed. For a function on an open subset of , its partial derivatives at are the limits
when the respective limits exist. Each is an ordinary derivative of a one-variable slice: or . This is why the other variable is treated as a constant during partial differentiation.[ref]
For an original example, take the polynomial function
Holding fixed gives , while holding fixed gives . At , the height is and the two partial derivatives are and . The values answer different experiments on the same mathematical model: change alone, or change alone.
The two exact slices through that point are
Dividing either height change by gives or ; taking the limit recovers the two slopes. At , the finite height changes are and , although their linear approximations are and . A derivative measures the limiting response, rather than an exact finite change.
Figure 1.
Two coordinate slices through one point give different partial derivatives
. Original contour plot of , with the point and coordinate paths. The right panel compares the exact slice height changes and with their tangent line predictions and . Both slices pass through height . Details.
For a function of variables, varies only its th coordinate: it is the same difference quotient along , the th standard basis vector. This gives a practical sensitivity analysis: one can compare how a mathematical model responds to changes in its individual inputs, provided the chosen system of units and the quantities held fixed are stated. Comparing the numerical sizes of two partial derivatives in different units does not by itself identify a physically preferable input.
Existence of the partial derivatives at one point is weaker than differentiability. The example under partial derivatives do not imply continuity shows how both coordinate tests can miss a bad diagonal approach. When the first partial derivatives are continuous in a neighborhood, they do give differentiability there, allowing the total differential to combine all small input changes.
One method is trim and fill. Estimate the direction and extent of funnel asymmetry, temporarily trim the extreme studies on the overrepresented side to estimate a centre, and fill in mirror-image studies on the underrepresented side. Recompute the pooled effect using the observed and imputed studies. This estimates what the summary might be under a symmetry-based missing-study model. It can move an exaggerated effect towards the null, but genuine heterogeneity can violate its symmetry assumptions.
A second method is a selection model for publication bias. Specify how the probability of a result being available depends on quantities such as its value, direction or precision, and combine that mechanism with a model for the underlying study effects. If a study estimate has density and availability probability , its observed density is proportional to , with a normalizing factor accounting for unobserved results. Fit the model, or vary the selection probabilities over plausible scenarios, to obtain selection-adjusted effects. Such models make assumptions about evidence that is missing, so their results are particularly useful as sensitivity analyses. Neither method removes publication bias without assumptions about the missing studies.
Ordinary multiple imputation by chained equations relies on missing at random, conditional on the variables included in its models, together with adequate model specification and suitable conditional distributions. For Bayesian inference that ignores the response mechanism, the usual sufficient condition also includes distinct parameters for data and missingness models, with an appropriately separate prior.
The suspected dependence on withheld responses makes the usual missing-at-random assumption doubtful. An accurately fitted observed-data model cannot, on its own, establish what the nonresponders would have reported. Use substantive judgement and sensitivity analysis under plausible missing not at random departures, for example a pattern-mixture sensitivity analysis shifting the imputed condom log odds or partner-count distribution relative to the observed-data prediction. Report how the final association changes. Additional informative measurements may make missing at random more credible, but cannot verify it.
Work in finite-dimensional Euclidean spaces. Suppose the graph of a set-valued mapping,
is locally closed at . Local closedness means that its intersection with some neighborhood of this point is closed relative to that neighborhood. This assumption is part of the criterion.
For a set and , define the Fréchet normal cone by
At an isolated point the condition is vacuous, so all vectors are regular normals. The limiting normal cone consists of limits of these regular normals at nearby points:
It can be nonconvex. The Mordukhovich coderivative is
The minus sign in the output-dual component is part of the definition. For a single-valued continuously differentiable mapping , the graph normal is , giving . Thus the coderivative extends a transpose derivative, rather than the ordinary forward derivative.
The exact Mordukhovich criterion is
This is equivalent to excluding a nonzero horizontal limiting graph normal . One must use the limiting normal cone; simply checking regular normals at the reference point can miss normals inherited from neighboring graph pieces.
For sensitivity analysis, apply this test to a solution map or use coderivative and normal cone calculus to express its graph normals through optimality constraints. Triviality of this kernel then proves Lipschitz-like stability without solving the perturbed problem explicitly. Under these same finite-dimensional, locally closed assumptions, the exact Lipschitz modulus is the outer norm
The zero-kernel condition is the qualitative criterion; the modulus quantifies the sensitivity bound. For the next problem an explicit local formula is simpler than evaluating these graph normals.
Let be a set-valued mapping and let . The Aubin property at means there are neighborhoods of , of , and a finite constant such that
Here is the closed unit ball. Equivalently, every solution near can be matched to a solution within . The localization is on the left-hand side: the matching point need not be in . The property is also called the Lipschitz-like property.
For sensitivity analysis, let represent data or perturbations and the set of feasible or optimal solutions. The Aubin property bounds how far a nearby solution can move when the data change. Taking , also guarantees a nearby solution for each sufficiently small perturbation . It is a stability estimate for a relation, and by itself does not imply uniqueness or differentiability. For a single-valued solution map, it reduces to local Lipschitz continuity.
The supplementary excerpt uses an adjusted observational study and a two-sample Mendelian randomization analysis.
The observational study examines co-occurrence of hypercalcaemia and migraine diagnoses in electronic health records, adjusting for age, sex, and ancestry. Its adjusted odds ratio is 1.58, with .
The two-sample Mendelian randomization analysis combines the associations of eight genetic variants with serum calcium and with migraine, using a weighted genetic risk score. It estimates an odds ratio of 1.80 per genetically predicted 1 mg/dL higher serum calcium, with 95% confidence interval . The weighted-median Mendelian randomization estimator and MR-Egger regression provide sensitivity analyses.
The measured and instrumented exposure is serum calcium, rather than dietary calcium intake itself. Calcium intake and serum calcium are not interchangeable interventions, and an odds ratio of 1.80 is an odds contrast rather than necessarily an 80% increase in probability. The shortened excerpt supplies two approaches; a further analysis in the full research paper is outside this excerpt.
Two useful ways to strengthen the causal inference are:
These are complementary: the first changes the proposed exposure experimentally, and the second probes the validity and reproducibility of its genetic evidence.
The nurse measurements can also reduce bias by making MAR more credible: withdrawal may depend on unobserved clinic QoL, but that QoL is partly represented by the post-dropout disability assessments. They also permit diagnostics comparing inferred QoL trajectories with an independently recorded proxy and can support sensitivity analysis for departures from MAR. They do not by themselves prove MAR, because the rough score may omit reasons for dropout related to QoL.
A predictively useful simulation of a simple multicellular organism is a plausible long-term goal, but “fully” must specify resolution, environmental conditions and the predictions to be tested. A model that reproduces selected behaviors is attainable in a different sense from an exact simulation of every molecule throughout development, physiology, reproduction and aging. The former can be evaluated scientifically; the latter is neither established by present models nor a necessary definition of success.
A useful target might be a specified developmental stage of Caenorhabditis elegans, in a controlled environment, with predictions for cell states, body movement and responses to defined perturbations. Its small size, optical accessibility and extensively mapped cell lineage make it attractive. The classic embryonic lineage study traced divisions, cell deaths and fates, while also using perturbations to investigate the role of interactions.[ref] Such a map constrains what a simulator must reproduce, but a list of normal outcomes does not itself specify the rules that generate them or how those rules respond to an unfamiliar intervention.
whole-cell modeling demonstrates both progress and the scale of the gap. A model of the bacterium Mycoplasma genitalium integrated 28 process models to connect cellular molecular functions with phenotypes, including growth, division and responses to genetic perturbation.[ref] This is a substantial integration achievement, but it is a unicellular system with many experimentally supplied quantities and modeling assumptions. Its existence does not show that adding a collection of copies yields a validated multicellular organism. Differentiation, tissue organization, intercellular communication and mechanical interactions introduce new dependencies.
At the organismal scale, OpenWorm is a concrete attempt to integrate components of a virtual Caenorhabditis elegans, including neural activity, muscle activation, body mechanics and interaction with an environment. The project's published account describes a program of integration and validation, not a claim to have completed all the animal's biology.[ref] A model can produce plausible locomotion while lacking developmental regulation, feeding or reproduction. Moreover, a neural wiring diagram alone leaves synaptic strengths, channel dynamics, neuromodulation, sensory transduction and the mechanical consequences of muscle forces underdetermined. Closing the loop through body and environment is therefore essential for behavioral prediction.
Several experimental developments make the goal more tractable. light-sheet fluorescence microscopy can follow living development with lower illumination of out-of-focus regions than conventional volume scanning, enabling repeated observation of cell divisions and movements, although phototoxicity and tracking errors still matter. single-cell RNA sequencing reveals heterogeneous cell states at scale; the lineage-resolved molecular atlas of Caenorhabditis elegans embryos connected transcriptional variation with known developmental ancestry.[ref] spatial transcriptomics complements dissociated-cell measurements by retaining spatial context. These approaches constrain different aspects of a model rather than supply interchangeable readouts.
Measurement remains incomplete. A transcript count is not an absolute protein concentration, an enzyme activity or a reaction rate. Dissociation-based measurements usually destroy the sampled organism, so a trajectory reconstructed across many cells is not direct observation of every molecular state in one living animal. Mechanical properties, metabolite fluxes and signaling dynamics require other assays. Perturbations such as controlled changes in gene activity, laser ablation or altered environmental conditions are particularly useful because they distinguish causal mechanisms that fit the same unperturbed trajectory. A sufficient validation dataset must therefore contain interventions as well as descriptions.
Computationally, multiscale modeling offers a more plausible strategy than resolving every atom. A simulator might couple gene regulatory networks inside cells to cell growth, fate transitions and movement, then to extracellular transport and tissue mechanics. For a diffusing signal, for example,
while each cell updates its internal state using the local signal concentration and its contacts. Those contacts change as the tissue moves, so the regulatory and mechanical descriptions must interact. Some processes can be deterministic at high copy number, while rare molecular events may require stochastic treatment. The choice of approximation should follow the prediction and timescale, rather than one mathematical formalism being imposed everywhere.
Platforms such as PhysiCell show how agent-based modeling can couple cell-level rules for division, death and mechanics to diffusible substrates and environmental conditions. Its demonstrations establish the feasibility of useful multicellular simulations, while leaving the user responsible for biological mechanisms and calibration.[ref] Data-driven approaches add another tool: scGen demonstrated prediction of some held-out cellular perturbation responses. That supports a restricted kind of generalization, not unlimited prediction of arbitrary interventions, long-term development or an entire organism.[ref] Learned components can be useful surrogates, but their training coverage and compatibility with physical constraints remain relevant.
The hardest obstacles are not just processor speed. Many parameter sets can reproduce the same measurements, creating identifiability problems. Errors in initial conditions, unobserved cell states and environmental boundary conditions can propagate through coupled modules. A mechanical model can change cell contacts, thereby altering signaling, which in turn changes growth and the mechanical state. Such feedback means that validating each module in isolation is necessary but insufficient. Interfaces must preserve units, spatial meaning, material balance and appropriate timing, and their numerical coupling must be verified. A larger model can accumulate more opportunities for error without producing more reliable predictions.
A credible development program would define success before fitting. For example, predict division timing, cell positions and a movement response within stated tolerances under a panel of withheld perturbations. Calibrate on different data, compare against simpler baselines, and evaluate whether predicted uncertainty covers observed variation across animals. Use sensitivity analysis and uncertainty quantification to identify which measurements would most improve the forecast, then design interventions that discriminate between competing mechanisms. model verification establishes that the simulator follows its rules; model validation tests those rules in the claimed biological domain. Neither a convincing animation nor recovery of data used in fitting is a sufficient substitute.
My expectation is therefore incremental predictive completion at chosen resolutions: increasingly broad, experimentally constrained models of development and behavior in controlled conditions. No fundamental physical separation prevents this, but limited observability, irreducible biological variation and the cost of resolving irrelevant detail prevent a guarantee of exact individual futures. The realistic goal is a whole-organism model with a declared and expanding domain of validated predictions, not an assertion that every detail has been captured because the simulation looks alive.
Model the joint distribution by multiplying a response model by a sequential dropout model. For example, the logit of dropout before visit , conditional on remaining observed, can depend on the currently unobserved as well as previous responses and baseline covariates. The observed-data likelihood sums over the missing binary responses. Such a dependence parameter is usually weakly identified or unidentified from observed responses alone; sensitivity analysis must vary it over scientifically justified values.
A selection model combines a distribution for all study results with a probability that a result becomes available. The observed distribution is reweighted by this probability and renormalized. Assumed or estimated selection mechanisms permit sensitivity analysis of a meta-analysis, but unavailable results generally prevent a fully assumption-free correction.
A response model and a dropout model share latent random effects. Conditional on those effects and observed predictors, the two processes may be independent, yet marginally dropout is missing not at random because the shared effects also predict unseen outcomes. Joint likelihood fitting integrates the product of both models over the shared effects; integrating the outcome model alone is insufficient. This is an explicit identifying model, and its latent-dependence assumptions should be assessed by sensitivity analysis.
Spreadsheet tabular model 2026-10-14
A spreadsheet tabular model assigns a consistent meaning to each row and column. For an original example, let rows 2–4 describe three items, with quantity in column A, unit price in column B, subtotal in column C, and total including tax in column D. Put the single shared tax rate in F1. The chosen rate is an illustrative assumption. Quantities, unit prices and F1 are inputs; columns C and D hold spreadsheet formulas and display their computed values as outputs.
Enter decimal inputs 2.5, 1.75, 4.5 for the unit prices and 0.2 for the tax rate. The following table expresses those values as exact fractions so that the arithmetic is easy to check. It does not require typing a fraction into an input spreadsheet cell or assume that all software calculates with exact rational numbers.
RowQuantity (A)Unit price (B)Subtotal (C)Total including tax (D)
2
3
4
Start with C2 containing =A2*B2 and D2 containing =C2*(1+$F$1). Here * requests multiplication, and 1+$F$1 adds the tax fraction to one. Copy these two spreadsheet formulas down into rows 3 and 4, a fill operation. The relative spreadsheet references change with the destination row: C3 becomes =A3*B3 and D3 becomes =C3*(1+$F$1); C4 becomes =A4*B4 and D4 becomes =C4*(1+$F$1). The absolute spreadsheet reference $F$1 continues to read the shared rate. Copying spreadsheet formulas adjusts relative coordinates while retaining absolute coordinates. [ref]
Figure 1.
Original three-row spreadsheet tabular model before and after filling two spreadsheet formulas, with a shared absolute spreadsheet reference
. Details.
The same mathematical expression applies to every item. Writing for quantity, for unit price and for the shared tax rate gives
For row 2, the exact arithmetic is . The subtotals add to , so the totals add to , agreeing with . The spreadsheet formulas encode the relationship; the displayed numbers are its results for these particular inputs.
This separation is useful for forecasting and sensitivity analysis. Keeping quantities and unit prices fixed while changing only F1 from to gives exact totals , , and . More generally, a rate change changes each total by
This follows by expanding the two mathematical expressions and cancelling . Here , so the increases are , , and , adding to . One shared input makes the assumption visible and consistent across all rows. Overwriting a computed total with a number would instead remove that spreadsheet formula; its value would cease to follow the model when the rate changes.
// Target: computer-science.bigb
This weighted median of genetic variant ratio estimates consistently estimates a common causal effect when more than half of its asymptotic weight comes from valid instrumental variables, subject to the usual sampling regularity conditions. It is a sensitivity analysis for horizontal pleiotropy, not an unconditional guarantee of validity.