Choose the sign convention
This is the optimization Lagrangian; equality-constraint Lagrange multipliers are unrestricted in sign. The Lagrangian sufficiency theorem for minimization says: if satisfies and globally minimizes on for some , then it globally minimizes the constrained objective function. Indeed, for every feasible ,
This is a full global certificate, not merely stationarity. No convexity is needed for the implication, although convexity commonly supplies the required global optimization Lagrangian minimum.
Let , setting , and assume is finite. The Strong Lagrangian property at means that a finite multiplier attains the constrained value as an unconstrained lower bound:
This includes dual attainment, but need not include primal attainment. A non-vertical supporting hyperplane of a value function at has a finite slope and supports the epigraph from below:
If this inequality holds, then for every ,
so . Conversely restricting the infimum to gives , even if the primal infimum is approached only by a sequence. Thus equality holds. In the reverse direction, the Strong optimization Lagrangian identity implies for every . Taking the infimum over yields the supporting inequality, with empty fibres causing no problem. This proves both implications without a convexity or attainment assumption beyond finite .
For the advertising calculation, measure the budget in thousands of pounds by . Requiring the full budget to be spent gives , with . Substitute to reduce the maximization problem to
Its second derivative is , so the unique constrained maximum is obtained by clipping the stationary point:
The upper constraint never clips the interior formula because for . The maximal revenue in thousands of pounds is
Equivalently the revenue Hessian is , negative definite since its leading minor is negative and its determinant is seven. Thus the full-budget affine feasible set has a unique global maximum.
At the two requested budgets,
The units in the middle columns are minutes; the last column is thousands of pounds. Revenue measured in pounds is , so
An additional advertising pound therefore increases optimized revenue locally by £2.50 at the smaller budget and £0.25 at the larger budget. These are marginal rates, not exact finite-difference increments: on the interior branch .
The maximization multiplier in equals on the interior branch. The sign is consistent with the minimization convention above applied to , whose supporting slope is . If spending is only capped by the budget, rather than required to equal it, these same answers apply at the two budgets. Beyond £11,000 the unconstrained maximum is affordable, so further allowed spending is unused and the capped-budget value is constant; forced full spending would instead lower revenue.
In a two-person Nash bargaining problem, an agreement specifies a jointly feasible pair of payoffs , measured in each player's own utility function. For a finite game, binding agreements can randomize jointly among action pairs, so the feasible payoff region is the convex hull of the pure-action payoff. This permits correlated joint actions; it is generally larger than the payoff region generated by independent mixed strategies. A disagreement point specifies what each player receives if negotiations fail. Assume a compact convex set of feasible agreements and at least one agreement strictly improving both disagreement payoffs.
A vector jointly dominates if , , and at least one inequality is strict. This is joint dominance of payoff vectors; strict improvement for both is unnecessary. A Pareto optimal agreement is one that has no feasible joint dominator. A jointly dominated agreement wastes a possible gain, but Pareto efficiency alone does not settle how gains should be divided. The negotiation set in two-person bargaining is
Its individual-rationality constraints keep either player from accepting less than disagreement; its Pareto efficiency constraint rules out wasted opportunities. This negotiation set is distinct from objection-and-counterobjection bargaining sets for coalitional games.
The Nash arbitration procedure selects the Nash bargaining solution by maximizing gains relative to disagreement:
The objective function is the Nash product. Essentiality makes its maximum positive; compactness gives attainment. On positive gains, its logarithm is , whose Hessian is diagonal and negative definite. Thus strict concavity on the feasible convex set makes the maximizing payoff vector unique. Positive gain in either coordinate increases the product, so the solution is Pareto optimal.
The procedure respects feasibility, bargaining individual rationality, Pareto efficiency, bargaining symmetry, positive affine invariance in bargaining, and bargaining independence of irrelevant alternatives. In particular, replacing each player's utility by a separate positive affine rescaling multiplies the product by a positive constant; it does not compare one player's raw utility scale to the other's. Deleting other feasible agreements cannot change a unique maximizer that remains feasible. Symmetry under interchange of the players gives equal selected coordinates when the bargaining problem itself is symmetric.
These properties also explain why the product rule is distinguished. Normalize a positive-gain maximizer to and disagreement to by positive affine maps. The first-order inequality along a segment from to any feasible gives . A sufficiently large symmetric triangle, bounded below in each coordinate and above by , contains the normalized feasible region. Symmetry and Pareto efficiency select in that triangle. Independence of irrelevant alternatives then selects the same point in the original normalized region, and affine invariance transforms it back. This is the supporting triangle for Nash bargaining argument; the assumptions of convexity and a strict joint improvement are important. Without strict improvement, a zero product need not select a unique agreement.
For a finite game, a natural disagreement convention is each player's security level payoff:
where are the two payoff matrices and are mixed strategies. Each player can independently guarantee at least its own security level. The maximin bargaining solution applies the Nash product rule using this . In this convention, “maximin” determines the disagreement payoffs; it does not replace the arbitration objective function by , which would depend improperly on interpersonal utility scales. The resulting agreement can strictly benefit both players relative to their guarantees, yet need not benefit both relative to a particular noncooperative Nash equilibrium.
For the general normal linear model, minimizing gives the least-squares normal equations . Full column rank makes invertible, so
The mean and covariance follow by substituting and using , . Normal errors also give the exact multivariate normal distribution of this estimator.
Use coded experimental variables
Their origin is the middle of the allowed rectangle, and the stated endpoints become . The four corners and center runs give mutually orthogonal columns , with
Writing when , the ordinary least squares estimates are
Their variances are , , , with zero covariances.
The repeated center runs estimate pure error without requiring the fitted mean surface to be correct:
They also permit a center-point curvature contrast. Let and . Under the first-order model, and . Under a quadratic surface, its expectation is , since the linear and terms average to zero. Thus
under the first-order normal model. With only one center run there is no pure-error degree of freedom. A zero center contrast does not exclude all curvature, because the two quadratic coefficients can cancel. The corners also estimate an interaction contrast; the full Lack-of-fit F-test compares the first-order fit with the five setting means, with two lack-of-fit and pure-error degrees of freedom.
If the first-order model is adequate and , steepest ascent in response surface methodology uses the unit coded direction . The Cauchy-Schwarz inequality proves that it maximizes the predicted directional derivative. Run sequential settings for increasing feasible , corresponding to physical increments from the center. Stop or reduce the steps when measured yield ceases to improve, and refit locally near promising settings. Respect the allowed rectangle; if a boundary is reached, investigate feasible boundary directions rather than extrapolating outside it. A near-zero gradient offers no first-order ascent direction and calls for further modeling.
If curvature is indicated, add the four axial settings , together with further center replication. This face-centered central composite design stays inside the allowed physical ranges and separates the two squared coordinates, which the corners alone cannot do. Fit the full quadratic regression surface
Write its fitted quadratic part as , where , and . Its gradient and Hessian are and . If is nonsingular, the stationary setting is
If is negative definite and is feasible, it is the fitted maximum. Otherwise compare feasible stationary settings, optima on each edge obtained from the restricted one-variable quadratic, and the corners. A singular or poorly determined calls for attention to ridge directions and more runs. Convert any chosen coded setting back using , , and confirm its yield experimentally. The fitted local surface guides the search; it does not establish an untested physical optimum.
Treat the displayed entries as the lower triangle of a symmetric sample covariance matrix , in the order mechanics, vectors, algebra, analysis, statistics. Compute the precision matrix . For a multivariate normal distribution, conditioning on all remaining coordinates gives
These identities follow by fixing the other coordinates in the quadratic form of the normal density and completing the square. For the second identity, the conditional precision matrix for the retained pair is its principal block; inverting that block gives the negative off-diagonal entry divided by the square root of the two diagonal entries.
Thus the two quantities to evaluate are
An equivalent procedure uses the Schur complement covariance: regress mechanics on the other four variables, or regress analysis and statistics separately on the remaining three. The first residual variance is ; the second result is the partial correlation of the two residuals. No arithmetic is required to specify this method.
The model qualification is important: a covariance matrix alone determines linear-regression residual variances and partial correlations. Identifying them with conditional quantities independent of the observed conditioning values uses the multivariate normal model, or another model with the same conditional moments; it does not follow for arbitrary distributions.

Pinned article: Introduction to the OurBigBook Project

Welcome to the OurBigBook Project! Our goal is to create the perfect publishing platform for STEM subjects, and get university-level students to write the best free STEM tutorials ever.
Everyone is welcome to create an account and play with the site: ourbigbook.com/go/register. We belive that students themselves can write amazing tutorials, but teachers are welcome too. You can write about anything you want, it doesn't have to be STEM or even educational. Silly test content is very welcome and you won't be penalized in any way. Just keep it legal!
We have two killer features:
  1. topics: topics group articles by different users with the same title, e.g. here is the topic for the "Fundamental Theorem of Calculus" ourbigbook.com/go/topic/fundamental-theorem-of-calculus
    Articles of different users are sorted by upvote within each article page. This feature is a bit like:
    • a Wikipedia where each user can have their own version of each article
    • a Q&A website like Stack Overflow, where multiple people can give their views on a given topic, and the best ones are sorted by upvote. Except you don't need to wait for someone to ask first, and any topic goes, no matter how narrow or broad
    This feature makes it possible for readers to find better explanations of any topic created by other writers. And it allows writers to create an explanation in a place that readers might actually find it.
    Figure 1.
    Screenshot of the "Derivative" topic page
    . View it live at: ourbigbook.com/go/topic/derivative
  2. local editing: you can store all your personal knowledge base content locally in a plaintext markup format that can be edited locally and published either:
    This way you can be sure that even if OurBigBook.com were to go down one day (which we have no plans to do as it is quite cheap to host!), your content will still be perfectly readable as a static site.
    Figure 5. . You can also edit articles on the Web editor without installing anything locally.
    Video 3.
    Edit locally and publish demo
    . Source. This shows editing OurBigBook Markup and publishing it using the Visual Studio Code extension.
  3. https://raw.githubusercontent.com/ourbigbook/ourbigbook-media/master/feature/x/hilbert-space-arrow.png
  4. Infinitely deep tables of contents:
    Figure 6.
    Dynamic article tree with infinitely deep table of contents
    .
    Descendant pages can also show up as toplevel e.g.: ourbigbook.com/cirosantilli/chordate-subclade
All our software is open source and hosted at: github.com/ourbigbook/ourbigbook
Further documentation can be found at: docs.ourbigbook.com
Feel free to reach our to us for any help or suggestions: docs.ourbigbook.com/#contact