Let be the finite, nonempty set of available routes for source-sink pair , and write for a route flow. The link-route incidence matrix has when route uses link , and zero otherwise. The source-sink route incidence matrix has when . Thus gives link throughputs and gives aggregate source-sink flows. A route's delay is
A Wardrop equilibrium uses only routes of minimum delay for their source-sink pair:
An infinitesimal user cannot improve its delay by changing route.
For fixed , the feasible route flows form a nonempty compact convex set: for each , and . Define the Beckmann potential
It is continuous, so the extreme value theorem gives a minimizer. Since every is strictly increasing, is a strictly convex function of . Its route-flow gradient is .
If an occupied route has greater delay than another route , moving a small amount of flow from to gives a negative directional derivative, contradicting minimality. Conversely, at a Wardrop equilibrium, for any feasible ,
The first-order condition for convex optimization therefore proves optimality. Consequently
If two minimizers had different , their midpoint would give a strictly smaller Beckmann potential. Thus the equilibrium link throughputs are unique. The route flows need not be unique, since need not be a strictly convex function of .
For a concrete example, take two successive stages of parallel links: in the first stage and in the second, with one source-sink pair and four routes . Put on every link and total flow . All allocations
have the same link throughputs and every route has delay two. These distinct allocations are all Wardrop equilibria.
For elastic demand, use the standard physical convention that and is finite, continuous, and strictly decreasing. Set and , and define the inverse demand function on . It is continuous and strictly decreasing, with and as . Choose any reference value and set
Each summand of is a strictly convex function. The reference values only add a constant to the objective. In the usual case , one may use a lower limit zero whenever the improper integral is finite; that integrability is not guaranteed merely by continuity of .
Minimize over the compact feasible set , , interpreting the objective at by its one-sided limit, which can be . This extension is sequentially lower semicontinuous, and an interior-demand feasible point has finite value, so a minimizer exists. It cannot have : adding a small amount on any route for has bounded marginal link cost, whereas its marginal demand benefit tends to infinity. Thus .
For , the route-flow partial derivative is . The first-order conditions for convex optimization give
If , reducing any occupied route cannot improve the objective only if that route has zero delay; nonnegative link delays then give . Therefore the conditions in every case are
Conversely these conditions give the nonnegative directional derivative for every feasible competitor and hence minimize the convex function . Allowing explicitly yields the stated form with and , with inverse-demand endpoint conventions understood. In particular, is defined on its demand range, rather than evaluating outside that range.
Strict convexity in the pair proves that the equilibrium aggregate source-sink flows and link throughputs are unique. Individual route flows may still be nonunique. Nonnegative, finite demand, nonnegative delays, finite route sets, and a usable route for each source-sink pair are the implicit modeling assumptions needed for the existence assertions.
For one observation, let and define . Differentiating the softmax function and its log-likelihood gives . The sigmoid-softmax network gradients are
These equations are backpropagation: use the chain rule through the output affine map, then through the hidden units, then the input affine map.
For a learning rate , select one observation and update every parameter by , computing all entries of the gradient from the old parameters before applying the update. A uniformly selected observation gives an unbiased gradient of the average log-likelihood; multiplying by 3000 would instead estimate the gradient of the sum. Equivalently perform stochastic gradient descent on the negative log-likelihood. Batch size one makes one update per observation, and five epochs make five passes through the data, typically with a fresh random ordering on each pass.
Use the Euler equations for an inviscid fluid with no magnetic or gravitational force. Let denote specific enthalpy. For a homentropic flow, , so the pressure acceleration is . The velocity identity
therefore gives
Taking the curl, using that the curl of a gradient is zero and that differentiation commutes for smooth fields, proves barotropic vorticity transport:
More generally the same proof works for any barotropic fluid, replacing by a pressure potential . Here “isentropic” must supply this barotropic closure, for example through one common specific entropy throughout the fluid. Merely imposing entropy advection equation allows spatial specific entropy gradients; in that case the vorticity equation contains the additional baroclinic vorticity generation term .
The Iterated Tikhonov regularization update is the proximal operator step
The objective has coercivity and is weakly sequentially lower semicontinuous and strongly convex, so the direct method in the calculus of variations and uniqueness of a minimizer of a strictly convex function give existence and uniqueness. Its gradient equation is
which is exactly . The second term penalizes the change from the previous iterate, rather than the norm of relative to zero.
For a differentiable convex function with -Lipschitz gradient and a proper lower-semicontinuous convex function , the proximal gradient method is
The proximal operator is . To obtain an explicit iteration for discrete isotropic total variation, let with the printed zero boundary differences and
The dual is minimization of over , and the primal minimizer is . Here must be the exact adjoint operator of these differences. For example,
with the analogous formula in for ; for both operators are zero. Equivalently use in the backward-difference expression, ignoring unused edge components.
The gradient of the dual objective is , with Lipschitz constant . Taking to be the indicator functional of a constraint set makes its proximal operator the Euclidean projection onto a convex set. Thus a valid explicit algorithm is
The bound follows by summing over grid differences. Finite-dimensional proximal gradient method convergence gives a dual minimizer and convergence of the recovered to the unique primal minimizer. Projection is pointwise in the dual; applying pointwise soft thresholding directly to would not compute the primal TV proximal operator.
Taking the gradient of the quadratic potential energy found in part (ii) resolves the linearized force into identical and components:
Each component therefore performs simple harmonic motion with
Thus the angular frequency is
Suppose the claimed Poincare-Wirtinger inequality were false. There would be such that, after setting
we have , , and . The sequence is bounded in , so part 1(b)(ii) supplies a subsequence converging strongly in and weakly in to some .
The weak gradient of is zero. Because is connected, is a constant function; its mean is zero, so . Strong convergence would then give , contradicting . Therefore
The weak maximum principle for elliptic operators here states
for .
To prove it, suppose the interior maximum exceeds the boundary maximum. Put . Since ,
For sufficiently small , still has an interior maximum. At that point its gradient vanishes and its Hessian matrix is negative semidefinite; ellipticity gives . But , a contradiction. This proves the principle.
Let . Away from ties and zero coordinates, its gradient is for a maximizing coordinate . Conditional on , the random variable is centered Gaussian with variance at most one. The supplied Gaussian concentration inequality therefore gives
A Chernoff bound, optimized at , yields
It remains to bound the mean. For , Jensen's inequality and the Gaussian moment-generating function give
Taking gives . Consequently
The zero streamfunction gives zero velocity. The temperature obeys both prescribed temperature values, has no horizontal gradient, and has zero Laplacian. Thus it satisfies both equations with :
This is the conductive state of Darcy-Bénard convection.
Minimize the data-misfit functional . For a perturbation , , so its gradient is . Gradient descent gives Landweber iteration:
On a singular component, the iteration error is multiplied by , whose modulus is less than one. Starting from zero preserves orthogonality to and makes the exact-data iterates converge to .
For the unit-step formulas and noise bound used below, rescale so that and . Finite iteration count bounds amplification of small singular-value components; the stopping count provides the regularization parameter.
Put . The noises required by a joint trajectory are and . Their independent Gaussian white noise weights give the joint path probability of an order parameter and its flux:
For the physically reversed path, is time-even and the transport flux is time-odd. Therefore , , and
The common factor includes the two noise normalizations and the midpoint Jacobian determinant. Its calculation must include both relaxation channels. On a finite spatial grid, let and represent the divergence and gradient, with the discrete Laplacian, and let be the Hessian matrix of at the midpoint of time step . Differentiating the two required noises with respect to the next configuration and the interval flux gives the Jacobian matrix
Using the Schur complement, its Jacobian determinant, apart from the path-independent power of , is
Reversal visits the same midpoint configurations in reverse order, so the product of these factors is unchanged. The joint time-reversal invariance of a path Jacobian therefore involves the complete relaxation operator .
Taking the action difference gives
Repeated component indices are summed. The second squared norm sums over both flux indices. This is mixed conserved and nonconserved order-parameter dynamics; reversing the order parameter history while leaving the flux unreversed would give the wrong probability ratio.
A standard sufficient form of Brenier theorem assumes have finite second moments and , that is, absolute continuity of measures with respect to Lebesgue measure. For the cost , there exists a unique optimal transport plan, and it is induced by a transport map:
Here is a proper convex function, which may be chosen sequentially lower semicontinuous, and its gradient exists -almost everywhere. The map is unique -almost everywhere and is the unique minimizer of the Monge optimal transport problem; its cost equals the Kantorovich optimal transport problem minimum. Equivalently, it is the unique gradient of a convex function transporting to .
The uniqueness claim concerns the map and the transport plan, not a globally unique potential. The potential may be shifted by a constant, and additional nonuniqueness away from the source can occur. No density assumption is required on . A primary reference is Brenier's Polar factorization and monotone rearrangement of vector-valued functions.
Under the gauge transformation,
because the curl of a gradient vanishes, and
The transformed Lagrangian is
A total time derivative changes the action only by endpoint terms, whose variation vanishes for fixed endpoints, so the Euler-Lagrange equations are unchanged.
The new momentum is
Use the type-two generating function for a canonical transformation
It gives , , and
This equals , so the gauge change is a time-dependent canonical transformation.
The physical rapid phase is
Define the local wavevector, angular frequency, and group velocity by
The equality of mixed partial derivatives gives the phase-compatibility equations
A ray is defined to move with the local group velocity:
Differentiate the local dispersion relation
with respect to . Along a ray,
The last two terms cancel because is a gradient. Similarly,
Finally,
Thus the Hamiltonian ray-tracing equations are
The curve is symmetric in both coordinate axes and under interchange of and . Its shape, including its eight inflection points, is:
Writing , the surface of revolution has equation
Let
Its gradient is
If this vanished, then and , but at such a point , not five. Hence zero is a regular value, and the regular level set theorem shows that is a smooth embedded surface.
For a surface of revolution, the two principal curvatures are the curvature of the meridian and the normal curvature of a parallel. Along ,
so the normal is vertical in the meridian plane and the parallel principal curvature vanishes. Therefore the Gaussian curvature, the product of the principal curvatures, is zero there.
These are not the only zero-curvature points. The meridian itself has inflection points, at which its principal curvature vanishes. Setting and , their positive squared coordinates satisfy
Besides interchanging and , the solution is approximately
Each corresponding meridian inflection point sweeps out another circle on , so does not exhaust the zero set of the Gaussian curvature.
For the Dirac delta distribution source , the stated Green function of the Laplacian gives
This is the Newtonian potential of a point mass; its negative gradient gives the inverse-square gravitational acceleration .
The condition says that is a regular value of . The regular level set theorem therefore makes a smooth submanifold of codimension one in , hence a smooth surface.
For
the gradient is
On , , so and cannot both vanish. Thus there, and the given set is a smooth surface.
Not every smooth surface in is a global zero set. Every set is closed because is continuous, whereas the open unit disk
is a smooth surface but is not closed in .
Suppose first that is harmonic. Since
the Cauchy-Riemann equations show that
is holomorphic on . An open disc is a simply connected domain, so has a holomorphic primitive . If , then
Thus has zero gradient and is constant on the connected disc. Subtracting that real constant from gives
Conversely, if for a holomorphic , differentiating the Cauchy-Riemann equations gives
Hence is harmonic. This proves the harmonic function as the real part of a holomorphic function criterion on .
Let
Its gradient is
If this vanishes, the first and third coordinates give , and the middle coordinate then gives . Thus the origin is the only critical point of . It has been removed from , so is a regular value of the restriction under consideration. The regular level set theorem shows that
is a smooth surface.