Let be the true density and the announced density. The advantage of truthful reporting for the logarithmic scoring rule is
The Kullback-Leibler divergence is nonnegative, with equality exactly when the densities agree almost everywhere. For instance, Jensen inequality gives ; equality requires a constant likelihood ratio on the true support and no remaining mass outside it. Consequently
This proves strict propriety when the expected log scores are well defined, for example with a finite true expected log density. A forecast assigning zero density to a set of positive true probability has score there and cannot outperform the truth. The hint's strict must be corrected to to allow its equality case.
Positivity means almost everywhere, since the real logarithm must belong to . A positivity-preserving operator gives . For fixed , the scalar shifted Poisson data fidelity is , with
Composition with the linear operator proves convexity in , and strict convexity holds along pairs whose forward images differ on a set of positive measure. The admissible class itself is convex: the concavity of the logarithm gives , controlling its negative part, while controls its positive part.
Because and , the Jensen inequality gives the requested bound:
The final equality uses nonnegativity and the unit area. Since , this controls the forward-image norm on energy sublevels.
The printed strictly positive problem has no minimizer. This is nonattainment under strict positivity for shifted Poisson fidelity, rather than a failure of the coercivity calculation. Indeed, with and , implies . Also cannot vanish identically for a strictly positive . To see this, let . If , positivity and give . But in and continuity of would imply , contradicting the hypothesis. Thus every admissible has positive fidelity and hence positive total energy.
Conversely, the constants are admissible, have zero total variation, and satisfy
Their logarithms are integrable for each , but the limit is excluded. Therefore
A bounded minimizing sequence and bounded-variation compactness do not repair a nonclosed positivity/logarithm constraint. In particular, a literal existence or uniqueness proof for that domain is impossible.
The natural correction is to minimize over with , omitting the unnecessary condition: the fidelity only contains , which is already integrable. Here is the full existence for nonnegative shifted Poisson regularization argument, also valid for any bounded nonnegative data . Let , , and take a minimizing sequence of energy at most . The displayed bound gives and . Write . The Poincaré inequality for total variation and mean control for positive imaging operators yield
The denominator is nonzero, so the full norm is bounded. Bounded-variation compactness gives in along a subsequence, with . Continuity gives in . On , , so the fidelity converges in the integral; lower semicontinuity of variation completes the direct method in the calculus of variations.
For the actual printed data , the corrected problem has the unique minimizer , even if is not injective. Zero attains energy zero. Any other zero-energy candidate would have both and ; on the connected square, zero variation makes a nonnegative constant, and forces that constant to vanish. For general positive bounded data, an injective is a sufficient uniqueness condition, because its fidelity is strictly convex; injectivity is not a necessary condition in every instance.
In the finite-dimensional interpretation, let . Independent Poisson observations with these intensities have negative log-likelihood . Removing the constant gives precisely the stated fidelity. Thus the model is Poisson counting noise with a unit background intensity, or an approximate version of it for rescaled/continuous grey values. Literal Poisson counts are integers; the constraint is a grey-value normalization, not a literal unscaled count sample.
For independent and identically distributed random variables sampled from a probability density function , a kernel density estimator with kernel for density estimation and smoothing bandwidth is
The usual kernel for density estimation is nonnegative; finite makes the integrated variance finite. The mean integrated squared error and its bias-variance decomposition of mean squared error are
The interchange is justified by the Tonelli theorem.
For the exponential distribution and the specified unit-width uniform kernel, put . The expected value is . Intersecting this interval with the positive half-line gives
On the true probability density function vanishes, whereas
Here for . This leakage across the support boundary proves the integrated squared bias from a density jump:
In particular, and suffice. The phenomenon differs from a smooth interior bias of a kernel density estimator: the order-one boundary error persists over a region of width proportional to .
By independence, . Integrating the first term and using yields
Also : the kernel density estimator mean is an average of translates of , so the Jensen inequality followed by the Tonelli theorem bounds its squared integral.
To optimize over every , we must establish that useful smoothing bandwidths approach zero, rather than optimize only a formal small- expression. An exact calculation supplies that justification. The autocorrelation integral of the exponential distribution density is
Averaging over the two uniform windows, or integrating the piecewise expression for , gives
These formulas show that is continuous on , is strictly positive there because on , and tends to as . Consequently, is bounded away from zero on for every . Its expansion agrees with the supplied .
The choice gives
Choose smoothing bandwidths within of the infimum. Their mean integrated squared error tends to zero, and nonnegativity of the integrated variance gives , hence . For any , eventually
The last step is the arithmetic-geometric mean inequality. Taking the lower limit and then matches the upper bound. Thus
The original PDF has this constant; the TeX aid's is a transcription error.
The increasing quadratic variation has a limit in . Since has a finite limit, the exponentials have limits too, with value zero when the bracket is infinite. Expanding exponents proves
because the coefficient of on the right is
and the bracket coefficient is . Taking limits preserves the identity, including the zero case.
Let , , and . The Holder inequality first yields
When is finite, apply the Jensen inequality to the concave function :
Since , rearrangement gives the terminal scaling inequality for stochastic exponentials
Here . If the last exponential moment is infinite, the bound has no positive content; the finite-moment form is the one used below.
Let , with ranging over finite stopping times. To locate the half-threshold for the exponential-martingale Hölder bound, put . Since is increasing for ,
On the other hand, taking and gives as . Hence
Fix . Choose with , and put . Part (a) and the Jensen inequality give, for every finite stopping time,
Thus the entire stopped family has a uniform bound for some . By uniform integrability from an Lp bound, it is uniformly integrable.
To check that this local martingale is a true martingale, stop it by a localizing sequence. At each fixed time the stopped variables are uniformly integrable by the same bound; taking limits in their conditional martingale identities proves the unstopped identity. The uniform bound over all finite stopping times then makes it a uniformly integrable martingale, with terminal expectation one. Therefore
Put and . Using natural logarithms, the Kullback-Leibler divergence is
The integrand is zero where , including where both densities vanish, and is where . Equivalently, when is absolutely continuous with respect to , and it is otherwise. This is a well-defined extended integral: on , writing gives , so its negative part is integrable.
For Pinsker's inequality, an infinite Kullback-Leibler divergence makes the conclusion immediate. Assume it is finite. Set
Since , the positive and negative parts of have equal integrals. Thus
This is the total variation distance with the convention .
We first prove the binary partition bound for relative entropy. For any measurable with , apply Jensen inequality to the convex function under the conditional probability measure . Absolute continuity of measures gives
If , both sides are zero; if , finiteness forces as well. Apply this bound to and its complement to obtain
For , regarding as a function of gives
Consequently is a convex function and has its minimum zero at . By continuity this also holds at . For , the finite case has and the remaining cases have infinite divergence. This proves the Bernoulli relative entropy lower bound in every case. Combining the bounds yields
For the Hellinger distance, retain the unnormalized convention in which
The integral is the Hellinger affinity. In the finite-divergence case, for -almost every point. Apply with to get
The affinity is finite by Cauchy-Schwarz inequality. Mass of on creates no difficulty, since the affinity vanishes there and both probability measures have mass one. The infinite-divergence case is again immediate. We obtain the relative entropy bound for the unnormalized Hellinger distance:
In the Gaussian white noise model, observe the entire path
where is standard Brownian motion and the deterministic drift belongs to L2 space on . Equivalently, . For every deterministic , the observed stochastic integral satisfies
The noise is an isonormal Gaussian process. In particular its variance is . Gaussian white noise is interpreted through these integrals, rather than as an ordinary random function with a pointwise value at every time. No smoothness of is needed.
Here is the Gaussian maximum bound without independence. Put . It is integrable since it is bounded by . For every ,
The second inequality uses only the moment-generating function of the standard normal distribution, so independence is unnecessary. Jensen inequality gives , hence
Minimizing at proves
For the dyadic partition, let , , putting the endpoint into the final interval. The Haar scaling functions
form an orthonormal basis of the space of functions constant on each interval. The Haar wavelets can be written as
For , the constant function together with , , is another orthonormal basis of . Indeed, each successive level splits a cell's two constants into their sum and difference; the number of basis elements is . Thus the Haar projection is the orthogonal projection
On cell its value is . The first formula also applies to .
Estimate each coefficient by its observed stochastic integral:
This is the Haar projection estimator in Gaussian white noise. The noise integrals over disjoint intervals form a Gaussian vector with zero off-diagonal covariance. The principle that uncorrelated jointly Gaussian variables are independent then makes these coefficients independent. Therefore
Taking expectations shows that is an unbiased estimator of , both coefficientwise and pointwise for the stated step-function representatives.
Only one scaling function is nonzero in each cell, so the supremum norm of the error has the exact form
The endpoint convention ensures the same identity at . Apply the Gaussian maximum bound without independence with to obtain the supremum norm risk of a Haar projection estimator:
The factor comes from cellwise scaling, while the extra square root of comes from taking the maximum over Gaussian errors.
On a compact metric space , a conservative Feller semigroup is a strongly continuous semigroup of positive linear maps on satisfying . Positivity means . These conditions imply sup-norm contraction. Conversely, for a contraction semigroup with and , differentiation on the generator domain gives , so . On the real space , if , then , implying . Scaling proves positivity for every nonnegative . This is the unital contraction positivity criterion. For complex the same conclusion follows because each functional has norm one and value one on , hence is a positive linear functional.
For each , the Riesz-Markov-Kakutani representation theorem represents that functional by a unique Borel probability measure :
Continuity of gives weak continuity of . Approximating indicators of open sets increasingly by continuous functions proves Borel measurability in ; a monotone-class argument then gives a Markov kernel. The semigroup property and uniqueness of representing measures yield and the Chapman-Kolmogorov equation
These are the required transition probabilities.
An invariant probability measure for a semigroup satisfies for every and . Equivalently its distribution is preserved by the Markov kernel. For , Jensen inequality gives pointwise. Integrating and using invariance proves
Also . Continuous functions are dense in these spaces for a finite Borel measure on a compact metric space, so the contraction extends to a strongly continuous semigroup on .
For real with , the kernel form of Jensen inequality gives , with equality at . Take its right derivative to obtain the generator square inequality
This is nonnegativity of the associated carré du champ.
Each time-average functional is positive with , hence represents a Borel probability measure . The compactness of probability measures on a compact metric space gives a subsequence converging weakly to a probability measure . Explicitly, is a separable Banach space, so Banach-Alaoglu theorem and a countable dense family give a subsequence converging on every continuous function, rather than merely a net. For fixed , the semigroup property gives the Krylov-Bogolyubov time-average argument:
Its absolute value is at most . Pass to the subsequential limit, observing that , to get . Thus the limiting measure is invariant.
On the polynomial subspace of , the Gaussian creation and annihilation operators are and . Gaussian integration by parts makes them adjoints there and gives . The Gaussian number operator is
The Probabilists' Hermite polynomials are . Their generating function is , giving . The commutator also yields
The orthogonality follows by repeated integration by parts; the leading coefficient is one, so these polynomials span every polynomial. By the allowed density assumption is an orthonormal basis. Define the closed number operator by on . This diagonal multiplication operator is self-adjoint and positive semidefinite; polynomial truncations show it is the closure of the polynomial operator.
The Ornstein-Uhlenbeck semigroup is , or . It also has the Mehler formula for the Ornstein-Uhlenbeck semigroup
To verify the formula, apply its right side to : the Gaussian moment-generating function makes the result , proving the eigenvalue identity on every Hermite polynomial. Positivity and invariance of Gaussian measure give contraction by Jensen inequality, so polynomial density extends the equality to all . The coefficient expansion gives
For continuously differentiable with bounded derivative, differentiate the Mehler expectation by the dominated convergence theorem to get the Ornstein-Uhlenbeck gradient commutation identity
The same identity extends to the Gaussian Sobolev form domain. Mehler's formula also gives pointwise convergence to the Gaussian mean for such , since bounded derivative permits at most linear growth.
The Gaussian Dirichlet energy is the energy form of :
For polynomials this follows from , and closure extends it to the form domain. For the given continuously differentiable , Gaussian integration by parts yields , so Parseval identity proves the derivative-energy equality directly. Bounded derivative puts in the Gaussian Sobolev space, hence in that form domain; it need not be in the full operator domain, so is not always a legitimate initial definition.
Use the entropy functional . Begin with bounded smooth bounded away from zero, and put . Invariance and Gaussian integration by parts give the Ornstein-Uhlenbeck entropy dissipation identity
The gradient identity and the permitted weighted Cauchy-Schwarz inequality, applied with weight , imply
The entropy tends to zero as by Mehler's formula and bounded convergence. Integrating in time and using invariance yields . Set to obtain the sharp Gaussian logarithmic Sobolev inequality
For the stated possibly unbounded , apply the argument to smooth positive clipped approximations with a common positive lower bound and uniformly bounded derivatives. They can converge pointwise together with their derivatives and have a common linear-growth bound. Since Gaussian measure integrates every polynomial moment, dominated convergence theorem passes both the entropy and the derivative energy to the limit. This also justifies use of the supplied inequality when itself is unbounded. The normalization concerns , and does not imply ; the second term in the entropy definition must be retained.
Lift the angular coordinate continuously to a real coordinate and write and for a prescribed winding number . Assume for the calculation; reversing the endpoints changes no length. The arc length functional on the circular cylinder is
The Euler-Lagrange equation says is constant. This expression is strictly increasing in , so is constant. The candidate is the helix
It is a global minimum within the chosen winding class: the integrand is strictly convex, and Jensen inequality bounds the functional below by , with equality only for constant slope. Equivalently, unrolling the cylinder makes the minimizing path a straight segment.
The signed pitch of a helix, measured for an increase of in angle, is
Its geometric magnitude is . If only the physical endpoints are fixed, choose the integer minimizing ; opposite points may give two equally short helices. If the lifted endpoint angles are prescribed, use that winding class. A zero angular increment gives a straight generator, the limiting infinite-pitch case.
The Erdős-Stone theorem says that, for a fixed graph with chromatic number ,
The lower bound comes from the balanced Turan graph with parts; the theorem supplies the matching asymptotic upper bound. Here and below, all forbidden graphs and blow-up parameters are fixed as .
First obtain an almost spanning, almost complete multipartite core. Put . We give the stability argument, rather than infer pointwise degree bounds by differentiating an asymptotic edge-count formula. Suppose first .
We need two elementary ingredients. First, positive homomorphism density of forces a fixed complete multipartite graph . To see this, perform vertex cloning in a graph, replacing one vertex by independent twins. Conditional on the images of the other vertices, its contribution to the homomorphism density changes from a number to ; Jensen inequality gives . Duplicating each original vertex therefore gives
A positive lower bound on the right supplies a positive proportion of all maps of the blow-up. Only maps fail to be injective, so for large at least one map is an embedding. Consequently a -free sequence has copies of . The clique removal lemma, proved in the next solution, then deletes edges to give a -free graph with .
Second, we prove the required stability for -free graphs by induction on . For such a graph is edgeless. In an -vertex -free graph , take a vertex of maximum vertex degree , put and , and note that is -free. The Turan theorem and the maximum-degree bound give
If , both nonnegative error terms are : and . The deficit in the bound for is likewise . Induction partitions into classes with a total of internal edges; adjoining gives an -class partition with the same property. Applying this to and restoring the removed edges gives such a partition of .
The number of possible crossing edges is . Since the actual crossing-edge count is within of this maximum, for every , and there are missing crossing edges. Choose so slowly that the number of vertices missing more than neighbours in other classes is . Delete those vertices and all internal edges. The remaining r-partite graph has vertices and every vertex has crossing vertex degree at least . The Turan theorem, or the size of a largest part, supplies the matching upper bound for its minimum vertex degree. Thus
This is a high-minimum-degree multipartite stability subgraph. The subgraph need not be spanning; deleting the exceptional vertices is essential. For , the spanning edgeless subgraph already proves the assertion.
Extremality forces the minimum degree. Choose . A proper -graph colouring embeds in , so every -free is also -free. By the Erdős-Stone theorem, its extremal edge count has the needed asymptotic size. The preceding proof supplies core classes of size in which every vertex misses only crossing neighbours, uniformly over the core.
Delete an arbitrary vertex from and introduce a new vertex adjacent precisely to with removed if necessary. The new graph is still -free. Indeed any new copy would use , all its neighbours in that copy would be in the specified core classes, and their set of common neighbours in has size . A vertex of this common neighbourhood outside the bounded vertex set of the copy replaces , producing an existing copy of in , a contradiction. For the new vertex is isolated and the same conclusion is immediate.
The replacement adds edges. Since has the maximum possible number of edges, . As was arbitrary and the minimum vertex degree is at most the average vertex degree,
This proves the minimum degree of an extremal forbidden-subgraph graph. The replacement argument avoids the invalid implication based solely on the asymptotic formula.
A colour-critical vertex also bounds the maximum degree. Suppose a vertex of has for some fixed . Since the core omits only vertices and all its classes have size , has at least neighbours in each . Otherwise, even counting every vertex in all other classes and outside the core would give too small a vertex degree.
Inside these neighbourhood sets, greedily choose a fixed number of vertices in each class. Every previously chosen vertex excludes only crossing nonneighbours, so each next candidate set still has positive linear size. This produces inside . A proper -graph colouring of embeds it in that complete multipartite graph; map to . All required incident edges exist, so this embeds , a contradiction. The case simply uses enough neighbours to embed the edgeless . Hence , and the average-degree lower bound completes the answer:
Write for the deterministic set of -step self-avoiding walks from . Each uses distinct edges, so independence gives
For , the function on is a concave function. The Jensen inequality gives the root-moment bound for open self-avoiding walks
Equivalently, the Lyapunov moment inequality compares exponents and , both strictly positive. Taking the limit superior and the connective constant limit proves
This includes and . No independence between the different self-avoiding walk indicators is asserted or needed.
The positive-part function is convex, so pathwise Jensen inequality gives
To compare the Asian option price with European call option prices at different dates, carry each earlier payoff forward using the numéraire. Purchase of each replicating strategy for maturity , and, when its payoff is received, reinvest it in until . This is a self-financing portfolio, with terminal wealth
The first inequality uses and nonnegative payoffs. Since the Asian option is replicable in the complete market, absence of arbitrage makes its replication cost no larger than this superhedging cost. Therefore
Equivalently, divide the first pathwise bound by , use , and take expectations under the numéraire equivalent martingale measure. Merely averaging earlier payoffs without reinvestment would miss the difference in payment dates.
Put , the uniform bound on the supremum norm of the gradient. The fundamental theorem of calculus on a line segment, together with the inner product inequality , gives
Thus is Lipschitz continuous with respect to the L1 norm. The Gaussian random variables comprising and have finite exponential moments of their absolute values. More explicitly, for , Hölder's inequality gives . Consequently and every exponential expression below are finite, including when the covariance matrix is singular.
Use the convex function . Since is an independent copy of , Jensen inequality for the conditional expectation gives
For , define the Gaussian rotation of independent copies
Writing , both rotated covariance matrices are and their cross-covariance is zero. The pair has a centered multivariate normal distribution, so its components are independent and has the same probability law as . This calculation uses no inverse of and therefore also proves the assertion for degenerate multivariate normal distributions.
The path runs from to . The chain rule and the fundamental theorem of calculus give the pathwise identity
Apply Jensen inequality to the uniform probability measure on . Then use Tonelli theorem and the Gaussian rotation of independent copies to obtain
This proves the Gaussian rotation interpolation inequality in the required form:
The stated almost-sure domination now gives an exponential moment of an absolute standard normal variable bound. If , completing the square in the standard normal density yields
where is the standard normal distribution function. Hence Markov inequality gives, for every ,
The exponent is minimized at . Therefore the resulting Gaussian tail bound is
No independence of from or is needed: only the given almost-sure domination is used.
A stable multiplicative sensitivity factor at detector pixel changes both means to . The noise-free ratio is still one, so flat-field correction is not required merely to remove that fixed pattern from the mean ratio. This is the principal advantage of using two matched flats rather than the variance of a single image.
However, the photon shot noise is not cancelled. At high counts the conditional ratio variance is . Pooling detector pixels gives , where brackets denote a spatial average. If the formula uses , it returns
The inequality follows from the Jensen inequality for on positive signals. For small fractional response variation, the relative bias is approximately minus its squared coefficient of variation. A locally nearly uniform region or a fit using detector pixel-dependent variances avoids this bias from mixing the harmonic mean with the arithmetic mean. Stable response cancellation also presumes the conversion gain itself is uniform; gain variations, offset errors or changing sensitivity do not obey that simple cancellation. The fixed response pattern cancels in the ratio mean; unequal shot-noise levels can still bias a globally pooled gain estimate.
For expected final capital, the Bellman equation is linear in wealth, with one-period factor . Therefore invest everything when the mean return is positive, nothing when it is negative, and any fraction when it is zero. For this agrees with the yield objective.
For , the root objective is concave and penalizes losses, so its optimal fraction need not be even when the mean is positive. For example, if and , the left derivative of at is , while its right derivative at is positive; the optimum lies strictly between and . If , Jensen inequality gives , so is optimal. Thus the root objective can favor partial investment over the all-in policy.
The Cauchy-Schwarz inequality is . Markov inequality says that for and , .
Jensen inequality states that for convex ,
Let . A supporting line at gives . Taking expectations makes the linear term vanish.
Encode each point by a partial binary sequence of length : coordinate is fixed to zero if , fixed to one if , and unrestricted otherwise. Disjointness makes these prescriptions consistent. Let be the number of fixed coordinates, equivalently the number of pairs containing , and let be the set of complete sequences consistent with them. Then .
The separating family of disjoint set pairs ensures that and are disjoint whenever : one coordinate prescribes opposite bits. Counting the sequences in these disjoint subcubes gives the disjoint subcube packing inequality
Since is a convex function, Jensen inequality implies
Taking logarithms yields . Therefore, for ,
The PDF omits the qualification . For , it follows from feasibility: separation requires positive total incidence, so the stated incidence bound cannot hold with . For , separation is vacuous, and makes the printed quotient undefined; the intended parameter range is .