The geometric family law on the nonnegative integers has probability generating function
Its expected value is , so this is a geometric-offspring critical branching process. Starting from , verify the rational iterate by induction. If , then
which has the same form with replaced by . Thus, for ,
The stated disk is the actual power-series convergence domain, not merely a place where the rational continuation can be evaluated. Its simple pole is at .
The extinction probability at generation is the constant coefficient:
For later use, expanding the remaining geometric series gives
In particular . At the initial population is one deterministically; its PGF is , and the displayed radius involving is used only for .
For independent random variables, and . Factor their probabilities to obtain the distribution functions of independent minima and maxima:
These formulas also allow atoms; no probability density function assumption is needed.
For independent unit-rate exponential distributions, for , so . To establish the independent minimum and gap of two exponential variables, set . On either ordering branch, the change of variables is or with unit absolute Jacobian determinant. Both contribute ; ties have probability zero. Thus the joint probability density is
It factors into normalized exponential probability density functions, proving , and their independence.
The maximum is . A half-scaled unit-rate exponential has rate two, so the independent pair has the same joint law as . Consequently
Using the expected values, variances and independence of the summands,
The spacing factorization explains why an order statistic can be represented as a sum of independent waiting times.
For each , choose the continuous probability density functions
The second is at least and integrates to one. Their expected values differ by
Writing gives
The supplied product bound, also obtained from the chi-squared divergence of product measures, implies
For the final elementary estimate, compare the exponential series with the geometric series: for . Thus the overlap of the product laws is at least . Part (b) now gives the explicit mean-estimation minimax lower bound for continuous densities
So one may take , uniformly for all . The alternatives are allowed to depend on , because the minimax risk takes a supremum over all continuous probability density functions separately at each sample size.
Write and . Holding the nuisance parameter fixed, the parametric score function is the derivative with respect to of the one-observation log-likelihood. The joint probability density function is
Because , differentiating gives
For instance ensures a square-integrable score function. Its expected value is zero by independence and the centered normal distribution of the error. This is the Gaussian regression score.
Now . With and the location score , differentiation of the log-likelihood gives
Take the usual regularity conditions and so that this score function belongs to L2 space.
For the specified nuisance statistical path, differentiating at zero gives the score function . Normalization requires . There is a second constraint: the statistical path must preserve the model's zero error expected value. Thus
This constraint follows from being a path through the model, rather than from normalization alone. For a centered symmetric logistic distribution, for example, is bounded and has zero expected value, but ; it would not preserve the mean.
For any , independence implies
All these products are integrable by the Cauchy-Schwarz inequality, since is square-integrable. Thus every such error-density score function is orthogonal to every . Covariate-density nuisance score functions are also orthogonal to these functions, since . This is the mean-preserving error tangent space orthogonality used in the final calculation.
First use the additional admitted form of the efficient score. Write and let . The difference is the orthogonal projection onto the nuisance tangent space. Part (c) makes every orthogonal to that space. Therefore, for all ,
The function in braces belongs to L2 space; choosing it as shows it vanishes -almost everywhere. Hence the required conditional deduction is
Under the regular tail condition at both infinities, integration by parts gives , and the formula becomes . This also confirms the sign.
The admitted product form is an extra restriction; it does not follow for every independent-error regression model. To locate the restriction precisely, suppose the error-density nuisance statistical paths preserve both normalization and mean to first order. Their closed mean-preserving error tangent space is . The full nuisance tangent space is the orthogonal sum of this space and the centered functions of .
For completeness, bounded functions satisfying the two constraints are dense in the error space. Truncate an arbitrary element, subtract its expected value, and then subtract a multiple of a fixed bounded centered function with . Such a exists by truncating , since . The correction coefficients tend to zero by the Cauchy-Schwarz inequality, so the corrected truncations converge in L2 space.
Let . With and , the orthogonal projection of onto the error nuisance space is ; its projection onto the covariate nuisance space is zero. Thus the general efficient score in independent-error regression is
The orthogonality of the two terms gives the displayed efficient information. For a normal distribution of the error, , so this reduces to the admitted formula. It also does so when is constant.
A concrete counterexample to the generality of the admission is , with uniform on and independent standard logistic distribution error. Here and , so the actual efficient score is . It cannot equal because is not constant. This score function is already orthogonal to every nuisance score function: its factor is centered against error-only directions, and its factor is centered against covariate-only directions. The requested formula is valid under its stated additional admission, with the general independent-error formula above explaining its limits.
For the exponential distribution of mean , . Substitution into the geometric-sum moment-generating function gives
This is the moment-generating function of an exponential distribution with rate . By the uniqueness theorem for moment-generating functions, the geometric sum of exponential variables therefore has probability density function
Its expected value is , agreeing with in the random sum of independent claims formula.
Use the shape-rate convention for the gamma distribution. A shape and rate give expected value and variance . The two moments here force and . Thus , and the geometric-sum moment-generating function becomes
Put , and . Then , , and
Consequently the geometric sum of shape-two gamma variables has the same probability distribution as the sum of two independent exponential distributions with rates . Their convolution of independent random variables yields
The probability density function is zero for . It is nonnegative because , and its integral is
This verifies normalization directly. An alternative check uses the conditional gamma distribution with shape :
which is exactly the same density. The expected value supplies a further check.
Set . The compound Poisson distribution variance identity and the per-claim excess of loss reinsurance payouts give
Apply differentiation under the integral sign. The endpoint terms in the first two terms cancel, while the last integrand is zero at its lower endpoint. Equivalently, differentiate the two payout squares inside their expected values; the finite second moment supplies a dominating integrable function. This gives the total variance stationary condition for excess of loss
Hence the specified equality makes . When , its interpretation is , where the mean residual life is .
For the exponential distribution of mean , and
Thus is negative below and positive above it. The variance-minimizing exponential retention is the unique global minimizer
For an explicit value, put . The capped claim moments and the excess-claim second moment give
The sign argument establishes global minimality, rather than just stationarity.
Use the classical risk model surplus , with , and write for its ultimate survival probability. The first-claim decomposition for survival probability follows by conditioning on the first arrival time of the Poisson process. That time has exponential distribution of rate . A claim at time leaves capital if , after which the Markov property restarts the same risk model. Consequently
Put and change variable :
The convolution is continuous since is bounded and is integrable. Differentiating proves the survival integro-differential equation
For the specified claim law, expand its probability density function as . This is an equal-weight mixture distribution of exponential distributions with rates and . In the convolution, set to obtain
Since , the requested coefficients are
For the exponential-mixture differential equation for survival probability, define , and . Differentiating the integrals yields
Apply to the last equation, where . The first two equations eliminate , giving
Thus
The characteristic polynomial factors as
The ordinary differential equation therefore has solution .
The claim expected value is . The relative safety loading is , and the given zero-capital survival probability is . The limit at infinity sets . A third condition comes from the original survival integro-differential equation: its convolution vanishes at zero, so . Therefore
which gives and . The final survival probability and ultimate ruin probability are
Both exponential coefficients of are positive. Hence increases from to one, and decreases from to zero. The initial slope is essential: the two stated boundary values alone do not determine all three constants of the eliminated differential equation.
A credibility estimate blends the risk's own sample mean with a population or prior expected value. In the basic equal-exposure form it is , where the credibility factor is the weight attached to the individual experience. More data ordinarily increase that weight; greater within-risk variation relative to between-risk variation reduces it.
Write for the conditional claim expected value, keeping for the prior-level parameter. Normalization of the probability density function gives
At interior points of its finite domain, differentiation under the integral sign yields
This is an instance of the exponential-family derivative identities for natural parameter . The minus sign is present in the PDF and is lost in the converted TeX. The conditional variance is likewise .
Differentiate the log of the natural conjugate prior:
Integrate on a compact subinterval and then let its endpoints approach those of the parameter interval. The prescribed vanishing of the prior density eliminates the boundary term. Since , monotone convergence theorem justifies the limit of its expectation, and the identity gives
In particular the assumed proper prior and boundary conditions themselves establish this first-moment integrability.
For and , conditional independence makes the likelihood function proportional to . Multiplication by the prior distribution gives the Bayesian posterior
Thus this is a conjugate prior family, with updated parameters
The integration-by-parts calculation for the posterior mean also needs vanishing posterior boundary values. Here that property can be checked, rather than assumed. Let be the essential lower and upper endpoints of the claim support. Every nondegenerate tilted claim law has , so the established prior mean satisfies . Supported observations have ; hence . At a finite parameter endpoint the prior's vanishing forces , because its exponential factor has a finite positive limit; the increased power makes the posterior vanish there too. At , choose with positive base-measure mass below . Then and the unnormalized posterior is at most . At , choose with positive mass above to obtain the corresponding bound . These bounds also ensure posterior propriety at infinite endpoints. This is the endpoint control for a Laplace-family conjugate posterior.
Apply the previous score integration to the Bayesian posterior. The natural conjugate credibility identity is
Thus is the credibility factor. This is an exact posterior mean, rather than an affine approximation to one.
For the specific shape-two gamma distribution, take
Then and . The gamma rate gamma conjugacy prior is
that is, . Its normalizing constant in the notation of the question is . The gamma distribution density vanishes at both zero and infinity for . The posterior has shape and rate , so its conditional-mean posterior mean is again .
For the last calculation, gamma distribution integration gives
The second identity requires the printed . Therefore the expected process variance and variance of hypothetical means, denoted by in this question, are
Consequently , and the Bühlmann credibility factor agrees with the exact Bayesian weight:
This is the exact Bühlmann credibility for gamma claims, expressed using the reciprocal rate as the random scale. The symbols here are the process and between-risk variances, respectively; their roles should not be interchanged when comparing with other notation for the Bühlmann model.
Put and . The hypothesis implies . For the number of isolated vertices, the isolated vertices in the Erdős-Rényi model formulas give
Thus the Chebyshev inequality gives with high probability, uniformly over the specified range.
The Cayley formula supplies a spanning tree on any connected vertex set. Consequently the expected value of the number of graph components of order is bounded by
Choose a fixed with . For , with , the binomial coefficient bound gives
Here . The geometric series and a union bound therefore exclude this entire size range, since . For , an empty graph cut would be necessary. Its total probability is at most
There are consequently no graph components of orders between and , with high probability.
For each fixed , a graph component containing a graph cycle has a spanning tree and at least one extra edge. Counting that extra edge gives an expected value ; hence every small graph component is a tree component. The total number of vertices in tree components of orders satisfies
The Markov inequality gives with high probability. When , this sum is empty and . Since , the remaining vertices must lie in one graph component larger than . It is unique, and its order is . Every other graph component is a tree with at most vertices. This is the logarithmic-regime giant component mechanism: almost all missing vertices are isolated.
Write , , , and let be the total progeny of a binomial branching process. The preceding binomial branching survival correction gives . For a branching process conditioned on extinction, the offspring probability generating function is , with mean
for sufficiently large . Summing expected generation sizes therefore gives .
Put and let count vertices in graph components of order at least . A breadth-first exploration of a binomial random graph is dominated by . The Markov inequality applied to finite total progeny gives
Always . Since , we have and . Hence . This bound controls the expected value directly, including rare large graph components.
For the lower bound, use the breadth-first exploration of a binomial random graph with unseen vertices, active vertices and explored vertices, starting from , . Let indicate a new root. Conditional on the past, the newly discovered count has a binomial distribution . Put . The unseen-count recursion gives
Here is a martingale. Up to , martingale-difference orthogonality gives , since each conditional variance is at most and is bounded.
Take . Then , and . The Doob L2 maximal inequality implies
The Taylor expansion, uniformly for , gives . Thus throughout the integer interval for large . The new-root sum is nonnegative, so on the preceding event throughout this interval. No graph component finishes there: all these explored vertices belong to one graph component, of order at least , with high probability. Its expected value is therefore at least . Combining both inequalities proves
The barely-supercritical largest-component expectation uses both a positive exploration window and a finite-progeny bound; a bare convergence-in-probability assertion would not by itself justify this expectation.
The Kruskal-Katona theorem states that a colexicographic initial segment minimizes the lower shadow of a uniform set family of prescribed size. Its numerical form is as follows. For , write the unique combinatorial number system expansion
Every of size satisfies
The empty family has empty lower shadow. Equality is attained by the first -sets in colexicographic order, where the largest differing element belongs to the later set. Iterating the Kruskal-Katona theorem shows that the same colexicographic initial segment minimizes every iterated lower shadow.
For , the Erdős-Ko-Rado theorem gives
for an intersecting family . All -sets containing one prescribed point show that the bound is sharp.
For the proof from the Kruskal-Katona theorem, put and form the complement family . Let be its rank- iterated lower shadow. No member belongs to : containment in would give , impossible for an intersecting family of nonempty sets. Hence
Suppose . The first members of the colexicographic order are all -sets of . Their rank- iterated lower shadow is all -sets of , since . The next -set contains and has an -subset containing , so taking even one more member strictly enlarges that iterated lower shadow. By the iterated Kruskal-Katona theorem, . Together with this contradicts Pascal's identity and the preceding inequality. This proves the Erdős-Ko-Rado theorem.
For the Katona circle method proof, fix a cyclic ordering of . A cyclic interval of length is specified by its final position. If no such interval belongs to , the bound below is automatic. Otherwise rotate one selected interval so that it ends at position , and thus occupies positions . Intervals ending at positions are disjoint from it and cannot be selected. Among the remaining endpoints, pair with for . The corresponding intervals are disjoint when , so at most one interval per pair is selected. Together with the interval ending at , this gives the cyclic interval intersection bound of selected intervals.
Choose a uniformly random permutation and read its positions cyclically. A fixed -set is a cyclic interval with probability : each cyclic position gives a uniformly distributed -set, and for the intervals are distinct. Summing over , the expected value of the number of selected intervals is . The cyclic interval intersection bound makes this at most , giving .
Finally apply the Katona circle method to an arbitrary antichain . If it contains or , it has exactly one member and the LYM inequality holds with equality. Otherwise all its members have sizes . In a fixed cyclic ordering, the cyclic intervals sharing a final position form a nested chain as their lengths increase. At most one of them can belong to the antichain. Summing over the final positions proves the cyclic interval antichain bound of intervals. Taking the expected value over a uniformly random permutation gives
After division by , this is the LYM inequality proved by cyclic intervals. The case consists only of the empty set and is immediate.