A generalized linear model has independent responses whose distributions belong to an exponential family:
Here the expected value and variance are and . A specified one-to-one link function connects the mean to the linear predictor: . The canonical link function is .
In binomial regression, independently, with known trial counts and probabilities related to the predictor. The logistic regression and probit regression specifications are respectively
Here is the standard normal distribution function. The binomial log-density contains , so its natural parameter is the log-odds: the logistic link is canonical. If the response mean is written as , the canonical link is .
The geometric family law on the nonnegative integers has probability generating function
Its expected value is , so this is a geometric-offspring critical branching process. Starting from , verify the rational iterate by induction. If , then
which has the same form with replaced by . Thus, for ,
The stated disk is the actual power-series convergence domain, not merely a place where the rational continuation can be evaluated. Its simple pole is at .
The extinction probability at generation is the constant coefficient:
For later use, expanding the remaining geometric series gives
In particular . At the initial population is one deterministically; its PGF is , and the displayed radius involving is used only for .
For independent random variables, and . Factor their probabilities to obtain the distribution functions of independent minima and maxima:
These formulas also allow atoms; no probability density function assumption is needed.
For independent unit-rate exponential distributions, for , so . To establish the independent minimum and gap of two exponential variables, set . On either ordering branch, the change of variables is or with unit absolute Jacobian determinant. Both contribute ; ties have probability zero. Thus the joint probability density is
It factors into normalized exponential probability density functions, proving , and their independence.
The maximum is . A half-scaled unit-rate exponential has rate two, so the independent pair has the same joint law as . Consequently
Using the expected values, variances and independence of the summands,
The spacing factorization explains why an order statistic can be represented as a sum of independent waiting times.
For each , choose the continuous probability density functions
The second is at least and integrates to one. Their expected values differ by
Writing gives
The supplied product bound, also obtained from the chi-squared divergence of product measures, implies
For the final elementary estimate, compare the exponential series with the geometric series: for . Thus the overlap of the product laws is at least . Part (b) now gives the explicit mean-estimation minimax lower bound for continuous densities
So one may take , uniformly for all . The alternatives are allowed to depend on , because the minimax risk takes a supremum over all continuous probability density functions separately at each sample size.
Write and . Holding the nuisance parameter fixed, the parametric score function is the derivative with respect to of the one-observation log-likelihood. The joint probability density function is
Because , differentiating gives
For instance ensures a square-integrable score function. Its expected value is zero by independence and the centered normal distribution of the error. This is the Gaussian regression score.
Now . With and the location score , differentiation of the log-likelihood gives
Take the usual regularity conditions and so that this score function belongs to L2 space.
For the specified nuisance statistical path, differentiating at zero gives the score function . Normalization requires . There is a second constraint: the statistical path must preserve the model's zero error expected value. Thus
This constraint follows from being a path through the model, rather than from normalization alone. For a centered symmetric logistic distribution, for example, is bounded and has zero expected value, but ; it would not preserve the mean.
For any , independence implies
All these products are integrable by the Cauchy-Schwarz inequality, since is square-integrable. Thus every such error-density score function is orthogonal to every . Covariate-density nuisance score functions are also orthogonal to these functions, since . This is the mean-preserving error tangent space orthogonality used in the final calculation.
First use the additional admitted form of the efficient score. Write and let . The difference is the orthogonal projection onto the nuisance tangent space. Part (c) makes every orthogonal to that space. Therefore, for all ,
The function in braces belongs to L2 space; choosing it as shows it vanishes -almost everywhere. Hence the required conditional deduction is
Under the regular tail condition at both infinities, integration by parts gives , and the formula becomes . This also confirms the sign.
The admitted product form is an extra restriction; it does not follow for every independent-error regression model. To locate the restriction precisely, suppose the error-density nuisance statistical paths preserve both normalization and mean to first order. Their closed mean-preserving error tangent space is . The full nuisance tangent space is the orthogonal sum of this space and the centered functions of .
For completeness, bounded functions satisfying the two constraints are dense in the error space. Truncate an arbitrary element, subtract its expected value, and then subtract a multiple of a fixed bounded centered function with . Such a exists by truncating , since . The correction coefficients tend to zero by the Cauchy-Schwarz inequality, so the corrected truncations converge in L2 space.
Let . With and , the orthogonal projection of onto the error nuisance space is ; its projection onto the covariate nuisance space is zero. Thus the general efficient score in independent-error regression is
The orthogonality of the two terms gives the displayed efficient information. For a normal distribution of the error, , so this reduces to the admitted formula. It also does so when is constant.
A concrete counterexample to the generality of the admission is , with uniform on and independent standard logistic distribution error. Here and , so the actual efficient score is . It cannot equal because is not constant. This score function is already orthogonal to every nuisance score function: its factor is centered against error-only directions, and its factor is centered against covariate-only directions. The requested formula is valid under its stated additional admission, with the general independent-error formula above explaining its limits.
For the exponential distribution of mean , . Substitution into the geometric-sum moment-generating function gives
This is the moment-generating function of an exponential distribution with rate . By the uniqueness theorem for moment-generating functions, the geometric sum of exponential variables therefore has probability density function
Its expected value is , agreeing with in the random sum of independent claims formula.
Use the shape-rate convention for the gamma distribution. A shape and rate give expected value and variance . The two moments here force and . Thus , and the geometric-sum moment-generating function becomes
Put , and . Then , , and
Consequently the geometric sum of shape-two gamma variables has the same probability distribution as the sum of two independent exponential distributions with rates . Their convolution of independent random variables yields
The probability density function is zero for . It is nonnegative because , and its integral is
This verifies normalization directly. An alternative check uses the conditional gamma distribution with shape :
which is exactly the same density. The expected value supplies a further check.
Set . The compound Poisson distribution variance identity and the per-claim excess of loss reinsurance payouts give
Apply differentiation under the integral sign. The endpoint terms in the first two terms cancel, while the last integrand is zero at its lower endpoint. Equivalently, differentiate the two payout squares inside their expected values; the finite second moment supplies a dominating integrable function. This gives the total variance stationary condition for excess of loss
Hence the specified equality makes . When , its interpretation is , where the mean residual life is .
For the exponential distribution of mean , and
Thus is negative below and positive above it. The variance-minimizing exponential retention is the unique global minimizer
For an explicit value, put . The capped claim moments and the excess-claim second moment give
The sign argument establishes global minimality, rather than just stationarity.
Use the classical risk model surplus , with , and write for its ultimate survival probability. The first-claim decomposition for survival probability follows by conditioning on the first arrival time of the Poisson process. That time has exponential distribution of rate . A claim at time leaves capital if , after which the Markov property restarts the same risk model. Consequently
Put and change variable :
The convolution is continuous since is bounded and is integrable. Differentiating proves the survival integro-differential equation
For the specified claim law, expand its probability density function as . This is an equal-weight mixture distribution of exponential distributions with rates and . In the convolution, set to obtain
Since , the requested coefficients are
For the exponential-mixture differential equation for survival probability, define , and . Differentiating the integrals yields
Apply to the last equation, where . The first two equations eliminate , giving
Thus
The characteristic polynomial factors as
The ordinary differential equation therefore has solution .
The claim expected value is . The relative safety loading is , and the given zero-capital survival probability is . The limit at infinity sets . A third condition comes from the original survival integro-differential equation: its convolution vanishes at zero, so . Therefore
which gives and . The final survival probability and ultimate ruin probability are
Both exponential coefficients of are positive. Hence increases from to one, and decreases from to zero. The initial slope is essential: the two stated boundary values alone do not determine all three constants of the eliminated differential equation.
A credibility estimate blends the risk's own sample mean with a population or prior expected value. In the basic equal-exposure form it is , where the credibility factor is the weight attached to the individual experience. More data ordinarily increase that weight; greater within-risk variation relative to between-risk variation reduces it.
Write for the conditional claim expected value, keeping for the prior-level parameter. Normalization of the probability density function gives
At interior points of its finite domain, differentiation under the integral sign yields
This is an instance of the exponential-family derivative identities for natural parameter . The minus sign is present in the PDF and is lost in the converted TeX. The conditional variance is likewise .
Differentiate the log of the natural conjugate prior:
Integrate on a compact subinterval and then let its endpoints approach those of the parameter interval. The prescribed vanishing of the prior density eliminates the boundary term. Since , monotone convergence theorem justifies the limit of its expectation, and the identity gives
In particular the assumed proper prior and boundary conditions themselves establish this first-moment integrability.
For and , conditional independence makes the likelihood function proportional to . Multiplication by the prior distribution gives the Bayesian posterior
Thus this is a conjugate prior family, with updated parameters
The integration-by-parts calculation for the posterior mean also needs vanishing posterior boundary values. Here that property can be checked, rather than assumed. Let be the essential lower and upper endpoints of the claim support. Every nondegenerate tilted claim law has , so the established prior mean satisfies . Supported observations have ; hence . At a finite parameter endpoint the prior's vanishing forces , because its exponential factor has a finite positive limit; the increased power makes the posterior vanish there too. At , choose with positive base-measure mass below . Then and the unnormalized posterior is at most . At , choose with positive mass above to obtain the corresponding bound . These bounds also ensure posterior propriety at infinite endpoints. This is the endpoint control for a Laplace-family conjugate posterior.
Apply the previous score integration to the Bayesian posterior. The natural conjugate credibility identity is
Thus is the credibility factor. This is an exact posterior mean, rather than an affine approximation to one.
For the specific shape-two gamma distribution, take
Then and . The gamma rate gamma conjugacy prior is
that is, . Its normalizing constant in the notation of the question is . The gamma distribution density vanishes at both zero and infinity for . The posterior has shape and rate , so its conditional-mean posterior mean is again .
For the last calculation, gamma distribution integration gives
The second identity requires the printed . Therefore the expected process variance and variance of hypothetical means, denoted by in this question, are
Consequently , and the Bühlmann credibility factor agrees with the exact Bayesian weight:
This is the exact Bühlmann credibility for gamma claims, expressed using the reciprocal rate as the random scale. The symbols here are the process and between-risk variances, respectively; their roles should not be interchanged when comparing with other notation for the Bühlmann model.
Put and . The hypothesis implies . For the number of isolated vertices, the isolated vertices in the Erdős-Rényi model formulas give
Thus the Chebyshev inequality gives with high probability, uniformly over the specified range.
The Cayley formula supplies a spanning tree on any connected vertex set. Consequently the expected value of the number of graph components of order is bounded by
Choose a fixed with . For , with , the binomial coefficient bound gives
Here . The geometric series and a union bound therefore exclude this entire size range, since . For , an empty graph cut would be necessary. Its total probability is at most
There are consequently no graph components of orders between and , with high probability.
For each fixed , a graph component containing a graph cycle has a spanning tree and at least one extra edge. Counting that extra edge gives an expected value ; hence every small graph component is a tree component. The total number of vertices in tree components of orders satisfies
The Markov inequality gives with high probability. When , this sum is empty and . Since , the remaining vertices must lie in one graph component larger than . It is unique, and its order is . Every other graph component is a tree with at most vertices. This is the logarithmic-regime giant component mechanism: almost all missing vertices are isolated.
Write , , , and let be the total progeny of a binomial branching process. The preceding binomial branching survival correction gives . For a branching process conditioned on extinction, the offspring probability generating function is , with mean
for sufficiently large . Summing expected generation sizes therefore gives .
Put and let count vertices in graph components of order at least . A breadth-first exploration of a binomial random graph is dominated by . The Markov inequality applied to finite total progeny gives
Always . Since , we have and . Hence . This bound controls the expected value directly, including rare large graph components.
For the lower bound, use the breadth-first exploration of a binomial random graph with unseen vertices, active vertices and explored vertices, starting from , . Let indicate a new root. Conditional on the past, the newly discovered count has a binomial distribution . Put . The unseen-count recursion gives
Here is a martingale. Up to , martingale-difference orthogonality gives , since each conditional variance is at most and is bounded.
Take . Then , and . The Doob L2 maximal inequality implies
The Taylor expansion, uniformly for , gives . Thus throughout the integer interval for large . The new-root sum is nonnegative, so on the preceding event throughout this interval. No graph component finishes there: all these explored vertices belong to one graph component, of order at least , with high probability. Its expected value is therefore at least . Combining both inequalities proves
The barely-supercritical largest-component expectation uses both a positive exploration window and a finite-progeny bound; a bare convergence-in-probability assertion would not by itself justify this expectation.
The Kruskal-Katona theorem states that a colexicographic initial segment minimizes the lower shadow of a uniform set family of prescribed size. Its numerical form is as follows. For , write the unique combinatorial number system expansion
Every of size satisfies
The empty family has empty lower shadow. Equality is attained by the first -sets in colexicographic order, where the largest differing element belongs to the later set. Iterating the Kruskal-Katona theorem shows that the same colexicographic initial segment minimizes every iterated lower shadow.
For , the Erdős-Ko-Rado theorem gives
for an intersecting family . All -sets containing one prescribed point show that the bound is sharp.
For the proof from the Kruskal-Katona theorem, put and form the complement family . Let be its rank- iterated lower shadow. No member belongs to : containment in would give , impossible for an intersecting family of nonempty sets. Hence
Suppose . The first members of the colexicographic order are all -sets of . Their rank- iterated lower shadow is all -sets of , since . The next -set contains and has an -subset containing , so taking even one more member strictly enlarges that iterated lower shadow. By the iterated Kruskal-Katona theorem, . Together with this contradicts Pascal's identity and the preceding inequality. This proves the Erdős-Ko-Rado theorem.
For the Katona circle method proof, fix a cyclic ordering of . A cyclic interval of length is specified by its final position. If no such interval belongs to , the bound below is automatic. Otherwise rotate one selected interval so that it ends at position , and thus occupies positions . Intervals ending at positions are disjoint from it and cannot be selected. Among the remaining endpoints, pair with for . The corresponding intervals are disjoint when , so at most one interval per pair is selected. Together with the interval ending at , this gives the cyclic interval intersection bound of selected intervals.
Choose a uniformly random permutation and read its positions cyclically. A fixed -set is a cyclic interval with probability : each cyclic position gives a uniformly distributed -set, and for the intervals are distinct. Summing over , the expected value of the number of selected intervals is . The cyclic interval intersection bound makes this at most , giving .
Finally apply the Katona circle method to an arbitrary antichain . If it contains or , it has exactly one member and the LYM inequality holds with equality. Otherwise all its members have sizes . In a fixed cyclic ordering, the cyclic intervals sharing a final position form a nested chain as their lengths increase. At most one of them can belong to the antichain. Summing over the final positions proves the cyclic interval antichain bound of intervals. Taking the expected value over a uniformly random permutation gives
After division by , this is the LYM inequality proved by cyclic intervals. The case consists only of the empty set and is immediate.
Let be the probability generating function. For the series can be differentiated term by term: is finite, even without a finite claim-count expected value. Multiply the Panjer claim-count class recurrence by and put . Then
Hence
This argument is valid throughout the open unit disk. Values at boundary points may be obtained by a limit when the required derivatives exist; one need not assume to establish the identity.
For quota share reinsurance the insurer retains the same fraction of each claim, so
The annual retained loss is consequently . Each transformed risk severity has probability density function for . The mixed transformed severity, with the same weights , still gives a compound Poisson distribution. Scaling the expected value and variance gives
This agrees with the general retained-claim formulas because and .
For an aggregate claims model, let denote one claim size, with expected value and variance . The total is zero when the claim count is zero. Given , independence gives
The law of total expectation and law of total variance, together with for a Poisson distribution, imply
The raw second moment appears because the random count itself contributes to the variance.
Conditional on , the moment-generating function of the sum is . Averaging with the Poisson distribution therefore gives the compound Poisson distribution transform
This is valid wherever is finite. Finite first and second moments alone do not ensure positive exponential moments; for positive claims the corresponding Laplace transform always exists.
For the independent portfolios put and . Their Poisson distribution counts add to a Poisson distribution with parameter . By Poisson-multinomial conditioning, conditional on the total count the first risk count has a binomial distribution with parameters , and the second is the remaining count. Thus one can generate the same total loss by drawing independent risk labels with these weights, then drawing each claim from its label's law. The merged severity has mixture distribution
It follows that has a compound Poisson distribution with count parameter and this severity law. This is the fixed-year version of Poisson superposition of insurance portfolios. Its expected value and variance are
Alternatively, multiplying the two independent aggregate Laplace transforms yields wherever finite, confirming the same compound Poisson distribution.
For the retained compound Poisson aggregate under per-claim reinsurance, replace each claim by its retained payment . Assume the retention is measurable, with as usual. The count parameter remains , and the severity law is the pushforward measure of the mixture severity under . Thus the retained compound Poisson aggregate has a compound Poisson distribution with that transformed severity and
Its moment-generating function is on its finite domain. For a general retention , zero retained payments can occur and are allowed as compound-Poisson marks; they may equivalently be removed by Poisson thinning. The two specified contracts retain strictly positive payments for strictly positive claims.
In the classical risk model write , where the Poisson process has rate and is independent of the claim sizes. Define the ruin time and ultimate ultimate ruin probability by
The relative safety loading is , so . The adjustment coefficient is the nonzero positive solution
Existence and uniqueness follow from the secant-slope existence criterion for an adjustment coefficient. Explicitly, has derivative at zero and is strictly convex for positive claims. The assumed divergence of makes it cross zero once at a positive . When , an exponential lower bound from any positive tail event shows that . In particular is inside the finite-transform domain, not at its endpoint.
Put . Replacing in the survival renewal equation for a classical risk model yields
By the tail integral formula for moments, . Therefore this is the defective renewal equation
The original kernel has mass . For the exponential tilt of the ruin renewal kernel, set
Multiplying by gives the required proper renewal equation
To verify that this is a probability renewal kernel, Tonelli theorem gives, for in the finite-transform domain,
The adjustment coefficient equation consequently implies . Its expected value is
It is finite because is interior to the finite-transform domain and is positive because the strict convex crossing has derivative .
We quote the key renewal theorem in the following form: for a nonarithmetic distribution of positive increments with finite positive mean , and a directly Riemann integrable nonnegative function , the locally bounded solution of satisfies . It has renewal representation ; this follows by iterating the equation, since the probability that arbitrarily many positive increments have sum at most a fixed tends to zero.
Here is absolutely continuous, and hence nonarithmetic distribution, even if the original claim law has atoms. The function is continuous. Choose with . The Markov inequality gives , and hence . Continuity on compact intervals and this exponential bound make the upper Riemann sums finite with uniformly vanishing tails, proving direct Riemann integrability.
A further application of Tonelli theorem evaluates the forcing integral:
All hypotheses of the key renewal theorem are now checked, so the interior adjustment coefficient ruin prefactor is
This proves the requested Cramér–Lundberg ruin asymptotic, including its constant.
For the two-component hyperexponential distribution, conditioning on the chosen exponential component gives
Its moment-generating function and derivative are
The moment-generating function diverges at , while the derivative of the adjustment equation at zero is negative. Strict convexity therefore places its unique positive adjustment coefficient in
The adjustment equation, divided by , becomes
Using this identity to subtract from gives
Thus the asymptotic constant in terms of and is
The denominator is positive on the identified domain. If desired, is the smaller root of ; the other algebraic root lies outside the positive finite-transform interval and is not an adjustment coefficient.
Conditional on , a Poisson distribution has both conditional expectation and conditional variance equal to . For the uniform distribution on ,
Thus and the one-year credibility factor is . With the observed count equal to one, the Bühlmann credibility estimate of the next year's conditional claim expected value is
The estimate gives relatively little weight to one year because the expected process variance is six times the variance of hypothetical means.