Write the Cox proportional-hazards model as , where is the hazard multiplier and is the unspecified baseline hazard. At an untied event time , let be the risk set immediately before the event and its failing individual. With independent censoring conditional on the covariates, the conditional probability that individual supplies the next event, given an event at that time and the risk set, is obtained by dividing its instantaneous event rate by the aggregate rate:
More precisely this is the limit of the conditional probability for one event in a short interval; simultaneous events have smaller-order probability in the continuous model. Multiplication of these successive conditional contributions gives the Cox partial likelihood
Censored individuals remain in each risk set until their censoring time but supply no numerator. Conditioning removes the baseline hazard; this is a partial likelihood for , rather than a complete likelihood for event and censoring times.
Ties require an observation model or an approximation. Suppose a recorded tie hides the order of continuous events, with no intervening entry or censoring. Put for the tied event set and . An exact marginal contribution for the coarsened ranks is the sum of the ordinary rank contributions over every possible order:
For example, if fail together while remains at risk, the two possible orders give
The risk set is depleted after the first of the two events. This expression concerns the missing event order; it is not the full likelihood of an interval in which the events occurred.
Convenient alternatives are the Breslow approximation for tied event times and the Efron approximation for tied event times:
The first keeps the initial denominator at every event; the second removes an average share of the tied-event multipliers successively. In the example their denominators are and . These conventional partial-likelihood factors omit multiplicities independent of , which do not affect its estimate; they should not be mistaken for normalized probabilities of the unordered event set.
For genuinely discrete event times there is another exact construction. If individual event odds are proportional to , conditioning on exactly events gives the exact tied-set conditional likelihood
For the same three individuals this is . It is not generally equal to the continuous-time rank sum: the assumptions differ.
Large tie groups make naive summation over orders or subsets impractical. Recursion helps with the subset denominator, and Breslow or Efron avoids exhaustive enumeration. However, extensive ties can also indicate that time is measured too coarsely for an exact continuous-time ordering to be a useful target.
For example, if patients are assessed only at annual visits, use one row per patient-year still at risk and model the probability of an event in that interval. A grouped proportional-hazards model follows directly by integrating the hazard over the interval, with covariates constant there:
Fit the resulting person-period likelihood, with Bernoulli distributions for the interval event indicators and interval-specific intercepts. Many events in the same year are then ordinary observations rather than a combinatorial ordering problem. This requires a compatible interval-observation scheme and appropriate independent censoring; it avoids pretending that unobserved within-year event times are known.
For each fixed , the variables are independent and identically distributed random variables with Bernoulli distribution of parameter . Their expected value is , and the strong law of large numbers gives almost surely.
For a finite set , intersect these probability-one events over its finitely many elements. On the resulting single event, every one of the finitely many errors tends to zero, so their maximum tends to zero:
If is empty, take the displayed maximum to be zero. The important point is simultaneous convergence on one event; pointwise convergence at an uncountable collection of arguments would not alone imply the uniform claim in part (ii).
An unordered bootstrap sample is determined by the multiplicities of the distinct observations, with . Conversely each such vector specifies exactly one sample up to rearrangement. Place identical marks into boxes using separators. The stars and bars argument therefore gives
These bootstrap count vectors are not equally likely: the probability of a vector is , counting its possible ordered sequences. The ordered index sequences themselves number .
The first simulation uses independent standard Cauchy distributions and returns
The tail probability and estimator moments are
The indicator count has a binomial distribution with parameters ; the infinite variance of a Cauchy observation is irrelevant because this estimator averages bounded indicators.
For the next code block, each row is an independent sample of size from the empirical distribution of the original . Its entry in the vector is the corresponding bootstrap indicator mean . The last expression is the variance of these replicate estimates, with denominator :
Condition on the original data and write a star on bootstrap expectations. Every resampled indicator has a Bernoulli distribution with success probability , and the draws within a row are independent. Thus the conditional bootstrap variance of a sample mean gives
It estimates the sampling variance of the tail-probability estimator, not the variance of the raw Cauchy data. Its square root is an estimated standard error. Finite leaves bootstrap simulation noise. Averaging over the original data, its expectation is , so it is not exactly unbiased for the true variance at finite .
In the importance-sampling block, the transformation gives, for ,
The variable is a proposal draw supported entirely in the integration region. The deterministic value computed from it is the importance sampling weight
Consequently
The code uses ordinary importance sampling of a Cauchy tail, not self-normalization; itself is neither an observation from the target Cauchy law nor the estimator's summand. The weight compensates for sampling from its proposal law.
The final block bootstraps these same proposal observations and recomputes the weight average in each row. Since is a deterministic function of , this is equivalent to resampling the observed weights . If denotes a replicate, the final output is its sample variance over the replicates. Its conditional expectation is
Its expectation over the original proposal sample is .
The variance reduction can be calculated, rather than inferred just from the appearance of the weights. Write . Then
because an antiderivative of the integrand without its prefactor is . Hence
By comparison, . For the true estimator variances are approximately and respectively. The importance estimator has about 1/1,317 of the indicator estimator's variance, because all proposals land in the tail and the weights remain in the narrow interval .
Thus the last bootstrap output should usually be much smaller than the first, and its expected value is smaller by the same variance ratio. This is not a deterministic ordering of two finite-run outputs: if all the original Cauchy draws happen to be at most two, the first bootstrap variance is zero, while unequal importance weights can still give a positive second variance.
Zero observed events do not mean that the underlying event probability cannot be estimated. For independent observations having a common Bernoulli distribution, the binomial likelihood with no events is , maximized at . A zero-event binomial upper confidence bound shows the remaining uncertainty: the one-sided 95% upper bound solves , giving
Thus the point estimate is zero, but a nonzero mortality risk is compatible with the observations. This bound is an illustration under independent equal-risk sampling; clustered data or unequal risks require their own uncertainty calculation.
The empirical unadjusted odds ratio is also defined:
Its log odds ratio is , so the ordinary normal approximation for a log-odds confidence interval is unavailable. Exact likelihood-based limits can still describe uncertainty; a specified continuity correction would instead yield a finite, method-dependent point estimate.
In an unpenalized logistic regression with a separate coefficient for elective exposure, every exposed death outcome is zero. Decreasing that coefficient toward increases the exposed observations' likelihood contributions and leaves the reference observations unchanged. This is quasi-complete separation: there is no finite ordinary maximum-likelihood estimate of the exposure coefficient, even after adding background predictors. It is reasonable to say that the usual finite adjusted coefficient could not be fitted; it is too strong to say that no risk estimate or statistical information is possible. A specified penalized likelihood or Bayesian inference with proper coefficient priors can provide a finite adjusted estimate, whose dependence on the regularization must be reported.
Set and absorb the common multiplier into . The model becomes
It is a Cox proportional-hazards model; the unknown baseline does not need a parametric form. The equality hypothesis is precisely . The absolute multipliers and have a scale ambiguity, but their hazard ratio is identifiable when both groups supply information.
For an untied event at , let be the risk set just before the event, and let be the subject who fails. The conditional event probability is proportional to that subject's hazard, so the common baseline cancels:
Multiply these factors to form the Cox partial likelihood. One can maximize it and compare its maximum with its value at using a partial likelihood-ratio test, or use the corresponding score test.
Explicitly, with group risk-set sizes and observed event indicator for group 1, the score at zero and its information are
Under the null the event label has exactly this Bernoulli distribution conditional on its current risk set. Hence is the usual one-degree-of-freedom log-rank test statistic, with an asymptotic chi-squared distribution when and enough informative events are observed. Censoring can differ between groups, provided it is independent of event time within the conditioning model. If there are recorded ties, use the appropriate tied-risk-set version: for events the null variance contribution is .
The Bernoulli distribution probability mass function is
Writing gives and . Therefore the exponential family representation has
The logit link is the canonical link.
An effective bandwidth converts a traffic distribution and a quality-of-service requirement into a capacity requirement, penalizing bursts as well as mean load. Let be the traffic generated in one observation interval and assume its moment-generating function is finite for some positive parameters. Write . The Chernoff bound follows immediately from Markov's inequality applied to :
Optimizing gives , where the supremum is restricted to finite exponential moments. This exhibits the effective bandwidth as the load appropriate to exponential tail control, not an extra physical stream of traffic.
For the mean and peak limits of effective bandwidth, if exponential moments exist near zero, the cumulant-generating function expansion is
For small , , with the variance giving the first burstiness correction. convexity of and show that its secant slope is nondecreasing; Jensen's inequality also gives .
If is bounded with essential supremum , then . For any , the probability is positive and
Let and then . For large , , so very stringent exponential tail control approaches peak provisioning. If traffic is unbounded and every positive exponential moment is finite, the same lower-bound argument gives . If exponential moments cease to exist beyond a finite parameter, is infinite there; one cannot assign a finite large- peak interpretation to that traffic.
For example, deterministic traffic has . A burst of size with Bernoulli distribution probability gives
which moves from to . For Poisson packet count of mean and packet size , , showing a mean limit but no finite peak limit.
For independent traffic sources, logarithmic generating functions add, so effective bandwidths add. For arrivals in a window of length , use the rate-valued definition . A resource with rate capacity then satisfies
Thus a sufficient admission condition for a target probability is for some . Independence is needed for this additive form; correlated sources require the joint exponential moment.
A queue involves a supremum over time windows, not merely one fixed window. For independent identically distributed discrete-time traffic increments , constant service , and stationary workload
the workload Chernoff bound for independent increments follows from a union bound:, whenever ,
The requirement is precisely . This explains why effective bandwidth is useful for buffer and delay design: the relevant time scale and tail parameter depend on the service rule and target overflow risk. A single-window bound cannot be silently substituted for an infinite-horizon workload bound.
A Gibbs sampler updates one coordinate by drawing from its full conditional distribution, leaving the others unchanged and using their current values. Each coordinate kernel preserves the target joint law : integrate first over the unchanged coordinates, then over the old coordinate, and finally draw the new coordinate from the same conditional distribution. The resulting joint law is again . In the discrete notation, if two states share the remaining coordinates,
which is symmetric in . Thus a coordinate update satisfies detailed balance. A systematic full sweep has kernel and remains invariant because each factor preserves . A fixed-probability random-scan mixture also preserves ; the mixture is reversible, whereas a systematic composition need not be.
In the autologistic binary-image model, count each neighboring pair once. Changing one pixel from zero to one raises by one and by the number of neighboring ones. The ratio of its two conditional weights is . Therefore
For single-site Gibbs sampling, select a pixel, compute its current neighbor sum and replace it by a draw from a Bernoulli distribution with this probability. One may use random scans or complete ordered sweeps. The normalizing constant is not needed. For finite , every conditional probability lies strictly between zero and one; the finite chain is irreducible and has self-transitions, so its stationary law is unique and iterating converges to it.
For checkerboard Gibbs sampling, no edge joins two black pixels or two white pixels. Conditional on the whites, the black-pixel law factorizes:
Draw all black pixels independently with these probabilities, then draw all white pixels independently conditional on the newly drawn blacks. Each color block is a full conditional update, so the two-block sweep preserves the joint target. Pixels of the same color can be updated together because their conditional distribution factorizes.
For the noisy image, the log likelihood contributes . Since , dropping terms independent of gives
The Gaussian-noise posterior for an autologistic image therefore has conditional probabilities
Use this probability in both single-pixel and sequential color-block schemes. The independent observation factors change only the local field, so conditional independence within each color is retained. The same invariance proof then targets the posterior distribution rather than the prior.
The cumulative-response logistic model uses instead of the two individual lag predictors. It and the two-lag history-dependent logistic regression are nonnested: the entire accumulated history generally cannot be represented using only the two recent outcomes. Their binomial deviance difference therefore has no ordinary nested chi-squared distribution calibration.
Use the Akaike information criterion, which up to the same saturated-model constant equals for these Bernoulli distribution conditional likelihoods. The two-lag fit has six coefficients, while the cumulative fit has five:
Thus prefer the cumulative-history model, whose Akaike information criterion is lower by 35 despite its smaller number of statistical parameters. This is a model-selection comparison of conditional histories, not a nested likelihood-ratio test.
Let indicate a smoking-free week, the recorded sex indicator, age in years and assigned treatment. The screening history supplies ; earlier lag initializations are also zero. A history-dependent logistic regression for the first model is
Here , is the observed past, and the five unknown regression coefficients have time-invariant values. Conditional on baseline covariates, this model has the first-order Markov property: only the immediately preceding outcome enters the current conditional probability. Distinct subjects have independent histories. There is no subject random effect or additional time trend in this fit.
Using the chain rule for probabilities, the individual conditional likelihood is
The lagged values in are the individual's actual preceding outcomes. This product is a sequential conditional likelihood, not an assertion of unconditional independence of the ten readings. The full conditional likelihood is ; no extra Bernoulli distribution factor is attached to the fixed screening history.
The preferred cumulative-response logistic model estimates
Its logit link describes conditional smoking-free probability given baseline predictors and prior successful weeks. Holding the other predictors fixed, males have times the female success odds; the reported p-value is , and the approximate 95% odds ratio confidence interval is . Age has estimated odds ratio per additional year, with p-value , giving little evidence for an age association in this fit.
The combined treatment has conditional success odds ratio versus the reference treatment, with approximate 95% confidence interval and p-value . The fitted conditional odds are about 39% higher for the combined treatment. The trial randomization supports treatment comparisons, but conditioning on accumulated post-treatment outcomes means this coefficient is not directly the marginal total treatment effect.
Each previous successful week multiplies current success odds by , with approximate 95% confidence interval and very small p-value . This is strong fitted persistence. It can reflect true state dependence, unobserved heterogeneity, or an omitted calendar-time trend; this fit alone cannot distinguish them. The baseline intercept implies success probability for a reference-treatment female aged zero with no previous success. That age is outside the study's useful interpretation range, so the intercept chiefly anchors the regression. The Bernoulli distribution dispersion parameter is fixed at one, and the residual binomial deviance is 1122 on 995 statistical degrees of freedom. With individual binary outcomes, comparing that binomial deviance mechanically to a chi-squared distribution is not a reliable general goodness-of-fit test.
In the slotted ALOHA model, a station retains one packet until it successfully transmits. Conditional on , take fresh independent trials with a Bernoulli distribution of parameter for the backlogged stations. Let arrivals be independent across slots and independent of these trials, with Poisson distribution of mean . New arrivals join the next slot's backlog. An idle slot serves nobody, exactly one attempt serves one packet, and a collision serves nobody. Consequently the backlog changes by arrivals minus the success indicator.
Under these independence assumptions, is a time-homogeneous Markov chain: the feedback probabilities and the independent arrival law depend only on its current state. Merely specifying Poisson arrival marginals would not suffice. For example, take , , , and arrivals , , for independent random variables with Poisson distributions. Histories with and both have current backlog two, but the next backlog is respectively two and four. The usual model therefore includes fresh arrivals as an assumption.
Write and . Set for , and use their exact binomial distribution probabilities at . Away from the clipping boundary, the conditional drifts are
Near , the latter must use for each update , rather than itself.
When both coordinates are large with , the Poisson limit theorem approximates the attempt count, which has a binomial distribution, by a Poisson distribution of mean . Thus and . Rescaling state by and slot time by motivates the fluid approximation of slotted ALOHA
This is an interior fluid approximation of slotted ALOHA, not the exact conditional drift at a clipped boundary.
Here is one explicit set of sufficient conditions, independent of the arrival rate within the subcritical range:
Put . Then
Hence is negative below one and positive above one: the controller decreases the attempt denominator when offered contention is too small, and increases it when contention is too large.
Use the ratio time change for a homogeneous fluid model, . The equations become
For ,
since and . Also . Therefore is negative on , and by continuity on for some . Its value at zero is , so nonnegative backlog is preserved.
The ratio remains bounded by and eventually enters : on the compact interval , its derivative is bounded above by a strictly negative number. Once inside it cannot cross upward. The bounded ratio and smooth coefficients make the transformed equations exist for all . In this region , so decreases at least exponentially in . The original time satisfies and has a finite limit ; boundedness of gives as well. Thus every nonnegative interior fluid trajectory drains to the origin in finite fluid time. At the origin the ratio equation is undefined; the usual stopped fluid trajectory is held there afterward. A state with enters the interior under the continuous limiting boundary drift ; the same argument then applies.
This proof supplies sufficient conditions, not a characterization of every stabilizing triplet. It also does not assert the positive recurrent Markov chain property of the original stochastic chain solely from the heuristic ODE.
If , the ALOHA throughput bound gives
No choice of the three feedback increments can make this fluid backlog drain, since . For the displayed controller, the supercritical fluid trajectory is global and grows instead of draining. At the ray consists of stationary fluid states, explaining why the strict load inequality matters.
Give each nearest-neighbor edge of the cubic lattice an independent Bernoulli distribution state, open with probability . The resulting product measure is denoted . In this bond percolation model, is the percolation cluster of the origin, and
The uniform-label monotone coupling of Bernoulli percolation shows that is increasing.
Let count -step self-avoiding walks starting at the origin, with . Splitting a walk after steps, and discarding the avoidance constraint between the two pieces, gives . The Fekete lemma therefore gives the connective constant
The locally finite graph structure means that an infinite percolation cluster at the origin supplies an open self-avoiding walk of every length. Each specified walk has distinct edges and is open with probability . The union bound gives
For the right side tends to zero. Hence the connective-constant lower bound for percolation is .
For the upper bound first work on the square lattice. A finite open percolation cluster has an outer boundary containing a simple closed graph cycle of dual edges, all crossing closed primal edges. Such a dual bond percolation circuit separates that cluster from infinity. Write for the number of simple dual circuits of length surrounding the origin. Each circuit meets the positive horizontal ray at distance at most : its bounding box contains the origin and its diameter is bounded by its length. Choose such an intersection as an anchor and orient the circuit. Removing its last edge leaves a rooted self-avoiding walk of length in the translated square lattice. Consequently, for an absolute constant ,
The exact constant and this possible overcount do not matter. If , the root test gives
A summable circuit count alone need not give a total sum below one. To use its tail correctly, let and condition every edge internal to to be open. This finite event has positive probability. A closed dual circuit surrounding all of crosses no internal edge of , and so its closed-edge probability remains under this conditioning. Its length tends to infinity with . Choose so large that the union bound for all such circuits is below one. With positive conditional probability, none occurs.
On that event, contains and cannot be finite: a finite cluster containing would have an enclosing closed dual circuit. Thus whenever . This is the connective-constant Peierls bound, proved by excluding short circuits through the open-box conditioning. An embedded coordinate plane in the cubic lattice has exactly the same bond percolation law as the square lattice, so . Together,
There are choices for the first step of a self-avoiding walk and at most thereafter, because immediate reversal is forbidden. Hence and . In particular . Substituting with the correct directions of the inequalities gives
Use the coordinatewise partial order: means for every . An increasing event is upward closed: and imply .
Under the independent Bernoulli distribution product measure on these coordinates, the Harris-FKG inequality states
for increasing events . For , let be the cylinder of configurations agreeing with on . The disjoint occurrence of increasing events consists of configurations for which there exist disjoint with and . For increasing events, witnesses can be taken to prescribe only open coordinates. The BK inequality is
Positive association rewards simultaneous occurrence; the disjoint-witness requirement in the BK inequality gives a bound in the opposite direction. The inequalities also apply to different independent Bernoulli parameters in different coordinates.
Regard the boxes as sets of lattice graph vertices. Write , and put . On the event defining , choose an open self-avoiding walk from the origin to its first visit to . Let be its first visit to . Its initial segment witnesses . Its remaining segment ends at a point with
For , truncate this remaining segment on its first visit to . The two segments use disjoint edges, so they are disjoint witnesses. For , the second event is the sure event with empty witness. Thus the union bound, the BK inequality and translation invariance give
An unrestricted connection event can depend on infinitely many edges. Apply the finite-coordinate BK inequality first to connections confined to growing boxes and take increasing limits; each occurrence has a finite path witness. This justifies its use here. The estimate is the weighted BK boundary-splitting estimate.
By summing cluster indicators and using Tonelli theorem, the percolation susceptibility is
If , then . At all vanish, so any positive exponential rate works. Otherwise choose with . Iterating the weighted BK boundary-splitting estimate gives, for with ,
For , , so . To include the finitely many smaller indices without a prefactor, note that under finite susceptibility and
Therefore one may take
For this follows from , and for it follows from the iterated estimate. This proves exponential one-arm decay from finite susceptibility with exactly the requested unit prefactor.
This is a generalized linear model with independent Bernoulli distributions for the responses and the logit link. Under treatment coding with colour one as the reference level, the linear predictor is
Colour is a categorical variable, not a numerical trend. Width has the same slope for every colour, since no interaction term is fitted. The parameters are estimated by maximum likelihood estimation.
The approximate Wald confidence interval for the width coefficient is , or approximately . This uses the approximate normal distribution of the maximum-likelihood estimator, rather than a confidence interval for an individual binary response.
For the requested crab, the fitted linear predictor is . Applying the inverse logit link gives . The rounded displayed coefficients need not reproduce the reported test statistics exactly.
For any fixed bin, each ball supplies an independent Bernoulli distribution indicator with success probability . Summing the indicator variables gives
The full occupancy vector has a multinomial distribution, the basic uniform balls-in-bins allocation. Distinct bin counts are not independent when and . To see this, write . For the same ball, if , while indicators from distinct balls are independent. Their covariance is therefore
With no balls the counts are deterministic; with one bin there are no distinct bin pairs. These degenerate cases do not contradict the conclusion.
Take independent and identically distributed random variables with the Bernoulli distribution of parameter , and their natural filtration. Set
The event at is the whole sample space. Independence gives
so this is a nonnegative martingale; it is integrable with . The first zero among the is almost surely finite, since the probability of having only ones through time is . After that first zero, every is zero. Hence the almost sure limit is zero:
This fair-coin doubling martingale also exhibits failure of uniform integrability: convergence in L1 would force the expectations to converge to zero.
In bond percolation on an undirected graph , a configuration is . The edge is open when and closed when . Under , the coordinates are independent and identically distributed random variables with the Bernoulli distribution of parameter . For a countable edge set, use the product sigma-algebra and the product measure
The open edges form a random subgraph with the original graph vertices. Its connected components of a graph are the percolation clusters. Write when an open graph path joins to ; a zero-length graph path is allowed, so always holds. The randomness is in the independently open bonds; all vertices remain present.
Use the probability space with the product measure of the uniform distribution on . Its coordinate random variables are independent and identically distributed random variables. Define simultaneously for every parameter
For , the indicator function inequality holds pointwise at every graph vertex. For fixed , each coordinate has the Bernoulli distribution with parameter , and the coordinates are independent because they are functions of distinct independent . Thus every marginal configuration is exactly the required site percolation model. This is a continuum-indexed family of processes, all on one probability space, and is the standard monotone coupling of Bernoulli percolation.
For , the Bernoulli distribution has mass
In exponential dispersion family notation , take
The support is ; outside it the probability is zero. The natural parameter of an exponential family is the log odds, and the dispersion parameter is fixed rather than freely estimated. Differentiating the cumulant gives
At or the degenerate distributions are limiting boundary cases with natural parameter or .