A real functional is Hadamard differentiable at if there exists a continuous linear functional such that, whenever , and in the normed vector space,
If is defined only on a subset, require to lie in its domain. The variation of the directions is essential: convergence along each fixed direction alone is a weaker differentiability condition. Tangential Hadamard differentiability restricts the limit directions to a specified subspace; here the derivative is defined on all of .
We prove the functional delta method using compact sets, so do not need an unjustified application of the Skorokhod representation theorem on an arbitrary nonseparable normed vector space. As usual for function-space convergence in distribution, the limiting random element is tight, and the real statistics are measurable, or convergence is understood through outer expectations. These are automatic under the usual separable complete random-element formulation; the empirical-process formulation used below has a tight separably supported limit.
For put
Hadamard differentiability says for every convergent sequence of directions, since continuity gives . It implies a Hadamard remainder near a compact set: for every compact and there are and such that
To prove it, suppose it failed. Choose and at distance less than from with . Choose with . A subsequence of converges by compactness, so the corresponding converge too. The defining derivative limit contradicts the lower bound on .
Now let and . Given , tightness of a probability measure provides a compact with . For the open -neighbourhood , the Portmanteau theorem gives
On the preceding uniform remainder is less than for all sufficiently large . Consequently . Since is arbitrary, this remainder tends to zero in probability. We have proved the actual expansion
Continuity of and the continuous mapping theorem give . The vanishing remainder and Slutsky theorem therefore yield
This derivation uses the derivative definition, rather than assuming a uniform Fréchet remainder over every bounded set. If outer expectations are needed, the same compact-neighbourhood argument uses outer probabilities and gives the corresponding empirical-process functional delta method.
For the statistical application, use the sample's empirical distribution function and the plug-in estimator
Here the printed denotes bounded pointwise functions with the supremum norm, namely , rather than equivalence classes modulo Lebesgue null sets. Assume Hadamard differentiability at the true and the usual measurability of the scalar estimator. The Donsker theorem for empirical distribution functions and the proved functional delta method give
No continuity of is needed for this application. Since the derivative is continuous and linear and the bridge is a centred Gaussian process, is a centred Gaussian real random variable, possibly identically zero.
Finally, a finite real weak limit ensures the required boundedness in probability. Choose so large that . Applying the closed-set part of the Portmanteau theorem to gives
Hence there is such that, for every ,
In particular the upper-tail condition in the question holds. The plug-in estimator has estimation error , even when its limiting variance is zero.
Choose a proposal probability density function and a finite envelope constant such that wherever the target has positive density. A rejection sampling trial draws and, independently, ; accept when
otherwise repeat with fresh independent draws. For any measurable set ,
In particular , so the conditional accepted density is . More explicitly, summing over the possible first accepted trial gives
Thus the algorithm terminates almost surely and its output has exactly the requested law.
The envelope constant satisfies and is the expected number of proposal trials for one output, by the geometric distribution of the waiting time. This is the quantity often called the rejection rate . The actual probability of rejecting a particular proposal is , and the expected number of rejections before one acceptance is ; these conventions should not be conflated.
To generate a standard normal distribution, first generate its absolute value, whose half-normal distribution density is
With the given exponential distribution proposal, the density ratio is
Its maximum is at , hence the normal rejection sampling with an exponential envelope constant is
Draw and a fresh uniform ; accept when . An accepted has density . Independently choose a sign, positive or negative with probability , and output with that sign and magnitude . On either half-line its density is , proving the normal output law.
To optimize the rejection rate, differentiate
Its derivative is , negative before one and positive after one; equivalently its second derivative is . Thus
The rejection probability is consequently about .
To use only uniforms, apply inverse transform sampling: for an independent ,
has survival probability for . Use a second independent uniform for acceptance, and, after acceptance, a third independent uniform to choose the sign. Repeat with fresh uniforms after any rejection. No exponential generator is then needed.
An unordered bootstrap sample is determined by the multiplicities of the distinct observations, with . Conversely each such vector specifies exactly one sample up to rearrangement. Place identical marks into boxes using separators. The stars and bars argument therefore gives
These bootstrap count vectors are not equally likely: the probability of a vector is , counting its possible ordered sequences. The ordered index sequences themselves number .
The first simulation uses independent standard Cauchy distributions and returns
The tail probability and estimator moments are
The indicator count has a binomial distribution with parameters ; the infinite variance of a Cauchy observation is irrelevant because this estimator averages bounded indicators.
For the next code block, each row is an independent sample of size from the empirical distribution of the original . Its entry in the vector is the corresponding bootstrap indicator mean . The last expression is the variance of these replicate estimates, with denominator :
Condition on the original data and write a star on bootstrap expectations. Every resampled indicator has a Bernoulli distribution with success probability , and the draws within a row are independent. Thus the conditional bootstrap variance of a sample mean gives
It estimates the sampling variance of the tail-probability estimator, not the variance of the raw Cauchy data. Its square root is an estimated standard error. Finite leaves bootstrap simulation noise. Averaging over the original data, its expectation is , so it is not exactly unbiased for the true variance at finite .
In the importance-sampling block, the transformation gives, for ,
The variable is a proposal draw supported entirely in the integration region. The deterministic value computed from it is the importance sampling weight
Consequently
The code uses ordinary importance sampling of a Cauchy tail, not self-normalization; itself is neither an observation from the target Cauchy law nor the estimator's summand. The weight compensates for sampling from its proposal law.
The final block bootstraps these same proposal observations and recomputes the weight average in each row. Since is a deterministic function of , this is equivalent to resampling the observed weights . If denotes a replicate, the final output is its sample variance over the replicates. Its conditional expectation is
Its expectation over the original proposal sample is .
The variance reduction can be calculated, rather than inferred just from the appearance of the weights. Write . Then
because an antiderivative of the integrand without its prefactor is . Hence
By comparison, . For the true estimator variances are approximately and respectively. The importance estimator has about 1/1,317 of the indicator estimator's variance, because all proposals land in the tail and the weights remain in the narrow interval .
Thus the last bootstrap output should usually be much smaller than the first, and its expected value is smaller by the same variance ratio. This is not a deterministic ordering of two finite-run outputs: if all the original Cauchy draws happen to be at most two, the first bootstrap variance is zero, while unequal importance weights can still give a positive second variance.
The Metropolis–Hastings algorithm proposes and moves from the current state with acceptance probability
On rejection it retains . The target need only be known up to its normalizing constant, but it must define a proper probability distribution. The accepted off-diagonal probability flow is
which is symmetric in and proves detailed balance. This permits considerable flexibility in proposals, including joint moves when a posterior distribution has strongly correlated parameters, but requires proposal tuning and can waste computation on rejections.
A Gibbs sampler instead updates a coordinate or block from its exact full conditional distribution, holding the other coordinates fixed. This is a special Metropolis–Hastings algorithm update with acceptance probability one: the joint density factors into the unchanged marginal density and the proposed conditional density, which cancel in the acceptance ratio. The coordinate update preserves the target; composing such updates therefore preserves it too, although an entire deterministic sweep need not itself be reversible.
Use Gibbs sampling when the conditional laws are easy to simulate and suitably chosen blocks mix well. Scalar updates can mix poorly under strong posterior distribution correlation, whereas a blocked Gibbs sampler can alleviate that dependence. Prefer a flexible Metropolis proposal when conditional draws are difficult or a well-tuned joint proposal is more effective. Variations include random or systematic coordinate scans, random-walk Metropolis algorithms, independence proposals, and using Metropolis updates for difficult blocks inside a Gibbs scheme. Both methods generate dependent draws; usable long-run estimates require an appropriate irreducible, aperiodic chain and assessment of mixing, not merely a formal update rule.
For the change-point calculation, put and
Multiplication of the Gaussian likelihood function by the specified prior distribution gives the formal posterior distribution kernel, with respect to and counting measure on ,
There is an empty component under an improper prior at . The sum is independent of , whose prior distribution is flat on all of . For every fixed finite and , the kernel is a strictly positive constant in , hence
The configuration has positive prior probability . Integrating over, for example, a bounded interval of and already makes the joint normalization infinite. Thus the printed prior distribution does not produce a posterior probability distribution. This failure is present for every data set, not just for a special arrangement of observations.
The formal full conditionals expose exactly where the requested sampler breaks. For , completing the two mean squares gives
The variance kernel is that of when , and the discrete conditional probabilities are proportional to . At the conditional kernel for is constant and cannot be normalized; it is not a normal distribution with an infinite variance. Therefore no valid Gibbs sampler, and no value of , exists for the model as printed. A chain that simply substitutes an arbitrary distribution for this missing conditional would be sampling a different model.
Here is a fully specified proper-prior repair retaining the no-change configuration. Choose fixed hyperparameters
independently, with . Its Gaussian change-point posterior with proper priors is
It is normalizable even for degenerate data: the likelihood function is at most , and its integral against the variance prior distribution is bounded by
The normal mean priors integrate to one, and the normalizing constant is positive. This proves posterior propriety for the repaired model.
Completing the conditional squares gives the Gaussian change-point Gibbs updates. Define
The four updates are
At , , giving its proper prior distribution unchanged. Starting from any finite means, positive variance and allowed , cycle through these four updates using the latest values. The sum-of-squares terms can be evaluated from cumulative data sums; normalize the discrete log weights after subtracting their maximum to avoid numerical underflow. The proper positive conditionals allow movement among all split values and throughout the continuous parameter support.
Under this specified repair, is the posterior probability of no change within the observed sequence: all data points belong to the first mean regime. For retained draws after initialization has ceased to affect the estimates, its Markov chain Monte Carlo estimator is
Alternatively average the displayed conditional probability of at the sampled continuous parameters, giving an estimate by Rao-Blackwellization. Autocorrelation must be accounted for in its Monte Carlo uncertainty. These are probabilities and estimators for the explicitly repaired model; the original unnormalizable kernel supplies neither.
The odds ratio compares event odds, not event probabilities. Let group 1 denote the elective group and group 0 the reference group. Their fitted event probabilities are and . Thus
The risk ratio is similarly about . The unadjusted observations show a lower adverse-event frequency in the elective group, rather than an increase. This is an association, not evidence that choosing the procedure prevents adverse outcomes. The direction is opposite to the reported adjusted odds ratio above one; the two analyses compare different populations or different conditional risks.
Zero observed events do not mean that the underlying event probability cannot be estimated. For independent observations having a common Bernoulli distribution, the binomial likelihood with no events is , maximized at . A zero-event binomial upper confidence bound shows the remaining uncertainty: the one-sided 95% upper bound solves , giving
Thus the point estimate is zero, but a nonzero mortality risk is compatible with the observations. This bound is an illustration under independent equal-risk sampling; clustered data or unequal risks require their own uncertainty calculation.
The empirical unadjusted odds ratio is also defined:
Its log odds ratio is , so the ordinary normal approximation for a log-odds confidence interval is unavailable. Exact likelihood-based limits can still describe uncertainty; a specified continuity correction would instead yield a finite, method-dependent point estimate.
In an unpenalized logistic regression with a separate coefficient for elective exposure, every exposed death outcome is zero. Decreasing that coefficient toward increases the exposed observations' likelihood contributions and leaves the reference observations unchanged. This is quasi-complete separation: there is no finite ordinary maximum-likelihood estimate of the exposure coefficient, even after adding background predictors. It is reasonable to say that the usual finite adjusted coefficient could not be fitted; it is too strong to say that no risk estimate or statistical information is possible. A specified penalized likelihood or Bayesian inference with proper coefficient priors can provide a finite adjusted estimate, whose dependence on the regularization must be reported.
Using the reference event rate as the background-risk benchmark gives
This is the expected count if the elective group had the reference group's baseline risk and the procedure added no effect. It is substantially above the observed count, illustrating the importance of the background-risk comparison.
Similarity of background factors alone does not fix the elective group's event risk if the procedure itself changes it. If one additionally retained the reported common adjusted odds ratio and used as the common baseline risk, then conversion from odds to probability would give
These are different assumptions: about 25 is the baseline/no-effect benchmark; about 64 includes an odds multiplier of 2.7.
Use a concurrent comparison: test the same specimens for both cocaine and mephedrone, rather than treating the historical cocaine percentage as an exactly known 2010 parameter. Assume representative sampling of privates, effectively independent specimens, stable underlying rates during the sampling period, and sufficiently accurate assays. I use a two-sided 5% test of equal positive-test probabilities, with 80% statistical power at and . This is a design to distinguish the rates at a twofold alternative; a significance test does not prove that their ratio is exactly two.
The paired design needs the joint positive-test distribution. For specimen , write and . Put and
Then and . Under equal marginal rates, the two discordant outcomes have equal probabilities; conditional on the total number of discordant specimens, their split is a fair binomial distribution. This gives the McNemar test. Its large-sample version rejects for a sufficiently large absolute difference between the discordant counts, divided by their estimated standard deviation.
For planning, suppose simultaneous positives are negligible, so . Under the alternative the difference in positive counts has mean and standard deviation ; the approximate upper null rejection boundary is . Requiring 80% upper-tail rejection probability gives the paired binary sample size calculation
Add the mephedrone assay to about 5,000 existing tests, roughly ten weeks at 500 per week. An exact conditional-power calculation under the negligible-overlap model gives about at 4,707 specimens and at 5,000, so the rounding also compensates for the conservative discrete test. If positivity for the two drugs were independent within a specimen, , giving a very similar requirement of about 4,676. For the stated marginal rates, , so negligible overlap is a conservative variance choice within this approximation. Substantial co-use reduces the discordant proportion and changes the necessary size. Repeated tests on the same person, unit-level clustered data or inaccurate assays can instead reduce effective information and require more specimens.
A pre-specified one-sided 5% comparison would use in place of and require about 3,708 specimens before allowing for discreteness under the negligible-overlap assumption. These are different testing conventions. Treating the historical 1% as fixed would give a one-sample calculation, but would ignore uncertainty or changes in the actual 2010 cocaine rate.
Set and absorb the common multiplier into . The model becomes
It is a Cox proportional-hazards model; the unknown baseline does not need a parametric form. The equality hypothesis is precisely . The absolute multipliers and have a scale ambiguity, but their hazard ratio is identifiable when both groups supply information.
For an untied event at , let be the risk set just before the event, and let be the subject who fails. The conditional event probability is proportional to that subject's hazard, so the common baseline cancels:
Multiply these factors to form the Cox partial likelihood. One can maximize it and compare its maximum with its value at using a partial likelihood-ratio test, or use the corresponding score test.
Explicitly, with group risk-set sizes and observed event indicator for group 1, the score at zero and its information are
Under the null the event label has exactly this Bernoulli distribution conditional on its current risk set. Hence is the usual one-degree-of-freedom log-rank test statistic, with an asymptotic chi-squared distribution when and enough informative events are observed. Censoring can differ between groups, provided it is independent of event time within the conditioning model. If there are recorded ties, use the appropriate tied-risk-set version: for events the null variance contribution is .
Average the covariate over its possible event subjects using the conditional probabilities from part (a). Define the risk-weighted sums
with . Then
This is the mean covariate of the next event subject, conditional on the current risk set and an event. It is generally not the unweighted average over the original sample. For it reduces to the unweighted current risk-set mean.
Label an orthonormal basis of the -dimensional Hilbert space by , with indices modulo . Let
These are the shift and phase Heisenberg-Weyl operators. Alice holds the input and one half of the shared maximally entangled state
She measures in the generalized Bell basis
Its inner products are
There are orthonormal vectors in an -dimensional space, so this is a complete projective measurement.
For an unknown normalized state , its contraction with measurement outcome gives Bob's unnormalized state
Each outcome has probability , independently of the input. Alice communicates the two -valued labels, and Bob applies the ordered inverse
The order matters because shift and phase operators do not generally commute. Normalizing the branch recovers the unknown state exactly, and all outcomes are corrected, so success is deterministic. The quantum resource is one maximally entangled pair of local dimension . The classical resource is an -valued message, with information content bits; ordinary bits suffice in fixed-length binary encoding.
This is faithful qudit teleportation even for an input entangled with a reference . Expand a joint pure state as , without requiring the reference vectors to be orthogonal. The same contraction and correction act on each system basis vector, producing . Thus the whole joint state, not just a reduced state, is preserved. Linearity extends the conclusion to mixed inputs. This is teleportation as an identity channel on a reference.
The event that is hit but is not has probability . Dividing by the probability that is covered, using the definition of conditional probability, gives
This conditioning concerns angular coverage of a sector; the two house-hit events are not independent.
The independent uniform distributions give a constant joint probability density on the unit square. For , integrate over :
For the random quadratic with uniform coefficients, real roots require its discriminant to be nonnegative, equivalently . The boundary has probability zero, and the area under this parabola is
On that event the roots are , both nonpositive. Bounding both absolute values by one therefore amounts to bounding the more negative root:
Since , squaring the inequality is legitimate and gives . The admissible unit-square region is . Its probability is
Dividing by the real-root probability gives the requested conditional probability:
The cumulative distribution function is . For the differentiable distribution in the question, its probability density function is , so probabilities over intervals are obtained by integrating . The survival probability is . Differentiating immediately gives
The strict inequality is consistent with the definition using . This relation connects the probability density function with the decline of the survival probability.
For , substitute in the probability generating function. The moment-generating function of is
The domain follows from convergence of the generating series; at or above that positive threshold the expectation diverges, even though a rational continuation can be written.
Conditioning on survival, the probability mass function from part (ii) becomes a positive-integer geometric distribution:
Its conditional moment-generating function is , tending to for fixed . We can prove the required limit directly, without invoking a continuity theorem. Set . For every , the strict upper tail is exactly
Since and ,
At both tails equal one. This is the exponential limit of surviving geometric branching. Conditioning is essential: the unconditional variable has probability of being zero, whereas the rare surviving population has size of order .
The geometric family law on the nonnegative integers has probability generating function
Its expected value is , so this is a geometric-offspring critical branching process. Starting from , verify the rational iterate by induction. If , then
which has the same form with replaced by . Thus, for ,
The stated disk is the actual power-series convergence domain, not merely a place where the rational continuation can be evaluated. Its simple pole is at .
The extinction probability at generation is the constant coefficient:
For later use, expanding the remaining geometric series gives
In particular . At the initial population is one deterministically; its PGF is , and the displayed radius involving is used only for .
For independent random variables, and . Factor their probabilities to obtain the distribution functions of independent minima and maxima:
These formulas also allow atoms; no probability density function assumption is needed.
For independent unit-rate exponential distributions, for , so . To establish the independent minimum and gap of two exponential variables, set . On either ordering branch, the change of variables is or with unit absolute Jacobian determinant. Both contribute ; ties have probability zero. Thus the joint probability density is
It factors into normalized exponential probability density functions, proving , and their independence.
The maximum is . A half-scaled unit-rate exponential has rate two, so the independent pair has the same joint law as . Consequently
Using the expected values, variances and independence of the summands,
The spacing factorization explains why an order statistic can be represented as a sum of independent waiting times.
For events with , the conditional probability is . Applying the definition in both orders gives Bayes' theorem:
Conditionally on , independent fair tosses give a binomial distribution for the head count, so . The joint probability mass function is consequently
Use the law of total probability and the differentiated geometric series, , to obtain . The posterior coin count after exactly one head is therefore
These probabilities sum to one by the same series identity. The conditioning weights possible coin counts by their likelihood of producing exactly one head.
For a nonnegative integer-valued random variable, the probability generating function is
with always allowed. Its derivative at from below gives the expectation when finite.
The waiting time has the positive-integer geometric distribution . For the capped geometric waiting time, exactly when , while occurs whenever . Thus the terminal mass is , giving
The finite sum is a polynomial; any apparent singularity of the rational expression is removable. This includes , where .
Differentiating the rational form at yields
As a second interpretation, the expectation is the sum of the tail probabilities for . Their finite geometric sum gives the same answer.
Let be the increasing events that an infinite simple open ray in a graph starts at the indicated side and immediately leaves the box, with all later graph vertices outside it. A corner exit is assigned according to the direction of its outgoing edge. The four events have the same probability by rotational symmetry. Their union is from the preceding step.
The Harris-FKG inequality applies to these exterior-ray events by approximation with finite connections to larger boxes and passage to decreasing limits. Positive association of the four decreasing events , by iterating the Harris-FKG inequality, gives
Equivalently, one may apply the preceding square-root bound for increasing events first to the two opposite-side unions and then to the two individual sides of one pair. Therefore
A union bound now shows
Choose such that . Then
The infinite exterior clusters touched by these two sides need not be the same. The same argument works for dual boxes and any sufficiently large size; this permits the matching primal/dual contours used in the full proof.