Taking logarithms of the product givesBy part (d)(i), in probability distribution, where has the exponential distribution of rate one. Thus and . The strong law of large numbers givesIf , choose . Eventually , so . If , choose ; eventually . ThereforeIn particular, the second range cannot have almost sure convergence to zero. This is the almost-sure growth rate of independent products. At the logarithmic limit is zero, which by itself decides neither behavior; that boundary case is not requested.
The inverse transformation of a random variable is , with absolute derivative . The condition becomes . The change of variables for probability densities givesEquivalently, has the exponential distribution of rate one. Applying a separate measurable transformation of a random variable to each independent preserves independence of random variables, so the are independent and identically distributed.
For , integration gives for . For , the candidate remainder moment-generating function isThis is the moment-generating function of the mixture distributionConstruct it by taking an exponential random variable of rate and a Bernoulli random variable with , with mutually independent, and setting . Then is independent of , andon a neighborhood of zero. By the uniqueness theorem for moment-generating functions, , so the exponential distribution is a self-decomposable distribution.
A Poisson process of rate starts from zero, has independent stationary increments, has unit jumps, and satisfies for . Its inter-arrival times are independent with the exponential distribution of rate : any finite joint density is on positive coordinates.
The second arrival is a sum of two such variables. Convolution givesThis is a gamma distribution of shape two and rate . If is the first arrival of the independent rate- process, exponential independence gives
For , . Differentiation givesThis is an exponential distribution of rate , with mean two and variance four.
For an exponential distribution with rate , direct integration gives the moment-generating functionIt is finite in a neighborhood of zero, so its derivatives there give moments. Differentiating three times gives , hence
Recognize the mixture distributionIt is a half-and-half mixture of exponential distributions with rates one and two. Uniqueness of a moment-generating function finite near zero identifies the law. Therefore
The independent identically distributed central limit theorem states that for independent identically distributed random variables with finite mean and positive finite variance ,For , continuity, strict monotonicity and the endpoint limits of the cumulative distribution function give a unique . Then . Thus has the uniform distribution on , by the probability integral transform.
For , when , and it is zero otherwise. Therefore its probability density function is : the exponential distribution of rate one. By integration by parts, and , so .
The variables are independent because they are separate measurable functions of independent random variables. The probability integral transform makes all of them identically distributed as , even though the need not be identically distributed. The displayed is exactly . The central limit theorem therefore gives
For , the geometric survival probability givesFor , the distribution functions are zero, as is the limiting exponential distribution function. Since that limiting distribution function is continuous everywhere, these limits proveThe parameter is rate one, so the limiting mean is one, consistent with .
Integrating the conditional distribution against the exponential distribution probability density function gives, for integer ,Here the gamma function identity evaluates the integral. Henceon . Put and . The geometric series gives . Its generalized inverse, the quantile function, isThis is the smallest nonnegative integer for which ; dividing by reverses the inequality. Draw from the uniform distribution on and use this formula. The commonly used expression has the same probability distribution, but differs from the exact generalized inverse when is precisely a jump value of the cumulative distribution function. Such values have probability zero for an ideal continuous uniform draw.
For the exponential distribution with rate , the cumulative distribution function is for , and zero for . Its quantile function isFor inverse transform sampling, draw from the uniform distribution on and return . Equivalently return , since has the same uniform distribution. Indeed, for , .
Assume and a current state with , . The unnormalized posterior density isThus the log-posterior, up to an additive constant, is the log-likelihood plus the beta distribution and exponential distribution log prior densities. The exponential distribution rate is , since is its mean. [ref]
https://stat.ethz.ch/R-manual/R-devel/library/stats/html/Beta.html. Official R documentation: dbeta arguments and logarithmic density output
[ref]https://stat.ethz.ch/R-manual/R-devel/library/stats/html/Exponential.html. Official R documentation: dexp rate parameter and mean equal to inverse rate
Choose a symmetric joint random-walk Metropolis algorithm proposal: and , for independent standard normal distribution draws. Its scale depends only on fixed hyperparameters, so forward and reverse proposal probability density functions agree. Reject immediately outside ; otherwise accept with Metropolis–Hastings acceptance probabilityThe following function makes exactly one proposal, with rejection retaining both old parameters:
MHstep <- function(x, p, beta, a, b, mu) {
p_new <- rnorm(1, mean = p, sd = 0.1)
beta_new <- rnorm(1, mean = beta, sd = mu / 2)
if (p_new <= 0 || p_new >= 1 || beta_new <= 0)
return(list(p = p, theta = beta))
logpost <- function(pp, bb) {
ll_f(pp, bb, x) + dbeta(pp, a, b, log = TRUE) +
dexp(bb, rate = 1 / mu, log = TRUE)
}
logA <- logpost(p_new, beta_new) - logpost(p, beta)
if (log(runif(1)) <= min(0, logA)) {
p <- p_new
beta <- beta_new
}
list(p = p, theta = beta)
}The returned field
theta contains the updated value of beta. The original PDF really asks for p and theta, although no parameter is defined in this question. This choice preserves its literal interface while making the intended second parameter explicit. A caller therefore advances with state <- MHstep(x, p, beta, a, b, mu), p <- state$p, and beta <- state$theta.The proposal is an unrestricted symmetric normal distribution followed by rejection outside the support. Repeatedly drawing until a valid proposal appears would instead truncate and renormalize the proposal, requiring a proposal-density correction. The code uses immediate rejection and needs no such correction. The displayed scales are valid fixed choices; practical efficiency can be improved using a separate tuning phase.
The proposal's normalization of a probability distribution isThis is the Laplace distribution with location zero and scale one. For example, generate its magnitude from the exponential distribution with rate one and give it an independent fair sign. The target is the standard normal distribution, with .
To obtain the tight envelope, let . By completing the square,Equality occurs at , so is the smallest valid envelope constant. It maximizes the acceptance probability for this fixed proposal. The supplied lower bound must be clipped at zero to satisfy the algorithm's nonnegativity requirement:This is valid because for , while is everywhere positive. Its support is .
Here is the fully specified squeeze rejection sampling procedure. Draw with probability density function , independently draw , and compute and . If , return immediately. Otherwise evaluate , independently draw , and return if . On rejection restart with fresh draws. In this example everywhere, so the residual denominator is positive.
Avoiding a target evaluation means accepting at the first test. Its unconditional probability for one proposal isFor comparison, the overall acceptance probability is . The first-stage saving is the fraction of proposals requiring no target evaluation, including both eventual accepted and rejected proposals in the denominator; it is not conditional on acceptance.
Here the exponential distribution is parametrized by its mean, so for and . Its log-likelihood and maximum-likelihood estimate areFor one observation, . Since , its Fisher information is . Consequently the estimated standard error is , givingThis is a large-sample confidence interval, not an exact one. If its lower endpoint is negative, intersecting with the parameter space removes impossible values without excluding any possible true statistical parameter.
No. A permitted counterexample is with all observed counts zero. Then and the posterior distribution is an exponential distribution with rate , whose density decreases strictly from the left boundary. Its equal-tailed credible interval isHere . This excludes values just above zero whose posterior density is larger than that of retained values near , violating the highest-density criterion. The actual highest posterior density interval starts at the support boundary and solves :Writing zero as the endpoint causes no problem because a single point has zero posterior probability. Thus even within the gamma family the two intervals need not agree. More generally, for an interior unimodal gamma distribution, highest-density endpoints have equal densities, whereas equal-tailed endpoints need not.
Write , and . For nondegenerate data from the shifted exponential distribution, the likelihood function isFor fixed feasible , differentiating its log-likelihood with respect to givesThe derivative changes from positive to negative there. Substituting gives the profile likelihood , which increases with . Therefore the unrestricted maximum-likelihood estimates arewhile under the null hypothesis the estimate is . Their likelihood ratio isSince the likelihood-ratio test rejects for small , the requested form is obtained withThe formulas assume , which holds almost surely for a continuous sample with ; coincident observations give an unbounded unrestricted likelihood and can be treated by its supremum.
An exact calibration is available and also explains why Wilks theorem should not be applied here. Under the null, the memoryless property makes and independent gamma distributions with common scale and shapes and . By beta sampling by gamma ratios,Consequently, for ,This yields an exact test size , independent of the unknown scale. The support endpoint and boundary null make this a likelihood-ratio test for an exponential support endpoint, with a different calibration from a regular one-parameter test.
Let . For the exponential distribution with mean , the likelihood function is on positive observations. Fix any . The alternative-to-null likelihood ratio isSince , this is strictly decreasing in . The Neyman-Pearson lemma says to reject for small . Under the null hypothesis, the given sum rule yields , where the second argument is a rate, and henceLet be the lower quantile of this chi-squared distribution. The required critical region isIts test size is exactly because the null distribution is continuous. Its cutoff is the same for every , so it is simultaneously most powerful against every such value: it is a uniformly most powerful test. Equivalently, reject if is below the lower quantile of the specified gamma distribution.
Write , with the natural logarithm. The likelihood function and log-likelihood function areThe score function is and the second derivative is . Thus the log-likelihood function is strictly concave, its stationary point is the unique global maximum, and the maximum-likelihood estimator isThe one-observation Fisher information is . The support of a probability distribution here is independent of , so the regular asymptotic normality of a maximum likelihood estimator givesThere is also a direct check: has an exponential distribution with rate , since for . Its mean and variance are and . Apply the central limit theorem to and the delta method to to obtain the same result.
