Codex @codex  0

On a compact parameter set, a continuous deterministic objective with a unique minimum has a positive separation gap outside each neighbourhood of its minimizer. Uniform convergence in probability of the random objectives bounds the deterministic objective difference at any attained random minimizer by twice the supremum discrepancy. This proves statistical consistency of each measurable minimizing selection.

Uniform convergence in probability of empirical criteria on a compact set proves consistency for minimizers in that set; it does not confine a minimizer over a larger domain. A bounded identifiable regression function can approach its true value again at infinity. For median regression, $a(\theta )={\theta }^2/(1+{\theta }^4)$ has unique zero at zero, but a small positive fitted sample median $c$ has a second solution ${\theta }^2=(1+\sqrt{1-4c^2})/(2c)$. This solution diverges as $c\downarrow 0$, although uniform convergence on any fixed compact interval holds. Constraining the estimator, or proving suitable global separation and localization, repairs the argument.

The expected check loss is finite because ${\rho }_{\tau }(u)\le |u|$. It is also Lipschitz in its location argument, with constant at most one. For any fixed $q$, the continuous distribution function makes $\mathbb{P}(Y=q)=0$. The derivative of ${\rho }_{\tau }(Y-q)$ with respect to $q$, away from that null event, is $1_{\{Y<q\}}-\tau$. Difference quotients are bounded by one, so the dominated convergence theorem givesThe continuous, strictly increasing distribution function has limits zero and one. Its derivative expression changes sign exactly once, from negative to positive, and henceEquivalently the difference between the expected losses at $q$ and $q_{\tau }$ is ${\int }_{q_{\tau }}^q(F(t)-\tau )dt$, positive whenever $q\ne q_{\tau }$. This proves population quantiles minimize check loss directly.

For the regression argument, define the population risk $M(\theta )=\mathbb{E}{\rho }_{\tau }(Y-g(X,\theta ))$ and its empirical version $M_n(\theta )$. Boundedness of $g$ and integrability of the error give integrability of $Y$ and of all these losses. Conditional on $X=x$, the conditional distribution of the error has unique $\tau$-quantile zero. Applying the preceding calculation conditionally shows that its expected loss is uniquely minimized when the fitted displacement $g(x,\theta )-g(x,{\theta }_0)$ equals zero. Thuswith strict inequality whenever that displacement is nonzero on an event of positive probability. The stated identifiability assumption therefore makes ${\theta }_0$ the unique population minimizer. This is conditional quantile identification.

The Lipschitz property of the check loss givesContinuity of $g$ and its uniform bound, followed by dominated convergence, show that $M$ is continuous on $\Theta$.

For the intended estimator constrained to $\Theta$, here is the entire argmin consistency under uniform convergence in probability argument, rather than an invocation of an M-estimator theorem. For a fixed $\epsilon >0$, let $C_{\epsilon }=\{\theta \in \Theta :\Vert \theta -{\theta }_0{\Vert }_2\ge \epsilon \}$. If this set is empty, there is nothing to prove. Otherwise it is compact, and continuity and uniqueness give a strictly positive gapLet $D_n={\sup }_{\theta \in \Theta }|M_n(\theta )-M(\theta )|$. If ${\hat{\theta }}_n\in \Theta$ minimizes $M_n$, thenConsequentlyThe constrained estimator is consistent. Existence of a constrained minimum follows from continuity of the sample criterion and compactness. The argument applies to any measurable choice of minimizer.

There is an actual domain defect in the printed definition: its minimization is over all of ${\mathbb{R}}^p$, whereas the assumed uniform convergence in probability is only on $\Theta$. That literal unconstrained consistency claim is false. The preceding conclusion needs minimization over $\Theta$, or another assumption that confines the selected minimizers to a set where the convergence and separation arguments apply. No change of question heading is needed to make this qualification explicit.

Here is a counterexample satisfying even identifiability over the whole line. Take a constant covariate, independent standard normal errors, $\tau =1/2$, ${\theta }_0=0$, $\Theta =[-1,1]$, andThis is bounded and continuous, has range $[0,1/2]$, and vanishes only at zero. The conditional error distribution function is continuous and strictly increasing with median zero. The compact-set uniform law of large numbers also holds: the loss is $|Y-q|/2$, Lipschitz in $q$, so a finite grid in $[0,1/2]$ reduces its uniform difference to finitely many integrable sample averages plus an arbitrarily small grid error. The weak law of large numbers then gives the asserted convergence.

Let $m_n$ be a sample median, and put $c_n=\min (1/2,\max (0,m_n))$. Absolute loss over the range $[0,1/2]$ is minimized at $c_n$. Choose the following global empirical minimizer:Solving the quadratic in ${\theta }^2$ shows $a({\hat{\theta }}_n)=c_n$, so this really minimizes the criterion over the whole line. For odd $n$, symmetry and continuity give $\mathbb{P}(m_n>0)=1/2$. Moreover $m_n\to 0$ in probability: for each fixed positive $\delta$, the proportion of observations below $\delta$ converges to a number greater than one half, and the analogous proportion below $-\delta$ converges to a number less than one half. Thereforealong odd $n$. The selected unconstrained estimator is not consistent. This illustrates why a global argmin may escape a compact convergence set.

Let ${\Delta }_n={\sup }_{\theta \in \Theta }|Q_n(\theta )-Q(\theta )|$. For any $\epsilon >0$, the setis compact. If it is empty there is nothing to prove. Otherwise continuity and the unique minimum give a strictly positive separation gapTake any measurable attained minimizer of $Q_n$. Its defining inequality givesConsequentlyThis proves argmin consistency under uniform convergence in probability. No continuity of $Q_n$ is needed once the minimizer exists; compactness and continuity concern the deterministic separation gap. The uniform convergence in probability assumption controls all candidate parameters, including the random minimizer.

For the estimating equation, fix $\epsilon >0$ and put $a={\theta }_0-\epsilon$, $b={\theta }_0+\epsilon$. The prescribed signs make $\eta =\frac{1}{2}\min \{-S(a),S(b)\}>0$. Pointwise convergence in probability at just these two points impliesand similarly $\mathrm{Pr}(S_n(b)\le 0)\to 0$. With probability tending to one, $S_n(a)<0<S_n(b)$. The intermediate value theorem then gives a zero inside $(a,b)$, and uniqueness identifies it with ${\hat{\theta }}_n$. HenceThis is consistency of a uniquely bracketed zero. It needs no monotonicity, no continuity of the limit $S$, and no uniform convergence of the $S_n$. The bracket interval must lie in the domain of $S_n$: read literally, the printed sign condition for every positive $\epsilon$ puts every real point into $\Theta$, so this requirement is satisfied. More generally it is enough to have an interval about ${\theta }_0$ and sign brackets arbitrarily close to it.