A metric space is a complete metric space if every Cauchy sequence in converges to a point of . Explicitly, the hypothesis is
and the conclusion is that some satisfies .
It is a connected space if there are no disjoint nonempty open subsets of with . Here openness refers to the metric topology of .
It is a path-connected space if, for every , there is a continuous map with and . Such a map is a path. Every path-connected space is a connected space: a separation would pull back along a path joining its two sides to a separation of the interval .
Let . Between the two middle order statistics, and the slope is zero. To the left decreases and to the right it increases. Consequently all joint maximum-likelihood estimates are
where the constant minimum is
The strict positivity follows from distinct observations. Thus the location maximum-likelihood estimate is not unique, while the rate maximum-likelihood estimate is unique and the same for every location in the displayed interval. Choosing the arithmetic midpoint of the two middle values is the usual sample median convention and gives one member of this entire maximizing family.
For each fixed , maximizing the likelihood function over is equivalent to minimizing . Order the distinct observations as and write . Between successive order statistics, with exactly observations to the left,
Thus decreases up to and increases after it. Its unique minimum is at the sample median:
At a fixed with , the log-likelihood function has derivative and second derivative , so its unique maximizing rate is . The maximized likelihood function is , which increases when decreases. Hence the joint maximum-likelihood estimates are
This is Laplace location and scale maximum likelihood, expressed with the reciprocal scale.
A finite rate maximum-likelihood estimate requires a positive total absolute deviation. For distinct observations and odd , that condition holds. For , however, gives and as . There is no finite joint maximum-likelihood estimate in the stated parameter space; the formula with zero denominator is not an admissible estimate.
The joint maximum-likelihood estimators are functions of the observations selecting a maximizing parameter pair:
The estimates after observation maximize the same likelihood function with . Maximization may be nonunique, as for an even sample size, or may fail to yield a finite admissible pair, as in the one-observation case below. The definition does not turn a boundary supremum into an attained maximum.
By independence, the likelihood function is the product of the individual probability density functions:
Writing , the log-likelihood function is . Here is a rate, the reciprocal of the scale in the usual Laplace distribution notation.
For this rate parametrization of the Laplace distribution, is its mean and median. By symmetry, , while has exponential distribution with rate , so
The integral follows by two applications of integration by parts. The central limit theorem therefore gives
With known and the supplied cutoff 2, an approximate 95% confidence interval is
This known-rate Laplace location confidence interval uses the sample mean; the later maximum-likelihood estimator of location need not be used to construct this valid asymptotic confidence interval.
At sample size 100, keep essentially the same numerical confidence interval, but treat its calibration as approximate. For independent heights with finite, nonzero variance, the central limit theorem makes the sample mean approximately normally distributed, and the sample variance consistently estimates the population variance. Hence the studentized sample mean is approximately standard normal even without a normal distribution for individual heights.
Using the permitted cutoff 2 gives
A Student t-distribution cutoff gives a similar approximation for large sample size, but its justification at fixed sample size is no longer exact. Extreme skewness or influential outliers could make 100 observations insufficient for accurate coverage probability; abandoning normality alone supplies no specific numerical correction. The sampling with replacement assumption still precludes a finite population correction.
The independent uniform choices from the student list describe sampling with replacement. Under the stated independent normal distribution model for the heights, the population variance is unknown and the given cm is the sample standard deviation . The exact pivotal quantity is
Thus the exact 95% Student t confidence interval is
using . The supplied approximation instead gives a normal approximation for large sample size
This latter confidence interval is approximate even under normality because it substitutes the sample standard deviation for the unknown population value. There is no finite population correction under the specified independent selections. Interpreting the finite student list literally as a discrete population makes normality an idealized model; it does not justify changing the stated sampling design.
It is single-linkage clustering. Its intercluster distance is the smallest cross-pair Euclidean distance. Successive nearby points can join around the ring and within the dense central cloud before any edge crosses the gap between them. Equivalently, at a threshold below the between-group gap but above the lengths needed to connect each group, the single-linkage clustering components are precisely the central group and the ring.
Complete-linkage clustering uses the largest cross-pair Euclidean distance. Opposite points on the ring are far apart, so an intact ring has a large diameter. That rule favors compact pieces and can attach a ring segment to the center before all ring segments join. The visible gap and short links within each group explain why single-linkage clustering recovers the two intended clusters in cluster analysis in this example; it is not a universal guarantee for arbitrary noisy rings.
With two distinct centroids, K-means clustering assigns points on opposite sides of their nearest-centroid decision hyperplane, which in two dimensions is a straight line. This constraint explains the typical outcomes in the three source plots; exact assignments depend on initialization and the realized points.
Dataset A: one cluster in cluster analysis contains most of the horizontal cloud and the bottom of the vertical cloud; the other contains the upper part of the vertical cloud. The two visually elongated groups are poorly matched to squared Euclidean distance from their centroids. Points at the lower end of the vertical group can be closer to the horizontal group's centroid, so the two original shapes need not be recovered intact.
Dataset B: a roughly straight cut divides the ring and generally the central cloud between the two clusters in cluster analysis. A Voronoi cell for either centroid is a half-plane; it cannot select a surrounding ring while excluding its center. The cut's direction can vary because the geometry is approximately rotationally symmetric.
Dataset C: the two dense lower clouds typically receive different centroids. The much smaller upper cloud is absorbed into one or divided between both clusters in cluster analysis, according to the nearly vertical separating line. With , the objective usually benefits more from separating the two large clouds than from spending one centroid on the sparse third group. These are typical qualitative outcomes, rather than guarantees about every initialization.
Complete-linkage clustering defines the dissimilarity between clusters in cluster analysis as . Remove point 6 and first merge 1 with 4 at height . The distances from to 2, 3, 5 are respectively
The next merge therefore attaches 2 at . Now the distances from to 3 and 5 are and , whereas . Merge 3 and 5 at . The final distance between the two remaining clusters in cluster analysis is the largest cross-entry, . Thus the dendrogram has merges
Figure 1.
Complete-linkage dendrogram after removing observation 6
. Details.
Cutting strictly between heights and gives the two clusters in cluster analysis
The figure is an original drawing of these computed merges.
Every Euclidean distance obeys the triangle inequality. The three recorded entries , and violate it:
At least one of must be incorrect. Two are in the final row as required. The gap is far larger than any possible rounding of entries to two decimal places.
Compute fitted responses and regression residuals . A conventional residual plot shows against or ; plotting against observation order additionally looks for runs. One checks for curvature, changing spread and other structure rather than random scatter around zero.
An ordinary residual plot need not reveal this failure of independence. The errors have constant mean zero, constant variance one and zero pairwise covariances, so the usual trend and changing-variance clues need not appear. A visually patternless residual plot cannot validate independence; fitted regression residuals themselves also share the fitted coefficients even when the true errors are independent.
There is detectable dependence in the magnitudes. The Gaussian fourth moment is , giving for every adjacent pair
For , the product is ; for , it is , with the same expected value 3. Large magnitudes tend to occur together. A lagged plot of squared regression residuals or a test directed at dependence in their squares is more informative. Thus recognition is possible with suitable diagnostics, but is not guaranteed by the standard residual plot requested here.
The least-squares estimators depend only on the observed responses and design, so the formulas in i still hold. Their variances and covariance need only the error covariance matrix, now . Therefore
For example the first formula follows from , and the second from . The formulas remain the same as before with ; this calculation does not establish independence or a normal distribution for the estimators.
Independence of the centered standard normal random variables gives for every . Also
For nonadjacent indices, the underlying sets of variables are disjoint, so the errors are independent and have zero covariance. For adjacent indices with ,
The first adjacent pair separately gives . Hence
These adjacent products of independent Gaussian variables are uncorrelated random variables even though adjacent errors share a factor and are dependent.
For the random vector , its covariance matrix is
Its diagonal entries are variances, and its off-diagonal entries measure pairwise covariance. Finite second moments make every entry well defined.
They need not be independent. For a counterexample take , , , and independent errors taking with equal probability. Then
Each centered estimator is zero with probability , but they are never both zero. Their zero events therefore violate independence.
A sufficient additional assumption is that the errors have a common normal distribution. The two estimators are then Jointly Gaussian, being linear combinations of the independent Gaussian random variables. Their zero covariance, established in iii, implies independence of uncorrelated jointly normal variables. Normal errors are a sufficient condition here, not a claim that no other error probability distribution could ever work.

Pinned article: Introduction to the OurBigBook Project

Welcome to the OurBigBook Project! Our goal is to create the perfect publishing platform for STEM subjects, and get university-level students to write the best free STEM tutorials ever.
Everyone is welcome to create an account and play with the site: ourbigbook.com/go/register. We belive that students themselves can write amazing tutorials, but teachers are welcome too. You can write about anything you want, it doesn't have to be STEM or even educational. Silly test content is very welcome and you won't be penalized in any way. Just keep it legal!
We have two killer features:
  1. topics: topics group articles by different users with the same title, e.g. here is the topic for the "Fundamental Theorem of Calculus" ourbigbook.com/go/topic/fundamental-theorem-of-calculus
    Articles of different users are sorted by upvote within each article page. This feature is a bit like:
    • a Wikipedia where each user can have their own version of each article
    • a Q&A website like Stack Overflow, where multiple people can give their views on a given topic, and the best ones are sorted by upvote. Except you don't need to wait for someone to ask first, and any topic goes, no matter how narrow or broad
    This feature makes it possible for readers to find better explanations of any topic created by other writers. And it allows writers to create an explanation in a place that readers might actually find it.
    Figure 1.
    Screenshot of the "Derivative" topic page
    . View it live at: ourbigbook.com/go/topic/derivative
  2. local editing: you can store all your personal knowledge base content locally in a plaintext markup format that can be edited locally and published either:
    This way you can be sure that even if OurBigBook.com were to go down one day (which we have no plans to do as it is quite cheap to host!), your content will still be perfectly readable as a static site.
    Figure 5. . You can also edit articles on the Web editor without installing anything locally.
    Video 3.
    Edit locally and publish demo
    . Source. This shows editing OurBigBook Markup and publishing it using the Visual Studio Code extension.
  3. https://raw.githubusercontent.com/ourbigbook/ourbigbook-media/master/feature/x/hilbert-space-arrow.png
  4. Infinitely deep tables of contents:
    Figure 6.
    Dynamic article tree with infinitely deep table of contents
    .
    Descendant pages can also show up as toplevel e.g.: ourbigbook.com/cirosantilli/chordate-subclade
All our software is open source and hosted at: github.com/ourbigbook/ourbigbook
Further documentation can be found at: docs.ourbigbook.com
Feel free to reach our to us for any help or suggestions: docs.ourbigbook.com/#contact