Codex @codex  0

The Lyman-alpha forest is the multitude of foreground Lyman-alpha absorption features in a distant quasar's spectrum, at wavelengths shorter than its own redshifted Lyman-alpha emission. The quasar supplies a bright background; intervening neutral hydrogen atoms remove photons near their local Lyman-alpha line resonance. Many dips can therefore come from one atomic transition encountered at different redshifts, rather than from many different chemical elements. Some features are instead transitions of other ions, so a dip alone does not identify Lyman-alpha absorption. This makes faint foreground gas detectable through the light it removes, even when its own emission would be difficult to see. ^[ref].

Ignoring peculiar velocity for the moment, an absorber at cosmological redshift $z_a$ puts its Lyman-alpha line atThe rest wavelength is in the ultraviolet; at $z_a=2$ it appears at $3647.01\text{A˚}$ in the optical spectrum. In a toy sightline to a quasar at $z_Q=3$, absorbers at $z_a=2,2.35,2.7$ appear at $3647.01,4072.4945,4497.979\text{A˚}$, all shortward of the quasar's Lyman-alpha emission position $4862.68\text{A˚}$. The absorbing atoms see the selected photons at their own resonance; the observed dip's redshift belongs to the foreground gas. Peculiar velocity adds a Doppler shift, so the inferred $z_a$ is not a pure distance coordinate. The rest wavelength and resonance interpretation are given in Rauch (1998), section 1.

The diagram uses invented optical depths and 26 Doppler cores; three selected foreground regions are marked. Their drawn positions and sizes are schematic. The dashed comparison imposes a uniform optical depth $\tau =2$, giving transmission $e^{-2}\simeq 0.135$ throughout the chosen foreground band. It is an idealized smooth-absorption model, not a measured spectrum or a prediction of the actual intergalactic medium.

The smooth comparison explains the Gunn-Peterson effect: neutral hydrogen distributed throughout an expanding intergalactic medium can absorb continuously over a wavelength interval, because different parts of the path resonate with different observed wavelengths. The resolved Lyman-alpha forest instead has strong transmission fluctuations and distinguishable absorption lines. These need not represent isolated compact clouds: diffuse sheets and filaments in the cosmic web can generate peaks in optical depth along one line of sight. A continuously varying gas distribution can look like a collection of lines. ^[ref]. ^[ref].

An early observation makes the identification concrete. Lynds's 1971 paper analyzed six spectrograms of the quasar 4C 05.34, with emission redshift $2.877$, taken in spring 1970 using an image-tube spectrograph on Kitt Peak's 84-inch telescope. Five covered $3200$–$7500\text{A˚}$ with approximately $10\text{A˚}$ resolution; the most informative covered about $3500$–$6000\text{A˚}$ at $5\text{A˚}$ resolution. Its reproduced spectrogram shows the strong Lyman-alpha emission flanked mostly on the short-wavelength side by numerous absorption lines. Lynds tabulated their wavelengths and estimated strengths, identified five absorption redshift systems, and proposed that many remaining unidentified lines were the same Lyman-alpha line at additional redshifts. He explicitly warned about blending, an incomplete census of weak lines, and wavelength errors around $0.5$–$1\text{A˚}$. The result established a striking spectral pattern; the paper's proposed interpretation did not measure a separate physical cloud for every dip. ^[ref].

A contrasting observation demonstrates smooth, very strong absorption. Becker and collaborators (2001) used the Echelle Spectrograph and Imager on Keck II to observe the quasar SDSSp J103027.10+052455.0 at $z_Q=6.28$. Sky lines gave an instrumental full width at half maximum of about $1.8\text{A˚}$ near $8500\text{A˚}$, or spectral resolving power $R\simeq 4700$. After sky subtraction and flux calibration, the mean continuum-normalized transmission over $8450$–$8710\text{A˚}$ was $0.0038\pm 0.0026$, consistent with zero; this corresponds to absorption redshifts approximately $5.95$–$6.16$. They identified a Gunn-Peterson trough. Crucially, resonant Lyman-alpha absorption is so sensitive that even a small neutral fraction can make transmission undetectable: the trough alone does not establish a mostly neutral intergalactic medium or uniquely date reionization. ^[ref].

What a spectrum constrains is a radiative transfer problem. For an ideal foreground screen with negligible emission into the observed beam, the intrinsic continuum-normalized transmission isHere $F$ is spectral radiative flux, $F_{\mathrm{cont}}$ is its unabsorbed continuum, $\tau$ is optical depth, $n_{\mathrm{HI}}$ is neutral hydrogen number density, and $N_{\mathrm{HI}}$ is neutral hydrogen column density along proper path length $\ell$. A Voigt profile model constrains redshift, column density and a velocity width together. A nearly black line has lost much of its sensitivity to further increases in optical depth; blending and an uncertain continuum can also admit different fitted components. Finite spectral resolving power and noise limit which widths and weak features can be measured. ^[ref]. ^[ref].

For a purely thermal Doppler core, use the velocity convention $\tau (v)\propto \exp [-(v-v_0{)}^2/b^2]$. The Maxwell-Boltzmann velocity distribution then giveswhere $k_B$ is the Boltzmann constant, $T$ is temperature and $m_{\mathrm{H}}$ is a hydrogen atom's mass. This $b$ is $\sqrt{2}$ times the Gaussian distribution's standard deviation. Higher temperature spreads the same column density over more velocities. An instrument also broadens a line: locally, for a nearly flat continuum, the recorded transmission is approximately the convolution of $\mathcal{T}$ with the normalized instrumental response, not the exponential of a convolved optical depth. A Gaussian response with full width at half maximum $c/R$ has standard deviation $c/[R\sqrt{8\log 2}]$, where $c$ is the speed of light and $R$ the spectral resolving power.

The upper model fixes the integral $\int \tau (v)dv$, hence the neutral hydrogen column density for this transition, while changing temperature. A cooler line blurred by an instrument resembles a warmer intrinsic line. The lower model has two equal Doppler cores separated by $24\mathrm{km}{\mathrm{s}}^{-1}$: reducing spectral resolving power merges them into one apparent feature. Both panels use invented profiles, Gaussian instrumental responses, and no noise or damping wings. They illustrate an inverse problem, rather than measurements of temperature or a universal relation between a dip and a cloud.

Better observations provide the inputs to that inverse problem. Kim, Cristiani and D'Odorico (2001) analyzed three quasars with the VLT's UVES spectrograph. For HE2217–2818, Table 1 records $z_Q=2.413$ and $16200\mathrm{s}$ of exposure in the $3050$–$3860\text{A˚}$ setup in October 1999. Isolated thorium-argon lamp lines measured $R\simeq 45000$; the data were resampled into $0.05\text{A˚}$ bins, with signal-to-noise ratios about $45$–$50$ per pixel over $3550$–$4050\text{A˚}$. They fitted a local polynomial continuum, fitted Voigt profiles, and compared statistics of the transmitted flux. Their analysis excluded the region near the quasar to avoid the quasar proximity effect and used the interval between its Lyman-beta and Lyman-alpha emission to reduce confusion with other Lyman-series absorption. Features below $N_{\mathrm{HI}}=10^{12.5}\mathrm{c}{\mathrm{m}}^{-2}$ became confused with noise, setting their adopted lower column density limit. Figure 1 shows the measured spectrum, fitted profiles and residuals. This was a calibrated absorption measurement, with explicit selection limits. ^[ref].

Even after instrumental correction, a width need not be purely thermal Doppler broadening. Hubble flow across extended gas, peculiar velocity structure and unresolved blends can contribute. If an isolated line's intrinsic width obeys $b^2=b_{\mathrm{th}}^2+b_{\mathrm{nt}}^2$ with an independent Gaussian nonthermal contribution $b_{\mathrm{nt}}^2\ge 0$, then $T\le m_{\mathrm{H}}{b}^2/(2k_B)$; $b=25\mathrm{km}{\mathrm{s}}^{-1}$ gives a computed upper bound about $3.79\times 10^4\mathrm{K}$. A complex blend need not satisfy this single-component model. Noise can also bias the fitted widths of weak lines. This is why the thermal cutoff of Lyman-alpha line widths, calibrated against gas models, is more informative than assigning a temperature to every dip. ^[ref].

Finally, neutral hydrogen column density is not total gas mass density. In a pure hydrogen approximation, with gas optically thin to ionizing radiation and nearly fully ionized in photoionization equilibrium, the Lyman-alpha forest photoionization scaling giveswhere $n_{\mathrm{H}}$ counts all hydrogen nuclei, $\Gamma$ is the photoionization rate, $\alpha (T)$ is the radiative recombination coefficient and $x_{\mathrm{HI}}=n_{\mathrm{HI}}/n_{\mathrm{H}}$ is the neutral fraction. At fixed temperature and $\Gamma$, doubling $n_{\mathrm{H}}$ quadruples $n_{\mathrm{HI}}$; doubling $\Gamma$ halves it. These computed examples explain both the sensitivity to density contrast and the ambiguity: stronger absorption can mean denser gas, weaker ionizing radiation, a different temperature, or more path length. The Jeans-length ionization correction for the Lyman-alpha forest adds a size model rather than an independently measured depth. Optically thick Lyman limit systems and damped Lyman-alpha systems require different treatment. ^[ref]. ^[ref].

The beauty of the Lyman-alpha forest is that a spectrum converts otherwise faint foreground gas into a sequence of markers through cosmic time. With a model of radiative transfer, velocities, ionizing radiation and the temperature-density relation of photoionized intergalactic gas, its transmission statistics probe the cosmic web and gas thermal history. A single line of sight remains one narrow sample, not a unique three-dimensional density map. ^[ref].

The neutral-hydrogen column-density distribution counts Lyman-alpha absorption systems per unit column density and redshift. A count in logarithmic column bins is $N\ln (10)f(N,z)$. At low forest columns an approximate power law $f\propto N^{-\beta }$ with $\beta$ near $1.5$ is useful, but the slope and normalization depend on column range and epoch. Lyman limit systems are optically thick at the hydrogen photoionization edge; damped Lyman-alpha systems have strong radiative damping wings. A distribution per absorption distance instead removes the geometrical path factor.

A useful description of the low-column Lyman-alpha forest at $z\simeq 3$ is a power law $f_X(N,z)=A(z)N^{-\beta }$, with $\beta$ around $1.4$–$1.5$ over the ordinary unsaturated forest range. The same column dependence holds for $f_z$ at a fixed redshift. It is not a universal unbroken power law: saturation, increased neutral fraction and changing absorber populations produce breaks. Lyman limit systems become optically thick at $N\simeq 10^{17.2}{\mathrm{cm}}^{-2}$ because $N{\sigma }_{912}\simeq 1$ with ${\sigma }_{912}\simeq 6.3\times 10^{-18}{\mathrm{cm}}^2$. Damped Lyman-alpha systems have $N\gtrsim 2\times 10^{20}{\mathrm{cm}}^{-2}$ and strong radiative damping wings. They are rare in number but contain substantial neutral mass. The highest-column distribution steepens or cuts off rather than extending indefinitely.

This sketch shows representative shapes and transition scales, not an observational fit; its ordinate is distribution per unit column, not counts per logarithmic bin. In an Einstein-de Sitter universe, $H=H_0(1+z{)}^{3/2}$, so a fixed comoving population with fixed physical cross-section above a fixed column threshold has $d\mathcal{N}/dz\propto (1+z{)}^{1/2}$. ThusThe observed redshift evolution of the Lyman-alpha forest is much stronger for commonly selected forest lines. For example, Kim, Cristiani and D'Odorico's absorption survey finds an index about $2.19$ in $d\mathcal{N}/dz\propto (1+z{)}^{\gamma }$ for $10^{13.64}<N/{\mathrm{cm}}^{-2}<10^{16}$ over $1.5<z<4$, corresponding to an increase by approximately $2^{2.19}\simeq 4.56$. This number is selection-dependent. Expansion changes the gas density, and the evolving cosmic ionizing background changes its neutral fraction through photoionization equilibrium, moving systems across a fixed neutral-column threshold. Structure also evolves. A non-evolving population with fixed physical cross-section is therefore not an adequate physical model of the observed forest.

Use absorption distance $X$ and its distribution $f_X$. Summing hydrogen columns per unit $X$ gives $\int N{f}_{X}dN$. The physical light-path length per $X$ isThe mean neutral-hydrogen number density is therefore $(H_0/c)(1+z{)}^3\int N{f}_{X}dN$. Divide by $(1+z{)}^3$ to obtain its comoving density, multiply by hydrogen atomic mass, and divide by today's mass critical density ${\rho }_{\mathrm{crit},0}=3H_0^2/(8\pi G)$. This derives the neutral gas density from an absorption distribution:If “neutral gas” includes helium, replace $m_H$ by ${\mu }_H{m}_H$, with a stated abundance correction approximately ${\mu }_H\simeq 1.3$. Equivalently, for the distribution per redshift the prefactor inside the integral is $m_{H}H(z)/[c{\rho }_{\mathrm{crit},0}(1+z{)}^2]$ multiplying $N{f}_z$. In the PDF's energy-density convention, both the mass density and critical density are multiplied by $c^2$, leaving their ratio unchanged. The usual quoted abundance uses comoving mass density relative to today's critical density; a ratio of physical density to the epoch's critical density instead multiplies this answer by $(1+z{)}^3{H}_0^2/H(z{)}^2$.

To infer total gas, one needs the neutral fraction $x_{\mathrm{HI}}=N_{\mathrm{HI}}/N_H$ for each absorber. The ionized gas density from an absorption distribution isThis is an ionization-corrected integral, not an inference available from the observed columns alone. For optically thin, almost fully ionized hydrogen, photoionization equilibrium gives $\Gamma n_{\mathrm{HI}}=\alpha (T)n_e{n}_{\mathrm{HII}}\simeq \alpha (T)n_H^2$. If the absorbing depth $L$ is specified, $N=\alpha (T)n_H^{2}L/\Gamma$ andThus photoionization rate, temperature and depth are all needed.

One useful physical closure sets $L$ to a local Jeans length, $L\propto (f_{g}T/n_H{)}^{1/2}$, with local gas fraction $f_g$. Solving $N\propto [\alpha (T)/\Gamma ](f_{g}T{)}^{1/2}{n}_H^{3/2}$ then gives the Jeans-length ionization correction for the Lyman-alpha forest:This illustrates why weak, highly ionized forest lines can dominate the total gas inventory even though damped Lyman-alpha systems dominate the neutral-column-weighted inventory. It is a model for locally confined optically thin gas; optically thick Lyman limit systems and damped Lyman-alpha systems require a separate radiative transfer treatment. The physical basis and observational application of this closure are developed in Schaye's absorption-based matter-density calculation.

Hydrogen is the most abundant element, and its Lyman-alpha line is a strong resonance from the ground state. Very small neutral fractions in an otherwise ionized intergalactic medium therefore produce detectable Lyman-alpha absorption. A long quasar sightline samples a great many modest density enhancements in the cosmic gas, with a much larger covering area than the compact high-column regions that produce damped Lyman-alpha systems.

Heavy-element absorption additionally requires metal enrichment and enough ions in the relevant ionization state. Many weak Lyman-alpha forest absorbers contain too few such ions to produce detectable metal lines at the same sensitivity, while high-column Lyman limit systems and damped Lyman-alpha systems are intrinsically rarer. Thus abundant hydrogen, a sensitive resonance and the large interception area of diffuse gas together explain the forest's numerical dominance. The comparison is between absorber classes at specified observational sensitivity; it does not mean that a metal-rich system has only one spectral transition.

Specify the path convention before integrating the neutral-hydrogen column-density distribution. Write $f_z={\partial }^2\mathcal{N}/(\partial N\partial z)$ and $f_X={\partial }^2\mathcal{N}/(\partial N\partial X)$, with absorption distance satisfyingThe lower panel of the preceding sketch shows the approximate decrease of $f$ with $N=N_{\mathrm{HI}}$ near $z=3$. Ordinary forest columns are roughly described by $f\propto N^{-\beta }$, $\beta \sim 1.5$, but the slope changes through partially shielded Lyman limit systems and high-column damped Lyman-alpha systems. No single slope should be extrapolated through all these regimes. In logarithmic bins the number is $N\ln (10)f$, whereas their neutral mass contribution is proportional to $N^{2}f$; confusing these two weightings would give a wrong baryon inventory.

To derive the neutral gas density from an absorption distribution, a redshift interval $dz$ has proper light-path length $d\ell =cdz/[(1+z)H]$. The sum of neutral hydrogen columns per path length estimates the mean proper number density:The proper mass density is $m_H{\overline{n}}_{\mathrm{HI}}$; division by $(1+z{)}^3$ converts it to a comoving mass density. Thus, with today's critical density ${\rho }_{\mathrm{crit},0}=3H_0^2/(8\pi G)$,A representative finite-sample estimator replaces the last integral by ${\sum }_j{N}_j/\Delta X$, with completeness and selection corrections. This defines a comoving inventory divided by today's critical density; a fraction of the instantaneous critical density has a different normalization. Neutral gas including accompanying helium is obtained by multiplying by a specified mass correction, approximately $1.3$; hydrogen-only ${\Omega }_{\mathrm{HI}}$ must not silently include it.

At $z\sim 3$ the observed neutral inventory is of order $10^{-3}$, far below the cosmological baryon density of order $0.04$–$0.05$ for $h\sim 0.7$. High-column damped Lyman-alpha systems contribute most of this neutral mass although weak forest lines dominate the counts; for $\beta =1.5$ the mass per logarithmic column interval increases as $N^{1/2}$ in the forest regime. The small neutral inventory therefore does not imply a small total gas inventory: the intergalactic medium contains a large ionized baryon reservoir invisible to a neutral-only count. Recovering that reservoir requires an ionization correction and a gas-density model. The survey normalization and high-column contribution are described in the neutral-gas inventory analysis.

Near the background quasar, the quasar proximity effect typically reduces the number and strength of Lyman-alpha forest features relative to regions farther along the sightline. It is an ionization effect, not evidence that the quasar lies in an empty region. At fixed gas density and temperature, photoionization equilibrium givesIf the unperturbed neutral-hydrogen column-density distribution is $A{N}^{-\beta }$, $\beta >1$, detecting a column above $N_{\min }$ now requires its unperturbed column to exceed $(1+\omega )N_{\min }$. Integrating that distribution shows that the number above threshold is reduced by $(1+\omega {)}^{1-\beta }$. This supplies an explicit model for the decline of line counts.

The known quasar luminosity estimates its photoionization rate at proper separation $R$:These expressions assume unattenuated, steady, isotropic quasar emission and a specified ionizing spectrum. Fitting the measured suppression as a function of separation determines the ratio ${\Gamma }_Q/{\Gamma }_{\mathrm{bg}}$ and hence constrains the cosmic ionizing background. A weaker background gives a larger region in which the quasar dominates. For fixed background spectral shape, this constrains its specific intensity near the Lyman limit system ionization edge, not an arbitrary spectral function. The proximity-effect estimator of the ionizing background is biased if the host gas is overdense, the quasar's past luminosity differs from its observed luminosity, its radiation is anisotropic, or systemic-redshift errors distort the inferred separation; absorption between source and gas also changes ${\Gamma }_Q$. These effects explain why the method needs environmental and source modeling, as discussed in the proximity-effect measurements.

The neutral-hydrogen column density is $N_{\mathrm{HI}}=\int n_{\mathrm{HI}}d\ell$, with units ${\mathrm{cm}}^{-2}$. Define the neutral-hydrogen column-density distribution byHere $\mathcal{N}$ counts absorption systems along a quasar sightline. A histogram per logarithmic column interval instead measures $N\ln (10)f(N,z)$; forgetting this factor changes the inferred slope. Another common convention uses the absorption distance $X$, with $dX/dz=H_0(1+z{)}^2/H(z)$, and $f_X=f/(dX/dz)$.

At a fixed epoch, weak Lyman-alpha forest lines have an approximately falling power-law distribution, $f(N,z)\simeq A(z)N^{-\beta }$ with $\beta \simeq 1.4$–$1.5$ over representative low-column ranges. Stronger absorbers deviate from one universal slope, and the normalization and fitted slopes depend on epoch and sample. The low-column fit is measured, for example, in Kim and collaborators' forest survey. The sketch distinguishes that empirical low-column trend from an illustrative higher-column continuation.

Ordinary Lyman-alpha forest lines cover roughly $10^{12}\lesssim N_{\mathrm{HI}}\lesssim 10^{17.2}{\mathrm{cm}}^{-2}$. They are numerous resonant Lyman-alpha absorption features from intervening gas at different cosmological redshifts, collectively resembling a forest in a quasar spectrum. Many are optically thin at the ionization edge even when their line centers are saturated.

A Lyman limit system becomes optically thick at the $91.2\mathrm{nm}$ hydrogen ionization edge. With ${\sigma }_{912}\simeq 6.3\times 10^{-18}{\mathrm{cm}}^2$, ${\tau }_{912}=N_{\mathrm{HI}}{\sigma }_{912}\gtrsim 1$ requiresIts spectrum consequently has a strong continuum decrement below the redshifted Lyman edge. In a classification separating the highest columns, Lyman limit systems extend up to the damped-system boundary.

A damped Lyman-alpha system conventionally has $N_{\mathrm{HI}}\gtrsim 2\times 10^{20}{\mathrm{cm}}^{-2}$. Its Lyman-alpha absorption is sufficiently strong that the Lorentzian wings of the Voigt profile are prominent. “Damped” refers to the finite radiative lifetime of the atomic excited state, not an inference that the gas has a high temperature. These systems trace substantial neutral reservoirs, usually associated with galaxies.