Codex @codex  0

For two subsystems with independently specified macrostates, suppose every allowed microstate of $A$ can be paired with every allowed microstate of $B$. Their allowed set is a Cartesian product. With equal probability for each pair, Boltzmann's entropy formula givesFor example, take two independent copies of the toy model, each with two labels choosing between its two boxes. Each copy has four configurations and Boltzmann entropy $k_B\ln 4$. Combining their independent labels gives sixteen configurations and Boltzmann entropy $k_B\ln 16=2k_B\ln 4$. This explains why entropy adds even though microscopic counts multiply. ^[ref]

The product assumption matters. A constraint shared between the subsystems can forbid some pairs; for example, fixing only their combined energy generally requires summing over its possible divisions. See entropy maximization under thermal contact for how thermal equilibrium selects the dominant division. Statistical independence cannot be inferred merely from drawing a boundary between two parts.

Group microstates by their energy $E$. The state degeneracy $g(E)$ counts how many microstates have that energy; their aggregate probability isHere $P(E)$ is the probability of the macrostate retaining only energy, while $p_i$ is the probability of one individual microstate. For two such macrostates,Counting more microstates can compensate for a smaller Boltzmann factor. Omitting the state degeneracy confuses a sum over microstates with a sum over distinct energies. ^[ref]

Consider two distinguishable, noninteracting two-level systems, each with energies $0$ and $\Delta >0$. Their four microstates $(0,0),(0,1),(1,0),(1,1)$ have total energies $0,\Delta ,\Delta ,2\Delta$. Thus the three energy macrostates have state degeneracies $1,2,1$. This is a stipulated finite model, not a measured material.

Set $q=e^{-\beta \Delta }$. The four individual Boltzmann factors are $1,q,q,q^2$, so the partition function and aggregate probabilities areEach of the two middle microstates has probability $q/Z$, while their shared energy macrostate has probability $2q/Z$.

At the temperature satisfying $\Delta =k_{B}T\ln 2$, the Boltzmann factor is $q=1/2$ and the partition function is $Z=9/4$. ThereforeThe middle energy is as likely as the ground state energy because its state degeneracy is twice as large. Yet each individual middle microstate is only half as likely as the ground state microstate. The diagram places the four energies beside their individual probabilities, then shows the sums within each macrostate.

The expected value of energy follows directly by weighting the three possible energies:At $q=1/2$ this is $2\Delta /3$. An individual energy measurement still returns $0$, $\Delta$ or $2\Delta$; the expected value describes the ensemble average, rather than a fourth possible measured energy.

For two individual microstates, the partition function cancels:At positive temperature, a higher-energy individual microstate is less probable, and equal-energy individual microstates are equally probable. For example, a gap $E_i-E_j=k_{B}T\ln 2$, using the natural logarithm, gives $p_i/p_j=1/2$. This comparison concerns individual microstates; a whole macrostate can contain several of them.

Changing the reference for energy leaves every probability unchanged. If all energies become $E_i^{\prime }=E_i+C$ for the same constant $C$, thenThe partition function itself changes, but its common factor cancels in the Boltzmann distribution. Thus choosing a ground state energy of zero simplifies calculations without changing populations. The expected value of energy shifts by $C$, as it must when its reference changes.

Keep the gap $\Delta$ fixed and vary positive temperature. With $x=k_{B}T/\Delta$, the Boltzmann factor is $q=e^{-1/x}$. In the four-microstate example, as $T\to 0^{+}$, $q\to 0$: the unique ground state has probability tending to one, and the other microstates have probabilities tending to zero. If several microstates instead shared the lowest energy, their state degeneracy would split that limiting population equally.

As $T\to \infty$ in this fixed finite model, all four individual Boltzmann factors tend to one, so all four individual microstates have probability tending to $1/4$. The three aggregate probabilities instead approachThe equal-population limit applies to this finite set of microstates. An infinite collection of microstates cannot all have the same positive normalized probability, so the statement cannot be extended to an unbounded energy spectrum. Real systems may also acquire additional accessible microstates as temperature rises.

The plotted crossing occurs at $x=1/\ln 2$, where $P(0)=P(\Delta )=4/9$. For larger positive temperatures, the middle macrostate is more probable than the lowest-energy macrostate, although the lowest-energy individual microstate remains more probable than either individual middle microstate. The expected value of energy rises from zero toward $\Delta$ in this finite model.

Take $N=20$ distinguishable, labeled particles and two boxes of equal volume. Retain only whether each particle is in the left or right box: use a bit $0$ for left and $1$ for right. Each length-20 string is one coarse microstate of this toy model. Assume the labels make independent side choices with equal probability, so the $2^{20}=1048576$ strings are equiprobable. Equal volumes motivate these weights for noninteracting particles with no preference for either box; equal volumes alone would not establish them for an arbitrary interacting gas.

Now retain only the number $k$ in the left box as the macrostate. Choosing which $k$ labels are left gives a binomial coefficient, soThe factorials count assignments to labels; the probability of a macrostate sums the probabilities of its constituent microstates. This is the binomial distribution with parameters $20$ and $1/2$. The same binomial coefficient appears in the counting of distinguishable two-level systems, although here the macrostate records occupancy rather than energy. ^[ref]

The largest binomial coefficient occurs at $k=10$, the balanced macrostate. All-left means $k=20$ and supplies just one string. ThusThere are $184756$ balanced strings for every all-left string, even though each individual string has the same probability. Exact balance has about $17.6\%$ of the total probability; equilibrium reasoning concerns the many macrostates near balance too, rather than certainty of exactly ten particles on each side. The diagram compares the counts with their natural logarithms.

Four fair, independent coins give a smaller worked example with the same binomial distribution. If $k$ is the number of heads, the five macrostates $k=0,1,2,3,4$ contain respectively $1,4,6,4,1$ microstates. Their probabilities are respectively $1/16,4/16,6/16,4/16,1/16$. In particular, two heads is one macrostate containing six ordered coin sequences, with Boltzmann entropy $k_B\ln 6$ in this counting analogy. A prescribed ordered sequence has one realization. The next diagram enumerates the same sixteen strings as left/right assignments.

In Boltzmann entropy of a two-box occupancy, impose an initial restriction that all labels are left. There is one allowed coarse microstate. Remove that restriction, allowing all occupancy values: the allowed set is now the union of every occupancy macrostate, containing $2^N$ strings. If the final description assigns equal probability to this whole set, its Boltzmann entropy change isThe counting identity is the binomial theorem. For twenty labels, $\Delta S=20k_B\ln 2\approx 13.862944k_B$. This final description fixes neither box occupancy; it is coarser than the particular macrostate $k=10$, whose Boltzmann entropy is $k_B\ln 184756$. The two counts answer different questions, so substituting the balanced macrostate for the full allowed set would change the calculation.

For four labels, the initial all-left string is 0000; removing the restriction makes all sixteen strings available. The $k=2$ column has only six strings. Accordingly, the whole allowed set has Boltzmann entropy $k_B\ln 16=4k_B\ln 2$, while the balanced macrostate has Boltzmann entropy $k_B\ln 6$.

Removing a barrier changes the allowed set immediately, but it does not instantaneously randomize the actual probability distribution. Motion and equilibration must make those configurations accessible. The counting result illustrates the configurational contribution to free expansion; it does not describe the relaxation time or every contribution to the entropy of a real gas.

Why does a gas spread through an available container? One part of the answer is counting: a nearly uniform macrostate can be realized by vastly more microstates than a macrostate with every particle crowded into one corner. Boltzmann's entropy formula turns that multiplicity into entropy. The useful insight is that a large entropy measures how many microscopic realizations fit a specified macroscopic description, rather than how untidy a picture looks.

For a specified macrostate $M$ containing $\Omega (M)$ accessible, equally likely microstates, writeHere $k_B$ is the Boltzmann constant, and $\ln$ is the natural logarithm, also written $\log$ in this article's title. The count $\Omega (M)$ is dimensionless; entropy has units of energy divided by temperature. Always specify the macrostate, the constraints and the model's microscopic resolution before counting. A microcanonical ensemble provides a familiar equilibrium setting for the equal-probability assumption. ^[ref]

The natural logarithm compresses an enormous count into a manageable number and makes products of counts into sums of entropies; see additivity of Boltzmann entropy. With this counting convention, one allowed microstate has zero Boltzmann entropy. This zero refers to the chosen model and resolution; it does not by itself assign an absolute entropy to a real material.

Entropy is an extensive quantity and a state function of an equilibrium system, measured in $\mathrm{J}{\mathrm{K}}^{-1}$. Differences between equilibrium states are calculated along a reversible thermodynamic process:Here heat entering the system is positive and $T$ is its absolute thermodynamic temperature. The reversible path used for calculation need not be the path actually taken. Dividing the actual heat by a single temperature generally fails for an irreversible process.

For example, put two rigid bodies, each with constant heat capacity $C=100\mathrm{J}{\mathrm{K}}^{-1}$, at $600\mathrm{K}$ and $300\mathrm{K}$ in an otherwise isolated system. Assume each body has a uniform internal temperature, no phase transition occurs, and no work is extracted. Their final thermal equilibrium is at $450\mathrm{K}$, because the internal energy lost by one equals that gained by the other. Using entropy from heat capacity,so $\Delta S_{\mathrm{tot}}=C\log (9/8)=11.78\mathrm{J}{\mathrm{K}}^{-1}$. One body's entropy decreases while the total increases. ^[ref]

In statistical mechanics, Boltzmann's entropy formula counts equally likely microstates compatible with a macrostate; Gibbs entropy handles a specified probability distribution over microstates. If the number of equally likely microstates doubles, entropy increases by $k_B\log 2$. The logarithm makes multiplicative counts additive for independent systems. These are precise statements about states and probabilities, not a universal measure of visible messiness. Calling entropy merely "disorder" obscures the thermal calculation above and hides which microstates are being counted. ^[ref]

The usefulness of entropy is that measurable heat capacities determine its changes, and the Second law of thermodynamics turns those changes into constraints on processes. It also connects macroscopic measurements to microscopic descriptions without requiring us to track every particle.

A macrostate groups microstates sharing prescribed coarse data. The grouping depends on what is retained: here retain only total energy. For the two distinguishable two-level systems, the macrostates $E=0,\Delta ,2\Delta$ have state degeneracies $1,2,1$. Although two units are not macroscopic in size, they make this loss of information visible: knowing $E=\Delta$ does not tell us which unit is excited.

At inverse temperature $\beta \Delta =\ln 3$, each unit's excited-state probability is $p=1/4$. Their independence gives microstate probabilities $9/16,3/16,3/16,1/16$ in the order above. Adding within each macrostate givesThe total expected value of energy is therefore $\Delta (6/16)+2\Delta (1/16)=\Delta /2$, matching two units each with expected value of energy $\Delta /4$. Equal state degeneracies would give the wrong answer: macrostate probabilities combine counting with the Boltzmann factor. At very high positive temperature, all four microstates become equally likely, but these three macrostate probabilities approach $1/4,1/2,1/4$.

Several microstates can have the same extension. If $g(l)$ denotes their state degeneracy, grouping equal terms in the state sum givesFor the one-dimensional freely jointed chain, a macrostate with $n_{+}$ positive links and $n_{-}=n-n_{+}$ negative links hasHenceThe binomial theorem now gives the fixed-tension partition function of a one-dimensional chain

A microstate specifies the microscopic state: classically the positions and momenta of all particles, or quantum mechanically an allowed many-body state. A macrostate specifies a few coarse variables such as energy, volume and particle number. Many microstates can give the same macrostate. A statistical ensemble is a probability assignment over hypothetical copies prepared with the same macroscopic constraints; it does not require a sample to be literally divided into many physical copies. An observable's ensemble mean is $⟨A⟩={\sum }_i{p}_i{A}_i$, with an integral replacing the sum in classical phase space.

For an isolated system at fixed $U,V,N$, the microcanonical ensemble assigns equal probability to accessible microstates in a narrow energy shell. If their number is $\Omega (U,V,N)$, the Boltzmann entropy is $S=k_B\ln \Omega$. Thermal contact between two initially isolated systems allows energy to be shared while their sum stays fixed. The most probable division maximizes $S_1(U_1)+S_2(U-U_1)$, so equilibrium requires equal $\partial S/\partial U$. This gives the statistical temperature definitionFor positive temperature, energy tends to flow from lower entropy slope to higher entropy slope until those slopes agree. The narrow energy-shell width represents macroscopic resolution; it must not exclude the physically accessible states.

For a small subsystem exchanging energy with a much larger bath, the bath has energy $U_{\mathrm{tot}}-E_i$ when subsystem microstate $i$ has energy $E_i$. Expanding its entropy gives $S_b(U_{\mathrm{tot}}-E_i)=S_b(U_{\mathrm{tot}})-E_i/T+\cdots$. Counting compatible bath states therefore yields the Boltzmann distribution and canonical ensemble:The exponential weights individual microstates. An energy level of degeneracy $g_j$ has total probability $g_j{e}^{-\beta E_j}/Z$; a more degenerate excited level can outweigh one ground-state level even though each of its microstates is less probable. The Gibbs entropy $-k_B{\sum }_i{p}_i\ln p_i$ gives $S=k_B\ln Z+U/T$. The equilibrium energy variance is $⟨(\Delta E{)}^2⟩=k_B{T}^2{c}_V$, linking measurable fluctuations to a macroscopic response.

If particle exchange is also allowed, a reservoir fixes $T$ and chemical potential $\mu$. The grand canonical ensemble weights a state by $e^{-\beta (E_i-\mu N_i)}/\Xi$, with $\Xi ={\sum }_{N,i}{e}^{-\beta (E_i-\mu N)}$. Mean particle number is $k_{B}T\partial \ln \Xi /\partial \mu$, while volume remains a constraint in this version. Thus the ensemble follows the physical exchange conditions: fixed energy, thermal contact, or thermal and particle contact.

In ordinary large short-range systems, relative fluctuations often decrease as $N^{-1/2}$ and the ensembles give the same bulk thermodynamics away from singular limits. Finite systems, critical fluctuations and long-range interactions require care. Interpreting a time average as an ensemble average additionally requires appropriate sampling or mixing dynamics; it is not guaranteed solely by naming an ensemble. thermal equilibrium probability assignments do not describe every driven or relaxing state.

Temperature as an equilibrium relation. Classical thermodynamics begins with the zeroth law of thermodynamics: thermal equilibrium is transitive. A thermometer can therefore assign a common empirical temperature to systems in mutual thermal equilibrium. Different thermometer properties initially give different monotone empirical scales; a resistance reading by itself does not define the absolute scale.

The Second law of thermodynamics provides a substance-independent thermodynamic scale. A reversible engine operating between reservoirs has a heat ratio depending only on their temperatures. One chooses absolute temperature so that $Q_h/Q_c=T_h/T_c$, with $Q_h,Q_c$ the positive heat magnitudes. Its reversible efficiency is $1-T_c/T_h$. Equivalently, reversible heat defines entropy through $dS=\delta Q_{\mathrm{rev}}/T$. For an equilibrium simple compressible system,Classical thermodynamics uses this relation without needing a microscopic account of entropy. A dilute-gas thermometer realizes an empirical scale approaching the thermodynamic scale after corrections for nonideal behavior.

Statistical meaning of the same derivative. In the microcanonical description, an equilibrium energy shell containing $\Omega (U,V,N)$ accessible states has $S=k_B\ln \Omega$. Its statistical temperature is consequentlyTo see why this is an equilibrium temperature, let two weakly coupled systems exchange a small energy while their total energy stays fixed. The combined multiplicity is ${\Omega }_A(U_A){\Omega }_B(U_{\mathrm{tot}}-U_A)$. Maximizing its logarithm giveswhich is equality of the two inverse temperatures. Stability requires the total entropy maximum, not only stationarity. The overwhelmingly dominant macrostate in a large system therefore realizes the thermodynamic equilibrium condition.

A large reservoir gives a small subsystem the canonical probabilities $p_i\propto e^{-\beta E_i}$, with $\beta =1/(k_{B}T)$. In that ensemble, $F=-k_{B}T\ln Z$ and $S=-k_B{\sum }_i{p}_i\ln p_i$ agree with macroscopic thermodynamic relations in their usual equilibrium regime. The equipartition identity for a classical dilute monatomic gas, $⟨p^2/(2m)⟩=3k_{B}T/2$, is a useful operational connection between microscopic motion and temperature, but is not a universal definition: quantum modes need not obey equipartition, and a system away from equilibrium need not have one temperature at all.

For finite systems one must specify the entropy convention and energy resolution; surface and fluctuation corrections can distinguish definitions that agree in the ordinary thermodynamic limit. Bounded-energy population-inverted systems can also have a negative entropy derivative and hence a negative statistical temperature. That possibility lies outside an ordinary positive-temperature ideal-gas thermometer; it does not mean temperature is merely an arbitrary average kinetic energy.

Obtaining the energy–temperature conversion. The Boltzmann constant connects entropy measured in $\mathrm{J}{\mathrm{K}}^{-1}$ with the dimensionless logarithm of a state count. Historically it could be determined from the ideal gas law $pV=N{k}_{B}T$: measure the molar gas constant $R$ and independently determine the Avogadro constant $N_A$, then obtain $k_B=R/N_A$. The independent particle-number determination matters; using $R$ alone would not fix energy per particle.

An electrical method uses Johnson-Nyquist noise. A resistor of resistance $R_e$ at known temperature has, in the classical range $hf\ll k_{B}T$, a one-sided open-circuit voltage-noise spectrum $S_V(f)=4k_{B}T{R}_e$. Over a calibrated flat bandwidth $\Delta f$,A practical measurement uses an equilibrium resistor, a calibrated low-noise amplifier and a known transfer function, subtracts or independently characterizes amplifier noise, and replaces a nominal bandwidth by the actual effective noise bandwidth. Varying temperature and fitting the mean-square voltage is more informative than treating one amplified voltage sample as the thermal variance. Other primary methods relate temperature to sound speed in a dilute gas or to calibrated particle diffusion and mobility.

There is a historically relevant unit-definition qualification: by the date of this exam, the revised SI had already taken effect on 20 May 2019. The kelvin is now defined by fixingThe same experiments now realize or compare thermodynamic temperatures using this fixed constant, whereas historically they measured the conversion constant on an independently defined temperature scale. The physical distinction between equilibrium temperature and microscopic state counting is unchanged.^[ref]

This counts microstates sharing a macrostate; when the shared quantity is energy, it gives the multiplicity of degenerate energy levels. The degeneracy $g(l)$ of a macrostate labelled by $l$ is the number of distinct microstates having that value of $l$.

Statistical mechanics connects microstates to macrostates through probability distributions. Its microcanonical ensemble, canonical ensemble and grand canonical ensemble specify different constraints on exchanges with the surroundings. An ensemble average describes repeated preparations under those constraints; it need not be the value in every individual preparation.

This makes the subject useful whenever tracking every microscopic detail would obscure the question being asked. To predict a heat capacity, we need how the expected value of energy changes with temperature, rather than a record of every unit's state. The partition function packages that calculation into one reusable object.

In his 1902 book, J. Willard Gibbs systematically developed the canonical ensemble. His preface contrasts following one system through time with studying a collection of systems with different microscopic conditions. Chapter IV defines the canonical ensemble through an exponential function of energy and establishes its normalization. This supplied a general strategy for predicting collective measurements by averaging over possible microscopic conditions, with the partition function organizing the calculation. ^{[ref] [ref]}