Additivity of Boltzmann entropy 2026-10-14
For two subsystems with independently specified macrostates, suppose every allowed microstate of can be paired with every allowed microstate of . Their allowed set is a Cartesian product. With equal probability for each pair, Boltzmann's entropy formula givesFor example, take two independent copies of the toy model, each with two labels choosing between its two boxes. Each copy has four configurations and Boltzmann entropy . Combining their independent labels gives sixteen configurations and Boltzmann entropy . This explains why entropy adds even though microscopic counts multiply. [ref]
https://web.mit.edu/16.unified/www/FALL/thermodynamics/notes/node57.html. MIT, §7.4, equation 7.17: independent state counts multiply
The product assumption matters. A constraint shared between the subsystems can forbid some pairs; for example, fixing only their combined energy generally requires summing over its possible divisions. See entropy maximization under thermal contact for how thermal equilibrium selects the dominant division. Statistical independence cannot be inferred merely from drawing a boundary between two parts.
Boltzmann distribution Created 2026-09-28 Updated 2026-10-14
The Boltzmann distribution assigns probabilities to individual microstates in a canonical ensemble, a statistical ensemble for thermal contact. The system exchanges energy with a thermal reservoir at fixed positive absolute temperature , while its particle number and external parameters, such as volume, stay fixed. The thermal reservoir is large enough that these exchanges barely change its temperature; the coupling permits thermal equilibrium but contributes negligible interaction energy. All the microstates considered have the same . No chemical potential term is needed in their weights; fixed does not imply that the chemical potential is zero.
For a finite discrete set of microstates with energies , writeHere is the Boltzmann constant, is the inverse temperature, is a Boltzmann factor, and is the partition function. The Boltzmann factor is a weight; dividing by the partition function makes it a probability. [ref]
https://ocw.mit.edu/courses/5-62-physical-chemistry-ii-spring-2008/ec4f40d5a0fa41df3692f076e850543d_02_562ln08.pdf. MIT 5.62 Physical Chemistry II, spring 2008, lecture 2, pages 4–7: fixed N, V, T and canonical probabilities
The useful surprise is that a fixed temperature still permits thermal fluctuations in the system's energy. The Boltzmann distribution predicts their probabilities and expected values without tracking every microscopic exchange. Its exponential function also makes rare excited microstates sensitive to temperature: an energy gap much larger than gives strong Boltzmann suppression, while warming increases their relative populations. A population ratio can therefore reveal a gap or serve as a thermometer, provided thermal equilibrium and the relevant state degeneracies are known.
Historically, Josiah Willard Gibbs's Elementary Principles in Statistical Mechanics (1902) presents the canonical ensemble in Chapter IV. His equations 90–92 give an exponential function of energy and its normalization, in classical phase space. This classical formulation exhibits the same weighting principle. [ref]
https://en.wikisource.org/wiki/Elementary_Principles_in_Statistical_Mechanics. Gibbs (1902), title page and preface
[ref]https://en.wikisource.org/wiki/Elementary_Principles_in_Statistical_Mechanics/Chapter_IV. Gibbs (1902), Chapter IV, equations 90–92
Boltzmann distribution and state degeneracy 2026-10-14
Group microstates by their energy . The state degeneracy counts how many microstates have that energy; their aggregate probability isHere is the probability of the macrostate retaining only energy, while is the probability of one individual microstate. For two such macrostates,Counting more microstates can compensate for a smaller Boltzmann factor. Omitting the state degeneracy confuses a sum over microstates with a sum over distinct energies. [ref]
https://ocw.mit.edu/courses/5-62-physical-chemistry-ii-spring-2008/bda82786b6014d3f468798339f658629_03_562ln08.pdf. MIT 5.62, spring 2008, lecture 3, page 4: degeneracy and the aggregate energy probability
Consider two distinguishable, noninteracting two-level systems, each with energies and . Their four microstates have total energies . Thus the three energy macrostates have state degeneracies . This is a stipulated finite model, not a measured material.
Set . The four individual Boltzmann factors are , so the partition function and aggregate probabilities areEach of the two middle microstates has probability , while their shared energy macrostate has probability .
At the temperature satisfying , the Boltzmann factor is and the partition function is . ThereforeThe middle energy is as likely as the ground state energy because its state degeneracy is twice as large. Yet each individual middle microstate is only half as likely as the ground state microstate. The diagram places the four energies beside their individual probabilities, then shows the sums within each macrostate.
The expected value of energy follows directly by weighting the three possible energies:At this is . An individual energy measurement still returns , or ; the expected value describes the ensemble average, rather than a fourth possible measured energy.
Boltzmann distribution ratios and energy reference Created 2026-10-14 Updated 2026-10-25
For two individual microstates, the partition function cancels:At positive temperature, a higher-energy individual microstate is less probable, and equal-energy individual microstates are equally probable. For example, a gap , using the natural logarithm, gives . This comparison concerns individual microstates; a whole macrostate can contain several of them.
Changing the reference for energy leaves every probability unchanged. If all energies become for the same constant , thenThe partition function itself changes, but its common factor cancels in the Boltzmann distribution. Thus choosing a ground state energy of zero simplifies calculations without changing populations. The expected value of energy shifts by , as it must when its reference changes.
Keep the gap fixed and vary positive temperature. With , the Boltzmann factor is . In the four-microstate example, as , : the unique ground state has probability tending to one, and the other microstates have probabilities tending to zero. If several microstates instead shared the lowest energy, their state degeneracy would split that limiting population equally.
As in this fixed finite model, all four individual Boltzmann factors tend to one, so all four individual microstates have probability tending to . The three aggregate probabilities instead approachThe equal-population limit applies to this finite set of microstates. An infinite collection of microstates cannot all have the same positive normalized probability, so the statement cannot be extended to an unbounded energy spectrum. Real systems may also acquire additional accessible microstates as temperature rises.
Aggregate Boltzmann distribution populations versus positive temperature for state degeneracies 1, 2, 1
. Details. The plotted crossing occurs at , where . For larger positive temperatures, the middle macrostate is more probable than the lowest-energy macrostate, although the lowest-energy individual microstate remains more probable than either individual middle microstate. The expected value of energy rises from zero toward in this finite model.
Boltzmann entropy of a two-box occupancy Created 2026-10-14 Updated 2026-10-18
Take distinguishable, labeled particles and two boxes of equal volume. Retain only whether each particle is in the left or right box: use a bit for left and for right. Each length-20 string is one coarse microstate of this toy model. Assume the labels make independent side choices with equal probability, so the strings are equiprobable. Equal volumes motivate these weights for noninteracting particles with no preference for either box; equal volumes alone would not establish them for an arbitrary interacting gas.
Now retain only the number in the left box as the macrostate. Choosing which labels are left gives a binomial coefficient, soThe factorials count assignments to labels; the probability of a macrostate sums the probabilities of its constituent microstates. This is the binomial distribution with parameters and . The same binomial coefficient appears in the counting of distinguishable two-level systems, although here the macrostate records occupancy rather than energy. [ref]
https://ocw.mit.edu/courses/8-333-statistical-mechanics-i-statistical-mechanics-of-particles-fall-2013/0cb99318c2ed889316cdcff839759e8d_MIT8_333F13_Lec12.pdf. Mehran Kardar, MIT 8.333 (2013), lecture 12, §IV.C, equations IV.17–18: binomial microstate counts
The largest binomial coefficient occurs at , the balanced macrostate. All-left means and supplies just one string. ThusThere are balanced strings for every all-left string, even though each individual string has the same probability. Exact balance has about of the total probability; equilibrium reasoning concerns the many macrostates near balance too, rather than certainty of exactly ten particles on each side. The diagram compares the counts with their natural logarithms.
Counts and Boltzmann entropies of the occupancy macrostates of twenty labeled particles
. Details. Four fair, independent coins give a smaller worked example with the same binomial distribution. If is the number of heads, the five macrostates contain respectively microstates. Their probabilities are respectively . In particular, two heads is one macrostate containing six ordered coin sequences, with Boltzmann entropy in this counting analogy. A prescribed ordered sequence has one realization. The next diagram enumerates the same sixteen strings as left/right assignments.
In Boltzmann entropy of a two-box occupancy, impose an initial restriction that all labels are left. There is one allowed coarse microstate. Remove that restriction, allowing all occupancy values: the allowed set is now the union of every occupancy macrostate, containing strings. If the final description assigns equal probability to this whole set, its Boltzmann entropy change isThe counting identity is the binomial theorem. For twenty labels, . This final description fixes neither box occupancy; it is coarser than the particular macrostate , whose Boltzmann entropy is . The two counts answer different questions, so substituting the balanced macrostate for the full allowed set would change the calculation.
For four labels, the initial all-left string is
0000; removing the restriction makes all sixteen strings available. The column has only six strings. Accordingly, the whole allowed set has Boltzmann entropy , while the balanced macrostate has Boltzmann entropy .Sixteen configurations of four labeled particles grouped by left occupancy, compared with the all-left restriction
. Details. Removing a barrier changes the allowed set immediately, but it does not instantaneously randomize the actual probability distribution. Motion and equilibration must make those configurations accessible. The counting result illustrates the configurational contribution to free expansion; it does not describe the relaxation time or every contribution to the entropy of a real gas.
Boltzmann factor Created 2026-09-24 Updated 2026-10-06
At inverse temperature , the Boltzmann factor is the relative canonical ensemble weight of a microstate with energy .
Boltzmann's entropy formula 2026-10-14
Why does a gas spread through an available container? One part of the answer is counting: a nearly uniform macrostate can be realized by vastly more microstates than a macrostate with every particle crowded into one corner. Boltzmann's entropy formula turns that multiplicity into entropy. The useful insight is that a large entropy measures how many microscopic realizations fit a specified macroscopic description, rather than how untidy a picture looks.
For a specified macrostate containing accessible, equally likely microstates, writeHere is the Boltzmann constant, and is the natural logarithm, also written in this article's title. The count is dimensionless; entropy has units of energy divided by temperature. Always specify the macrostate, the constraints and the model's microscopic resolution before counting. A microcanonical ensemble provides a familiar equilibrium setting for the equal-probability assumption. [ref]
https://web.mit.edu/16.unified/www/FALL/thermodynamics/notes/node57.html. MIT, §7.4: equiprobable microstates and S = k ln Ω
The natural logarithm compresses an enormous count into a manageable number and makes products of counts into sums of entropies; see additivity of Boltzmann entropy. With this counting convention, one allowed microstate has zero Boltzmann entropy. This zero refers to the chosen model and resolution; it does not by itself assign an absolute entropy to a real material.
Canonical partition function Created 2026-09-24 Updated 2026-10-14
The partition function is the sum of the Boltzmann weights over individual microstates. Dividing by it makes their probabilities sum to one. When summing distinct energies instead, include the state degeneracy: . For two independent distinguishable two-level systems,The middle coefficient counts two microstates, exactly as in the preceding figure. For such units, ; this factorization requires additive energy and independence, and generally fails with interactions.
The usefulness goes beyond normalization. For fixed energies, derivatives of the natural logarithm of the partition function yield measurable quantities:Here is internal energy, the second expression is the energy variance, and is Gibbs entropy. For one two-level system at fixed , its heat capacity and entropy areAt , these give , and . For independent units, all three quantities add.
The figure shows why heat capacity peaks. At low temperature, the excited energy is rarely occupied; at high temperature, the probabilities are almost equal and further warming barely changes internal energy. The largest response lies between these limits, at , where . Meanwhile entropy rises from zero toward , reflecting two equally likely alternatives. This high-temperature limit belongs to the stipulated two-level system; extra accessible energy eigenstates would change it.
Entropy Created 2026-09-24 Updated 2026-10-20
Entropy is an extensive quantity and a state function of an equilibrium system, measured in . Differences between equilibrium states are calculated along a reversible thermodynamic process:Here heat entering the system is positive and is its absolute thermodynamic temperature. The reversible path used for calculation need not be the path actually taken. Dividing the actual heat by a single temperature generally fails for an irreversible process.
For example, put two rigid bodies, each with constant heat capacity , at and in an otherwise isolated system. Assume each body has a uniform internal temperature, no phase transition occurs, and no work is extracted. Their final thermal equilibrium is at , because the internal energy lost by one equals that gained by the other. Using entropy from heat capacity,so . One body's entropy decreases while the total increases. [ref]
https://web.mit.edu/16.unified/www/FALL/thermodynamics/notes/node41.html. MIT, Entropy changes and the hot-brick problem
In statistical mechanics, Boltzmann's entropy formula counts equally likely microstates compatible with a macrostate; Gibbs entropy handles a specified probability distribution over microstates. If the number of equally likely microstates doubles, entropy increases by . The logarithm makes multiplicative counts additive for independent systems. These are precise statements about states and probabilities, not a universal measure of visible messiness. Calling entropy merely "disorder" obscures the thermal calculation above and hides which microstates are being counted. [ref]
https://web.mit.edu/16.unified/www/FALL/thermodynamics/notes/node57.html. MIT, Statistical entropy and randomness
The usefulness of entropy is that measurable heat capacities determine its changes, and the Second law of thermodynamics turns those changes into constraints on processes. It also connects macroscopic measurements to microscopic descriptions without requiring us to track every particle.
Finite-size rounding 2026-10-14
Finite-size rounding replaces a limiting discontinuity or divergence by a finite crossover or peak. For a spatial system near a continuous phase transition, the bulk description ceases to apply unchanged when the correlation length becomes comparable with the sample size. How the crossover width and location depend on size also depends on the model, geometry and boundary conditions; there is no universal rule for every phase transition.
An exact finite example is the Curie–Weiss model with , , and a conjugate field in energy units. Set and . Its statistical Hamiltonian and finite partition function areThe binomial coefficient counts the microstates with positive Ising spins. The diagonal terms in the square add a configuration-independent constant to the energy; retaining them fixes the normalization used here. Divide each summand by to obtain the probability mass function of . In particular,The variance expression makes the finite response nonnegative, while spin inversion symmetry gives exactly at for every plotted .
Every curve is computed from the finite partition function, without selecting one minimum of the Bragg-Williams free energy of the Ising model. The field panel holds fixed and shows increasingly rapid switching between opposite spin magnetizations. The temperature panel uses : its nonzero measures the typical magnitude, while the mean spin magnetization stays zero. The reference marks the limiting critical temperature, not a singular point of any finite curve.
A short limiting argument explains the field panel. Combining the binomial coefficient with its leading entropy gives a Helmholtz free energy per spin whose stationarity equation is . For and the two ordered minima have , where . For large well below the critical temperature, their relative Boltzmann weight is approximately , giving . Thus this two-peak approximation has a field width of order in . It is not valid at the critical temperature, where the peaks merge; the figure uses the exact finite sum throughout.
Finite-system analyticity Created 2026-10-14 Updated 2026-10-20
For finitely many microstates with finite energies that are real analytic functions of a real control , the canonical partition function at is a finite positive sum:It and the resulting Helmholtz free energy are locally real analytic functions of and . Hence such a finite Ising model has no literal nonanalytic equilibrium phase transition. A limit of these real analytic functions can nevertheless fail to be a real analytic function; the narrow but smooth crossover can become a sharp phase transition.[ref]
1 From Spins to Fields. §1.2.1, discussion following equation (1.14): finite sums, analyticity, and macroscopic sharpness
Finite particle number alone is not the hypothesis of a finite sum. Classical phase space is continuous, and a system of quantum states can have infinitely many energy eigenvalues: its partition function requires convergence and local bounds that permit differentiation or an analytic extension of the integral or thermal trace. A divergent partition function, a singularly changed statistical Hamiltonian, or the zero-temperature limit falls outside the finite-positive-sum argument. Observing a steep change in a finite sample therefore motivates a limiting model; it does not measure an actual infinity.
Four-spin Ising ring Created 2026-10-18 Updated 2026-10-20
Take a cycle graph with four labeled graph vertices and four distinct edges . Set , , and impose periodic boundary conditions by writing . The square drawing represents a one-dimensional ring: it has no diagonal interactions and is not a two-dimensional lattice.
Call an edge between opposite Ising spins a domain wall. If is their number, the four bond products sum to , so the energy isEach domain wall costs relative to an aligned bond. Returning around the ring must return to the starting Ising spin, so is even: equivalently, . Choosing an even set of wall edges and then choosing determines the entire pattern. The state degeneracy is therefore , using a binomial coefficient.
| Domain walls | State degeneracy | Energy | Total Boltzmann factor weight |
|---|---|---|---|
The twelve middle microstates consist of eight patterns with one exceptional Ising spin and four patterns with two adjacent Ising spins and two adjacent Ising spins. The two alternating patterns have four domain walls. All microstates are shown below.
Writing , the partition function and the probability of each energy class areFor an original exact example, choose . Then , , and , , . Each aligned microstate has probability , each middle microstate , and each alternating microstate : multiply by state degeneracy before comparing whole classes. As , all sixteen microstates become equally likely, but the class probabilities approach . As , the two all-aligned microstates each have limiting probability .
Frustrated Ising triangle 2026-10-18
Take three Ising spins , with an antiferromagnetic interaction of energy scale on each edge of a triangle. An individually satisfied bond has . But multiplying all three bond products gives , whereas three satisfied bonds would give . At least one bond must therefore remain unsatisfied. This is an exactly finite example of geometrical frustration.
There are six ground states with one unsatisfied bond and ground-state energy . The two all-aligned microstates have energy . No interaction is switched off in a ground state: the system minimizes their sum by accepting one local disappointment. Allowing continuous three-component spins instead of Ising spins changes this optimization problem and permits the -degree arrangement described under geometrical frustration.
Writing for inverse temperature, the exact partition function and mean internal energy areAt these expressions are smooth: a finite triangle has no thermodynamic phase transition. In zero magnetic field, spin inversion symmetry also gives at every site, even as the Boltzmann distribution concentrates on the six frustrated ground states.
Heat bath Created 2026-09-29 Updated 2026-10-18
A heat bath, or thermal reservoir, is an idealized system so large that exchanging a finite amount of heat does not appreciably change its temperature.
The ideal heat bath supplies a fixed absolute temperature while its internal energy changes through heat transfer. A real body's suitability as a heat bath depends on its heat capacity relative to the exchange being studied, and on how quickly its internal temperature gradients disappear. Large physical size alone supplies neither condition. A finite heat bath makes the approximation quantitative; a regulated calibration bath instead uses feedback control to maintain its temperature by exchanging energy with external equipment.
For a weakly coupled system that exchanges energy but no matter with an ideal heat bath, the canonical ensemble assigns the Boltzmann distributionHere is a microstate's energy, the Boltzmann constant and the partition function. The fixed temperature removes the need to track every exchange with the environment. A substantially changing bath temperature no longer gives this one fixed Boltzmann distribution.[ref]
1 The Fundamentals of Statistical Mechanics. Statistical Physics, §1.3, printed pp. 17–18, equation (1.19): reservoir assumption and canonical probabilities
Ising model Created 2026-09-24 Updated 2026-10-18
The Ising model is a spin model with an Ising spin at every graph vertex . For a finite graph with vertex set and edge set , a uniform coupling and field parameter give the HamiltonianEach edge is counted once. Here is temperature, is the Boltzmann constant, and is inverse temperature; and have units of energy. For magnetic applications, includes the magnetic moment multiplying the applied magnetic field. The canonical ensemble assigns the Boltzmann distributionThe partition function makes the probabilities sum to one. Positive rewards equal neighboring Ising spins, modeling ferromagnetism; negative rewards opposite neighbors, giving an antiferromagnetic Ising model. Positive rewards , while negative rewards .[ref]
Statistical Physics by David Tong. §5.2, equations (5.192)–(5.194), nearest-neighbor energy, field convention and canonical partition function
A single local rule can organize a whole graph: rewarding agreement on each edge makes all-equal Ising spin patterns favorable even though no edge directly couples distant vertices. The four-spin Ising ring makes this visible with only sixteen microstates. It also separates three different questions: whether neighbors agree, whether the mean spin magnetization is nonzero, and how large its thermal fluctuations are.
A motivating experiment is the University of Colorado Boulder's Curie-temperature demonstration. An iron rod suspended from a twisting wire on a stand is initially held near a permanent magnet by ferromagnetism. A gas burner supplied from a propane cylinder heats the rod; the readout is its motion away from the magnet, followed by return as it cools. Repeated cooling supplies a reversible comparison on the same sample. The source explicitly calls for heating the rod while keeping the magnet cool, since heating the magnet can reduce its strength. The inference is that warming the sample weakens its magnetic attraction across the Curie temperature. This is a qualitative force readout, with no calibrated temperature or magnetization trace supplied: it motivates competition between alignment and thermal fluctuations, but does not identify , measure individual Ising spins, or realize a four-spin Ising ring.[ref]
Curie Temperature (University of Colorado Boulder Physics Undergraduate Labs). Curie Temperature, Purpose, apparatus Figure 1, and Magnet Positioning: suspended iron rod, propane burner, cooling return, and keeping the magnet cool
Ernst Ising's 1925 paper examined a linear chain of two-orientation magnetic elements with neighboring interactions. In its calculation for a large chain, the zero-field mean magnetization vanishes and the model has no spontaneous magnetization. The inspected English translation states this immediately after equation (8) in §2. This historical result concerns the chain; it does not establish the behavior of a two-dimensional Ising model.[ref]
Beitrag zur Theorie des Ferromagnetismus by Ernst Ising. Beitrag zur Theorie des Ferromagnetismus by Ernst Ising (1925), English translation, §2 The simple linear chain, energy (3′) and the paragraph immediately after equation (8)
Ising ring bond correlation 2026-10-18
The Ising ring bond correlation is the neighboring two-point correlation function in the four-spin Ising ring. All four edges are equivalent. At zero field each mean Ising spin is zero by spin inversion symmetry, so also equals the connected correlation function. Agreement gives bond product and disagreement ; thus .
Differentiating the finite partition function with respect to inserts the sum of four bond products. ThereforeHere is internal energy. At , the class-weight calculation gives and . The agreement probability for a selected bond is , despite the exactly zero mean spin magnetization.
A second derivative gives the energy variance, and hence the heat capacity at fixed and :To see the variance identity directly, a derivative of an expected value under weights inserts , where . The factor follows from . At the same exact example, . The heat capacity vanishes both as and as : at high temperature its dimensionless factor vanishes, while at low temperature excited microstates become exponentially rare.
Ising ring magnetization fluctuations 2026-10-18
Define the instantaneous spin magnetization . Global reversal sends to without changing the zero-field energy. Pairing every microstate with its reversed partner proves at every positive temperature, even when almost all probability lies on the two fully aligned patterns. A vanishing mean does not imply weak alignment: the limiting probability distribution is half at and half at .
The Ising ring magnetization fluctuations measure this distinction through variance. In the class, both patterns have . Among the patterns, eight have and four have ; the two patterns also have . ConsequentlyIt equals at , approaches for four independent fair Ising spins at , and approaches as . Unlike the energy variance, the spin magnetization variance remains large in the low-temperature symmetric mixture.
The same thermal fluctuation controls the field response. Allow to vary before setting it to zero; differentiating the Boltzmann distribution inserts , givingThis is a spin-normalized magnetic susceptibility with respect to the energy-valued parameter ; conversion to physical magnetization and magnetic field requires the magnetic moment and sample volume factors.
For finite , is a finite positive sum of exponential functions. Its free energy is a real analytic function for , so the smooth heat capacity peak here is not a critical phase transition. Spontaneous magnetization concerns the order of limits: first a thermodynamic limit, then removal of a symmetry-breaking field. The four-spin Ising ring alone establishes neither that limit nor any two-dimensional Ising model result.[ref]
Statistical Physics by David Tong. §5.2.3, paragraph beginning with the analytic finite partition sum: phase transitions require the thermodynamic limit









