Scope of Boltzmann's entropy formula 2026-10-14
The strings in Boltzmann entropy of a two-box occupancy are complete microstates only within the binary toy model. They retain a coarse-grained variable for each particle and omit its exact position within a box and its momentum. An actual classical gas instead occupies continuous phase space; obtaining a dimensionless count from a phase space volume requires a specified cell convention and the appropriate treatment of particle identity. A quantum state count must respect the allowed quantum states and quantum statistics. Thus is not a general count of microstates for a gas obeying quantum ideal-gas statistics. [ref]
https://ocw.mit.edu/courses/8-333-statistical-mechanics-i-statistical-mechanics-of-particles-fall-2013/0cdb670a825c6aaea7e229ac40776cbf_MIT8_333F13_Lec13.pdf. Kardar, MIT 8.333 (2013), lecture 13, §§IV.D–E: gas phase space and particle counting
For a discrete probability distribution with unequal weights, use the existing Gibbs entropy article; its equal-weight case gives Boltzmann's entropy formula. Shannon entropy uses the corresponding information measure, with the logarithm base setting its units. A count alone cannot replace the specified probability distribution, as the Boltzmann distribution examples demonstrate. [ref]
https://web.mit.edu/16.unified/www/FALL/thermodynamics/notes/node56.html. MIT, §7.3: statistical entropy for general microstate probabilities
Overwhelming multiplicity explains why thermodynamic equilibrium is overwhelmingly probable in macroscopic systems under the appropriate statistical assumptions. It does not make low-entropy thermal fluctuations logically impossible. Nor does counting alone derive irreversible macroscopic evolution: one also needs dynamics, an initial preparation, and a reason the system samples the allowed microstates on the timescale of interest. [ref]
https://ocw.mit.edu/courses/8-333-statistical-mechanics-i-statistical-mechanics-of-particles-fall-2013/0cb99318c2ed889316cdcff839759e8d_MIT8_333F13_Lec12.pdf. Kardar, lecture 12, §§IV.A–B: statistical equilibrium and the limits of counting arguments
Historically, Boltzmann's 1877 paper counted microscopic arrangements, called complexions, and related the natural logarithm of their number to entropy. The Sharp and Matschinsky translation appeared in Entropy 17 (2015), pages 1971–2009, DOI 10.3390/e17041971. Its notation differs from ours: Boltzmann's permutability measure is already logarithmic, whereas here is the count. [ref]
https://gilles.montambaux.com/files/histoire-physique/Boltzmann-1877-entropy.pdf. Boltzmann (1877), translated by Kim Sharp and Franz Matschinsky (2015), §III after equation 34 and §V
Josiah Willard Gibbs's Elementary Principles in Statistical Mechanics (1902) developed the statistical ensemble framework; Chapter XIV compares several statistical definitions of entropy with thermodynamics. [ref]https://en.wikisource.org/wiki/Elementary_Principles_in_Statistical_Mechanics. Gibbs (1902), title page and preface
[ref]https://en.wikisource.org/wiki/Elementary_Principles_in_Statistical_Mechanics/Chapter_XIV. Gibbs (1902), Chapter XIV: discussion of thermodynamic analogies
Single-orbital interacting defect 2026-10-20
An isolated spin-degenerate orbital coupled to a particle reservoir has Hamiltonian . The four occupation microstates have weights , where and . Thus and . The factor two counts distinct spin states. At the grand partition function factorizes into two independent fermionic orbitals; positive U separates the two electron-addition thresholds.
Spin overlap 2026-10-18
For two spin configurations on the same sites, their spin overlap is when they agree everywhere and when they are opposite everywhere. Two independent canonical ensemble draws must use the same quenched disorder. Otherwise their comparison mixes changes of thermal state with changes of material sample.
An original finite example uses the six equally weighted ground states of the frustrated Ising triangle. For each first configuration, the second has one identical choice, one fully reversed choice, two choices differing at one site and two differing at two sites. Thus the probability distribution of spin overlap isIt is symmetric, with but . At infinite temperature, all eight microstates are equally probable and instead . This computable change in similarity statistics is a finite-model fact, not evidence for replica symmetry breaking.
State degeneracy Created 2026-09-24 Updated 2026-10-13
This counts microstates sharing a macrostate; when the shared quantity is energy, it gives the multiplicity of degenerate energy levels. The degeneracy of a macrostate labelled by is the number of distinct microstates having that value of .
Statistical ensemble 2026-10-14
A statistical ensemble describes hypothetical copies of the same system under specified constraints, with a probability distribution over their microstates. An ensemble average is an expected value across those copies. The canonical ensemble fixes temperature and particle number while allowing energy exchange; the microcanonical ensemble fixes energy, and the grand canonical ensemble also allows particle exchange. These choices specify different physical preparations. [ref]
https://en.wikisource.org/wiki/Elementary_Principles_in_Statistical_Mechanics. Gibbs (1902), preface: ensembles of systems with different microscopic conditions
Statistical mechanics 2026-10-13
Statistical mechanics connects microstates to macrostates through probability distributions. Its microcanonical ensemble, canonical ensemble and grand canonical ensemble specify different constraints on exchanges with the surroundings. An ensemble average describes repeated preparations under those constraints; it need not be the value in every individual preparation.
This makes the subject useful whenever tracking every microscopic detail would obscure the question being asked. To predict a heat capacity, we need how the expected value of energy changes with temperature, rather than a record of every unit's state. The partition function packages that calculation into one reusable object.
In his 1902 book, J. Willard Gibbs systematically developed the canonical ensemble. His preface contrasts following one system through time with studying a collection of systems with different microscopic conditions. Chapter IV defines the canonical ensemble through an exponential function of energy and establishes its normalization. This supplied a general strategy for predicting collective measurements by averaging over possible microscopic conditions, with the partition function organizing the calculation. [ref]
https://en.wikisource.org/wiki/Elementary_Principles_in_Statistical_Mechanics. Gibbs, Elementary Principles in Statistical Mechanics (1902), preface
[ref]https://en.wikisource.org/wiki/Elementary_Principles_in_Statistical_Mechanics/Chapter_IV. Gibbs (1902), Chapter IV, equations 90–93
Statistical physics Created 2026-09-24 Updated 2026-10-13
Statistical physics explains collective behavior using probability distributions over microscopic possibilities. Its central surprise is that incomplete microscopic knowledge can still produce precise predictions for internal energy, entropy and heat capacity. The bridge is statistical mechanics: specify the available microstates, assign their probabilities, then compute the expected values of measured quantities.
A two-level system already displays the idea. Warming it makes its higher energy more likely; its heat capacity first rises, then falls as the two probabilities approach equality. With two distinguishable units, merely counting microstates explains why the middle energy has twice the state degeneracy. These small examples expose the machinery before the much larger sums needed for a photon gas or an Ising model.
The appeal is economical: the same microscopic energies and probabilities explain both an average reading and its variance. A measurement's spread therefore becomes useful physical information rather than an inconvenience to discard.