Binary entropy product inequality Created 2026-09-24 Updated 2026-09-24
For , the binary entropy and the golden ratio satisfy
On the doubly infinite ladder graph, self-avoiding walks from a fixed graph vertex using only rightward or vertical steps are in bijection with words in containing no consecutive symbols. Their count is , since , , and . Its exponential growth rate is the golden ratio.
Generating function Created 2026-10-07 Updated 2026-10-14
A generating function packages a sequence into a series so that operations on objects become operations on their encodings. An ordinary generating function uses the power series ; in counting problems, the coefficient records the number of objects of size . The variable initially marks size: it need not be assigned a numerical value. Coefficient extraction writes this recovery as . One compact expression can therefore answer infinitely many counting questions, while explaining how their answers fit together.
Start with two contributions: choose from and from , with exactly one option at each allowed value. Their individual ordinary generating functions are the polynomials and . To count ordered pairs by total , multiply:
The coefficients count the ways to obtain totals zero through three. For total two, the possibilities are and ; the two corresponding monomials both contribute . There are six ordered pairs altogether, agreeing with .
Figure 1.
Polynomial multiplication groups six ordered choices by their total contribution
. Details.
If the first contribution has two distinguishable choices when , replace by . Its product with becomes . The coefficients now carry multiplicities as well as possible totals; the exponent still records cost. This lets the same construction handle several actions with identical costs without losing their separate identities.
In general, the Cauchy product gives
For each split of the total size, the rule of product counts the choices of the two components; summing over those splits counts all possibilities. This requires each combined object to have a unique decomposition into the two components. The same idea works for costs, lengths, or other additive measures, not just the number of pieces. See MIT 18.310, generating functions, sections 1–2.
Now cover a board of length with tiles of lengths one and two, without gaps or overlaps. Let count these tilings. There is exactly one empty tiling, so , and . Removing the first tile leaves a board shorter by one or two, giving the recurrence relation
These are the Fibonacci numbers shifted by one index: under the convention , . Keeping the empty tiling is essential to both the counting rule and the resulting ordinary generating function.
Figure 2.
Length-one and length-two tiles give five coverings of a length-four board and the Fibonacci recurrence
. Details.
For , the empty board or a first tile followed by a remaining tiling gives
Equivalently, : each factor chooses one tile, and counts pieces while the exponent of records total length. The same ordinary generating function counts ordered histories of two repeatable actions costing one and two units. Histories and differ despite having the same total cost. MIT's notes use dots and dashes with these costs, including the empty message. [ref]
These identities hold in formal power series algebra: each requested coefficient uses only finitely many contributions. The repeated-choice expansion is legitimate because has zero constant term; a zero-cost repeatable action would allow infinitely many histories of the same size. Numerical evaluation separately requires a convergent series. Here the radius of convergence is , the reciprocal of the golden ratio. At , the rational function equals , but the counting series diverges: that value cannot represent its sum.
Other generating functions change the encoding: an exponential generating function divides by factorials, while a Dirichlet series uses . A counting generating function also differs from a probability generating function, whose coefficients must be nonnegative and sum to one.
When each variable appears in at most one normalized singleton clause, satisfy that favored literal with probability and choose independent variables. Every proper binary clause is then satisfied with probability at least , and every singleton with probability . Maximize the common lower bound by , giving the reciprocal of the golden ratio. The method of conditional probabilities derandomizes the construction, obtaining approximation ratio . Tautologies are harmless; the singleton restriction must be applied after removing repeated literals within clauses.
Represent the doubly infinite ladder graph by , with horizontal edges between successive columns and a vertical rung at each column. An allowed self-avoiding walk is coded by a word in . Two successive steps revisit the preceding graph vertex and are forbidden. Conversely, every word without consecutive steps is a self-avoiding walk: horizontal steps strictly increase the column, and a column is visited vertically at most once. This establishes a bijection, not merely an upper bound.
For the directed ladder self-avoiding walk count, , , and for a word either ends in , or ends in . Removing that final block gives
Let be the golden ratio, and . The Binet formula for the Fibonacci number yields
Since , taking th roots gives . This use of the golden-ratio symbol is independent of the connection rate in Question 1.
When , the argument of the inverse hyperbolic sine is large. Using gives
The mass remains the zero-temperature gap, with an exponentially small correction from thermally activated excitations.
When , expand around . If
is the golden ratio, then , and
The leading value is universal. This is the quantum-critical regime: temperature is the only leading energy scale and the correlation length is of order .
Let
where is the golden ratio. If the union-closed family consists of one nonempty set, any element of that set has frequency one, so assume its cardinality exceeds one. Choose independent uniform members and let be their characteristic vectors of sets. Then .
Suppose for a contradiction that every element has frequency . Put , and let , the characteristic vector of a set of . The chain rule for information entropy and conditioning reduces entropy give
because is a function of .
Fix the two prefixes and set
The two conditioned bits are independent random variables, and exactly when both are zero. The supplied binary entropy product inequality therefore gives
Averaging over the independent prefixes yields
whenever either conditional entropy is positive. Summing and using gives .
But set union keeps inside the union-closed family, so is supported on . The maximum entropy distribution on a finite set gives , a contradiction. Some element must therefore occur in at least members, proving the entropy bound for a union-closed family.