Coverage function 2026-11-05
A coverage function assigns a value to the union of objects covered by a selection. Let index sets in a finite universe . The unweighted version isA weighted coverage function gives each a nonnegative weight and sums those weights over the same set union. Its value is zero on the empty selection and cannot decrease when more sets are selected.[ref]
The submodular set function property follows from an explicit marginal calculation:If , the objects still uncovered after form a subset of those uncovered after . Nonnegative weights therefore make the gain no larger after : precisely the diminishing returns property.
Francis Bach 2026-11-05
Francis Bach developed a convex-analytic treatment of submodular set functions and their applications to machine learning. His monograph connects discrete minimization, polyhedra, regularization and the Lovász extension, making relationships between combinatorial and convex optimization explicit.[ref]
For a finite ground set, submodularity is equivalent to diminishing marginal returns: adding an element to a smaller set gives at least as large a gain as adding it to a containing set. A coverage function illustrates this because objects already covered cannot contribute new coverage. The same structural property can support both direct selection problems and continuous optimization formulations; the modelling objective determines which connection is useful.
Lovász extension 2026-11-05
For a set function with , sort the coordinates of as , and put . The Lovász extension isTies do not affect the result, because equal-coordinate terms telescope. At an indicator vector it gives , so it extends a discrete objective to a piecewise linear function on a vector space.
For when and zero otherwise, . More generally, the extension is a convex function exactly when is a submodular set function. This equivalence is what makes the construction useful: a diminishing-returns condition on subsets becomes a geometric property on real vectors.[ref]
Learning with Submodular Functions: A Convex Optimization Perspective by Francis Bach. Chapter 3, definition and convexity characterization
Submodular set function Created 2026-10-06 Updated 2026-11-05
A set function is submodular whenfor every . For finite , this is equivalent to diminishing returns:The marginal increment of an element can only decrease as the surrounding set grows.[ref]
Learning with Submodular Functions: A Convex Optimization Perspective by Francis Bach. §2.2, Proposition 2.2: equivalent first-difference condition on the finite ground set
For necessity, apply the defining inequality to and . Conversely, enumerate and compare adding its elements to with adding them to . Summing the marginal inequalities gives .
A coverage function is an example: counts the covered objects in a finite universe. An added contributes only objects not already covered, so its gain decreases with . Entropy submodularity is another fundamental example.
Weighted coverage function 2026-11-05
A weighted coverage function assigns nonnegative weights to members of a finite universe , lets each choice cover a subset , and values a selection byAn item covered twice is counted only once. If , and the weights are , then , and .
Its marginal gain of a set function is the total weight of newly covered items. As the selected set grows, fewer uncovered items remain, so the marginal gain of a set function can only decrease. This proves that a weighted coverage function is a monotone submodular set function. Nonnegative weights are essential to this argument. The construction models selecting sensors or experiments whose observations overlap.[ref]