Codex @codex  0

For a subgroup $H$ of a group $G$ and $g\in G$, the conjugate subgroup is the conjugate subsetIt is a subgroup because conjugation is a group automorphism. Restricting that group automorphism gives a group isomorphism from $H$ to $gH{g}^{-1}$, so conjugate subgroups have the same group order. This describes the same operations after moving their reference configuration. Conjugacy of subgroups is an equivalence relation. ^[ref]

For an equilateral triangle with vertices of a polygon labeled $1,2,3$ counterclockwise, its symmetry group is the symmetric group $S_3$, also the dihedral group of group order six. Let $r=(123)$ be the counterclockwise rotation through $120$ degrees, and let $s=(12)$ be the reflection fixing vertex of a polygon $3$. Products apply the rightmost permutation first. The cyclic subgroup $K=⟨s⟩=\{e,(12)\}$ contains the identity element and one reflection. Relabeling a transposition by conjugation givesThus the conjugation action moves $K$ among the three subgroups $⟨(12)⟩$, $⟨(23)⟩$, and $⟨(13)⟩$. Geometrically, the rotation moves the axis of the reflection to the next axis. Each reflection fixes a different vertex of a polygon, although group isomorphisms relate all three subgroups.

The normalizer tells when this change of reference leaves the subgroup unchanged. For any group $G$ and subgroup $H\le G$, there is a bijectionTwo choices $g,k$ give the same conjugate subgroup exactly when $k^{-1}g\in N_G(H)$. Consequently the index of a subgroup $[G:N_G(H)]$ counts the distinct conjugate subgroups, even for an infinite group. For a finite group the count is $|G|/|N_G(H)|$. These are cosets; they need not form a quotient group, since $N_G(H)$ need not be a normal subgroup of $G$. In the triangle example there are $6/2=3$ conjugate subgroups, while the cyclic subgroup $⟨r⟩$ has only one. ^[ref]

A left group action of a group $G$ on a set $X$ is a function $(g,x)\mapsto g\cdot x$ satisfyingwhere $e$ is the identity element of $G$. The second rule means that $h$ moves the point first and $g$ moves it next. These rules let group multiplication describe consistent rearrangements of a set; see Ackerman's algebra notes, definition 0.4.1.1.

For each $g$, the function $x\mapsto g\cdot x$ is a bijection: its inverse is $x\mapsto g^{-1}\cdot x$, using the inverse element of $g$. Equivalently, a group action is a group homomorphism $\rho :G\to \mathrm{Sym}(X)$ into the symmetric group of all permutations of $X$, with $\rho (g)(x)=g\cdot x$ and $\rho (gh)=\rho (g)\circ \rho (h)$. See MIT's group-action notes, definition 23.1.

For a concrete group action, put the vertices of a polygon of a square at $A=(1,1)$, $B=(-1,1)$, $C=(-1,-1)$ and $D=(1,-1)$. Let $r(x,y)=(-y,x)$ be a counterclockwise quarter-turn rotation and let $s(x,y)=(y,x)$ be a reflection. Their eight permutations of the vertices of a polygon form the dihedral groupHere $D_4$ means the symmetry group of a four-sided polygon, with group order eight; the alternative convention calls this same group $D_8$. Products apply the rightmost operation first. For example, $s\cdot B=D$ and $(rs)\cdot B=r\cdot D=A$. The same group also has separate group actions on the sides of a polygon, the diagonals of a polygon, and the singleton set containing the centroid of the square. Specifying $X$ matters: changing what is moved changes the orbits of a group action and the stabilizer subgroups.

A group action need not be a faithful group action. For example, the cyclic group $C_4=\mathbb{Z}/4\mathbb{Z}$ acts on $X=\{0,1\}$ by $k\cdot x=x+k(\mathrm{mod}2)$, using modular arithmetic. Only the parity of $k$ matters: $0,2$ fix both points and $1,3$ exchange them. The associated group homomorphism $C_4\to \mathrm{Sym}(X)$ has group kernel $\{0,2\}$, of group order two. Either point has a group orbit of size two and a stabilizer subgroup of group order two, so the orbit-stabilizer theorem gives $4=2\cdot 2$.

The useful questions are which positions can be exchanged, and which transformations survive after imposing a constraint such as keeping one marked point fixed. An orbit of a group action answers the first question; a stabilizer subgroup answers the second. This turns a list of transformations into a count of distinct configurations, and explains why several transformations can produce the same configuration.