Note that:
and for that to be true for all possible and then we must have:
i.e. the matrix inverse is equal to the transpose.
Conversely, if:
is true, then
These matricese are called the orthogonal matrices.
TODO is there any more intuitive way to think about this?