Unipotent Invariant Matrices