Connectivity of $3$-distance graphs