The Galactic Underworld: The spatial distribution of compact remnants