3-D CMZ IV: Distinguishing Near vs. Far Distances in the Galactic Center Using Spitzer and Herschel