Spectral Lower Bounds for Local Search