Improved rate-distance trade-offs for quantum codes with restricted connectivity