Phantom fluid cosmology: Impact of a phantom hidden sector on cosmological observables