Modified coherence of quantum spins in a damped pure-dephasing model