Dust growth in the interstellar medium: How do accretion and coagulation interplay?