Ehrenfest breakdown of the mean-field dynamics of Bose gases