Direct baryogenesis in the broken phase