On the Diversity of Realistic Image Synthesis