Dissecting the role of initial collision geometry for jet quenching observables in relativistic heavy ion collisions