The Simons Observatory: impact of bandpass, polarization angle and calibration uncertainties on small-scale power spectrum analysis