On the interplay of adversarial robustness and architecture components: patches, convolution and attention