A dichotomy in classifying quantifiers for finite models