Generalized Gravity I: Kinematical Setting