Small solar system objects on highly inclined orbits: Surface colours and lifetimes