On the microscopic basis of Newton's law of cooling and beyond