What does the N-point function hierarchy of the cosmological matter density field really measure ?