Finding of a population of active galactic nuclei showing a significant luminosity decline in the past $\sim 10^{3-4}$ yrs