Spectral convergence of graph Laplacians with Ricci curvature bounds and in non-collapsed Ricci limit spaces