The spectral weight of hole doped cuprates across the pseudogap critical point