Restricted limits of minimal affinizations