Experimental investigation of delayed self-interference for single photons