Updates for existing users while App not visible in App Store

Due to some problems with my app, I would like to make it "invisible" in the App Store for a while to stop acquiring new users, but I would like to be able to publish bugfix updates for the existing users.

Is this possible somehow?