In which case you need to delineate your channels of access more clearly. Move your main communication to something more asynchronous (email, text, wechat/whatsapp, slack), set a time where things will be checked, and perhaps offer an emergency line over real-time messaging (phone calls fit the bill best).

Most things are not time critical, and a sizable portion of the things that are, are not mission critical.