Wire messaging app does this nicely, allowing to set the default time per conversation and showing a small non-distracting timer icon (progress bar) next to a message.