That's a good reason to have timestamps in the history, which you should.
Something like
export HISTFILESIZE=
export HISTSIZE=
export HISTTIMEFORMAT="[%F %T] "
shopt -s histappend
really ought to be default in bash.It's not as clear why you need it in the interactive prompt.