Don't do that in your .bash_profile unless you run login shells on all of your terminals!

Setting HISTFILE propagates that setting to child shells - unsetting HISFILE does not.