I just discovered this today, but if you whisper to your Echo, it will skip all of the "by the way" BS (it will also reply in a whisper, which is kind of creepy, but you win some, you lose some).