+1 to learning a little bit of Vim, but I'd say buffers aren't necessary to get a passable experience. At least for casual SSH purposes.
Never been able to get the hang of tmux though. I know it's super powerful but I feel like in constantly fighting it. Though even just screen for keeping multiple console sessions alive at a time is super helpful even if I only use one at a time.