The size of mirrorless cameras is only one benefit, and there's no particular reason that a mirrorless camera couldn't have a big Nikon D5 style battery if there was a market for it.
I don't see any particular reason that mirrorless cameras won't completely replace SLRs in time, a mirror is no longer neccessary, like it was for film. No one would make a new SLR system if they were starting now, and they haven't, all the new mounts are mirrorless.
I don't love the menu system either and I really wish they could have figured out a way to get ISO on a top dial.
That said, the X-E3 has a lot of appeal. Especially with its pancake lens, its feel reminds me a lot of various rangefinders I used to use and it's much more responsive than the X-E1 I used to use. I'm less of a fan of the more SLR-looking form factors.