I went from a note 3 to an s7. Like you I never really utilized the stylus, and even though I had 3 extra batteries for my note, I'm still mostly ok with the tradeoff.

The size of the phones is nearly identical.

As you mention, the only thing that I dislike is not having a hardware menu key.. but it's worth looking into as a decent replacement phone.