This is exactly why I experiment with pen and paper combinations every now and then trying to find something I like. I find the act of note-taking very beneficial, both for work and for self-study of math, CS, programming, etc. Just writing my thoughts down solidifies things a bit better, so encouraging that by making the writing enjoyable is what I've strived for.
I don't even spend that much, just allowed myself to pitch what didn't work and find something I like. My current favorite combination is National Brand Computation notebooks ($12) which I like for being quite large at nearly 12"x10" and having thick smooth paper and the largest (08) Pigma micron pens ($2) which are almost like felt tip markers. It almost feels like writing on a whiteboard.
Of course, what I like specifically isn't that important, but I definitely recommend experimenting with pen and paper if note taking is something you want to encourage yourself to do.