I think you should start with easy ones. IIRC kids take small tests in class every semester at elementary school (like 50-150 kanjis per test). Those kanjis are the easy ones and then you can build up. So learning kanjis you find on a newspaper or a novel might be too hard. Understanding those words in real life context requires you to have higher language skills anyway (e.g. understand economy news or whatever in Japanese).

On a slight side note, kids can't even write their own names in kanji. You can imagine how happy we got when we were taught kanjis that were part of our name. So you shouldn't feel bad about it, taking small steps serve you well in the long term.