In my career it hasn't mattered if I'm cleaning bathrooms or building Software used by millions of people IF I'm doing it with people I enjoy being around. The people you work with will make or break your career, and (this will be shocking) if you're smart and like working on hard problems you'll end up wanting to be around people who are like that... so choose your direction based on the people.