Go work in something that interests you, and watch for opportunities. Uber and Flexport are proving that Vanderbilt was right, and transportation is still sexy. For myself, I like finance. There's plenty of room in healthcare, especially senior care, education, security... I think for the best ideas, you have to know something. The lightning bolt out of the clear blue sky to twenty-year-olds with no life or work experience is probably played out.
When you find common/repeated gaps, problems, and frustrations, stop and look at them. If you care about the problem, find out who else has it, what alternatives there are, what it takes to get a MVP to solve the first 80% of the problem.
I have had some ideas in the past that would have solved one of my problems, but they are very rare.
Try having less of a routine, not in terms of schedule but of habits --
Entropy is the crux of creativity.
I've considered making a "life randomization" app to add perturbations to my own habits. So if you solved your own problem, which is also one of mine, you'd have at least one user.
Just a thought.
Another strategy is to look for large problems in your industry that have been solved and then try to find analogous problems in other industries where the same or a similar solution could work.
For our startup, my co-founder and I went and talked to friends and contacts of mine in medicine and generated a list of 15 or so things we thought were everyday pain points for many individuals. We then shelled out some money and went to an industry conference to field test them. It turns out that all of them were being actively worked on, but while we were exploring them we stumbled upon another idea which is now the basis for our startup.
I described what I was working on, what research I did on those industries and that I was looking to better understand the existing problems that might fit what I was interested in.
Some conversations did not lead anywhere, other times I got excellent, tactical, advice. That gave me more information and ideas, until I landed on my current project.
The reason this approach worked for me this time (as opposed to the other times I've tried this) is that I had a direction I was presenting and I did a bunch of research to get educated about some of these industries. I don't mean I studied it for some long time, but reading related subreddits, searching for conferences and looking up sponsor companies from that, learning some terms specific to those industries, etc. helped to have a better conversation.
While YMMV, getting warm intros to smart and successful people for a 15-20 minute phone conversation will expose you to what you don't know yet. This will result in you asking better questions, which can lead to more ideas.
Though I did start out with an idea that I flushed out by talking to people in the industry.
Would love to hear more about your experience, let me know if you have time to compare notes.
Let us have it! And please add your email in profile
One fairly effective way is to focus on problems, nuisances, frustrations, or pain points. What do people/groups/companies dislike, hate, etc? What can be improved on? What wastes resources that could be made more efficient? Someone will usually pay for something that solves a problem.
You don't necessarily need an original idea, often it's just a matter of doing the same thing others are already doing, but better, or cheaper, or differently. Many people get stuck on coming up with some unique idea, when in reality most businesses are not doing anything particularly unique at all.
I have started a number of blogs in response to apparent demand for information I know on various subjects. Even that has been very challenging in terms of trying to figure out how to best serve the needs of other people, turn it into a business model, etc. I have "pivoted" repeatedly in certain problem spaces. I might have a few things that don't completely suck at this point. ;-) But, I am still sorting out how this becomes some kind of meaningful income stream, etc.
Best.
For example, an app for tracking expenses vs income => business owners tracking expenses => expenses in a business => selling tight integration into a POS (where the income happens) => startup about POS systems that integrate into your slick app (and yeah that exists)
Edit: the Google now lists at least 6