Even for Patrick, he did't get there over night and he is very good at his marketing. But the good news is that you can get there. I'd focus on the first customer. Getting that first customer is one of the best feelings ever. And the good news about SaaS, is that they stay with you. I still have my first customer paying me every month.
My thoughts were similar to yours going into it. I only need 500 customers and I'm set. I'm a long, long way off. The problem is not that there are not enough customers, the issue is reaching them. I have a ton of competition in my market, some good, some bad. I'm somewhere in the middle product wise and somewhere near the bottom half marketing wise. At my current rate of customer acquisition, it will still be a few years until I get there. But I keep plugging away.
Good luck!