1. Network of your friends and ex-colleagues. Meet or call them to say that you are available. They or someone on their network is likely to have some work available. This is your best bet for the first gig.
2. Meet people at networking events.
3. Ask from your earlier middlemen if you can use "non-real" gigs as a reference on your website. "Together with Company X, I helped to build Y for company Z."
4. Be ready to do your first gig way below your price. And do it well. It's really valuable to have one gig under the belt.
5. Pick a niche. If you build just websites, there are several established small web development companies in your area. But if you build websites for lawyers, or build iPhone-versions of an existing websites, you have a better change to become a name that is recommended when people are looking for a right person for the job.
6. Do something small but visible as a spare-time project. It doesn't need to be on your niche, but something that other techies in your area appreciate.
The client has to have a trust that you are the right guy for the job. To get people calling you instead you calling them, you have to build that trust over the time. But you can shortcut it somewhat when people that already know you recommend you to someone.