Networking and contacts (and I mean legitimate networking) really play a big part in your overall success.
I'm in a large city, but nothing like NYC or the Valley either.
| I mean legitimate networking
Networking and relationship building is huge. I got laid off from my previous $DAYJOB back in Jan '12. I showed up at the office at ~9:30am, got called into my manager's office almost immediately, left by 10:00am, made 2 phone calls from my car on the way home... by ~3:00pm that afternoon I had a new job all but lined up (had to interview and everything as a formality, but the job was essentially offered already).
Why? Because I take networking seriously, get to know a lot of people, participate in a lot of groups, do some public speaking, organize Meetups, etc., and more than a few people in my area know who I am and what my skills are. And I also knew exactly who was looking for the same reasons. So the 2 phone calls I made were extremely targeted, as I specifically knew those firms were looking to hire.
Now it might not always work out that way, but I absolutely endorse the idea that networking is crucial.