I've messed around with golf for about a year or two before getting serious this summer. Lessons made the biggest improvement. After I had a rough idea from the lessons, reading really made me understand the hows and whys.

This should help you on your way: If there are any golf courses around you, check their clubhouses for a local pro. There's usually someone around giving lessons.

This is where you need to spend the most money. Buy 5 or 10 lessons. Learn the fundamentals first, dont worry about distance, worry about contact.

Do this instead of a "craigslist deal". You'll be sure to get sound advice from someone who really understands the game.

For clubs, buy used or secondhand. These will last you until you either fall in love with the game or give it up and something else.

Suggested reading would include:

    Five Lessons: The Modern Fundamentals of Golf — Ben Hogan
    Harvey Penick's Little Red Book: Lessons And Teachings From A Lifetime In Golf — Harvey Penick
    Golf My Way: The Instructional Classic — Jack Nicklaus

If you want to try it out in a less intimidating environment, check out your local Par 3 course.

They're usually pretty low-cost and only 9 holes. As someone who enjoys playing golf, but doesn't have it as a top priority to get better at, 18 holes of a real course can be exhausting and frustrating if I'm not playing well. 9 holes on a par 3 can be over in less than an hour.