An Arduino kit is a good starting point. You can get some starter kits with excellent tutorials for $50 or less.

Arduino gets you quickly up and running, without spending days fiddling with compilers and settings just to get something working.