Pick a framework and order some devices / components. I was attempting to get into this but never got beyond toying around with GPIO on the Beaglebone. You just have to start getting the equipment and dive into it.
I'm also wondering where people interested in this stuff gather, and where some of the better tutorials / blogs / books are.
You're right though, I need to just start putting parts together.