Try a SheevaPlug. Its a little ARM with a full-on debian install. About $80.
http://en.wikipedia.org/wiki/SheevaPlug
Or if you're into x86 try something from pcEngines. A bit more expensive, but no crosscompiler required to build packages on your desktop.