There are serious obstacles to this. The "freedom to redistribute copies" and "freedom to modify" aspects of Free software really don't translate well to hardware. There is unavoidable work and cost associated with copying a board, and much more associated with copying an ASIC (modified or otherwise). It's simply not going to be within the reach of the average user in the forseeable future.
What you might get is crowdfunded hardware, but that requires reasonable demands from the target market.
See this discussion http://electronics.stackexchange.com/questions/61873/why-is-...