There are plenty of hardware startups, you just don't hear about them a lot. The AVR (used in Arduino) was designed by a few guys from Norway, which sold their idea to Atmel.

The development costs are higher, but with some investment it's certainly possible for a small startup to create new CPUs and GPUs. Gaining market share is more difficult which often necessitates a huge established chip company as a backer.