Even if you had a magic box that could turn wafers into dies, you'd still need to be able to source the wafers, ensure an extremely clean environment, screen for imperfections/failures, and package the dies into chips which are robust enough to be handled, soldered, etc.
Some people like Jeri Ellsworth have managed to fabricate individual transistors in the garage, which is extremely impressive, but it's still a long way from there to a packaged integrated circuit.
One step at a time though, right?