The problem is that building the entire warehouse to support automation from day 1 requires a lot of upfront costs that only the largest orgs can reasonably afford. And it's remarkably easy to screw up, such that the automation doesn't end up being all that effective or itself introduces inefficiencies. It ain't like software, either, where it's (comparatively) easy to refactor things; if you fuck up an automation project, it's gonna be stuck that way for years.
Besides, in my experience (as a professional in this exact field of warehouse / supply chain / fulfillment operations), the biggest gains are usually process-related, and adding robots doesn't really help. The average warehouse tends to have ridiculously inefficient processes, driven by clunky and cumbersome software. Things like aisle zoning / pick path planning (i.e. minimizing the distances pickers have to travel for average pick orders, and minimizing contention between pickers and replen), data entry automation (e.g. barcode scanners and computerized scales instead of manual data entry), precise and measured use of conveyors, etc. help maximize the return on every labor dollar spent. These things can all be done incrementally to good effect.
That is, to your point: throwing robots at an inefficient warehouse just gets you an inefficient warehouse full of robots. And yes, designing the warehouse from the ground up to support automation as efficiently as possible is a good idea, but focusing on human efficiency will get you 90% of the way there - and then you can spend the other 90% of that effort on whiz-bang software and droids ;)