If we were to "just stop growing", it would pretty much collapse the entire civilization on the spot. Unfortunately, the assumption of growth is the basis of not just the economy, but a lot of things in the society.

Sure, I think we should move away from the growth-based economy. But this needs to be a gradual process.