There are limits to such growth. Arguably, the growth of last few centuries has been achieved by burning up finite resources [1]. And even if we'd somehow get an infinite source of energy, at some point we'd run into the heat dissipation limit of the earth. [2]
[1] http://www.inscc.utah.edu/~tgarrett/Economics/Physics_of_the... [2] https://en.wikipedia.org/wiki/Waste_heat