You mean slave labor society right, if you can't expand the empire fast enough, you "human capital" stream dries up, its like taking on too much debt and not being able to keep up with paying.
Not ready to drop a book on HN regarding the nuance of Roman evolution just yet.