If your engine doesn't need to render objects outside the viewport, then you don't need to generate those objects until you actually need to render it.