Everything is finite when you have a fixed amount of information and mass in the universe. That doesn't mean the common economic definitions of wealth are useless. The act of creating capital such as a piece of art, a new algorithm, or a manufacturing tool all change the total amount of wealth in the world.

Information is also amost certainly bounded. In humans it's limited by the rate of transmissibility -- if what the next generation has to learn is greater than what the present generation can pass on, knowledge will be lost.

Given various inefficiencies of educational institutions, this is all but certain to be occurring as we speak. There is a notion of a "forgetting curve".

And, as you note, information can at best asymptotically achieve some maximum theoretical efficiency. It's not a limitless fount of potential.