but what about human intellingence, clearly it does not require infinite anything.
also, what about accumulated 'memory' in our human culture? how finite is that? how do you quantify this? (I'd think it'd be quantified by a timestamp, like a reference to an era or an historic age?? shrug)
> How to define an abstract neural network with some explicit memory component, which can grow to infinite sizes?
I think "culture" is the answer.. but maybe I actually mean a free "natural language" (in contrast with a formal (or synthetic) language)