What he's saying is that by "infinite," people usually mean "arbitrarily large". I've found that if you just say "arbitrarily large" when that's what you mean, it eliminates a lot of these misunderstandings.
Of course, I talk to a lot of engineers and mathematicians. You run the risk of sounding unnecessarily pedantic.