This is a fine and defensible (although not mainstream) viewpoint with several adherents among mathematicians and various levels of success in making it formal and precise.
See e.g. https://en.wikipedia.org/wiki/Finitism
Doron Zeilberger would like to pat you on the back.