Finitism sounds like a good idea actually because Mathematicians have a terribly bad habit of playing with infinity when they could be doing real work :)
Infinity simplifies mathematics _a lot_ in proving things from the basics of calculus (i.e. analysis).