> and most of that payment going towards my saving

For the first several years at least, most of the mortgage payment goes to interest and taxes, not principal, and is "wasted" in much the same way rent is.