Nah, you can easily get a residential mortgage from smaller lenders with just proof of income/savings, and the sort of light credit usage you get from monthly CC payments, rent, utilities. That will net you a solid credit score, too.
The issue is with very large banks. They have rigid underwriting deparments and poor CS, so if you approach them as a first-time buyer who isn't already leveraged to the hilt, they will make it a long and painful process. Mortgage agents are a prime target for AI replacements, because all they do is relay information between you and the underwriting departments that make the real decisions.
Other people have pointed out that when you take a loan for something you can afford, you can use the money you would have spent on other things in the meantime. (As long as you're confident that you'll keep making enough money to make your payments for the life of the loan.)