All phones have undeletable apps provided by their manufacturers. For example, on iPhones you cannot delete Messages, Phone, Safari, Clock, Photos, Health, App Store, and Camera in a conventional way.
Not much of a phone without a phone app.
But Apple does sell an iPhone without a Phone app. It's called an iPod.