That's not really true, most scammers have a male voice with a heavy accent. When they have tools that easily disguise their voice, scammers can reach many more elderly people.
Sample sizes of 1 are never representative but they definitely have full access to native speakers or tech that can generate very passable speech.