I seem to be protected from most of these types of scams because I never answer the phone unless the number is known. If it is important they will leave a voicemail.
Yes caller ID can be spoofed, but it’s not as easy as it used to be, and a lot of spam call appears to have moved to overseas numbers.