To expand on the banking scenario: If you get a call about a stolen/lost credit card don't call the number back (or use a number the caller provides.)
Instead lookup the fraud/accounts contact number for the bank and call them yourself. - aka start the interaction with known good information