That's only a problem if you use code that is unsound. Well-written crates do not incorrectly mark functions safe.