I don't know about the US, but German law has classes of knives you can only legally carry for purposes compatible with society. I am allowed to carry a leatherman for electrical work or to peel an apple, carrying that same knife for self defense or to play with it in front of the train station is illegal. You don't have to do anything, just carrying it in a suspicious context can be enough to have it confiscated.