Your passport is checked when you leave the U.S. It’s done electronically though, so if your passport is clear you don’t even notice it when you leave (unlike say the exit Visa stamp you get in Schegen countries). If your passport comes back flagged when you’re leaving the U.S. the FBI or Marshall’s or whoever can apprehend you.