Wallets contain money, driving licenses and credit cards and such. USB drives may contain peoples lives, incriminating information, pictures that you wished you had not seen, state secrets and so on. Once you read that data you move yourself into a position of some responsibility and then your question is a harder one than the one that you asked above.
That's why I'd destroy the stick if not properly claimed.