The fed doesn't just give away money... they can only loan money out, which had to be repaid later.
But it wouldn't ever lose value and could inject some cash into the USPS.
There are some issues with postage stamps as an investment, though. They're not as liquid as T-bills, though if they become a popular investment that problem solves itself. More worrying is that the USPS is not quite as reliable a borrower as the US federal government - can you really be certain this would never lose value? I'd like to see where the bond ratings agencies would rate USPS stamps.