USPS is run as a federally owned business. It was traditionally self sustained by postage fees not by taxes, but it is nice that it was from our country's earliest days, a key piece of infrastructure.
Nowadays mailing any letter is pretty rare as most people communicate via text, email, etc but it is still absolutely possible to do so.
And yes the red flag is to indicate a letter needs to be picked up for delivery.