Nope, they have a plastic lining on the inside to make them waterproof.
Same is true of coffee cups, although there are a number of organizations (in Aus, at least) now that have processes for separating the plastic from the paper so it can be recycled.