I got a temporary license and received the real one in the mail later. Yes, you can keep the old one.
My licenses have always been printed on a plastic card, but I remember seeing older licenses that were basically laminated photo paper.
Of course, only until the real DL arrives in the mail, which usually takes a week or two.