My grandparents always swear by using "brown soap" if you think you've been exposed to poison ivy. aka Fels-Naptha. It's a pretty strong soap, but I don't think it contains naphtha anymore.