The manufacturing byproducts of vegetables are known to be hazardous (pesticide residue).

I'll wager those PFOA are worse, but it's worth saying that if you're gonna manufacture PTFE for human consumption you could possibly clean up the process and get something perfectly clean, even cleaner than vegetables.