It's complex, but the fertilizer itself is actually the source of the radioactive stuff. Tobacco has the odd characteristic of capturing that and the decay products are things like polonium
https://news.cancerresearchuk.org/2008/08/29/radioactive-pol...