Where are you getting this info? Also, nonsense looks like a very strong word, there seems to be a huge amount of evidence that Cd is in fact very toxic.
There in fact isn't really any.
There is the japanese poisoning accident, which however seems to be Paget's disease.
Then there are poisonings with ridiculous amounts, like 120g(IIRC, won't look it up again) of cadmium chloride, or combination with other chemicals or metal fumes.
Then crickets.