People have already spent a _lot_ of time and money looking, at least in the case of Aspartame.
https://en.wikipedia.org/wiki/Aspartame_controversy
> FDA officials describe aspartame as "one of the most thoroughly tested and studied food additives the agency has ever approved" and its safety as "clear cut."