It's also good to be aware of how strong the nocebo effect can be in this context. If you are convinced of the danger of something it can lead to significant issues. For an extreme example, severe airborne peanut allergy seems to be hard to be reproduce in controlled studies, yet there's people having significant symptoms from this, like lack of breathing etc.
Basically, when it comes to food, a lot of skepticism, including to our own experience, is often required. The risk is that we otherwise end up with unnecessary restrictive eating.
Personally I have a lot of things I "can't" eat, but even then, I try to challenge it now and then, sometimes I find something in a category I can actually eat and sometimes it turns out that I can eat it in low amounts or slowly learn to handle it.
It's not hard to believe that immune responses (allergic reactions being one end of that spectrum) are affected by the body's response to ingested substances. Especially given how strongly the gut microbiota affect blood chemistry.