I don't think I've ever met a vegan who takes such a fundamentalist view. Generally the question is more: "does this product contribute to animal suffering or environmental degradation via unnecessary resorce use of animal husbandry?"
If figs aren't acceptable because wasps get digested by the plant, then surely no food is vegan, as insects are certainly involved in pollination and probably form some small percentage of almost any food product available.