As others have stated, the common fig does not require a wasp for pollination: https://en.wikipedia.org/wiki/Fig#Habitat.
In my opinion, in order for this to actually be a controversial topic amongst vegans, the following would need to be true:
1. The variety of fig that you're most likely to eat would require wasps to pollinate them. 2. Fig farmers would need to directly breed, control, or otherwise manipulate/exploit fig wasps in order to ensure that their trees would be pollinated.
My research tells me that neither of these are true.
Food grown using manure is much less vegan and even that isn't widely discussed in the vegan community.