Downside to natural immunity: because you've necessarily been infected, you put yourself and others, and their others, in danger from covid.
This doesn't happen with, at least, the viruses used in the US, because it doesn't use killed or weakened covid.
I would think real danger to self and others would greatly outweigh any theoretically greater efficacy of natural over vaccinated.