So if I don't do a thing that has no appreciable benefit for me or the people around me, I'm being selfish, because if everyone who was in a different context did the same thing, this would somehow produce a gigantic difference?

You dumping your trash in the local drinking reservoir would probably have a couple orders of magnitude more of an impact on others than me not vaccinating after recovery (depending on what's in your trash).