There's been a breakdown in trust.
People who accept vaccination as good, do so because they trust the scientific and political institutions which have developed and tested those vaccinations. A relatively small number of people have actually done the scientific work to prove the effectiveness of vaccination themselves.
People who do not believe that vaccinations are effective/an overall good do not have trust in this scientific and political institutions. Perhaps because the system has failed them economically, educationally or otherwise.