In New York State where I live, we have 95% first-dose vaccination status for adults and 73% for complete vaccine series (https://twitter.com/GovKathyHochul/status/148608338468219289...) .
so here, continued vaccine mandates won't have much additional effect. However, I would venture to say a whole lot of that 95% has been vaccinated *because* of the mandates that were temporarily in effect at the national level as well as the mandates that continue to be in effect (health care workers, federal contractors, large employers that mandate vaccination in any case). My general sense is that the vaccine mandates, despite their being in the process of being torn down by a very broken supreme court, most certainly helped a whole lot in states where state-level leadership was on board with the general idea.
in conservative states where vaccination rates are low, state governments are in varying degrees of defiance towards the federal government, vaccine mandates are not as effective because of the very great resistance to them in these states. you could argue that continued vaccine mandates will continue to not be very effective, and for that reason they should also be rescinded. I'd guess some replies here will make this kind of argument.
I would disagree with that argument, and it's my opinion that vaccine mandates should stay in place to the degree that it's the right thing to do, as well as the completely normal and traditional thing to do from a public health standpoint. The fierce political interference with traditional public health measures is unfortunate but that should not be a rationale for sensible policies to just be switched off.