> Having any belief at all, none, one, many, infinite, all falls into the same category. We don't know.
If you have no evidence for it, your belief in a multiverse is religious not agnostic.
>To me it seems like the additional universes in this context serve a purpose similar to (my understanding of) additional dimensions in math/physics. It allows you to navigate around singularities.
This is additional dimensions in physics, and we just don't have any actual evidence that a multiverse exists. We have a some suppositions that say 'well there's nothing to say it couldn't exist' but no evidence that it could.
You could view that as 'useful' but you can't judge its truthfulness or whether reality reflects such a 'purpose'. Either something exists or it doesn't, and a multiverse is a strictly religious belief at this point.