Here are some numbers on reusability vs single-use plastic bags https://ourworldindata.org/grapher/grocery-bag-environmental...

Bottomline, it depends, but for most commons cases it seems worth it to reuse reusable plastic bags.

but you are correct about cloth bags, those are not worth it at all