Yeah, that's a definite issue I've had in dealing with mine. Fortunately, they're easy to swap in/out and are mostly affordable to buy new ones ($11 for a two pack on amazon right now).

I have one I use for the chilis, bbq, ribs, etc I do. One for soups and such, etc. It's a slight pain I guess, but the ease of use of the Instant Pot in general outweighs swapping out the silicone seal occasionally.

We have multiple rings in the house, one designated "sweet" and the other "savory", so that we can avoid this problem.