I’d definitely still say the experience was worth it, given that I still have much of my previous ability and can probably relearn it rather quickly. It certainly is a bit sad to see your skills degrade over time, and this has certainly contributed to some fear of picking up the language again, but that probably goes for most skills and hobbies anyways.
And as you said, I have the same experience whenever someone asks me about my language learning experience —- I always mention how rusty I am these days, and there’s a nagging feeling I need to shake off the rust so I don’t have to say that anymore. But in the end, I guess we have to settle for doing whatever we think is best in the moment, and if it’s important enough, we can always pick it up again some day.