Is it worth it? probably. but maybe not.
There's a one time cost of learning all that stuff, and then each year you just reuse those same templates and skills with a new logo/graphics from your design guy.
If this is something your team/volunteer group/etc. rarely does, then it's probably worth just paying conference badges. It's a trade-off.
If it's a non-profit thing, consider open souring the process and CC licensing the designs to help others doing the same thing.
It takes me anywhere between 5–15 minutes to set things up, and my biggest annoyance throughout the process is dealing with CSV character encodings.
I think the main value the service provides is that it provides "guaranteed" next-day delivery. My print shop gives me a fair amount of crap for not sending my badges to print a few days in advance.
On the other hand, it's so much less work for organisers to print blank white boxes, and let attendees fill in their own preferred names at check-in.
The true cost of a full time office worker employee once all taxes and benefits are factored in are usually going to be a lot higher than that. This would make the service a lot more worth it.
OTOH if that employee is underutilized, their time is effectively free, so the only thing you would be paying for is (hopefully) quality and consistency.
Our (enterprise) business customers dont care about price much, they care about things going smoothly for an event which has a ton of moving parts.
We serve a similar demographic.