According eesti.ee, it will take around six months to close limited liability company in Estonia. So yes, technically you can pull out but if it's anything like other more obscure legal procedures in Estonia, good luck. Conveniently this is not mentioned anywhere in the nice looking promo sites either ;)
Generally:
- on boarding is easy and relatively cheap,
- off boarding is more difficult.
And if you want to close then:
1) you better do it right—it's a process with rules that can take weeks if not months;
2) you gotta pay unless you declare the business bankrupt;
3) it takes a lot of off-the-path back-and-forth exchanges with people that have limited incentive to help you.