I am a Canadian resident, my co-founder is an Estonian resident (physical). Both of these may change in the future and the intended market for our startup is global. Estonia was chosen as a common ground with a minimal overhead - it's easy and costs almost nothing.
Using government services with an ID-card was a breeze. For banking we use a "physical" Estonian bank, once set up I have no problem accessing it online either.
We didn't have any revenue the previous year, so cannot say much about taxation story here. It gets more or less complicated depending on your country of residence, but I don't think that having a business entity in Estonia is fundamentally different from other EU countries here.
Slightly more personal and readable story, written by me: https://medium.com/e-residency-blog/how-to-launch-an-estonia...