Can anybody explain exactly what is meant by "distributed" here?
When the article says "distributed", it means Persona is many-to-many. Any domain can implement the protocol, so when a site accepts Persona login, you can choose from many identity providers – including your own, if you're industrious and want to set one up for your domain. Most people are using Mozilla's service today, but the idea is that email providers like gmail will implement it themselves in the future.
It doesn't have to go through Mozilla's servers; anyone can set up their own instance and work with the other ones.
Distributed identity seems to be notoriously tricky to fully understand for both end-users and developers. I still don't really get OpenID.