I think privacy abuse can be largely prevented if a hard line is drawn saying that digital ids must only be used by the government for government services, such as voting, taxes, immigration, welfare, etc.
If any private parties like banks, social media, or online stores are allowed to check your digital id, they are going to be a privacy disaster.