It seems to me that one significant barrier is that most people don't have a static IP. If we can move to IPv6, will ISPs start issuing static IPs for everyone by default?
It makes more sense for ISPs to focus on efficient delivery, while anonymity is handled by things like overlay networks.