Some enterprising individual should purchase the data for the sole purpose of publishing activity of politicians, judges, and so on. I bet you the laws would change in a hurry.
"... restrict public access of their residence address in tax appraisal records..."
If they took a mortgage on property, the document with their name is usually recorded by county clerk and recorder.