Please provide the citation for this requirement? What laws or regulations have this requirement?
They list the air space requirements, the MSL's, the procedures, etc. 500ft AGL isn't set in stone but it's the moment when you would enter an airspace should you be in one. This is why people go out to the deserts where there's no airspace and the minimums are FL10.
https://www.faa.gov/air_traffic/publications/atpubs/atc_html...
In aviation, the onus is on you to lookup the right regulations for flight. Ignorance isn’t a valid defence.