Tesla did it to save costs. The world is not static, you can’t map it once and expect that to be enough.
The mandate of FSD has always been that humans get away with driving using only their vision so it must be possible for a computer to do the same. If you have used FSD lately it's largely there.