But L2 requires the drivers active attention as they have to have their hands on the wheel every 60 seconds (or something like that). As long as Tesla doesn't remove that constraint then there shouldn't be any worries.

I don't see how you can get to L5 without L2 and the learning that is going on in these cars today.