I can easily imagine that multimodal GPT-style LMs running in real-time could do all the common sense thinking that seems to be lacking in modern self driving. That future could be just a 100x optimization away.

Edit: multimodal. Does no one remember the vision + language version of GPT4 that microsoft demoed?