The problem is not integrating millions of sensors of the same type (like individual pixels in a camera), but rather to integrate 2-10 different types of sensors, like microphones, cameras, lidars and tactile/temperature sensors.
Progress has been slow mosly because it's been hand-written, such as the sensor fusion in the F-35.
While there are some attempts at using neural networks to do much of the integration (Like Tesla's self driving) they're mostly quite primitive, and lacks the kind of general understanding of the world that we're starting to se in LLM's.
We have started building multimodal neural networks, though, such as GPT-4's ability to handle images, though. he next step is to add video, which is the mode that requires the greatest amount of compute, we will be able to integrate it with lower bandwidth sensors using the same techniques.
That would be where general purpose models start to become good enough to be deployed in robots. Let's imagine your Tesla has the ability to reason about the world the way GPT-4 can (and with enough fine tuning that halicunations are gone), and that it can do that not only based on text, but also all the sensors of the car, then it might become able to handle situations outside its training set much better than today, possibly better than many humans.
Once we're able to build multimodal models able to handle realtime video and s