That's the entire problem. These systems don't understand anything about the world. If you see a sign covered in snow you're going to recognize it as such and make your best guess as to what it says and weather you care. You probably don't need that information to drive safely because you have a lot of knowledge to fall back on. These things dont, so some folks want to improve GPS accuracy and maps and signage. That's not a viable solution on so many levels.
General AI is the only way forward for fully autonomous cars.