You can't also look at index to decipher what it means to see "red light bulb that is 'on' over two light bulbs that are 'off'" or "human figure walking over piano keyboard inside a white triangle which is inside a blue square" when you are driving, you are supposed to get familiar with those symbols before get in the car. Typical car has barely a dozen or two pictograms, and any car is a machine than can easily kill and maim. It would be advisable to look at the manual before one starts driving. Of course, it would advisable if those symbols were also standardized like traffic signs.
I actually agree with you about Unicode mission creep, but it is better not get overboard with pictograms that have nothing to with Unicode.