One could argue the original band-aid was just rubber colored and non-racial in some way, but keeping ignoring it matched light color skins better was becoming a choice in itself.
Emojis are the same to me, in that they were introduced with very limited scope (original ones were simple outlines, with bright pink, blue or green faces). Then expanded and got more detailed, less caricatural, and stopped fitting a single byte.
IMO the can of worm got opened the moment we got detailed drawings with artistic choices that best match one category of people. We have shown we weren't limited in number, and accepted a ton of complexity to deal with flags or gender representations for instance, it would be tone-deaf to just go on saying it's too complex to also care about racial representations where they might apply.
If you're arguing for getting back to simple outlines of random colors, I'm with you. But I think we're not in a stable place right now to say "we made enough diversification, let's just stop here".