Some 20 years ago a ICQ-like instant messenger in Poland called Gadu-Gadu has become the default way of communication on the Internet for us here. GG had own set of emoticons but only few of really big set were in constant use [1; set for KDE's Koperte but it was same on Windows native client]. I doubt that anything have changed and emoji are being treated in same way: a small set is used and rest is largely skipped.
There was this little thing about GG's emoticon that when you typed "??" and "!!" application would turn these into looped gifs. People were so accustomed to that effect they were doing double punctuation elsewhere on the Internet and even in real life.
https://i.pinimg.com/736x/0a/e5/36/0ae536826bb1cf643e6f05066...
There's no "neutral" rather its just "white without specifying it"
I grew up in two multi-cultural places so do not have the same default perceptions.
England
Japan
Turkey
Sri Lanka
South Africa
Language changes all the time, emoji are just part of that.