Did these buttons first show up on cassette players? The reel-to-reels I can think of had multi-position switches.
Here's an interesting reddit discussion about it with an image of an older style play button.
And an older more in depth discussion on the same thing
http://www.stackprinter.com/export?service=ux.stackexchange&...
This machine is apparently from 1961, so it must have been quite early in the 60s: http://www.reelprosoundguys.com/images/1962_GRUNDIG_TK_46.jp...
For a very basic and obvious example, possibility to turn right vs turn left signs look different not just because of convention but they resemble the shape of the road.
One thing to be aware of with both names and logos, is potentially what the name/logo may mean in other places throughout the world.
To go further with the idea of context, a square on its own is meaningless, a square next to a circle and a triangle means stop, next to play and record.
And it's also these relationships that will tell the user what to click on.