At some point I heard Atari 800 (released in 1979) was the oldest machine ever to connect to the Internet, thanks to Contiki. But a quick google now suggests older DEC machines from mid 70s. Still impressive though.
So it was before the other ports and in all likelihood it was never an official record anyway.