I use 4, and it's not difficult to remember, for anyone worth chatting to.
You just naturally remember, like you would remember where your friends live. I guess if you are constantly dealing with "contacts" rather then friends it would get confusing.