What's more likely is that people that you contact via email are allowing LinkedIn to search their contact list.