The problem is that LinkedIn wanted to let some bots in (e.q. Google) but not competitor's.