I didn't and have had people say to me that they don't connect with current colleagues.
I also don't connect with recruiters until I have announced that I am leaving. I'll happily chat with them via private messages or give an alternative email address.
There is no benefit in the default behavior of having the system send all your contacts, including your boss and HR colleagues that you have made a new recruiter friend today.