Then it's best to recognise this early and decide if you want to be true to yourself or if you want to succeed[1].
[1] Depending on your definition of "success", plodding along for 40 years as an IC, contributing your skills to whichever employer and eventually retiring is, for many, "Success" with a capital "S". The people giving the networking advice are using a different definition, which is usually "rising in your career until you are making an impact far larger than an IC could". Not networking with the other rising stars gives you a very low chance of attaining that second definition of success.