As a remote worker, people won't come to like you. They won't necessarily dislike you either, just not form bonds with you on the basis of spending 8+ hours together every day. You won't get a share of their "Dunbar budget", so to speak.
If you are really, really good, there is no reason to think this will affect you. You earn your place in terms of your contribution, which may be the raw amount of work you perform, but you can use force multipliers to. By over-communicating, and in general having the disposition to help out people.
On the other hand, if your work is average or below average, I believe it's far easier to hide in plain sight at the office; blending with the crowd, being seen at least putting the hours.