Being "out of sight, out of mind" from management generally means you're passed over for promotions, and often the first to get cut during layoffs.
It's just human nature. It's easier to layoff the person that's been working from across the country (or another country) than it is to layoff the person at the desk next to you that you've worked beside for years.