I've seen people gain skills while working remote with a fully remote team. If the company culture encourages the employees to be social and talkative, you can learn as a junior dev working remotely.
Offices may still hold the upper hand here, a lot of people have mental barriers about messaging coworkers vs casually wandering by their office.