I share the same interest. I remember years ago looking on Google Maps at South Georgia and dreaming about going there one day.
Well I decided to make "one day" happen and visited there as part of a two month sailing voyage on a tall ship. We also visited Antarctica and a number of Antarctic islands. Deception Island was a highlight. We approached Tristan da Cunha but couldn't land due to the swell, which was disappointing.
I still dream about visiting these remote places, but the voyage did a great job of satisfying the urge (for now).
The voyage was via barkeuropa.com and it was one of the best experiences of my life.