I ran into this same issue. I've been quite fond of the idea of external gpus for this exact reason.