Well for starters, no scp command at the beginning and end of each job. I'm sure you could work out an alternative solution, this is just one such solution.
If you were relying heavily on the remote machine, maybe using a pinebook pro or something, ssh or rdp might make more sense.
It's cool to have more options though, I have considered workflows like this before especially in the context of replacing my laptop with something like a pinebook.