You might also see if you can just restrict interaction to a shell. That's definitely going to be much lower bandwidth (and thus more responsive). Then anything you can do in the shell, you can do through SMS. Updating an 80col screen isn't a completely unreasonable number of messages... especially if you're doing compression.
Security is probably a bigger issue.