I usually add sth. like

ServerAliveCountMax=5,ServerAliveInterval=2,ConnectTimeout=2

to avoid it hanging for too long if the network goes away, works like a charm.