I stumbled on grequests for this use case and it just works.