Sure, but machines are actually pretty good at spoken and written translation these days, so I would expect that once the image recognition is solved they could handle ASL readily as well.
in practice that's all difficult, if at all possible -- but just sayin; we have decently good speech interpretation at this point, perhaps we aren't far from self-training ASL against something similar.