Sometimes you can even get away by dropping the square completely:

  if (x2-x1) - (y2-y1) < (x4-x3) - (y4-y3) then ...

I once used this in a path tracer to speed things up a little. The results where less accurate but sometimes this can be used as trade-off.