You can re-pose it as a regression problem to detect the coordinates of the 4 corners in the case of a single object in the image.