A square orbit would require infinite acceleration. Specifically, a dirac delta.