what happens if I type in /user/654322/orders instead of /user/654321/orders? Did I just access someone else's account?
Preventing flexibility at the URL level rather than performing proper authentication strikes me as a poor decision.
You're just tying yourself down for no good reason.