It may not be your boss/manager setting it, but your work structure is still being dictated by others (e.g. "within constraints if engagements of course").
You can put this to the test by just ceasing all work on your current projects, without telling anyone, and seeing what happens.