I'd tell the manager that I was overbooked (which I normally was), would list the activities, and ask him what should be cut.

It's not hard, and if you cultivate a track record of delivering on your word, he'll appreciate it.

If you say yes to things you cannot deliver, when you don't, he won't respect your judgment.