Your boss has heard it all before. Don't worry about it. He probably already knows you're leaving.
Ask your boss for a private meeting. Sit down. Chances are he'll glance at you and say "So where are you leaving to, then?"
Above all, don't stress about it. It's not as important as you seem to think.