Deltas or no deltas, apt feels significantly faster, but yum isn't slow enough to be a real problem for me.
Be careful: apt is deprecated. aptitude has been its replacement for a while now.
The real problem with yum (and apt) is poor dependency solving. This is an NP-complete problem sufficiently close to 3-SAT that a good SAT-solver can solve this way faster than the stupid Python/C++ heuristics in yum/apt. I wish they'd switch to using something like zypper.
After getting into an argument with one of the yum developers some time ago, I did sit down and attempt to benchmark apt vs yum, but it's impossible to do this. Fedora and Debian are completely different distros, so benchmarking two package installs isn't fair -- the package you are installing might be configured completely differently or have more dependencies on one distro than the other, so it's just not a fair test.
Nevertheless, yum does feel slower, and anyone who uses both daily like I do would tend to agree.
Does Portage do full dependency resolution? That's what kills package managers (see my posting above yours).
> so it's just not a fair test.
There are statistical methods for counteracting that, but I don't see the point. It would be non-impossible to construct a test where you tested the overhead of the package management system.
Of course, if the speed of updating is so relevant, you should probably be using Fedora anyway, since it's rather bleeding edge.