To play along with your analogy: patrickaljord's point is that if sales decreases, then you get less commission. Decreased sales in this case is decreased number of ad viewers that comes as a result of decreased number of Google users.
So yes, ad publishers may not care about Google users in and of themselves, but they care about volume, and Google making its users happy and engaged keeps that volume high. By transitivity, ad publishers should (theoretically or indirectly) care about whether Google treats its users well as it would have some positive correlation with their viewership volume.
You're trying to draw a false dichotomy between the two -- they are not mutually exclusive goals. Just because Google is building for the users doesn't mean it's not building for the ad publishers. By building and improving their products for the users, they are increasing the stickiness and value of their users for the ad publishers.
If you had to choose between advertising at a location where people just breeze right through, and advertising at a location where people stick around to browse the goods, which location would you rather pick? Obviously the latter where people stick around, as it's more likely that they'll notice your advertisement. Google improving their products for the users makes it more likely that their users will stick around to notice the ads.