I think it comes down to control and trust. Right now advertisers can run all sorts of crazy stuff without reproach, they don't want to give that up. Having ads served by the first-party would also require the advertiser to trust them to report all data accurately.
Perhaps another reason is that you lose the ability to track users through third-party cookies?