The desire and the solution are quite simple: Apple wants to increase revenues from services, so provide better quality paid services instead of looking at nooks and crannies to pick up a few (mega) pennies here and there.
Apple may be under the false impression that the competition is far behind and that its loyal user base has nowhere else to go. Sometimes these things turn the other way quite quickly. Considering the regulatory scrutiny and pressure in other areas, Apple would be better off not antagonizing its user base with the "let's put ads everywhere and collect more information from our users" initiative.