Sometimes the objectives align, but not always. And yes, the world would be a better place if they were better aligned, but we don't live in that world.
I'm sure X's motivation is something along the lines of forcing logins creates more users, or the downside of scraping outweighs the benefits.