> it's a question I ask and almost never hear a coherent answer to.

There are a lot of coherent answers though.

One is that responding with HTML encumbers the server with brittle UI over the wire when it could instead be a simpler API server that any client can talk to.

Returning data instead of UI from the server is a clean separation of concerns.

There's nothing incoherent about that.