Why use a full ORM with everything it imposes when all you need is the query builder?

It probably does. But the query builder doesn’t require architectural constraints, the ORM does.