PostgreSQL + PostgREST IS my "API backend." They're one and the same. There are no other layers. Using an ORM would ADD a layer, not subtract one.

Perhaps what you're asking is, "Why not just have your user interface connect directly to PostgreSQL and issue SQL statements?"