Bricks are great for humans to build with, they are just the right size and weight for the human hand to manipulate and place. They are not optimised for machine manipulation.
I would guess that if you wanted to automate construction you would start by making things like walls on an automated production line, then ship the largest practical piece to the construction site. Once there I'm guessing some automated cranes could move them into location far more easily than thousands of slightly randomly sized pieces of hard clay.
Work out what problem you are trying to solve. Do you want cheap construction? then why choose a material that requires thousands of operations just to build a wall regardless of if it is a human or machine doing the building. There are far more efficient building materials used every day... Just see how fast commercial buildings can be constructed and you can be sure that they are optimised both for speed of construction as well as (hopefully) energy efficiency and ease of maintance after construction.
The problem seems to be people have a emotional idea of what a dream house is, an idea that is firmly stuck in the red brick house of 1970's sitcoms.