I agree, if the goal is cost and speed, prefab is the way to go.
I also think a major limitation here is the boom itself, there's plenty of bricklaying done in fairly confined spaces. Between two buildings for example. Here one could just lower panels into a confined space with a crane.