Building bots is hard: there are few tools available of any sophistication, leading to a vicious cycle of trial and error (with users getting the worst of it).
Remember what the first websites looked like? Everyone was just making it up as they went along. We're in a similar situation today.