A simple system, like drip irrigation, could save 50%. An ebb and flow hydroponic system could save 95%. These technologies aren't new, they're just not cost effective until water becomes less cheap.
I think in 20 or 50 years we'll look back at the current sprinklers that just spray water into the air as ridiculously wasteful.