It's too broad of a brush to say 'agriculture.' Clearly, some withdrawals have a greater impact than others. Withdrawing from aquifers in arid areas has a greater long-term impact than water from rivers in wet areas.
Wisconsin produces lots of cheese. Are they using water faster than it's being replaced?
Ocean seafood I have to imagine uses near-zero fresh water.