It depends on the amount of tea you're using per L of water. One could steep 1 g of tea in 4 L of water, which is essentially drinking water.

"1 gallon of tea" provides very little information on the amount of tea used.