I was about to rebut you, but the facts remain: The largest supplier (by far) of almonds in the world is California. So yeah, if you drink almond milk it's likely sourced from CA using up precious water that is causing the CA central valley to literally sink [1], as much as several inches a month (ie, several feet so far).
However, almonds pale in comparison to cows or other livestock in terms of water usage (esp when used as meat) - while consuming large quantities of almonds may not be sustainable, it's a lot better than eating meat... just may be as water-unsustainable as drinking local milk (if you live in CA).
[1] https://www.theguardian.com/us-news/2015/nov/28/california-c...