Almond milk is not dairy milk, but it is absolutely "milk", in the sense of a white liquid derived from plants - a definition that has existed in English for hundreds of years.

The name "almond milk" has been used since at least the 1500s.