Some cultures eschew dairy almost entirely. Most of the world is lactose "intolerant" actually. Not sure why it would be considered an important part of ones diet.
A different sort of vegetarian diet might work without any dairy (I'm pretty sure this describes some traditional Buddhist food). Not everyone uses the same stuff.