I'd like you to, then, define what is and isn't considered art, a process to which your exact argument — "everything isn't [art|a game]" — has been applied countless times (see: Duchamp's Readymades).
You could argue that many aspects of life are and always have been games; I think fnid2 has a valid point.