Neanderthals probably did have some form of language since appear to also have had a gene that is crucial to language in humans. And they buried their dead. So why would we presume they didn't make some sort of marks intentionally, to convey meaning or just to decorate their favorite rock?