It doesn't have to be direct conflict.

The margins for survival are very slim. Out-competing through more effective hunting and gathering would make a huge difference.