Motion controls and button controls are not mutually exclusive. And buttons are essential for games that require more precise controls, in the same way that a physical keyboard is essential for writing long texts.
It's also a bit premature to draw conclusions from kids at an age where their fine motor skills are still developing. They could be getting frustrated because pushing buttons is hard for them.