City builders do this a lot where you often have lots of difficulty settings you can adjust to tailor the game to your preferred playstyle.
I’ll also say this: if you’re making a game and you add in a mechanic or mini-game that is not typical of the genre, make it optional or provide a way to skip it. Few things things in gaming piss me off more than a memory or Simon Says puzzle in an MMO or similar. If I wanted to play puzzle games, I’d be playing a puzzle game, not your game.