I thought it might be something like that. I've never been able to do them. I just find them frustrating and quit.
I do play various puzzle games, but I'm not a huge fan of this particular type. For me personally, it would put me off your game, especially if the failure to complete the puzzle stopped me progressing.
I can't speak for other people. I may just be weird.