It is pretty challenging at times, but luckily it's just a minigame for earning some rupees. It's not mandatory. I wished someone had warned me before clearing all 18 puzzles just to see them automatically reset, though...