Not a huge fan of the Apple TV remote either (But I also don't hate it). The good news is that the Apple TV plays nice with stock TV remotes + game console controllers — I use my 8bitdo Sn30 Pro, but PS/Xbox controllers should work fine too.
If you already own an extra gamepad, then it's worth a try and doesn't cost extra. There's a few gems in Apple Arcade, which was a surprise.