Yep, I think people who say they think it is boring really don't understand what these sports are about.
Two examples are golf and cricket. Both take days so the action clearly isn't important. If you go live, it is about the day out, having some beers with your mates, relaxing (tbf, golf has managed this far better than cricket which has had to move to shorter formats). Watching at home, it is the same thing. Relaxing, having a good time with your mates, whatever.
It is true, nothing is going to compare to seeing an "action sport" live: boxing, a huge soccer game...very little in life compares. But I think there is room for other stuff too: stats, stories, experiences, etc. (tbh, I think action sports are going to struggle against Esports too). I am a big soccer fan but rarely watch games, I just follow the story and the stats (and bet on games). Viewership has gone through the roof because the stories are just so compelling (and yes, the money too nowadays).
I hope that sport doesn't become "all action, all the time" though. Again, nothing compares to action but you can't watch that every day.