Maybe it's just a targeting problem.
(One of the UK minor channels has just launched a programme "Goggle box", which is basically a reality show of people watching television and chatting over it. This may be taking the whole thing too far)
Even when I want to get to the finish, live, I just start watching an hour after the recording begins. Fast forward through commercials and head-under-hood challenges, etc.
If it's a game I'm only semi-interested in, I'll wait until it's completely finished. Then just FF until I notice a score change, back up some reasonable number of minutes. Voila, personal highlight reel.
Spoilers are generally hard to avoid. This year I've given in and accepted spoilers in exchange for following various communities. So far the participation has been worthwhile and knowing race outcomes and other highlights in some cases had made watching an even better experience.
YMMV as they say.