One thing that's helping is Lobsters. Lobsters is super slow so if I do make a full switch from HN to that I only need to check it a handful of times a week.
But to me, it's not so much about how much time I spend on the time but rather the why. I simply don't get as much value out of HN as I think I do. Most news are irrelevant and unimportant, and I haven't really learned anything too insightful like others said they have (sadly). Simply put, tech news boards apparently just aren't for me.