Punishing bad actors depends on informed voters, but in a larger population democracy it also depends on the informed voter : uninformed voter ratio staying above some value.
The lower the ratio sinks, the less weight informed voters have, and the less intelligent the outcome gets.
The modern party duopoly exacerbated the issue (parties mobilize uninformed voters and often actively work against informing them), but voter enfranchisement also seriously impacted.
Universal suffrage is amazing from a human rights and ensuring everyone has political power standpoint, but troublesome when you have poor levels of universal education and ability for voters to inform themselves.
In modern times, with modern populations (US or larger), it feels like indirect democracy might be a better answer.
Allow voters to directly elect non-partisan voting representatives (many, so elections are hyper-local and candidates individually canvas), then pay those representatives a stipend for a few months (like jury duty) which they spend educating themselves on issues. Then have those representatives vote.