One of the arguments against representative democracy at all was basically the same: People were supposedly too uninformed, and someone else needed to moderate their wishes.
The arguments against expanding the electorate from land owners to all males in many countries were the same.
The arguments against allowing women to vote, again largely along similar lines.
As was the resistance to steadily lowering the voting ages.
As I'm sure you can tell, I don't really buy that this would be such a huge problem.
Sure, some decisions will end up different. It's not clear it will be better or worse. But personally I believe that giving people more direct ownership of decisions is valuable in itself. As is improving representation - with current systems (even proportional ones), a lot of people are very poorly represented because finding a party or candidate that fits their views and that has a chance of getting elected is near impossible.
There are many mechanisms to counter the issues of an uninformed electorate, such as for example allowing people to delegate votes to representatives (possibly with indirection, so you can e.g. delegate your vote to the candidate from some minor party you agree with, knowing they'll be able to try to parlay a voting block into influence with the parties with seats), or vote "I don't care / I don't know enough about this issue to want to influence it, so I want my representative to count my vote the way they prefer", and many others, while still allowing people to take control and override for things where they do care about deeply about the outcome.