It's the people who remain asymtomatic through their infections who barely infect others. For people who end up becoming symptomatic their viral load and infectiousness peaks somewhere in the day before symptoms first appear. That's the one thing we've found about this virus so far that's genuinely weird. It seems to be very good at evading the automatic immune system but once the Interferon starts flowing the viral population starts crashing immediately.