Unfortunately that's not necessarily the case. I don't have the reference, but I read somewhere that asymptomatic patients may have even larger amounts of the virus, compared to symptomatic people.