By week 20 there is practically no chance you're not going to know if you're carrying a baby with downs or not unless you refuse all the modern screening/tests available.
NIPT tests can be done at week 8 and give a very high indicator that can be followed up with close monitoring/invasive tests at week 14-15 that give a 99% accuracy. That's hardly "are really not that exact".