That's actually not true -- congenital deaf children average almost a standard dev below average on IQ tests. However, your overall point still stands, as non-deaf children of deaf parents do just fine.