Yes, that is how not being prejudiced works. You judge the individual based on what it has done, not what it might do or what others do.
At a minimum you are talking about dogs that are capable of killing a child and seriously injuring an adult, and when we talk about the larger breeds in the pit bull family, clearly capable of killing an adult.
Some larger breeds, like golden retrievers, can be ferocious when provoked, and can be dangerous in this regard, but in terms of brute strength are more limited. This is even putting aside differences in temperament.