As a saying it's been around for over 500 years.

https://en.wikipedia.org/wiki/Don%27t_throw_the_baby_out_wit...