I don't know much about bacteria and antibiotics, but the strategy you described is the reason HAART is so effective and HIV patients live much longer lives than they did even 20 years ago.

http://en.wikipedia.org/wiki/Management_of_HIV/AIDS