Caesar and Augustus didn't insert those months, they were renamed from Quintilis and Sextilis in their honour.
The reason for the discrepancy in names is due to the fact that March used to be the first month of the year. It was changed to January hundreds of years before Caesar came along, so the naming scheme was already 2 months off by that point.