Starcraft was doing that in the 90s including the tweaks to balance the different races. IMO it made the game better as clear imbalances got fixed over time.
Awhile back I was playing through darkest dungeon and they did two rebalances that changed how most characters work. I had spent time leveling up characters and building teams only to have the game change out from under me. It was annoying even if the final rebalance was better since I made decisions that were based on obsolete information.