As an aside for those not aware, OpenSCAD is CAD software where you describe the models with a programming language. Basically you have vim or some other text editor of choice in one window, write your changes and OpenSCAD detects the write and updates the preview of the model in another window. This obviously lends itself better for tracking CAD model changes in git. You can comment your code and everything.

That said, depending on the model you want to make, it may be much more challenging. Adding fillets, for example, may be not trivial.