Here's where we differ. Adobe Illustrator is like a canvas on an easel. Visual manipulations appear right in front of you, and then you can dive in and inspect. Change a color easily and know if it's right immediately. Not commit, then look at a rendered version, notice it's off. Try again, commit and then attempt until it's right. That's a huge waste of time as a designer. It feels magical to edit and create in Illustrator to me, and I'm sorry that someone offering free .ai files isn't pristine enough for you.
Your "editing" of a graphic file is still 4 steps, there's not much being cut out:
1. Click edit.
2. Propose changes.
3. Owner decides nothing is bad, or messes up other parts of the design.
4. Owner accepts pull request (still can't see the files in Github, because there is nothing for viewing graphical diffs anywhere yet)