Andrew, co-founder of Gitter here.
Removing secrets was a lot of work - more than I expected - while we open-sourced the product.
I agree with your sentiment though. Handling secrets in a codebase is not something that it currently easy or standardised.
As an aside, BFG Repo Cleaner really helped a lot with cleaning things up: https://rtyley.github.io/bfg-repo-cleaner/