If you are willing to adapt to a different structure and workflow, you can filter the scope of git down dramatically with sparse checkouts (as @WorldMaker also mentioned).
https://github.blog/2020-01-17-bring-your-monorepo-down-to-s...
https://github.blog/2020-01-17-bring-your-monorepo-down-to-s...