Yes you will, but only because GitHub already recognised this class of problems and came up with their own solution [1]. Bear in mind that it works only for vendors that integrated, so while it's true for AWS it might not be for your FOO API.
I giggled at meme.
[1] https://developer.github.com/partnerships/secret-scanning/