Gradient descent obviously has none of that, it has not feelings or goals, and so there would be no preferential remembering or forgetting other than to do better next word prediction or rlhf or whatever. So it would be interesting to think about what a model should remember or forget in order to align it with our goals (because it doesn't have any of it's own).
Also, don't volunteer for Google. They have lots of money, they can pay for this stuff and if you know how to do it you have lots of options.