It does not build up in your body, it builds up in the environment. The amount in your body is basically exactly the same as whatever environment you are in.
On top of that, how much PFOA would you imagine is even in a frying pan? It's already so little it's considered negligible, so unless you are buying new ones every day, even the negligible amount is not "building up".