They're trained on human data. I would expect them to emulate human biases as closely as possible.
Even if an LLM starts by pursuing things that follow human bias, continuous failures and re-prompting to try something different will eventually force it to consider things outside of what ever biases it has.
You can do the same thing to a human. But most people would consider it unethical to lock someone in a box and force them to keep trying to solve the same problem over and over again until they figure it out.
Is a 'bias' in a piece of writing generally a property of word to word choice and sentence to sentence construction or is it something more nebulous? Especially in terms of the appreciation of mathematics and someone's hesitance about publishing a mathematical argument they think is ugly or brute forced in some way.
You might be fascinated when you read the story of Golden Gate Claude: https://www.anthropic.com/news/golden-gate-claude
Why do you think it's called Alpha ZERO?
It's called Alpha Zero specifically because it was trained from scratch - zero, not on human data.