E2E payload weight will be much lower than typical LEO configs, total altitude lower. You don't need to circularize etc etc.

This means you can spend more fuel/be less efficient overall for a much more comfortable acceleration profile.

In terms of safety, starship will fly hundreds, perhaps thousands of times before people fly on them. They'll get there.