Everything we know about anything is mediated through our subjective understanding and perception. Be it mathematical formulas that describe the universe or feelings about something. If you remove people, we don’t know what there is, because we have no way of knowing
Sure you can remove some people and have others observe, but that is still mediated by people
We can never truly know anything that we don’t perceive ourselves - so it is just impossible to know anything about a universe that doesn’t include our perception of it