Science can't answer questions like:

"Is it OK to curb freedoms and force medical procedures in order to save a million people?"

"Trust the science" people either think we all agree on those questions or they believe that their positions are the correct ones.

Also, "trust the science" used to mean things like "electroshock your abnormally behaving child." It's hard to fault people for a lack of trust.