https://en.wikipedia.org/wiki/Edwin_Thompson_Jaynes
"Jaynes strongly promoted the interpretation of probability theory as an extension of logic. "
Oh, sorry, I didn't realise this was a dick-waving competition.
On the matter of probability and science, I like how Karl Popper put it, although I can't find the text now so I must report it from memory. His point was that scientific hypothesis formation is an instance of inductive generalisation while probabilistic inference is a form of abductive reasoning, and so using probability to support an inductively derived hypothesis is basically supporting a guess, with another guess.
Statistics of course is not the same as probability. Personally I think statistics is a bunch of hooey.