Yes, they were making their predictions based on physics, math, and experimental evidence. One thing you have to keep in mind is that in most cases science tends to follow discovery, rather than vice versa. Here [1] is a random selection of great quotes from the time. If you're not familiar with the names, feel free to Wiki them. It is about as credentialed a list of scientific experts as one might imagine possible:
--------
Is it not demonstrated that a true flying machine, self-raising, self-sustaining, self-propelling, is physically impossible? — Joseph LeConte, November 1888
It is apparent to me that the possibilities of the aeroplane, which two or three years ago were thought to hold the solution to the [flying machine] problem, have been exhausted, and that we must turn elsewhere. — Thomas Edison, November 1895
I can state flatly that heavier than air flying machines are impossible. — Lord Kelvin, 1895
I have not the smallest molecule of faith in aerial navigation other than ballooning, or of the expectation of good results from any of the trials we heard of. So you will understand that I would not care to be a member of the Aeronautical Society. — Lord Kelvin, 1896
The present generation will not [fly in the next century], and no practical engineer would devote himself to the problem now. — William Worby Beaumont, January 1900
There is no basis for the ardent hopes and positive statements made as to the safe and successful use of the dirigible balloon or flying machine, or both, for commercial transportation or as weapons of war. — George Melville, December 1901
The demonstration that no possible combination of known substances, known forms of machinery and known forms of force, can be united in a practical machine by which men shall fly along distances through the air, seems to the writer as complete as it is possible for the demonstration to be. — Simon Newcomb, 1900
Flight by machines heavier than air is unpractical and insignificant, if not utterly impossible. — Simon Newcomb, 1902
It is complete nonsense to believe flying machines will ever work. — Stanley Mosley, 1905
The aeroplane will never fly. — Lord Haldane, 1907
--------
I'm sure one can dig up plenty more. Mathematicians and physicists simply thought it impossible. You could have asked the question on stock overflow math/physics of the time and gotten plenty of well informed and accurate (by the standards of the times) explaining exactly why it was impossible. It just so turns out that everybody was wrong, as was about to be demonstrated by a couple of high school drop-out bike shop repairmen. As the article mentions, one noteworthy thing is that the final quote is even after the Wright Bros succeeded. So absurd was the concept to many, that most people still did not believe it happened, even after it did.
[1] https://www.linkedin.com/pulse/heavier-than-air-flight-impos...