The question is not "is gravity a force?". The question is "What is gravity?"
An accepted answer, what I was taught in school, and what I would answer if you asked me is "it's a force". And labeling something as "a force" has huge implications for people that know what that label means.
If a four year old asked me "What is gravity?", I'd know better than to give him a label, because he wouldn't know what a force is from school. Obviously.
If it turns out gravity is not really a force -- if modelling gravity as a force breaks down at some point -- that's a good fundamental result. It is a falsification of the theory "Gravity is a force". (So the line of thought goes: "What is gravity?", "It is a force!", "Is gravity really a force?", "Perhaps not!")
How is this not helping us attaining a deep understanding? How is this not advancing science? How is this any different from any science?