And you can do fine in a road race with a gravel or cyclocross bike!
Just gotta put appropriate tires on.
That so called nervousness is greatly overstated. I think this is a US thing actually.
As I said, that so called nervousness is overstated because people overthink it. BB height matter but for the most part we intuitively and inconsciously accounts for it and adapt. Also the difference is minute, from a 5 mm to 15mm. It is not like we switch from a road to a tall bike either. And guess what? A tall bike is pretty easily rideable, there are even people doing offroad on them.
edit: Realized it is for turning radius