My biggest pain point is the fact that OpenAPI uses YAML. They always demo it with the simple short examples but soon as you go above a handful of endpoints the YAML will be just horrible to maintain. This is not my only pain point with OpenAPI but it's definitely my biggest. I'd rather use something else and then generate out OpenAPI specs