Ask HN: Any services for running API performance tests on every pull request?
Do you know of any turnkey services for running performance tests on a RESTful web service codebase whenever a pull request is created on Github?
Over the years, I've seen many instances of performance killing commits making it into production where they're discovered only when users start complaining. It seems like the ideal solution would be to run performance/load tests prior to merge.
Obviously this could be rigged up in the build job, but that brings a lot of issues like having to maintain infrastructure, do the config yourself, and especially blocking the build job while performance tests run. I would also like first-class integration into the Github PR check status.
Seems like a perfect case for a SaaS offering, but I haven't been able to find one.