Tools for REST API Monitoring in 2019
slao.io
slao.io
Also many thanks for mentioning Checkly[0]. I can totally see why you guys opted for a more APM driven solution. In the end, you probably want white box and black box monitoring.
Disclaimer: I am the founder of Checkly.
You really need to look into distributed tracing solutions and instrument the endpoints which your customers rely on - and measure the response time, codes, and availability of those.
I work for an APM company, and that's what we do at instana.com -- what you've built here is cool, and it's inspiring, but it's not going to help anybody if your customers are getting 500's from their calls, but your "health check" is sending back 200's.
https://www.moesif.com/features/api-monitoring
(Disclaimer: I blog for them)
Disclaimer: I work here.