Great story, and very recognizable.
Also many thanks for mentioning Checkly[0]. I can totally see why you guys opted for a more APM driven solution. In the end, you probably want white box and black box monitoring.
Disclaimer: I am the founder of Checkly.