Hacker News Reader

What I really want is an Android app that keeps alerting until a page is ACKed or escalated.

check out pushover, I use it for this exact case

OpsGenie's Android app does this. Wouldn't be surprised if OnCall has this as well (or is coming soon).