You're describing https://www.followupthen.com/ pretty closely.