> There are times where a AAAA record points to an IP that doesn't respond, but the A record responds and so on
> If it went down for months I wouldn't notice.
you are not alone.
I am building a service to monitor such events. usual up-time monitors mostly checks the v4 address.