Be wary of shared SSL. For example, sites on Cloudflare often share SSL carts but are not owned by the same person. You may have to blacklist certs with Cloudflare CNs to avoid false positives.
Same with IP addresses and nameservers. Unrelated sites could share the same nameserver or IP address. But if you have a number of those factors match up then two sites are likely related.