I will say the cost gives me hesitation but you've put a lot of work into it so I understand the justification.
For the visualization, does the crawl map limit the connections? I was expecting to see more of a web with pages linked from the entire site. Can you tell us more about that?
Thanks
Regarding Crawl Maps, yeah it does have some limitations on, which I've written about here - https://sitebulb.com/resources/guides/crawl-maps-faqs/
Although from your comment I think you might be thinking it is a link map, rather than a crawl map. So with the Crawl Map it is mapping out how each URL/node was found when the crawler traversed the site. So each node will only ever have one edge/link.
A link map ends up a LOT more messy, although it's on our roadmap to try and build one of these too!
It's really hard to make sense of full link graph visualisations. I'm talking about this in an upcoming conference presentation. We should share notes :)
I'd love for us to come up with some sort of solution for it, I just don't know how we'd do it!
SL presentation I assume?
Will be sharing and writing about it too - still a bit of a work-in-progress. Hopefully it all comes together nicely!
I'm leaning towards comparisons between tables of data, metrics etc rather than visualisations for much of this.