Hacker News Reader

Comment by mrdmnd | Hacker News Reader

My team at Airbnb is working on a tool called "Salus" - named after the Roman goddess of hygiene - that allows you to check the correctness of your data in a number of common, extensible ways. Perhaps this is something that the open-source community at large might be interested in?

View on HN

I have rolled an extensive (purpose-built) general data quality system at work, and would love for there to be a general purpose tool that does the same sort of thing. I would love to use, contribute to, or otherwise make real an open source version of such a tool.

There is an enormous need in several industries for this sort of thing; but most people don't really know they need it yet.

Interesting. I'd love to hear the details.

Yes. This is something that could be useful to data journalists, who often have to quickly grip and rip new datasets.

I'd be interested. Any tool that checks correctness is one less thing I have to write before I begin my analyses.

Sounds intriguing... Is it something rule-based where I have to define things ahead of time, or can it infer stuff - for example highlighting outliers in an automatically detected numeric field?

Definitely something I'd be interested in taking a look at, I imagine others would as well!