Ask HN: What is your biggest problem with data?

3 pointsazianmike2 comments

What is your biggest problem with data, whether it be querying it, storing it, manipulating it, processing it, etc.

What is that one problem, if solved, would make your job much more efficient?

As someone who is not in the field but reads about it from time to time I see the same theme over and over: The formatting, consistency, and manual cleanup of data. The theme of data scientists who are "data janitors" that spend most of their time "cleaning data" is a consistent one.

storing and querying it. It's huge and the engineers haven't been able to provide easy access.

Reply on news.ycombinator.com