Hacker News Reader

Comment by lloydatkinson | Hacker News Reader

Is this just the new way of saying "big data"?

Big metadata is one of the big upcoming trends in the data space.

Data tooling has gotten a lot better over the last 10 years with Spark + Airflow + Cloud data warehouses. The next step is getting everything to talk to each other with better details.

+100

No, it’s saying how important metadata is, going over the components and key features for a platform to manage metadata, and includes some of the history of that category of software at LI.

If you’re at a company with more than 10-20 people doing data science type work, this is an important service.

Perhaps, but it's also a service you are unlikely to want to outsource if your data is proprietary.

You're absolutely right. That's why we treat our customer's data with utmost care, even if it's just metadata. Here's our security white paper if you're interested in learning more: https://www.notion.so/metaphordata/Security-Whitepaper-371ac...

Why not? I don't think that's an issue if the actual data is already sitting on a third-party cloud in some middle-of-nowhere undisclosed location or being transited through various other cloud services, right?

Depends on the data, but everyone should be treating metadata at the same classification level as the underlying data. Perhaps even moreso, as metadata leaks information about the company, versus leaking data about the user. (Rightly or wrongly, things that harm the company are more likely to be prioritized.)

Reply on news.ycombinator.com