Hacker News Reader

arivkinon Yandex open-sources its exabyte-scale big data platform

Here are some developers from YT which can help you and answer some technical questions. Also YT is a huge and old project. I believe you can find a lot of people which are ex-Yandex who worked with YT.

arivkinon Yandex open-sources its exabyte-scale big data platform

Why do you think so? How many companies use Apache Hadoop?

arivkinon Yandex open-sources its exabyte-scale big data platform

It's true. We are very close to CDP and Apache Hadoop. We are only about on-prem right now. It's not a secret that we didn't need a cloud deployment at Yandex. But we see and understand the demand for it. And we have a plan:)

arivkinon Yandex open-sources its exabyte-scale big data platform

That's true. We have been preparing for opening YT for a long time when we found out about the leak. We even joked inside that they couldn't even do it normally and we still have to open our part of the code ourselves :)

It's truly a hard work, because we were very tightly tied to the Yandex infrastructure and we had to learn how to deploy in k8s from scratch. Also you need a new brand and clean your documentation from irrelevant things... All this takes months.