Open-source infra for data scientists | Hacker News Reader

Open-source infra for data scientists

magniv.app

It reads open source core which means it's not fully open source. So the product page isn't exactly clear to me what's being offered. Although it is possible to have a sass with a fully open source code base of course.

We will have an open-source core framework (the Python decorator part). Kind of following the DBT model. Still very early (in alpha) so will not open source until the beta development begins.

"Request early access" is not a valid Show HN. Please see the rules:

https://news.ycombinator.com/showhn.html

Hey- Jared here! I am one of the founders of Magniv. Let me know if you have any questions. We are excited to get this in the hands of beta testers in the community :)

The site says open-source but there's no link to code, only a suggestion to sign up for early access?

Yes we are still very early! The core framework will be released to design partners first then to the community.

So it’s not currently open-sourced?

How did this make it to the front-page - it’s basically nothing more than an advertisement at this stage? Am I misinterpreting something?

We are looking for people to join the beta -- we are basically offering them free engineering.

I guess there are enough people who find this relevant to vote us onto the front page.

Would you be interested in the beta? :)

Touché!

Not at the moment but best of luck with the product.

Rereading my initial comment came off more hostile than I wanted, so thanks for the level-headed response :)

Signups can't be Show HN's, take a look at

https://news.ycombinator.com/showhn.html

Show HN is for things people can try right now.

It looks like Magniv is targeting Python in general. This is similar to ClearML. What are the differentiating points to Magniv compared to similar products?

It seems like the product also integrates with SCM systems. Are you using gitea and then containers to push code and data to execution like CodeOcean?

https://github.com/allegroai/clearml

https://codeocean.com/

Yeah, so one of our differentiating points is that we can integrate with whatever scheduler you are already using.

On top of that a lot of the libraries that exist are focused on ML, focusing on resources/gpu etc. We are more focused on the data science side of this problem.

Similar though.

We’ve been trying to plan out building our data team at my company— been so hard finding a data scientist to do infra too. Wonder if this would help...

Yes! Please sign up on our website, would love to chat further and see if it can help. Our goal is to decrease reliance on data engineers when building data teams

Sounds good. Just signed up

Very hyped to see where this goes. Much needed for data science teams.

The “our experienced ex-Facebook engineers” sounds like a bit weird claim to me, TBH. I imagine them securing a continuous flow of ex-FB employees to guarantee this in the future.

are you ex fb, if so you are hired.

The two founders are two of the smartest people I know. I think Magniv will be a game-changer for data science teams

Thanks man!! Now back to building..

Reply on news.ycombinator.com