Hacker News Reader

Comment by mdmglr | Hacker News Reader

So just so I understand- this is all based on taking input from the user, injecting it in a template prompt that instructs chatgpt to answer the question based on providing it all the source material? What happened to building your own models to run offline?

View on HN

A trained AI model is a platform that you can build applications on. Pretty sure >90% of the developers in this space will be building applications, not models. Kinda like how the vast majority of mobile developers build mobile apps, not mobile operating systems. True, this particular application is pretty simple, but early applications are.

What happened to inventing wheels?

Ha! I do love making artisan wheels! :)

I agree on that. I think about it multiple times a day, but primarily I want that model but run client side or my own environment, and ideally without the content filter.

That's like complaining that a musician doesn't build their own piano. Or actually, it's like asking why they don't build their own piano factory. No sole developer has the skills or resources to build something like GPT. Even if it was open source no user would be able to run it locally anyway.

No, you completely miss the point.

It's like complaining that a musician cannot practice their instrument without software that requires you to be always-online.

> Even if it was open source no user would be able to run it locally anyway.

You are just stating this, it does not make it true. Several of us are running GPT-3 workloads locally.

> Several of us are running GPT-3 workloads locally.

Unless you work for OpenAI (and your “local” machine somehow has 1TB+ of VRAM, equivalent to roughly 25 A100s), this cannot possibly be true…

1.7k forks… https://github.com/openai/gpt-3

apart from that, several pre trained corpuses had been around for a while

That repo just seems to be a bunch of JSON files and sample outputs. Am I missing something?

Very strange counterpoint that makes no sense unless you're just arguing against cloud software in general, which was clearly not the point the parent made.

> Several of us are running GPT-3 workloads locally.

Several people out of 8 billion is the same as no-one. The point made was that anyone should be able to run this document assistant on their local machine.

> Several of us are running GPT-3 workloads locally.

Do you mind sharing how? I didn't think the model was available to download and thought it was api only?

It wasn't a complaint. I'm just trying to understand.

When I was in school, in AI/ML classes we needed to build our own models. So now I'm guessing that you use existing models...

I'm trying to gauge how behind the times I am.

In this day and age there is no way a well funded University Lab can build a model that is even a fraction as good as GPT-3. Just look at "Bloom", from BigScience a commendable effort but useless for any real world use case compared to GPT-3. Unfortunately moving forward, if you want to build useful apps that use ML Models, you need to call API's from well funded Industry groups.

Reply on news.ycombinator.com