609 karma · joined May 24, 2023
The article seems to lean into security and usability concerns.
On the security front: the weak-point is still the human. If you hand over your credentials to someone nefarious, well.. you handed over your credentials to someone nefarious.
Usability isn't convincing me either. One of the great things about email is that it really is the lowest-common denominator, as another commenter mentioned above. (Almost) everyone, from kids to the most tech-inept luddite have some sort of email.
You ship your code as a container within a library they provide that allows them to execute it, and then you're billed per-second for execution time.
Like most FaaS, if your load is steady-state it's more expensive than just spinning up a GPU instance.
If your use-case is more on-demand, with a lot of peaks and troughs, it's dramatically cheaper. Particularly if your trough frequently goes to zero. Think small-scale chatbots and the like.
Runpod, for example, would cost $3.29/hr or ~$2400/mo for a single H100. I can use their serverless offering instead for $0.00155/second. I get the same H100 performance, but it's not sitting around idle (read: costing me money) all the time.
With serverless GPUs, the cost has been basically nothing.
The challenge of understanding minified code for a human comes from opaque variable names, awkward loops, minimal whitespacing, etc. These aren't things that a computer has trouble with: it's why we minify in the first place. Attention, as a scheme, should do great with it.
I'd also say there is tons of minified/non-minified code out there. That's the goal of a map file. Given that OpenAI has specifically invested in web browsing and software development, I wouldn't be surprised if part of their training involved minified/unminified data.
I don't know what the threshold is, but I'm fine with the trade-off I received.
Depends on what you're deploying, really.
If it's one Go service per host, there's no real need. Just a unit file and the binary. Your deployment scheme is scp and a restart.
For more complicated setups, I've used docker compose.
> Also like setting up virtual networks among VPSes seemed like it required advanced wizardry.
Another 'it depends'.
If you're running a small SaaS application, you probably don't need multiple servers in the first place.
If you want some for redundancy, most providers offer a 'private network', where bandwidth is unmetered. Each compute provider is slightly different: you'll want to review their docs to see how to do it correctly.
Tailscale is another option for networking, which is super easy to setup.
I've done similar interviews in the past and they are remarkably high signal.
This sort of political rhetoric has a distinct smell that is very obvious.
Anyone browsing the internet without it at this point is doing it intentionally to be special.
The point is that, in practice, the attacks are so uncommon and mitigated by so many other factors that the cost involved of further mitigation it isn't worth it.
You develop a threat model to specifically get rid of concerns like this; not to list every possible attack vector imaginable.
Is BGP an attack vector that matters for the vast majority of threat models right now? I would say no. Given that: there is no need for (inevitably) poor regulation.
An example of RAG could be: you have a great LLM that was trained at the end of 2023. You want to ask it about something that happened in 2024. You're out of luck.
If you were using RAG, then that LLM would still be useful. You could ask it
> "When does the tiktok ban take effect?"
Your question would be converted to an embedding, and then compared against a database of other embeddings, generated from a corpus of up-to-date information and useful resources (wikipedia, news, etc).
Hopefully it finds a detailed article on the tiktok ban. The input to the LLM could then be something like:
> CONTEXT: <the text of the article>
> USER: When does the tiktok ban take effect?
The data retrieved by the search process allows for relevant in-context learning.
You have augmented the generation of an LLM by retrieving a relevant document.
It's not just SpaceX outperforming NASA, it's SpaceX outperforming everyone.
> Twitter dropped in value to just 25% of what it was.
It's a private company. You don't know the value.
> Racism and naziism are rampant, endless stream of bots pushing propaganda or porn
Maybe on your feed? Statistically, no.
> and has any advertiser actually come back?
Who knows. It's still running after firing anyone: that's the point.
Tesla was the first and still the only electric car player that matters.
Same with SpaceX and space.
Again: you can dislike Elon's personality or politics, but trying to attack his results is ridiculous.
If Elon is so horrific at SpaceX, why is it the only space organization (including NASA) able to innovate and ship anymore?
You can dislike his personality, but criticizing his performance is silly.