idkyall

> Hardware companies simply don't pay as much as software companies in industry. I don't fully understand the reasons, because hardware is often more difficult to deal with than software.

My theory is it comes down to the margins on software vs hardware products. If you look at software, in a certain sense, your unit margins are infinite - your variable costs are nothing(well, besides the literal bandwidth) to copy a piece of code and sell it to a second customer. With hardware, for every unit of your product, you have raw material cost, mfg, transport, etc. At scale, there's less $ to go around.

Small Nit: "This grammer can be used during LLMs generation."

I didn't know Llama.cpp had this grammar feature, so this is interesting.

I can't speak to rrweb specifically, but I can say having used open source projects at large companies that sometimes they require major code changes to work around an internal limitation or use case that upstream frankly might not want.

E.g., my team wrote an exporter plugin for an internal only database, so there's almost zero value to open source it when other exporters for OSS data sources already exist as reference material.

I wonder if maybe they cache and re-serve answers to similar prompts? Probably they could use a GPT-4 response as a template and have GPT-3.5 tweak it to be specific to your prompt

But Slack is owned by Salesforce, a US company

I've seen at least one startup around this idea posted on HN: https://codecomplete.ai/

Probably also tiny corp for self hosting: https://geohot.github.io/blog/jekyll/update/2023/05/24/the-t...

I think there's a tremendous concern about letting data exfiltrate to any AI SaaS offering among business execs. If you could offer an experience minus the cloud that's easy to use and has compliance/logging features, I think you'd find success from industries that are reticent sharing customer data(e.g. Banking, government) who benefit greatly from the NLP workflows that LLMs enable

I think it's hard to comment because this depends on the HCOL/LCOL area, the company and the level very wildly. I believe Netflix Seniors make that level of cash comp, and I'm sure staff/principal+ at a large tech company in the bay area or HCOL could push 300k in salary.

Assuming you mean the US. I think it depends a great deal on the area and part of the economy you are targeting. I have seen a ton of hiring in my local area by banks, for example. The large cap tech company(b2b) I work at is still in a hiring freeze, by contrast.

I doubt that startup funding will recover much until interest rates go down, as I think the general attitude right now is pretty conservative about investment. Probably this will recover early to mid ~2024, and definitely by 2025[1] depending on when the US Fed cuts interest rates.

[1]https://www.federalreserve.gov/monetarypolicy/files/fomcproj...

Wait, can llama.cpp accelerate inference without full VRAM for the model? Or do you mean Llama 65B quantized to fit?

> 32 GB minimum, but 16 GB recommended.[0].

I see Memory: 6 GB RAM under Minimum

Yeah, that's fair. I think another thing is that a lot of these internal tooling projects date back 5-10 years when open source alternatives may not have been viable yet. For example, my company uses an in-house written time series database, which probably made sense at the time because when the project started, Prometheus wasn't 1.0 yet. Now it's reaching growing pains as we've scaled, and at this point it's a bit of a sunk cost fallacy to not migrate off of it.

Another thing is that sometimes it's truly impossible to use one-size fits all for some tools if your company scale is large enough. I've heard from friends at Amazon that the dev experience and tools are totally different in the hardware space than it is for those working in the retail or AWS orgs.

Some interesting follow-ups on OthelloGPT https://www.neelnanda.io/mechanistic-interpretability/othell...

Seems pretty bad right now. A lot of companies, mine included, are in a hiring freeze. Some companies outside of big tech are hiring(I noticed quite a few jobs from banks), but a lot are expecting relocation or hybrid in addition to substantial pay cuts compared to tech salaries. I've had most of my recent applications rejected without even a recruiter call when in the past I had felt my resume was very strong.

Look, I'm not the biggest Mark Zuckerberg fan or anything, but I don't think the thus-far questionable business decision to pivot to the metaverse is quite the same level as having an very public mental breakdown and making anti-semitic remarks

Developer credentials should not be able to deploy to production, only CICD system credentials should.

Absolutely, you need proper controls in the system to control and authorize deployments with appropriate responsibilities in place, but fundamentally if your deployments are fully hands-off, it shouldn't matter who clicks the 'deploy' button

"I make the systems IT uses"

Isn't there a theory that any nootropic substance needs to have a downside or we would have naturally evolved it by now? I am amused thinking of the idea that this drug being a laxative is that downside

If I were a visitor to planet Earth, I'd still want to visit the grand canyon, I think

Vicuna is a specific open source AI LLM: https://ai.plainenglish.io/vicuna-the-unparalleled-open-sour...

Yes, I would imagine PoW for Ethereum was millions of GPUs at least

I imagine someday we'll see a protocol like this - autonomy in a controlled situation, such as clearing out a traffic jam

I wonder if American Idol or Paula Abdul has paid to reduce some of those results in relevance

It's sort of a catch-22, Law in the US is only a lucrative market to disrupt because the regulation and gatekeeping has made labor expensive. If lawyers didn't bill 300+/hr in the US, then an AI powered startup to replace them wouldn't be cost effective. There's a joke I saw recently about a guy hiring a lawyer for a $800 traffic violation and getting a bill for $1200.

I can't speak to the price of a lawyer abroad, but a quick google seems to indicate US lawyer salaries on avg are up to ~2x as much as in some parts of Europe[1][2].

[1]https://www.legalcheek.com/2020/12/revealed-the-eu-countries...

[2]https://money.usnews.com/careers/best-jobs/lawyer/salary

The article listed his options price at $18.71, so even with a slump in the share price they're still valuable, albeit a large multiple less

>Drones capable of monitoring traffic would be even less cost-effective than helicopters, he said, and a drone wouldn't be able to med-evac anyone.

Certainly the med-evac point is valid, but I bet you could come up with a basic traffic monitoring system using an off the shelf Drone today for a fraction of the cost of a helicopter, fuel, and pilot.

There are still traffic ticket cameras in some parts of the US(Washington DC), but in many places they are challenged legally: e.g. https://www.click2houston.com/news/local/2020/04/08/ask-2-wh...

Seems VW and Mercedes have highly rated systems today[1] [1]https://www.euroncap.com/en/ratings-rewards/assisted-driving...

I am not a lawyer, but I don't think this necessarily confirms that as a legal decision. This is the case for assets that were in a lending program and had a terms and conditions which gave all rights to Celsius. I think any reasonable interpretation of the law would see that as a different scenario vs a company providing custody services.

Comparing to the Coinbase user agreement[1]: "2.7.1. Ownership. Title to Supported Digital Assets shall at all times remain with you and shall not transfer to Coinbase. All interests in Digital Assets we hold for Digital Asset Wallets are held for customers, are not property of Coinbase, and are not subject to claims of Coinbase’s creditors. " [1]https://www.coinbase.com/legal/user_agreement/united_states#...

Specifically within California, the cost of living for things like housing is sky high if you live local to SF or SV. I live in a lcol and own a home, but home ownership with my same salary would be impossible in a HCOL area. I would easily pay 3-4x as much for the same amount of property. To relocate and keep the same standard of living, my salary would need to effectively 1.5-1.7x just to offset the costs of a higher mortgage payment. And renting in an average apartment in the area would cost at least much as my current mortgage.