531 karma · joined June 13, 2025
Training a decent open weight model takes atleast millions of dollars and they are all associated with real people and companies, almost exclusively in the US and China. So just make normal open weigjt go through bio testing before release and that gets you a lot of the way there.
There is more problems like finetuning but you need to start somewhere.
China is also financially repressing their people to build often useless infrastructure projects to be fair they are also not the good guys.
Doesn’t mean that you have to think only Anthropic should be able to make bioweapons or whatever, but it just feels like this ignores the risk
People who know him frequently refer to Altman as a literal psychopath unprompted. People who don’t know Dario just find him arrogant.
And China has invested immensely in sovereign chip industry for a long time and is still incredibly behind.
I'm curious how hard the go to market in hard tech like this is? What is the long term economic model in terms of what you think the margin can be and what the incentives for plants to adopt this technology?
The main reason is the machines they use to scan books at scale destroy the books in the process.
I made a Rust version of Valkey/ Redis was wondering if this would become relevant.
I.e. for Google to build data centers they need the US gov to play ball, so if they were considering a service of hosting open source models on their TPUs they wouldn't do this. Another example is the merger between Paramount and Skydance where they paid out Trump to get the merger approved [1].
[1]. https://www.yahoo.com/news/paramount-settles-donald-trump-la...
I know people are working on these things I just haven’t seen the right way yet. Like in manufacturing right now people are trying to encode what skilled machinists do into software and scale it up, we need to go further on that for Math/ data analysis etc.
Seems like hyprland is on C++ so maybe not a direct use case but thought Lua people in general might be interested.
The question is just how to organize these outputs and conclusions in a way that is consistently reproducible and also how to correct errors or remove LLM nonsense where it refuses to take a position on something.
Before it made sense to do this in papers but it feels like we need something like a paper format.. that is fully reproducible ideally and optimized for aggregating knowledge in a better way. I.e. before a person spent months on one of these and there was just more filtering, and the output itself was a clear signal of time spent and effort that no longer exists.
But yeah it’s kinda a zone where most weekends there’s no problems so it’s not a huge priority… until it is
Here is a real use case: you are are responsible for some alerting channel. You have datadog/ cloud logging/ github all connected. You see a bunch of alerts come through while you are out and about and you prompt CC to investigate - Claude triages and says “all of the sudden you are getting time outs from this bank API your company partners with, this started an hour ago. It’s happening on ~15% of requests”. So you ping the guy at your company who does vendor relationships and go back to your weekend.
This is a non hypothetical example. Obviously it would be better if your job had a real on call rotation and more robust alerting and you wouldn’t be getting slack alerts on the weekend… but I take the approach this job affords me a lot of nice flexibility so it’s ok
I find it hard to imagine having a chatbot fix your broken SQL query or summarize some event be experienced as gross.
> Your dichotomy is bullshit.
Middle class is the 25th-55th percentile of income. Most workers in tech/ finance/ law are above the 55th and most people in the trades are below it. Teachers and the like aren’t going to directly benefit from construction, but would atleast benefit from property taxes.
Obviously any given project is temporary but it seems like there will be a multi year build out so lots of projects.
There is then the secondary effect of skilled labor like machining and manufacturing parts for these centers locally when it makes sense, I.e. turbines or rack assembly.
Data centers pay high property taxes which has been huge in places like Virginia.
And then it’s not just data centers there is kinda a larger war on construction in the North East in general. So NYC blocks tons of common sense urban infill, the state blocks common sense infrastructure projects, and it’s death by a thousand cuts and people just leave the area or leave the trades because it’s not worth it.
Genuinely huge projects like Microns $100B fab in NY get delayed and moved to the center of the country [1], which would’ve been huge for the local economy in terms of spending and opportunities.
[1] https://www.constructiondive.com/news/micron-delay-construct...
New York heavily restricts construction and infrastructure projects of all kinds. The tech and finance elite will stay here but normal people who are trying to make a decent living in construction and similar trades will end up following opportunities.
NYC population is declining after all [1] largely because the city would rather treat housing as a scarce resource for them to divy up than something to increase the supply of.
[1]. https://www.realtor.com/news/trends/new-york-city-population...
The electricity is expensive basically due to the state, so we have to block economically productive projects like data centers because we made our resources artificially scarce. I.e. Indian Point 2 GW Nuclear Site was shut down in 2021, replaced by Natural gas. And then we pay high prices for Natural Gas since we block building of gas pipelines.
NYC is also home to some of the worlds most productive financial and tech companies - it makes tons of sense to have datacenters located close by for latency reasons.
All these laws that block tons of economical construction are made by people who have already "made it" financially and then the class who benefits by having a robust construction, manufacturing, and machining type economy is screwed and we need to turn to destructive measures like rent control.
A lot of the time people state the kind of fundamental limitations of LLMs very confidently when it feels like it is too early for people to really know. Like we are already well past the point where where LLMs are just pre trains on the internet with some RLHF for chatbot… Most of the effort is spent on elaborate reinforcement learning.
Is it unconceivable that future generations of LLMs could be RL’d to use einsteins visual method for theories [1] with the right tooling and geometry representations? Or just something random like that.
[1]. https://www.visualscribing.com/blog/2019-11-11-einstein-on-v...
Like are you saying that AI is still kinda not a powerful tool and unlikely to become geopolitically relevant etc? I don’t know how to relate this to culture war media frenzies which is rather stay out of.
It’s more he screamed that bacteria is gonna do evolution faster than any before it and turn into a beast that destroys the world, and now that bacteria has turned into a squirrel so far. He’s been very right so far and if that squirrel keeps sizing up you’d want to give him credit.