9,265 karma · joined January 26, 2017
> the CCP is clearly the most capable threat—build AI models that are more powerful than those built by the US, and use them to achieve permanent military superiority or perpetrate incredibly deep repression of their own people.
This comes off a bit hypocritical, coming from one of the men responsible for the models most likely to be used by the US military, and for repression of US citizens.
> We should crack down on industrial-scale distillation operations ... We should have policy interventions to deter this behavior.
How exactly would you design policy interventions to stop distillation? If Anthropic wants to make their products available around the world, you would need some kind of global regulation to curtail it. And you would need to find some way to enforce it, which is far from trivial.
Honestly I don't see how securing models against distillation is up to anyone but Anthropic, if that's something they want to achieve. Calling for regulation is a bit like crying to mommy and daddy when things aren't going as you would like.
--
Overall, I can understand the argument that advanced AI models can present risks. But I don't see how regulation within the US can mitigate any of those risks. Any bad actor would be able to access the models outside the US, or covertly access the weights.
The only real way to prevent advanced models from being deployed would be to go around the world bombing every significantly powerful data center, and I don't think Dario would call for that any time soon.
The only thing this kind of regulation would achieve would be cutting US companies out of half of the innovation happening in the AI space, putting the US at a disadvantage relative to the rest of the world at everything except maybe frontier AI development.
The sound advice for the past decades has been, just invest in a low-cost ETF tracking the S&P instead of picking stocks to minimize risk and invest in the market broadly.
So a huge number of people have done that, believing they're diversified, while tech makes up 40% of the index.
Yes you could sell your S&P and find things to invest in least likely to be impacted by a potential bubble, but your average 9-5'er with automated contributions to their 401k is probably not sophisticated enough to do that.
And that's assuming only these companies would be affected if there was a massive draw-down in tech/AI related stocks. We haven't really seen a situation like this before, so it's not easy to predict what effects there might be in the broader economy.
At this point these companies make up a huge portion of 401k's for a huge chunk of Americans. How would it affect retirees if they dropped 40-50%, likely taking the market with them?
In the run-up to 2008 a big factor in the bubble forming was that poor quality loans were packaged in a way to hide the risk in those investments. I'm not expert enough in finance to know if it's the case now, but we do know that clever accounting to hide debt can lead to the incorrect valuation of assets, potentially leading to financial ruin.
If you use `assert` in tests, I don't understand why you wouldn't also prefer unwrap in this context.
I think it's also perfectly reasonable to use in a context like binary you run locally for private consumption, or for instance a serverless function which allows you to pinpoint the source of errors more easily in the logs.
It's not a good fit for cases where you do expect cases where the unwrap will fail, but it's a great fit for cases where you believe the unwrap should always succeed, as it allows you to pinpoint the cases where it fails.
Even their high-end prosumer hardware could be interesting as an AI workstation given the VRAM available if the software support were better.
I am honestly shocked Nvidia has been allowed to maintain their moat with cuda. It seems like AMD would have a ton to gain just spending a couple million a year to implement all the relevant ML libraries with a non-cuda back-end.
Probably you can squeeze a bit of optimization out of using Metal directly, but I think it's a more than viable approach to start with Vulkan/MoltenVK as a target, and add a Metal branch to the renderer when capacity allows (although you might never feel the need)
I have no insider knowledge, but I always wondered if those kinds of cultures had a hazing / blind-leading-the-blind aspect to them. I.e. the people who got hired were the ones who jumped through some arbitrary hoops, so they doubled down on those hoops being the right hoops to choose the best candidates.
It's a shame, because it's definitely powerful enough, and the idea of traveling with just an iPad seems super interesting, but I imagine they will not extend those features to any devices besides macs
So like if you are executing a series of commands, the one requiring admin privileges tends to be one you might want to be more careful about (i.e. altering system configs, or doing a potentially insecure operation)
So if you are running everything in an admin terminal, it seems like you wouldn't have that extra check to remind you to be extra mindful of a particular operation, since everything you do in that terminal is in the same bucket
But honestly I'm most amazed by the fact that there wasn't previously a way to run commands with elevated permissions in Windows. How did people work like that? Just run everything in an admin terminal super unsafely?
Some people won't follow the advice, but that's what code review and static analysis tools are for.
It seems to me the US healthcare system sits in this weird gap where it's not funded by private individuals, but it's also not publicly funded (excluding medicare/medicade/VA/tricare etc)
So it doesn't benefit from efficiencies of a single-payer system like the UK has, and it doesn't have to obey proper market forces either, since you have a bunch of for-profit entities in the middle, but the costs are obfuscated from the consumer unless you're unlucky enough not to have employer-funded health insurance.
So until you fix those core issues, I don't see how technological advancements are going to have much of an effect either positive or negative.
It's an orthogonal issue.