It doesn't go to zero, however!
4,849 karma · joined August 21, 2013
It doesn't go to zero, however!
It is pretty clear that Nvidia is sunsetting FP64 support, and they are selling a story that no serious computational scientist I know believes, namely that you can use low precision operations to emulate higher precision.
See for example, https://www.theregister.com/2026/01/18/nvidia_fp64_emulation...
It seems the emulation approach is slower, has more errors, and doesn't apply to FP64 vector, only matrix operations.
Did you profile at all? And have you observed if it's not compute-bound? If it's memory or IO bound it can be due to other virtualization overheads, such as memory encryption.
The two largest supercomputers in the world are powered by AMD. I don't think it's accurate to say Nvidia has monopoly on HPC
The essay attempted to mitigate this by noting OAI is nominally a non-profit. But it's clear the actions of the leadership are firmly aligned with traditional capitalism. That's perhaps the only interesting subtly of the issue, but the essay missed this entirely. The omission could not have been intentional, because it provides a complete motivation for item #2.
[1] #2 is 'The US is a democracy and China isn’t, so anything that helps the US “win” the AI “race” is good for democracy.'
This is the crux of the issue. There's simply no clearly articulated doom scenarios that don't involve massive leaps in capabilities that are explained away by the 'singularity' being essentially magic. The entire approach is a doomed version of deus ex machina.
It also appears quite telling the traditional approach is focused on exotic technologies, such as nanotech, and not ICBMs. That's also magical thinking.
It's that start up funding that will drive talent, more than anything else.
For example, high bandwidth, low latency interconnects, supporting GPU direct network messaging and IO, are important.
High memory bandwidth is also quite important.
Debugging and performance profiling at scale also commonly uses similar tools.
Juicy. Anyone have a link or context to this? I'd not heard of this reception to NOVA and related.
Frontiers in Artificial Intelligence for Science, Security and Technology (FASST)
DOE is seeking public input to inform how DOE can leverage its existing assets at its 17 national labs and partner with external organizations to support building a national AI capability.
More doctors working on the same amount of medical demand will be an increased supply of doctors, and so will reduce doctors salaries.
This seems like an ideal outcome for consumers, and I suspect the AMA would lobby against this. But American doctors should also be aware that their famously world class compensation might be reduced with this tradeoff.
I agree but doctors should go in with open eyes that working fewer hours will require more doctors, and this will in turn drive down MD salaries.
I think that's a great idea, but that seems to be the undeniable tradeoff.
"Although biological ageing was accelerated in sedentary and highly active classes, after adjusting for other lifestyle-related factors, the associations mainly attenuated."
"Conclusion: Being active may reflect a healthy phenotype instead of causally reducing mortality."
Therefore, the paper isn't supporting the article claim that too much exercise is speeding up aging, rather, that this is dominated by genetics.
Even if true, that would imply ANY probability of a comfortable lifestyle is ~0.
The world's largest computer, Frontier at oak ridge national laboratory, runs AMD GPUs. AMD is undisputably the #2 in the GPU space.
The fact that GROMACS is unwilling to drop CUDA support to stand fully behind SYCL is very telling.
> Banding together with Intel to support SYCL would in my opinion
Except that Intel has more control over SYCL and has repeatedly hurt AMD products with anticompetitive behavior in the past. Why would AMD permit their software to be controlled be a competitor?
AMD is executing with ROCm NOW, with multiple Top500 supercomputer wins and deployment in major cloud vendors with MI300X. Yes, the software needs to improve, but the practice of throwing out software to start over is not a good strategy.
AMD has far more momentum in the data center than INTC at present.
You are probably two years behind the state of the art. The world's largest supercomputer, OLCF's Frontier, runs AMD CPUs and GPUs. It's emphatically using ROCm, not just BLIS and AOCL. See for example: https://docs.olcf.ornl.gov/systems/frontier_user_guide.html
That's hardly non-existent support for HPC.
I disagree. I think this looks productive, but people who only do this will hit a terminal level and find themselves stuck.
Getting above this, into Principle/Director/Executive ranks certainly requires being a great communicator, but also typically involves __success__. I see this as shipping a successful product, closing a key customer deal, etc.
It's easy to see productive people and expect that being on top of email and product plans is what made them successful, but this is only an effect of their productivity and mastery of the product development.
Note that John Wick did have great production values: it needed much more than 'just' Keano. That logistics happened in the background.
The sooner I called myself a scientist in life, the better.