What can we use fields of GPUs for next?
The "twist" is they rot as e-waste every 18 months when newer models arrive, generating roughly 30,000 metric tonnes of eWaste annually[0] with no recycling programmes from manufacturers (like Bitmain)... which is comparable to the entire country of the Netherlands.
Turns out the decentralised currency for the people is also an environmental disaster built on planned obsolescence. Who knew.
[0]: https://www.sciencedirect.com/science/article/abs/pii/S09213...
Only proof of work systems, such as Bitcoin. Proof of stake such as Ethereum is a lot less energy intensive
Is it any worse now than say, the NYSE ?
This reference says energy usage was 0.0026 TWh (2.6 GWh, or 2600 MWh) in a year
https://ethereum.org/energy-consumption
If the power was used over the whole year (and not just one hour)
(2600 MWh / year) / (24 * 365 h/year) = 0.29 MWh = 296 kWh. Thats like hair dryer levels of power consumption (if the hair dryver was left on all the time)
Even if we continue down this route, its something like 15% of global stock transactions going through NYSE, per transaction its extremely efficient when compared to Ethereum; but thats not the argument anyway- its that the hardware used for mining is barely useful outside of that use-case, and the shelf-life is very low to boot.
If there was a use-case, we’d have found it by now, since 30,000 Tonnes a year of it ends up in landfills, surely someone would dig it out or buy it if it had utility.
Let's say tomorrow OpenAI and Anthropic have a huge down round, or whatever event people think would mark the end of the bubble. That doesn't mean suddenly nobody is using AI. It means they have to rapidly reduce burn e.g. not doing new model versions, laying off staff and reducing the comp of those that remain, hiking prices a lot, getting more serious about ads and other monetized features. They will still be selling plenty of inferencing.
In practice the action is mostly taking place out of public markets. We won't necessarily know what's happening at the most exposed companies until it's in the rear view mirror. Bubbles are a public markets phenomenon. See how "ride sharing"/taxi apps played out. Market dumping for long periods to buy market share, followed by a relatively easy transition to annual profitability without ever going public. Some investors probably got wiped along the way but we don't know who exactly or by how much.
Most likely outcome: AI bubble will deflate steadily rather than suddenly burst. Resources are diverted from training to inferencing, new features slow down, new models are weaker and more expensive than new models and the old models are turned off anyway. That sort of thing. People will call it enshittification but it'll really just be the end of aggressive dumping.
It's also possible non-tech industries just have a collective imagination failure and can't find use cases for AI, but I doubt it.
I’m not worried about the technology flourishing. I’m worried about my fucking retirement, know what I mean? The question isn’t whether there is demand, it’s how much demand there is, because they’re betting on having all the demand. I don’t have a ton of money. People getting this wrong in a way my financial advisor can’t outmaneuver is an existential threat to my ability to not live in crumbling public housing in a few decades.
We’re talking about this needing to meaningfully move towards making whole digit percentages of the US GDP, soon. Not only are these initiatives largely unprofitable, they’re increasing their expenses based on hopes and vibes. I think a whole lot of people are so focused on short-term gains and being king of the hill that sustainability is a distant afterthought — just like it was in the .com era. I have zero faith in the current cohort of tech leaders to get this right.
Some local models run well already too and do the job. Not sure if i would pay any money when a discarded mac can run these just fine already.
This may turn out like trying to make people game over streaming.
At least, the GPUs that are currently plugged in. A lot of this bullshit bubble crap is because most of those GPUs (and RAM) is sitting unplugged in a warehouse, because we don't even have enough power to turn all of them on.
So if your question is how to use a GPU... I got plenty of useful non-AI related ideas. But only if we can plug them in.
I wouldn't be surprised if many of those GPUs are just e-waste, never to turn on due to lack of power.
That's my fear.
The problem is these GPUs are specifically made for datacenters, So it's not like your average consumer is going to grab one to put into their gaming PCs.
I also worry about what the pop ends up doing to consumer electronics. We'll have a bunch of manufacturers that have a bunch of capacity that they can no longer use to create products which people want to buy and a huge backstop of second hand goods that these liquidated AI companies will want to unload. That will put chip manufactures in a place where they'll need to get their money primarily from consumers if they want to stay in business. That's not the business model that they've operated on up until this point.
We are looking at a situation where we have a bunch of oil derricks ready to pump, but shut off because it's too expensive to run the equipment making it not worth the energy.
Servers can (and do!!) use 10+ year old hardware. Consumers are kind of the weird the ones who are so impatient they need the latest and greatest.
The flock cameras are going to be fed into them.
The bitcoin network will be crashed.
A technological arms race just occurred in front of your eyes for the past 5 years and you think they're going to let the stockpile fall into civilian hands?
That's truly e-waste. Now in practice, we programmers find uses of 10+ year old hardware as cheap webhosta, compiler/build boxes, Bamboo, unit tests, fuzzers and whatever. So as long as we can turn them on we programmers can and will find a use.
But because we are power constrained, when the more efficient 1.8nm or 1.5nm chips get released (and when those chips use 30% or less power), no one will give a shit about the obsolete stockpile.
In what sense? Not competitive for chat bot providers to use? Is that a metric that matters?
> when the more efficient 1.8nm or 1.5nm chips get released
What if they don't get released? You don't have a broad and competitive set of players providing products in this realm. How hard would it be to stop this?
> no one will give a shit about the obsolete stockpile.
You have lived your life with ready access to cutting edge resources. You ever wonder how long that trend could _possibly_ last?
We are power constrained. The GPUs of this generation can't even be plugged in yet because of these power constraints.
When power is a problem, getting lower power GPUs in is a priority. The 1.8nm and 1.5nm next generation is already in production, and will likely launch before these massive GPU stockpiles are used.
And then what? Why plug in last generations crap when the next generation is shipping?
--------
Todays GPUs have to actually launch and be deployed while they are useful. Otherwise they could fully be obsolete and lose significant value.
Seems like the G in GPU is very obsolete now:
https://www.tomshardware.com/news/nvidia-h100-benchmarkedin-...
> As it turns out Nvidia's H100, a card that costs over $30,000 performs worse than integrated GPUs in such benchmarks as 3DMark and Red Dead Redemption 2
I would love to live in the world where everyone joins a pool for inference or training, and as such gets the open source weights and models for free.
We could call it: FOSS