1,367 karma · joined August 27, 2024
Oh so you mean the thing HuggingFace wasn't doing at all while also allowing any user's arbitrary programs to call out to the open web from prod?
Ended up giving it away to an irc friend for the cost of shipping, they used it to start a minecraft server hosting business.
20 years later I now have nieces and nephews wondering how I know so much about minecraft, can't wait until they're a little older so I can host one for them. Funny how much and how little things change
Goddamn if that buyer's remorse didn't scar me for life, the amount of researching I did before any purchase from then on was obsessive. I still think of the card fondly for what it represented to 10 year old me. This story does have a happy ending, we ended up getting a Dell XPS not long after with a Pentium 3 & a GeForce 2, back when they were still beige.
Similarly I am not willing to wrap a LiPo battery around one of my fingers. Absolutely not. I suspect this is in part why we have not seen more smartwatch bands doing the same.
But to reason in other direction, unless you absolutely need cards right now, you could throw that ~$1440 in a 6 month CD and let the 4.5% pay for the tax or shipping on a 10090 XT or whatever RDNA 5 flagship when those drop in about as much time. If it lands anywhere close to what the rumors are indicating it should be a fucking monster.
The FP16 throughput on RDNA1 is both shader reliant and requires everything to be packed first. Even with 2 or 4 or 1000 cards, you would be consuming all of the available memory and memory bandwidth just packing and unpacking values, and if you really want to dump a hundred billion tokens into making it work anyways, you're only going to find out that even if you bother to sit there ferrying packed values to ram or disk before then issuing the instructions, paying that already severe penalty again when the values then have to be unpacked is so steep of a cost that the 256 BF16 flops/cu/clock's effective throughput is outright lower than simply doing it on a Zen 2 processor. You also don't have INT8 (or really INT4) on RDNA1 so the other RNS/CRT tricks aren't viable.
Sadly RDNA1's VCN2 also lacks actually good x264 bframe encoding support, or even P010 for 10 bit color, so what I'm saying is you should sell them. Used Radeon VII's are like $260, you'll go a lot further with those especially if you throw in a 7900XTX, and then augment that further with a 9070 CRE (you only want it for its int8 cores), and of course 128GB of ram.
E: And sure, that's 3, or ideally 4 GPUs, and a good bit of extra work. But that gets you up to more than halfway to the naive performance of a $15,000 MI300x in a surprising amount of cases, with additional strengths that it lacks. For far less than half of the cost
But also what the fuck happens to the core of such a planet when that happens?
We aren't actually sure what gave our core the spin it has, right? I'm not fully awake yet but I think it's plain where I'm going with this.
I saw someone call out the stock performance of $OC (shingles) vs strong el ninos... it seems so obvious. What else is like that?
The 90s were lit
Nah you're right tho let's imagine the worst case scenario. What if that person in the waymo had a nuclear bomb in their suitcase? There's only one option
Intel is going nowhere but we all knew that anyways.
And again, you must not be paying attention, AMD is doing exactly what they said they would. No flagship for RDNA4 (just like RDNA2), RDNA5 flagship (10900 XT) coming right on schedule
If it's your personal stuff, skip it at your own peril. If it's a paid responsibility, that's what hourly billing is for (this incentive was much stronger when I learned netadmin, back before nvmes)
It's always been my understanding that virtually everyone cheats (doctors/non-computer engineers aside)