HNHacker News
TopNewBestAskShowJobs

cthalupa

5,961 karma · joined April 24, 2014

Opinions are my own, and not that of anyone or anything else.
submissionscomments
cthalupa··on AMD Ryzen AI Halo – $4k AI Dev Kit
I’ve got a 128gb m5 max mbp and two sparks. For my real-world use cases, a single spark running DS4 Flash will have fully responded by the time my Mac has even started generating tokens. I figured I’d have more generation heavy work when I also bought the Mac, but it has done very little work running LLMs since I got the first Spark.

I mostly run them clustered for DS4 and am quite happy with the performance, and the cost isn’t that much more for two than the MBP while giving me double the unified memory.

I’ll probably pick up a third to run multiple smaller models. I don’t understand why people would buy a halo over a spark at comparable prices, particularly because if you want to cluster, the cx7 be beats the shit out of them when it comes to latency and throughput

cthalupa··on Nvidia is proposing a beast of a CPU system for Windows PCs
Plenty of demand outside the US. Why would the hyperscalers not buy the chinese RAM for all of their datacenters across the world besides the US one?

Rising supply from China will impact prices even in countries where there are tariffs.

cthalupa··on Nvidia is proposing a beast of a CPU system for Windows PCs
Anything where you're dealing with a large volume of records/documents. Lots of people are using these for large-scale digitization of documents - scanned stuff being OCR'ed and summarized, generating embeddings, etc. Large scale translation.

Anywhere where you might have a large backlog of data to work with can end up in this sort of situation.

cthalupa··on Nvidia is proposing a beast of a CPU system for Windows PCs
> The cuda cores can be broken up into compute complexes which larger blocks of memory directly attached to the cores.

Perhaps in theory, but for the gb10 stuff the memory is all on the CPU die and connected to the GPU die via nvlink-c2c

cthalupa··on Nvidia is proposing a beast of a CPU system for Windows PCs
The dgx spark is the same chip and those are in the low 3s to 5 range for most of them depending on manu, storage config, etc. The dgx sparks also have connectx 7 cards in them to support the 200gbps networking for RoCE.

So I would expect the mini PCs to come in less than the sparks. Laptops I assume will be close in price with the addition of all the other laptop stuff.

cthalupa··on Nvidia is proposing a beast of a CPU system for Windows PCs
Prefill is another advantage vs. Apple. It's way way way way faster on a spark than it is even on an m5 max.

Same model, same quant, same query, as close to as matched settings as I can get from vllm, and for workloads with large prompts + low cacheability, one of my sparks will often be done responding before the mbp is done with prefill.

cthalupa··on Nvidia is proposing a beast of a CPU system for Windows PCs
Not true. This is aimed squarely at the Strix Halo and Mac markets. It's basically just strictly better than the Strix, and it's not clear cut vs that Macs in any sort of blanket statement.

My M5 Max 128gb MBP decodes faster than one of my Sparks, but the Spark's prefill is so much faster it can often answer the same query before the mac's prefill is finished. If you have large prompts, low cacheability, etc., a spark might be a very good options.

Not to mention you get can get two sparks and the MBP will be 85%+ of the cost at half the RAM.

I'm kind of tempted to pick one up. Leave running big models to my dual dgx setup, and all the misc. random stuff on an rtx.

cthalupa··on Nvidia is proposing a beast of a CPU system for Windows PCs
For these in specific, they appear basically transparently to the GPU. There's a lot of software/firmware stuff for this, but also a different hardware architecture - while the RAM is on the CPU die, the nvlink-c2c gives it extremely low latency and 600GB/s bandwidth between the GPU and CPU.
cthalupa··on Did Claude increase bugs in rsync?
> If I see code like the one above posted by the OP, that the author wouldn't have written, I start to pay attention.

Except the author did write it. https://github.com/RsyncProject/rsync/issues/959#issuecommen...

Which is part of the problem with all of this nonsense right now - everyone is running off of emotion and not looking to see if what is being said is actually true. Which is somewhat ironic, considering the message of the article.

cthalupa··on Microsoft builds MacBook Pro rival with NVIDIA-powered Surface Laptop Ultra
Never had this issue with any of my MBP. I never even have magsafe available, couldn't tell you where a USB-C to magsafe cable is in my house if my life depended on it.
cthalupa··on I put a datacenter GPU in my gaming PC
There are a variety of inference engines that support this, regardless of whether or not there is native FP8 in Ampere - llama.cpp will do it quite happily. VLLM you can do W8A16 quant too.

There are a whole lot of ways to quantize models in general.

cthalupa··on Microsoft builds MacBook Pro rival with NVIDIA-powered Surface Laptop Ultra
I remember getting my first CalDigit TB dock and being excited - everyone seemed to love them. I expected it to largely Just Work.

That thing Didn't Work more than it Worked, but options were slim. Eventually it fully died about 14 months in. I didn't even bother checking to see what the warranty terms were. TS3 Plus, back in 17 or 18. What a piece of shit.

Sounds like it's a good thing I didn't bother trying again in the early 2020s and only recently bought a new dock.

cthalupa··on I put a datacenter GPU in my gaming PC
You can split tensors across an AMD GPU and Nvidia GPU - different architectures are not an issue. People run LLMs across some pretty crazy setups.
cthalupa··on I put a datacenter GPU in my gaming PC
I've had multiple X520-DAs in desktop cases for years without doing anything special for cooling. Hell, one of them was in a fully watercooled system that had very little in-case airflow.
cthalupa··on Amazon Web Services – Four Years and Out
To the best of my knowledge, the Indian support teams for AWS have all the same access their US/EU/etc. support teams have when it comes to escalation and communication avenues. Obviously real time communication is harder for them than the US counterparts speaking to teams in Seattle, but the same is true for a team in Ireland or Australia.

If you are building a follow-the-sun support organization for a technology company, would you really avoid building a support team in India? Seems like it's the country most likely to have a large enough number of people with the expertise and language skills to staff for the need, even if you were paying them the same as their US counterparts.

cthalupa··on Amazon Web Services – Four Years and Out
From talking to people I know on support teams at hyperscalers and other tech companies: A mind-boggling huge portion.

But even as an AI believer and thinking it's great for this sort of thing, I also think if it's good enough for this sort of work, it should be good enough to identify when it's not capable of providing value, too.

cthalupa··on An OpenAI model has disproved a central conjecture in discrete geometry
You have a minority view on this argument, though. Scientific and structural realism both reject the idea that math is just a map. You've got company with the instrumentalists and antirealists, but the majority consensus is that math is somewhere between the structure underlying the territory to all the territory.

Zero was already part of the territory. Lack of something is a very normal state in the universe. Once we added it to our understanding of math, we were discovering it, not creating it. Of course people who are scientific or structural realists would agree it didn't change reality - because reality already had it, whether we knew it or not.

cthalupa··on An OpenAI model has disproved a central conjecture in discrete geometry
Well, I was thinking more along the lines of, say, multiplication and division - you can handle every single equation humanity has ever come up with without either of them. It might be messy and awful and annoying, but I would say in particular these operations are invented more than discovered.

So, more properly phrased, we created some operations.

cthalupa··on An OpenAI model has disproved a central conjecture in discrete geometry
I don't know what you're even trying to argue here.

We're not comparing math to reality (though there's a strong argument to be made that reality has a structure that is mathematical in nature - structural realism didn't die a scientific philosophy just because someone came up with a pithy saying), we're talking about if math is discovered or invented.

Most mathematicians would argue both - math is a language, we have created operations, axioms are proposed based on human creativity, etc., but the actual laws, patterns, etc. are discovered. Pi is going to be pi no matter if you're a human or someone else - we might represent it differently with some other number system or whatever, but that's a matter of representation, not mathematical truth.

cthalupa··on The AI water issue is fake
So basically you're asking everyone to just trust you, a random commentator that provides no evidence or sourcing, over an article written with extensive sourcing, details, and explanations?

You might be the correct person here, but you're not going to convince anyone like this.

cthalupa··on I returned to AWS and was reminded why I left
Most of the companies behind Valkey were writing significant code for Redis. It was certainly not a case of them paying nothing.

Valkey has some of the (formerly) most prolific Redis contributors for the era in which it was forked.

cthalupa··on Google removes "Doki Doki Literature Club" from Google Play
Avoidant behavior is defined as specifically attempted to avoid being exposed to things that remind you of your trauma.

Avoidant behavior is basically universally agreed to be a maladaptive behavior to ptsd.

cthalupa··on Google removes "Doki Doki Literature Club" from Google Play
Facilitating negative behaviors that prevent/increase the difficulty of overcoming trauma is not being kind to someone.
cthalupa··on Google removes "Doki Doki Literature Club" from Google Play
> There has been no proper research on the effectiveness of "being given a trigger warning, and then not consuming the content because of it."

Well, there has been. From multiple angles. One, avoiding content because it might trigger you is just... avoidant behavior. Which is pretty much universally considered a bad thing. There's a big difference from seeking out exposure because you want to do your own exposure therapy (bad thing) and just letting yourself be exposed to things in a more organic fashion (good thing).

Two, most research indicates that TW do not actually reduce the consumption of content. Not all of the studies are on "did they help people process content they watched," as a lot of them are "did the TW make people not watch the content to begin with." Mostly it seems to haven no impact. A smaller subset of studies showed effects in other directions - both reduction and increase of content viewing after TW. If they reduce viewing I'd argue this is bad because it's avoidant behavior, and I suspect that the 'forbidden fruit' effect is also not positive because it's now giving you pre-viewing anxiety and is no longer the more organic 'let exposure happen naturally, don't just stop watching the news because it might contain stories about war.'

cthalupa··on Google removes "Doki Doki Literature Club" from Google Play
https://www.ptsd.va.gov/understand/what/avoidance.asp

> A combat Veteran may stop watching the news or using social media because of stories or posts about war or current military events.

https://www.verywellmind.com/ptsd-and-emotional-avoidance-27...

> The avoidance cluster of PTSD symptoms involves efforts to avoid distressing memories, thoughts, or feelings, and external reminders like discussions about the traumatic event or encounters with people or places associated with it.

I don't see how specifically avoiding content that contains triggers is anything but avoidance behavior as discussed above - avoiding the news or discussions about war is pretty explicitly facilitated by TW - before the clip plays on the news, by people posting it at the top of their social media content, etc. And media with the content would fall in line pretty explicitly as an "external reminder"

Like, I don't think someone who has been physically tortured and dealing with PTSD should watch Hostel or other torture porn, and I don't think a vet with PTSD should watch a compilation video of some of the worst horrors of war. So I'm not arguing for massive exposure or intentional forced exposure, etc. But the fundamental issue is that going out of your way to prevent yourself from being exposed to it at all, which is what TW facilitate if they were to work, is pretty definitionally avoidant behavior.

cthalupa··on Google removes "Doki Doki Literature Club" from Google Play
Generally agree with basically everything you wrote.

For me it's not even really political - I certainly am not aligned with the "heterodox" community that has been so actively against them. I think if people want to put trigger warnings on things, they should be able to make that choice, and people should be able to abide by them if they think they want to as well.

The issue is how it is framed as being important for helping people heal, like several people have spoken of it being important for in this thread. And I don't think the game/movie ratings ever really purported to be a part of that - indeed, it's always been more of an age appropriateness thing from my understanding.

If all of this was just "People should be able to make informed choices about the content they consume" and no one on any side was making claims about the mental health benefits for people with PTSD or similar, I think it would be a nonissue.

> Basically, if you have anything like PTSD, you need an actual therapist not the collective hivemind of twitter (instagram these days?).

100%. Far far far more likely to get through it and overcome the trauma with a good professional guiding you through the process. Social media is just going to have you doing silly things like writing gr@pe or gr*pe as if somehow using a euphemism that you already map back to the original word is helping and it wasn't originally just trying to get around content filters.

cthalupa··on Google removes "Doki Doki Literature Club" from Google Play
Everything you wrote sounds really good in theory - it passes the smell test for me, and I believed it for a long time because it seemed perfectly logical. It all just Made Sense to me in an intuitive manner.

But there's pretty universal agreement that avoidant behavior isn't a good thing. There's a difference between the awful idea of trying to self-manage exposure therapy or forcing exposure and allowing yourself to be exposed to things in the manner that matches the 'real world.' If someone wants to put 'Dead Dove' on their ao3 and provide a a trigger warning because the fic is based around that thing, then yeah, that's one thing. I wouldn't recommend someone go watch Hostel if their trauma is at all related to that either. But most media that has triggering content aren't anywhere near those extremes. And obviously, if the trauma just occurred, it's a whole different thing. But if the studies that show an increase in avoidant behavior from trigger warnings are right, it's increasing a bad thing. If the studies that show a 'forbidden fruit' effect are right, then it's a negative for the proposed benefit from trigger warning proponents.

But most studies show no increase or negligible increase in avoidance for the study participants, including trauma groups. So if that's the case, they aren't doing what proponents are saying is their core benefit, either.

Meanwhile quite a few show an increase in anxiety from the warning itself, which is obviously a negative.

I'm open to the idea that there might be some effective way to do trigger warnings - more specific warnings up to spoilers, or something couching it in context of how this relates to recovery and how to manage it, etc. etc. - something along those lines. There's certainly plenty of precedent for a general idea being right and the initial implementations of it being bad. But proving that is going to come down to someone figuring it out and getting studies that show positive impact.

cthalupa··on Google removes "Doki Doki Literature Club" from Google Play
> The article does briefly mention "unhealthy avoidance behaviours", but in the context of one university's opinion and without supporting evidence.)

There's not much additional context here because avoidant behavior is basically universally understood to be a bad thing when it comes to the long term treatment of PTSD (this is separate from immediately/short-term after the event - different situation there) - there's no real serious argument against this idea, so when avoidant behavior is discussed it doesn't require context on why that behavior is a bad thing, in the same way that a an article targeted at cardiologists isn't going to explain why poor ejection fraction is an issue - it's baseline knowledge for the target audience.

The results are mixed on whether it encourages avoidance - some studies like https://www.sciencedirect.com/science/article/abs/pii/S00221... indicate that it does, others found no effect or negligible increases.

To be clear, I'm not definitively stating it causes avoidant behavior - I am saying that it might, which would be one of those 'worst case' scenarios.

Trauma groups have been part of the meta-analysis that indicate no real change in avoidance, and some have had the 'forbidden fruit' impact even in trauma groups, but it's in similar quantities as the ones that show an increase in avoidant behavior.

Fundamentally, trigger warnings just don't make a lot of sense to try and argue in favor of from a 'helping people with their PTSD' standpoint if you believe the science.

1) For them to have the effect you claim is desirable, they would need to avoid the content - but avoidant behavior is a negative when it comes to overcoming PTSD

2) The science largely indicates that it doesn't cause them to change their behavior at all in this manner - so the desired effect, it doesn't seem to do anything.

3) There's some evidence that it might increase avoidant behavior (science would call this bad!) and some evidence it might increase people exposure due to the 'forbidden fruit' effect (which would be bad from the supposed desired effect, and not necessarily good from the scientific standpoint - unnaturally being pushed towards something might also be negative vs. more 'natural' exposure, particularly when coupled with the upcoming point)

4) A variety of studies have shown that they increase anticipatory anxiety in people when they appear, which is of course a negative for anyone. I haven't been able to find any studies particularly engaging on this specific topic of anticipatory anxiety from trigger warnings + follow up exposure from the 'forbidden fruit' effect so this isn't something backed by science like the rest, but my gut instinct is that it would be more likely to be negative vs. something more organic. I could very well be wrong there.

I don't see any combination of piecing together these studies that could lead to a belief that trigger warnings provide value from a therapeutic standpoint.

cthalupa··on Google removes "Doki Doki Literature Club" from Google Play
Except we have some studies that show they lead to and reinforce avoidant behavior, e.g. https://www.sciencedirect.com/science/article/abs/pii/S00221...

Some also showed no evidence of this, but avoidant behavior is pretty much universally considered to be a specific maladaptive behavior when it comes to treating PTSD in the long run. It has nothing to do with the idea that it is the same as exposure therapy.

cthalupa··on Google removes "Doki Doki Literature Club" from Google Play
I think that's a reasonable argument.

A whole lot of people do make the argument that they are beneficial from a mental health perspective, though, and that's what isn't backed by the science. You can see discussion of it in-thread, even.

← PreviousPage 2 of 34Next →