HNHacker News
TopNewBestAskShowJobs

mistymountains

118 karma · joined October 11, 2019

submissionscomments
mistymountains··on We fine-tuned Llama 405B on AMD GPUs
Again, the problem is custom kernels in CUDA. It’s not straightforward for many applications (LLMs are probably the most straightforward).
mistymountains··on Venting Doesn't Reduce Anger, but Something Else Does, Study Says
It doesn’t sound like having a house will magically make you feel better. Plenty of people are just as exposed to markets as you yet respond differently. I suggest exercise, nutrition, nature, and extended travel if those are not already a part of your life.
mistymountains··on AMD's MI300X Outperforms Nvidia's H100 for LLM Inference
These kinds of comments make me think few people have actually tried. My experience has been 1 work day of getting things set up to work the same as before for training and testing (PyTorch).
mistymountains··on AMD's MI300X Outperforms Nvidia's H100 for LLM Inference
Unless you develop in CUDA, you can easily train code (e.g. PyTorch) written for training on Nvidia hardware on AMD hardware. You can even keep the .cuda() calls.
mistymountains··on AMD's MI300X Outperforms Nvidia's H100 for LLM Inference
I’m a AI Scientist and train a lot of models. Personally I think AMD is undervalued relative to Nvidia. No, chips aren’t as fast as Nvidia’s latest and yes, there are some hoops to get things working. But for most workloads in most industries (ignoring for the moment that AI is likely a poor use of capital), it will be much more cost effective and achieve about the same results.
mistymountains··on Tesla cuts even more workers as unsold inventory stacks up
Why would you want (versus need) a Tesla? It’s no longer an aspirational product, it’s an appliance.
mistymountains··on How to Study (2023)
For all you know he had a hard adjustment to the college workload. Maybe his high school was not serious and nobody really challenged him. You all could have interrogated why he may have struggled and shared your strategies for success, lifting him up rather than beating him down. That would make you true “brothers”.
mistymountains··on What it was like working for Gitlab
My (biotech, mostly remote) company does this. They may not love it but they realize they have to hire from SF, Boston, NYC etc to get the best ML talent and people expect market salaries / don’t want to up and move if they don’t have to.
mistymountains··on MBAs who can't find jobs
The issue is that actually, outside of technical paths, businesses do like to hire business grads as it allows them to do even less training and they usually don’t care if someone is well read or opinionated (possibly prefer the opposite).
mistymountains··on The GPT Store
Or, just maybe, AGI is a mirage with the bulk of its current utility as a marketing tool for much more realistic, if ultimately mundane, applications. OpenAI, of course, knows this.
mistymountains··on Mamba: Linear-Time Sequence Modeling with Selective State Spaces
You won’t teach yourself by running papers through Claude, and you won’t need to if you went from first principles rather than rushing.
mistymountains··on WiFi without internet on a Southwest flight
You gave your 9 year old a smartphone?
mistymountains··on Volvo to cease production of diesel cars in a few months
It’s annoying how much things have shifted now that you can’t really own a performance car without worrying if someone will mess with it.
mistymountains··on TikTok proposes giving US govt control over moderation, software, security
Yeah we all need to do better and trust China more! Lol.
mistymountains··on A Texas semiconductor boom on the horizon?
Is this your diagnosis? That things are more corporate in terms of outcome? Genuinely curious, as a Bay Area native, why UT/Texas can’t begin to compete given how many issues face SF currently.
mistymountains··on Running a 180B parameter LLM on a single Apple M2 Ultra
Cool it with the italics.
mistymountains··on X/Twitter has updated its terms of service to let it use posts for AI training
Comment datasets are valuable for conversational AI, it’s the same reason Reddit locked down the API I imagine.
mistymountains··on DMV tells Cruise to reduce its driverless vehicle fleet in SF by 50%
It’s probably the best from their training standpoint. The city is quite small relative to others and their only hope is to essentially memorize San Francisco in the neural networks. IMO you could not take a cruise and drop it into any other city and have it work.
mistymountains··on DMV tells Cruise to reduce its driverless vehicle fleet in SF by 50%
They’re too deep, their networks are overfit to San Francisco at this point. Making it work in other cities would require the insane training hours to basically memorize that city.
mistymountains··on Ask HN: Is GPT 4's quality lately worst than GPT 3.5?
I’ve seen this stated a ton and it’s not really true. Once trained, the model (except for decoding) is deterministic, and you can enforce determinism fairly easily. ChatGPT is not deterministic at the chat window but that’s not inherent to the model.
mistymountains··on Wall Street shrinks headcount as dealmaking and trading slump
Welcome to the real world. Move somewhere more affordable.
mistymountains··on Wall Street shrinks headcount as dealmaking and trading slump
Grow up.
mistymountains··on The open source learning curve for AI researchers
I’d be very careful about this.
mistymountains··on GPT-Prompt-Engineer
May I ask, are you a VC? This is a complete non sequitur.
mistymountains··on GPT-Prompt-Engineer
They don’t. They simply assume the model’s most likely output is meaningfully correlated with true rankings even though it was never trained on this task and certainly has not been trained to output the most likely prompt given a prompt in some meaningful order. It’s hogwash.
mistymountains··on GPT-Prompt-Engineer
Agreed. This is a pretty terrible idea.
mistymountains··on Hacking LangChain for fun and profit
It’s no longer useful / never was that useful. It’s main function was a shiny toy for investors.
mistymountains··on Classifying customer messages with LLMs vs traditional ML
No, you need to show the model is better on this narrow task, not just assert it is because it’s a great general LLM. It’s quite possible you’re correct but just saying GPT is the best, prove me wrong, reeks of a VC or AI bandwagoner.
mistymountains··on Classifying customer messages with LLMs vs traditional ML
The training classes in this case are words in the vocabulary in the context of a sentence.
mistymountains··on Classifying customer messages with LLMs vs traditional ML
It’s not similar other than that attention relates tokens.
Page 1 of 3Next →