HNHacker News
TopNewBestAskShowJobs

skdotdan

338 karma · joined December 25, 2016

submissionscomments
skdotdan··on After months of coding with LLMs, I'm going back to using my brain
Personally, I use LLMs to write code that I would have never bothered writing in the first place. For example, I hate web front-end development. I'm not a web dev, but sometimes it's cool to show visual demos or websites. Without LLMs, I wouldn't have bothered creating those, because I wouldn't have had the time anyway, so in that case, it's a net positive.

I don't use LLMs for my main pieces of work exactly due to the issues described by the author of the blogpost.

skdotdan··on Trump temporarily drops tariffs to 10% for most countries
Not true. VAT does way less economic damage. Tariffs introduce massive distortions in the market.
skdotdan··on Young adulthood is no longer one of life's happiest times
Edited
skdotdan··on Young adulthood is no longer one of life's happiest times
As an anecdotal data point, I’m happier than in my early and mid 20s, and I have hope for my 30s.
skdotdan··on Overcoming the limits of current LLMs
This is not what hallucination means in the pre-LLM machine learning literature.
skdotdan··on Overcoming the limits of current LLMs
It’s used incorrectly. Hallucination has (or used to have) a very specific meaning in machine learning. All hallucinations are errors but not all errors are hallucinations.
skdotdan··on Prover-Verifier Games improve legibility of language model outputs
What do you mean by “true” RL?
skdotdan··on Dola Decoding by Contrasting Layers Improves Factuality in Large Language Models
The way I see it hallucination and factual error are particular cases of incorrect answer.
skdotdan··on Stable Video Diffusion
Deepmind tried something similar in 2018 https://deepmind.google/discover/blog/learning-to-write-prog...
skdotdan··on Was Rust Worth It?
Cool! Thanks!
skdotdan··on Was Rust Worth It?
Rust is great, but one thing I’d like to see is an interpreted, dynamic, less strict version of it that could be used for prototyping and gradually typed into compiling Rust code. In other words, a new programming language doing to Rust the reverse of what Mojo is trying to do to Python.
skdotdan··on Mojo is now available on Mac
I believe the main Mojo use cases are scenarios in which you'd need dependencies anyway. Code that you can't write in Python due to performance concerns, so you'd need to call C/C++/Rust/CUDA/Triton/etc anyway.
skdotdan··on Mojo is now available on Mac
I'm sure Chapel has its merits, but one of the main selling points of Mojo is the aspiration to be part of the Python ecosystem, and so far I haven't seen any other programming language offering a similar promise, other than Python itself coupled with DSLs or other extensions for high performance.
skdotdan··on LLMs confabulate not hallucinate
The term of “hallucination” referred to generative ML models have been used in the literature for years, at least since GANs.L
skdotdan··on The Power of Prolog
I graduated in 2019 and studied Prolog in my third year.
skdotdan··on Candle: Torch Replacement in Rust
Looks great! Rust is the wrong language for developing ML models, but it has a clear potential for being the best one for deploying them.
skdotdan··on Apple says it'll remove iMessage and FaceTime in UK rather than break encryption
Aren’t iMessage and FaceTime irrelevant outside from the US? I don’t know a single non-American person who uses them.
skdotdan··on How the BPE tokenization algorithm used by large language models works
Not an expert in East Asian languages, but GPT tokenizers are generally byte-based. Meaning that the basic unit to do the merges is a single byte, not a character.
skdotdan··on Compilers for the Future
I’d add that while languages should die, code written in it shouldn’t. So, even if a language is deprecated, we still should be able to run, call and interoperate with all the legacy code that was written in it.
skdotdan··on Ask HN: Open source LLM for commercial use?
https://huggingface.co/google/flan-ul2

https://huggingface.co/docs/transformers/model_doc/gpt_neox

skdotdan··on GPT4 and the Multi-Modal, Multi-Model, Multi-Everything Future of AGI
No one said it was. What some researchers hypothesize is that at the current rate of improvement, it wouldn't be especially unreasonable to expect AGI at GPT-N.
skdotdan··on Ask HN: What is the most interesting software you wrote in a few days?
Could you share more details about it? Is your code open source?
skdotdan··on Ask HN: Why is Google Premium not a thing?
YouTube ads are way more disruptive because they have to interrupt the video you are playing for at least a few seconds.
skdotdan··on We raised $100M for open and collaborative machine learning
The moat is network effects, not the hosting service. GitHub is indeed a potential competitor but, again, you are just thinking about the hosting, while Huggingface provides an API compatible with all the uploaded models and datasets. GitHub would have to create their own API and then hope that users would switch to their service.
skdotdan··on We raised $100M for open and collaborative machine learning
I don't think OpenAI is a valid comparison. Huggingface's mission, unlike in the case of OpenAI, is not training models, but being the standard service for sharing them. The vast majority of models and datasets available at the Huggingface Hub have been provided by third-party companies or researchers. They aim to be the Github of ML models and data, not an AI-building startup.
skdotdan··on SpaceX successfully launches two humans into orbit
I wonder whether Bezos is feeling envious (in the good sense of the word). Wouldn't it be cool a new Space Race between SpaceX, Blue Origin, and Boeing?
skdotdan··on GPT-3: Language Models Are Few-Shot Learners
AFAIK they used half-precision (Float16)
skdotdan··on We can’t trust AI systems built on deep learning alone
https://arxiv.org/abs/1905.12149
skdotdan··on Ask HN: What's stopping OEMs from building an all-in-one device?
Never heard of them, thanks!
skdotdan··on Ask HN: What's stopping OEMs from building an all-in-one device?
Thanks for your comment. I don't think it's that hard.

Take a middle/high-end smartphone phone. Install something like Maru OS (but preinstalled and with OEM support). That's it.

I agree with the cooling problems, but a desktop browser and Unix terminal would be enough, and these apps are not that demanding for the CPU.

Page 1 of 8Next →