HNHacker News
TopNewBestAskShowJobs

osmarks

231 karma · joined April 10, 2018

submissionscomments
osmarks··on $95 AMD CPU Becomes 16GB GPU to Run AI Software
It's not very useful because the point of VRAM is that it's very very high-bandwidth. CPU RAM is slow and the PCIe link to the GPU is even slower.
osmarks··on How mobile apps illegally share personal data
We do not have "agency" in the sense of a magic black box which makes optimal decisions regardless of the information we have, nor "no agency" in the sense that we'll immediately do anything because ads tell us to, but ads are incentivized to exploit human psychology as much as possible and being exposed to that is probably bad.
osmarks··on We will all be dead soon
I am expecting lots of biotech progress during my existing likely natural lifespan.
osmarks··on We will all be dead soon
I was expecting this to be about AI timelines or something. This is not very novel or interesting to me. Besides, it's not as if there's no plausible way to extend lifespans enough that I could live until 2123.
osmarks··on We will all be dead soon
Believing in reincarnation does not make it true.
osmarks··on Maghammer: My Personal Data Warehouse
Some part of the data pipeline apparently uses 255 as "not recorded at this time".
osmarks··on Non-determinism in GPT-4 is caused by Sparse MoE
Petals does a layerwise split I think. You could probably run separate experts on each system. I don't think this sort of tech is very promising so I haven't looked.
osmarks··on Non-determinism in GPT-4 is caused by Sparse MoE
I don't expect LLMs to be good enough at engineering to trivialize this kind of thing for a while - possibly never, if something else comes along and outcompetes them.
osmarks··on The Myth of AI Omniscience: AI's Epistemological Limits
This is mostly a property of the RLHF/instruction-tuned chatbot models most people use. Base models tend to be more varied.
osmarks··on The Myth of AI Omniscience: AI's Epistemological Limits
"Directly access"? Computers can use cameras and robotics hardware and such. It is not as if humans are special because of using eyes and muscles instead.

Also, text does say a lot about the world. It includes descriptions of physics experiments and people's best knowledge of the laws, for instance.

osmarks··on Non-determinism in GPT-4 is caused by Sparse MoE
It would be bad for single-consumer-GPU inference setups.
osmarks··on Non-determinism in GPT-4 is caused by Sparse MoE
I feel like this introduces the potential for weird and hard-to-implement side channel attacks, if the sequences in a batch can affect the routing of others.
osmarks··on Local async executors and why they should be the default
Go is internally doing async-like cooperative multitasking. You just don't see it because they actually integrated it into the language well.
osmarks··on Firefox has surpassed Chrome on Speedometer
I wrote a script (https://github.com/osmarks/random-stuff/blob/master/histrete...) to dump a Firefox places.sqlite database to a separate SQLite database for long-term storage (I run it nightly). It seems to delete stuff based on some combination of visit frequency and last visit time.

I suspect they need to do this to keep history searches fast, since I also separately hacked a bunch of `about:config` options to retain more history and they run quite slowly now, particularly on my phone.

osmarks··on Twitter now requires an account to view tweets
It is not an issue of human nature. Centralization just makes implementation waaaay easier. Distributed systems design is very hard.
osmarks··on Hello World This Is Rampart
Why "Texis" rather than SQLite? The licensing seems weird and I'd trust SQLite with my data more.
osmarks··on Where has the passive radar code gone?
If they were particularly consistent about this, they would have to watch a lot of electrical engineers.
osmarks··on How criminals are using jammers, deauthers to disrupt WiFi security cameras
That probably requires more forward planning and effort than most criminals will bother with.
osmarks··on Intel Laptop Users Should Avoid Linux 5.19.12 to Avoid Damaging the Display
Does it actually "damage" the display or just make it not work while 5.19.12 is loaded?
osmarks··on Android 12 is live in AOSP
There are some tweaks out there which patch the CSS to bring stuff slightly closer to the original style.
osmarks··on Android 12 is live in AOSP
Even if it's technically possible to work around it, it would be a ridiculous amount of effort for not particularly good reasons.
osmarks··on Google sets burial date for legacy Chrome Extensions, fears for ad-blockers grow
The issue is that Firefox doesn't actually support hardware video decoding on Linux without various hackery.
osmarks··on Show HN: SQLite Playground
Presumably use on bad devices with no CLI available. Also sharing URLs with people to show them a thing quickly.
osmarks··on OpenAI Shuts Down Chatbot Project by Indie Developer
GNU/Linux requires basically the same hardware as the usual alternative (Windows). If you switch from hosted GPT-3 to selfhosted GPT-J you start needing to get and manage all the hardware, which might go underutilized most of the time depending on what your demand looks like, and which requires lots of software optimizations to use maximally effectively. You can use hosted GPT-J, though, a few companies offer that.
osmarks··on OpenAI Shuts Down Chatbot Project by Indie Developer
You can rent GPUs from various cloud providers, but those are hilariously expensive too even given datacentre GPU prices.
osmarks··on OpenAI Shuts Down Chatbot Project by Indie Developer
Seems fine, just quite slow, as it says.
osmarks··on OpenAI Shuts Down Chatbot Project by Indie Developer
It's not exactly "almost free"; you need a powerful GPU, which are extremely costly right now. But apart from the cost of that and power, free.
osmarks··on CSAM Detection Technical Summary [pdf]
You might be safe now in relatively okay Western countries. Consider the possibility of places like China using these features, or just future Western governments which are worse.
osmarks··on Gitly: A light and fast GitHub/GitLab alternative written in V lang (pre-alpha)
https://news.ycombinator.com/item?id=20230351 says they got $927/month some time ago, which is a decent amount of income I think. It seems to be less now.
osmarks··on An Open Letter Against Apple's Privacy-Invasive Content Scanning Technology
It would probably kill the battery to do that constantly, as the processor would not be able to sleep ever. Although relying on energy efficiency to not improve is not a good long term situation.
← PreviousPage 2 of 5Next →