HNHacker News
TopNewBestAskShowJobs

crazypython

4,542 karma · joined July 18, 2019

submissionscomments
crazypython··on Entropy, a CLI that scans files to find high entropy lines (might be secrets)
It would be interesting to see a variant of this that used a small language model to measure entropy.
crazypython··on Ask HN: What is the current (Apr. 2024) gold standard of running an LLM locally?
It lacks batching support (n>1), unfortunately, which is necessary for Loom-like applications
crazypython··on Overview: What are Cpp2 and cppfront? How do I get and build cppfront?
What are the tradeoffs between cpp2 and Carbon?
crazypython··on Searx is no longer maintained
https://Kagi.com and https://metaphor.systems have been doing a great job for me
crazypython··on Non-determinism in GPT-4 is caused by Sparse MoE
The GPT-3.0 "davinci-instruct-beta" models have been returning non-deterministic logprobs as early as early 2021. This is speculation. CUDA itself often has nondeterminism bugs.

text-davinci-001 and text-davinci-002 were trained through FeedMe and SFT, while text-davinci-003 was RLHF; the models themselves have more variance at high temperature.

crazypython··on Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM
"™" has no legal meaning. "(R)" means a registered trademark.
crazypython··on The NixOS Foundation’s Call to Action: S3 Costs Require Community Support
S3 is a highly reliable storage media. You should use a CDN that transparently caches S3 artifacts to save on reads, such as AWS CloudFront or Cloudflare R2 are good choices.
crazypython··on OpenAI ChatGPT: Optimizing language models for dialogue
How did you come up with the long-term memory idea?
crazypython··on Stable Diffusion Public Release
Setting norms of asking folks not to abuse it reduces the likelihood people will step out of line with those norms.
crazypython··on Prometheus: Fuel from the Air
Definitely worth getting excited about, though it seems the current cost of fuel production as of Aug 8 including crude oil cost is $3.40/gal minus taxes and distribution.[0] Prometheus will likely cost less to distribute, since it doesn't need to be shipped across seas, funneled through pipelines, and between refineries, it can be produced next to solar or wind generation.

For reference, Prometheus costs $1.86/gal to operate and they are aiming to reduce the cost of the machine so it can be produced including capex at $3.00/gal.

[0]: https://www.energy.ca.gov/data-reports/energy-almanac/transp...

crazypython··on Hacker FAQ
> More generally, a job that requires fast and unexpected changes, significant skill, and is not very repetitive will be one a hacker will excel at. Repetitive, simple jobs are a waste of a good hacker, and will make your hacker bored and frustrated. No one works well bored and frustrated.

> The good news is, if you get a hacker on something he particularly likes, you will frequently see performance on the order of five to ten times what a "normal" worker would produce.

crazypython··on OPT: Open Pre-trained Transformer Language Models
BigScience (a coalition including Huggingface) is training and releasing a 175B language model and finishes in 2 month.
crazypython··on Twitter set to accept Musk's $43B offer – sources
I don't receive them on my main account. I do receive them on a less active alt.
crazypython··on Ask HN: What's the most stable form of digital storage?
Or microfiche, tiny paper.
crazypython··on In defense of swap: common misconceptions (2018)
I agree with this post, though there's another factor to consider: SSD endurance. A system that swaps a lot will write more, decreasing endurance. You might need to buy a new SSD every 5 years.
crazypython··on Richard Stallman – The state of the Free Software movement
under the free software philosophy (free SOFTWARE), art assets are allowed to be non-free, but stallman believes the game code itself should be free. considering games rely heavily on art, this model still lets you sell games.

Stallman isn't a free culture person

crazypython··on Assume your devices are compromised
I use a separate user account for games.
crazypython··on Ethereum Has Issues
It means they worked on it and acknowledge it now. The fundamental problem is still very much there.
crazypython··on Super Simple Storage Service
Reminds of C14, which stores data in a nuclear fallout shelter, and takes a few minutes to retrieve. https://www.scaleway.com/en/c14-cold-storage/
crazypython··on My entire PC got wiped Do not download
this only gives the kremlin the ability o say "The West is out to get you"
crazypython··on My essential Firefox fixes in 2022
I use Web Annoyances Ultralist, a cosmetic filter for adblockers. It blocks:

> Block annoying web elements such as sticky headers, dickbars, floating headers, scrolling headers, fixed headers, scrolling videos, stickynavs, social icons, social share bars, smartphone app banners, app download prompts, cookie notices, GDPR warnings, scroll to top buttons, modal overlays, interstitial site overlays, removed or hidden overflow scroll bars, subscription nags, and generally distracting elements that have increasingly been turning the web into a user-hostile environment.

https://github.com/yourduskquibbles/webannoyances

crazypython··on Apple M1 Ultra
Intel 12th gen i9 is 11% better at single core and 42% slower at multicore. https://www.cpu-monkey.com/en/compare_cpu-intel_core_i9_1290...

For most non-parallel tasks, my guess is the Intel 12900K will beat at performance.

Intel's next generation will have 50% more cores and beat this chip at multithreading.

crazypython··on Namecheap: Russia Service Termination
They banned doxajournal.ru, a student news organizing publishing anti-putin information.
crazypython··on Parallels Desktop Pro now sends spam notifications with ads to your desktop
The app bundle is first-party and includes Parallels as well as other native mac app.
crazypython··on Linux's GPLv2 licence is routinely violated (2015)
> So if you violate the licence, it is terminated. That's it. Given that “you” may refer to a corporation, this creates the following disturbing possibility:

GPLv3 fixed this, after being notified of a violation, you have 30 days to remedy it

crazypython··on Windows 11 Pro will soon require a Microsoft Account during initial setup
Which games specifically do not work? Proton has been improving rapidly.
crazypython··on It's often said that the Analytical Engine was before its time
It was too CISC!
crazypython··on Cassowary – Run Windows Apps on Linux using a VM as if they were native apps
Does anyone know something like this except for running Android apps on Linux with a similar level of integration?
crazypython··on The great renaming: what happened to Eth2?
Very excited about Ethernet!
crazypython··on Abuse and Harassment on the Blockchain
Interesting, how would the proofs be created?
Page 1 of 23Next →