HNHacker News
TopNewBestAskShowJobs

pumanoir

160 karma · joined November 19, 2017

submissionscomments
pumanoir··on Open source implementation for LLaMA-based ChatGPT
I think is feasible. The description even says is designed to save on vram[1]. I don't get the other comments about needing more vram than a 3090.

Also, Neuralmagic may run their sparsification on ARM cpu's in the future, so keep an eye.

1. ChatRWKV v2: with "stream" and "split" strategies. 3G VRAM is enough to run RWKV 14B :)

pumanoir··on Open source implementation for LLaMA-based ChatGPT
Look into sparsification of ML models: https://neuralmagic.com/ If your cpu has avx512 it can make it even faster.
pumanoir··on A GPT in 60 Lines of NumPy
I saw this [1] presentation where they use scheme to train GPT on a single consumer GPU. I've had no luck finding the 'scorch' compiler they mentioned in the video.

1. https://youtu.be/rDke29MbKQA?list=PLyrlk8Xaylp7NvZ1r-eTIUHdy...

pumanoir··on A GPT in 60 Lines of NumPy
For someone not familiar with jax, if I do the suggested replacement. What'd be the little extra code to make it do the backward pass? Or is it all automatic and we literally would not need extra lines of code?
pumanoir··on Tesla owners in California uneasy as Supercharging costs are on a constant rise
They tried it in Spain [1]https://www.morairainvest.com/sun-tax/
pumanoir··on DeepSpeech 60x Smaller, 9x faster, and 2x accuracy
Is there anything as accurate and as small but Open Source and no subscriptions? Or at least just a small tflite model with similar specs?
pumanoir··on Masterclass on mathematical thinking
https://www.wondrium.com/home
pumanoir··on Masterclass on mathematical thinking
Looks good. It reminds me of The Great Courses and its streaming service Wondrium [1]. They have (from the top of my head [1]) at least two courses that would be the equivalent to this one. The courses are taught by experts in a field who also happen to be great teachers (usually teaching award winning professors).

1. https://www.wondrium.com/art-and-craft-of-mathematical-probl...

2. https://www.wondrium.com/home

pumanoir··on Senate panel approves antitrust bill restricting big tech platforms
Isn't the very definition of antitrust to target "a handful companies" and prevent them from running an entire industry?
pumanoir··on A small scheme VM, compiler, and REPL in 4k
Thanks. I will check it out.
pumanoir··on A small scheme VM, compiler, and REPL in 4k
Can Ribbit w/ the max lib run everything from SICP? It'd be really cool to have a self contained (html or other text) file of the SICP book.
pumanoir··on AWS's Egregious Egress
I didn't see the amount of the discount in the article. Is there a place where one can see the pricing (i.e. 10TB azure -> CF)?
pumanoir··on Web Applications from the Future: A Database in the Browser
There are a few of those frameworks. The first one that comes to mind is YJS here is a getting started[1]. 1. https://www.tag1consulting.com/blog/deep-dive-real-time-coll...
pumanoir··on Rescue Mission for Sci-Hub and Open Science: We are the library
I just learned about IPFS this week, it sounded really cool and was planning on learning more about it. But as my time is limited I'd wanna know if it's worth the time investment. Which parts of IPFS didn't work for you? Was it to slow? Missing features? No integrations? Or plain broken ridden with bugs?
pumanoir··on Rescue Mission for Sci-Hub and Open Science: We are the library
Is any part of the library stored in the IPFS network?
pumanoir··on Rescue Mission for Sci-Hub and Open Science: We are the library
That'd be file coin: https://filecoin.io/
pumanoir··on Apple blocks game streaming services unless individual games are approved
I've used iphones from the 6s till 11 and this week I switched to an android. I hadn't realized how limiting iOS is.
pumanoir··on Dark’s new backend will be in F#
Indeed but not only C# but all of .Net's. So that gives you quantity. But more importantly (at least to me) is that the quality of libraries is much higher than those of the JS (which is what I'm more familiar with) ecosystem.
pumanoir··on The End of OS X
The comment states the why clearly when read within the context of the article: "I'm clearly no longer the target demographic and their corporate goals aren't aligned with mine as a customer any more"
pumanoir··on Learning operating system development using Linux kernel and Raspberry Pi
They focus on rpi 3b
pumanoir··on Learning operating system development using Linux kernel and Raspberry Pi
The "book" you download from this website is not an epub. You must use their apps to read it.
pumanoir··on AWS Ruins Own Attempt at Sabotage
Which practice are you referring to in the last paragraph, AWS's, Google's or the employee's?
pumanoir··on On Voice Coding
Sure! Id love that. I only use one noise at the moment for mouse clicking (since I only know one sound). Could you point me to a video that shows an example of each of the 40 available sounds?
pumanoir··on On Voice Coding
When using vim keys for example, to jump to the beginning of the line I press ^ then press 'dw' keys delete first word in a line. So I do the caret with my voice and the other press with my hand which is faster than doing it by hand alone.
pumanoir··on On Voice Coding
I use Talon with Dragon and an Audio Technica PRO8HE. I mostly whisper to the system, and people in my office say they don't hear me at all. Also whispering allows me to not get my throat get tired.
pumanoir··on On Voice Coding
I have intermittent RSI and I've been using Talon for 1.5 years for programming (web) with intellij and spacemacs. I reckon I'm as productive as using my hands if I use only voice. When my hands don't hurt and i mix talon with my hands I feel i can do more than I could do with my hands alone. Thanks, lunixbochs. Talon is great.
pumanoir··on EU: Call to introduce common charger for all mobile phones
That would fantastic.
pumanoir··on Duolingo becomes first VC-funded $1B Pittsburgh tech startup
Search for Michel Thomas tapes/cds at your local library
pumanoir··on NanoNeuron – simple JavaScript functions that explain how machines learn
@trekhleb thanks for this write up, it is fantastic. Are you planning on a similar explanation for neural nets?
pumanoir··on W3C recommends WebAssembly
That is correct, a minified JS will preserve most of the semantics of the original program. And since the original source can come from any language, how would one know which decompiler to use.
← PreviousPage 2 of 3Next →