HNHacker News
TopNewBestAskShowJobs

amrb

382 karma · joined December 1, 2020

submissionscomments
amrb··on DisTrO – a family of low latency distributed optimizers
It's a red flag that the 1.2bil model has to fit in gpu memory, happy to be provided wrong when the code drops
amrb··on Tokens are a big reason today's generative AI falls short
Can't say I mastered the concept either, I'm waiting for the code [0] to be release so I can run some head-to-head tests.

[0] https://github.com/Aleph-Alpha/trigrams

amrb··on Tokens are a big reason today's generative AI falls short
An alternative approache to BPE tokenization https://arxiv.org/abs/2406.19223
amrb··on Distributed Inference and Fine-Tuning of Large Language Models over the Internet
Can check out their project at https://github.com/bigscience-workshop/petals
amrb··on How to Reduce Memory Requirements with Product Quantization
Speaking of quantized vectors https://huggingface.co/papers/2309.14717
amrb··on Petals runs Llama 2 (70B) from Colab at 5 tokens/sec
Great project and I'm happy to see it expand to more models!
amrb··on Reddark: Website to watch subreddits going dark
What's the new reddit to try?
amrb··on Ask HN: Has an API key issuer ever leaked their own customers’ API keys
Anything can end up in logs, then it depends on getting access to hosted splunk via employee creds, for a hypothetical breach.
amrb··on 90% of laid-off H1-B visa holders were able to find new work
There is a salary requirement, as not to under cut local works. Of course if you working over 40 hours a week maybe the company gets it's pound of flesh!
amrb··on Tree of Thoughts
Good talk on the paper https://www.youtube.com/watch?v=ut5kp56wW_4
amrb··on The Dual LLM pattern for building AI assistants that can resist prompt injection
So we just recreated all of the previous SQL injection security issues in LLM's, fun times
amrb··on Attention with Linear Biases (ALiBi)
The "one weird trick" to squeeze limes for extra juice
amrb··on Hundreds of millions of stars turned into a map of GitHub projects
Group names are 10/10
amrb··on Second IC – Homemade 1000 transistor array chip (2021)
Sorry to hear you had this experience, I would say its worth giving another go maybe you can check out the IRC first to check the vibe before committing.
amrb··on Capturing the Flag with GPT-4
I appreciate they say they need to learn more about 'exec' when asking GPT4, it also plays well into some of the reading strategies I've seen to get a high-level understanding then read the documentation with more general idea going in, could also lower frustration for new engineers so they push through to the end!
amrb··on Supercharging Security with Generative AI
Sounds cool but I'm not seeing how this discovers IOC's or reverse engineers malware.
amrb··on Bard vs. GPT – Math, Logic and Problem Solving Battle
I'd like to see a yearly benchmark for models, could be logic puzzles or a suit of tasks but as it stands there is not good way to measure the ability of models.
amrb··on Bard can now help you code in over 20 programming languages
Can some one test fizzbuzz, sounds silly tho a lot of models fail on the combination check in my tests.
amrb··on Second IC – Homemade 1000 transistor array chip (2021)
You should look up for hackerspace's in you city, it's a space with tools to do projects.
amrb··on Nvidia RTX Remix Runtime Open Source Available Now
We have seen hair works as a Nvidia only tech.. Compatibly could be why the licence theory was rejected.
amrb··on Show HN: GPT-4-powered web searches for developers
What is chatgpt-turbo api pricing like .0001 pre 1k tokens, your paying more in workers salary at the moment.
amrb··on We achieved a 6-fold increase in Podman startup speed
A type of battery the small round one.. not the year
amrb··on Nvidia RTX Remix Runtime Open Source Available Now
I could see Nvidia licensing the tech to game publishers but they didn't get much uptake, so open source it is.
amrb··on Nvidia RTX Remix Runtime Open Source Available Now
feel more likely to rip game assets and build in a supported engine like Unreal.
amrb··on Nvidia RTX Remix Runtime Open Source Available Now
The of the widescreen fixes for the Unreal games was the addition of a dll file in the game folder.
amrb··on Generative Agents: Interactive Simulacra of Human Behavior
https://en.m.wikipedia.org/wiki/Strange_loop
amrb··on The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
Seems the fine tuned models I.e. gpt4all and alpaca are trained as LoRa's. Best advice is jump in and try the demos on hugging space!
amrb··on Ask HN: Do you have GPT-4 access?
Silly question, but would it be more impactful to use grey or open models to achieve the goals? End of the day the finally model may need to run outside a datacenter so if people don't fine-tune models this could be a limiting factor.
amrb··on The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
LoRa has been pretty popular and untill the llama leak was not aware of it, maybe will see something cool out of the open assistant project, we have a lot of English and Spanish prompts and was crazy to see people doing an massive open source project for ML.
amrb··on The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
Would like to see a yearly benchmark's for models like this!
Page 1 of 9Next →