HNHacker News
TopNewBestAskShowJobs

f38zf5vdt

1,336 karma · joined December 4, 2019

submissionscomments
f38zf5vdt··on Llama 3.2: Revolutionizing edge AI and vision with open, customizable models
Refer to the blog post I linked. Molmo is ahead of Qwen2 72b.
f38zf5vdt··on Llama 3.2: Revolutionizing edge AI and vision with open, customizable models
1. Ignore the benchmarks. I've been A/Bing 11B today with Molmo 72B [1], which itself has an ELO neck-and-neck with GPT4o, and it's even. Because everyone in open source tends to train on validation benchmarks, you really can not trust them.

2. The method of tokenization/adapter is novel and uses many fewer tokens than all comparable CLIP/SigLIP-adapter models, making it _much_ faster. Attention is O(n^2) on memory/compute per sequence length.

[1] https://molmo.allenai.org/blog

f38zf5vdt··on Blood puddles, mold, tainted meat, bugs: Boar's Head inspections are horrifying
Most first world countries have long and vivid histories of food safety scandals. In the US in the 2000s, the PCA comes to mind.

https://en.wikipedia.org/wiki/Peanut_Corporation_of_America

The UK had mad cow disease, Italy continues to deal with diluted and falsified olive oil, the EU has had repeated horse meat scandals. Most recently Japan had a health food supplement scandal in which many people died.

f38zf5vdt··on The US fiscal mess: Some unpleasant fiscal simulations
The US has been in similar places during a world war where they were asserting global dominance.

It appears there is no further reasonable headroom for debt should a third world war break out -- the Americans will be up "shit creek without a paddle". In that scenario, roaring inflation would destroy whatever is left of the current economy as globalist trade routes collapse.

The recent wars and posturings of Western rivals (Iran, China, Russia) are no surprise. They are sharks circling what they perceive as a failing economic system in a winner-takes-all game.

f38zf5vdt··on Why don't they compose music like Bach any more?
They still do? One instance is MASTER BOOT RECORD and it's metal styled after Bach's composition styles made on a 486DX. It is very popular.

https://masterbootrecord.bandcamp.com/

f38zf5vdt··on Supreme Court rules ex-presidents have immunity for official acts
The President is the commander-in-chief of the armed forces. Why would he have to stop at only his domestic rival when he could instead simply eliminate anyone who appears to be in the way, and whether or not that is the right decision is deferred to congress and the courts who now consist of people who are still alive and have fallen in line?
f38zf5vdt··on Supreme Court rules Trump gets limited immunity from prosecution
This is a really interesting ruling for American politics. On one hand, Trump appears to have considerable immunity from his actions as president. On the other hand, Biden also appears to have considerable immunity from his actions as president.
f38zf5vdt··on X: This week we're making Likes private for everyone
It will come back to bite people since the likes are still visible to the content creator. Elon has a history of liking stupid things and will be emboldened by this, and content creators may freely see/repost these likes on their accounts as endorsements.

Feels bad all around.

f38zf5vdt··on Study shows banning false info traffickers online can improve public discourse
BirdWatch ("Community Notes") is a simple reproduction of reddit top comments on Twitter. And like u/spez, Elon just can't seem to resist hopping into the database and monkeying with things.
f38zf5vdt··on The Nonprofit Industrial Complex and the Corruption of the American City
Yeah, for anyone else still questioning, if an article about former president Donald Trump's foreign relations with Finland during his presidency opened in the starting paragraphs with:

"Donald J. Trump was found by a jury to have committed sexual abuse and forcible touching of E. Jean Carroll. By her own account, Carroll said that on her way out of the store she ran into Trump and he asked for help buying a gift for a woman. After she suggested a handbag or a hat, the two reputedly moved on to the lingerie section and joked about the other trying some on. Carroll said they ended up in a dressing room together, the door of which was shut, and Trump forcefully kissed her, pulled down her tights and raped her before she was able to escape. Trump has also stated in the past that 'You know I'm automatically attracted to beautiful—I just start kissing them. It's like a magnet. Just kiss. I don't even wait. And when you're a star, they let you do it. You can do anything. Grab 'em by the pussy. You can do anything.'"

You would rightly consider this to be yellow journalism, as it has nothing to do with Trump's foreign relations with Finland despite being despicable.

f38zf5vdt··on Russia's glide bombs devastating Ukraine's cities on the cheap
The West was startled by the fact that the Ukrainians were able to rout the Russians. Most Western analysts expected Russian to win in the event of an invasion and Zelenskyy pleaded with Putin not to invade the night prior.

That Russia took almost 3 years and a presumed 300-500k casualties to begin deploying basic air support with guided glide bombs, like the west has been doing for 25 years, was indeed surprising.

Every military has the ability to innovate and adapt because the life of every member of the military is on the line each day. It took an astounding number of embarrassments and lives lost for the Russian military to adapt, including a near coup by PMC Wagner.

f38zf5vdt··on Russia's glide bombs devastating Ukraine's cities on the cheap
> Ukraine and its allies have much smaller stores of large, outdated dumb bombs to refit,

Unlikely, the US still has a lot (hundreds of thousands) of dumb bombs. As you said, they don't have a good delivery platform until the F-16s get there. The US orders 20-30k JDAM kits _per year_.

f38zf5vdt··on We have 4 days to contest KYC being required by internet services
From the executive order (Executive Order 14110) it seems to affect only massive compute infrastructure:

> (i) any model that was trained using a quantity of computing power greater than 10^26 integer or floating-point operations, or using primarily biological sequence data and using a quantity of computing power greater than 10^23 integer or floating-point operations; and

> (ii) any computing cluster that has a set of machines physically co-located in a single datacenter, transitively connected by data center networking of over 100 Gbit/s, and having a theoretical maximum computing capacity of 10^20 integer or floating-point operations per second for training AI.

Keep in mind that most consumer graphics cards are in the _teraflops_ range, which is 10^12. It's hard to imagine this affecting the average person, it seems that they are specifying KYC for people using clusters with thousands or tens of thousands of cards.

f38zf5vdt··on ScreenAI: A visual LLM for UI and visually-situated language understanding
Google claims SoTA but it appears that, according to Apple, they may already be out of date: https://arxiv.org/abs/2404.05719
f38zf5vdt··on Top Israeli spy chief exposes his true identity in online security lapse
"Making an entire book about my AI death machine is the best idea I ever had!" is the intelligence equivalent of The Simpsons "Videotaping this crime spree was the best idea we ever had!"

edit: Since this thread is getting turfed so hard that my other, serious comment is already gone. I would ask you to read this thread about said AI death machine and make your own thoughts about what is currently happening.

https://news.ycombinator.com/item?id=39918245

f38zf5vdt··on 'Lavender': The AI machine directing Israel's bombing in Gaza
That was, of course, sarcasm.
f38zf5vdt··on Smoking cannabis is now legal in Germany
It's a middle ground similar to the handling of pornography (often legal) and prostitution (often illegal) and it doesn't make much sense. Usually production, trafficking, and sale are also considered illegal, because to only make illegal the latter would make it more much difficult to prosecute those involved in sales and distribution. Some users need more than others, and some users produce their own supplies. Neither should be illegal, but both often are.

Either it's okay for adults to consent to activities that don't harm others or its not. People should have the right to choose what to do with their bodies, and the legal system should have to ability to disincentivize antisocial behavior in ways that are productive i.e. that actually reduce it.

The antisocial behavior is not people selling/smoking a joint or having/selling consensual sex -- and while it might be associated with them, the government should be tackling those other, actual problems instead.

f38zf5vdt··on Lawyers who voided Elon Musk's pay as excessive want $6B fee
Elon packed the board with personal friends who would never in a million years turn down any compensation package he asked for. The extent of their relationship was not disclosed in public filings. It's reasonable for the shareholders to ask if maybe the money could have been better spent on R&D or a cheaper CEO than being shuttled off as personal funds for the CEO.

> Typical elements of the crime of embezzlement are the fraudulent conversion of the property of another person by the person who has lawful possession of the property.

You can read about the extent of the alleged fraud in the judgment, but it is clear that the board was nothing more than sycophants _not_ acting in the fiduciary interest of the shareholders.

https://courts.delaware.gov/Opinions/Download.aspx?id=359340

> The Proxy failed to disclose any of the Compensation Committee members’

> actual or potential conflicts with respect to Musk.747 In fact, the Proxy repeatedly

> described the members of the Compensation Committee as independent, stating:

> “The[] [Grant] discussions first took place among the members of the Compensation

> Committee . . . all of whom are independent directors;”748 and “[t]he independent

> members of the Board, led by the members of the Compensation Committee, spent

> more than six months designing [the Grant].”749 The Proxy’s introductory letter is

> “[f]rom the Independent Members of Tesla’s Board of Directors,” and the first four

> signatories are Compensation Committee members Gracias, Ehrenpreis, Denholm,

> and Buss.750 Notably, Gracias signed as “Lead Independent Director.”751

> The description of the Compensation Committee members as “independent”

> was decidedly untrue as to Gracias and proved untrue as to the remaining committee

> members.

f38zf5vdt··on Lawyers who voided Elon Musk's pay as excessive want $6B fee
It's straightforward. The attorneys are arguing that because they have prevented what amounts to the embezzlement of $50b from Tesla and its shareholders, they are entitled to close to 10%. This is similar to SEC whistleblowers.

> The Commission is authorized by Congress to provide monetary awards to eligible individuals who come forward with high-quality original information that leads to a Commission enforcement action in which over $1,000,000 in sanctions is ordered. The range for awards is between 10% and 30% of the money collected.

f38zf5vdt··on Lawyers who voided Elon Musk's pay as excessive want $6B fee
Elon leaving Tesla would be the one thing _to_ make me invest. The company has fantastic growth potential being squandered by Musk on useless products like the Cybertruck.
f38zf5vdt··on Coding Self-Attention, Multi-Head Attention, Cross-Attention, Causal-Attention
More than I would like to admit
f38zf5vdt··on X blocks Taylor Swift searches after fake AI videos go viral
The DALLE3 stuff on 4chan is 10000% worse than nudes. One of my friends showed me a picture of TS putting jews in ovens in a concentration camp. Microsoft is the one spouting out about the need for "generative image AI safety", meanwhile they have to be the worst offender given some of the stuff I've seen out of Bing.
f38zf5vdt··on HPV vaccine study finds zero cases of cervical cancer among women vaccinated <14
Yes, please, even if you've had HPV before, get this vaccine. The medical literature says there are benefits in almost every person, even if your insurer does not.

> In a retrospective analysis of data from two qHPV vaccine efficacy studies in young women who underwent cervical surgery or were diagnosed with genital warts or vulvar/vaginal disease related to infection present before vaccination (Figure 1), prior qHPV vaccination was associated with a significant reduction (46.2−64.9% for those who underwent cervical surgery; 35.2% for those diagnosed with infection-related disease) in any subsequent HPV-related disease, including high-grade disease.6 Other studies demonstrated that HPV vaccination before and after surgical treatment for cervical lesions reduced the risk of subsequent cervical intraepithelial neoplasia (CIN) grade 2 or higher, related to HPV16/18 (88.2% efficacy 60 days or more post-surgery),8 and the risk of recurrent CIN 2–3 post-surgery was higher in qHPV vaccine non-recipients compared with recipients (hazard ratio [HR] 2.840).

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10038021/

f38zf5vdt··on Coding Self-Attention, Multi-Head Attention, Cross-Attention, Causal-Attention
As mentioned, these are all toy implementations and you should not use them in production. If you want to the fast, easy, and extremely optimized way of doing things, use torch.nn.MultiheadAttention or torch.nn.functional.scaled_dot_product_attention so that you get the optimal implementations. You can use xformers scaled dot product attention if you want the bleeding edge of performance.

> (Note that the code presented in this article is intended for illustrative purposes. If you plan to implement self-attention for training LLMs, I recommend considering optimized implementations like Flash Attention, which reduce memory footprint and computational load.)

Flash attention is already part of torch's kernels as of torch 2, but the latest versions and optimizations land in xformers first.

f38zf5vdt··on X Purges Prominent Journalists, Leftists with No Explanation
Is there a database somewhere that keeps track of all the flagged threads on here so we can see what gets censored on a regular basis? It would be fun to k-means cluster it and see what is verboten to HN users or staff.
f38zf5vdt··on Things are about to get worse for generative AI
The X-Robots-Tags header already exists as "noai" and "noimageai". Scraping software like img2dataset respects these by default.
f38zf5vdt··on Laion Took Down Its Datasets After Discovery of Child Sexual Abuse Material
Still not an argument for ever using them as reliable evidence. You have to trust whoever made the original hash to not have generated it with a duplicate, innocuous image providing a collision. These hashes are not verifiable as they appear to be parts of secret databases, so you are trusting the authority of that database not to do something like make innocuous colliding images for the sake of violating your personal freedoms.
f38zf5vdt··on Laion Took Down Its Datasets After Discovery of Child Sexual Abuse Material
md5 hashes are not a reliable indication of anything, since producing images that have collisions can be done in realtime.

https://www.exploit-db.com/docs/english/46047-md5-collision-...

f38zf5vdt··on EU opens proceedings against X over efforts to combat information manipulation
I think it's more that Birdwatch/Community Notes, which gets a lot of feature-love from Valley types, is already being weaponized to the point of failure. In the absence of any other moderation, this is leading Twitter into a dark descent of increasingly moderationless content.

> How Twitter's Community Notes Accelerates Denialism About Hamas Atrocities Against Israelis

> The Community Notes feature was supposed to shut down conspiracy theories on X, formerly Twitter. Instead Elon Musk's preference for crowdsourced moderation is allowing malicious users to weaponize hatred, lies and disinformation about the October 7 Hamas attack

https://archive.is/j1Diy

Community Notes is just a subset of rank-based comment systems (e.g. Reddit and HN), and these are known to fail over time due to the commodification of votes. Even now you can go on certain forums and purchase a Community Note for a post for some hundreds of USD. It's not a substitute for moderation and everyone knows that if Hackernews defaulted to it instead of relying on dang that HN would fall apart.

f38zf5vdt··on Improving deep sleep may prevent dementia, study finds
The study is about duration of deep sleep, not quality. And that's an easy one, you can increase the amount of deep sleep with cannabis.

> Cannabis users demonstrated significantly longer sleep latency and less REM sleep overall; no other differences occurred in objective sleep measures between groups.

https://bmjopenrespres.bmj.com/content/6/Suppl_1/A23.1

← PreviousPage 2 of 16Next →