HNHacker News
TopNewBestAskShowJobs

gabegobblegoldi

22 karma · joined September 27, 2024

submissionscomments
gabegobblegoldi··on Jeff Dean responds to EDA industry about AlphaChip
Looks like he aligned himself with the wrong folks here. He is a system builder at heart but not an expert in chip design or EDA. And also not really an ML researcher. Some would say he got taken for a ride by a young charismatic grifter and is now in too deep to back out. His focus on this project didn’t help with his case at Google. They moved all the important stuff away from him and gave it to Demis last year and left him with an honorary title. Quite sad really for someone of his accomplishments.
gabegobblegoldi··on Jeff Dean responds to EDA industry about AlphaChip
The court case provides more details. Looks like the junior researchers and Jeff Dean teamed up and bullied Chatterjee and his team to prevent the fraud from being exposed. IIRC the NYT reported at the time that Chatterjee was fired within an hour of disclosing that he was going to report Jeff Dean to the Alphabet Board for misconduct.
gabegobblegoldi··on Jeff Dean responds to EDA industry about AlphaChip
Markov’s paper also has links to Google papers from two different sets of authors that shows minimal advantage of pretraining. And given the small number of benchmarks using a pretrained model from Google whose provenance is not known would be counterproductive. Google likely trained it on all available benchmarks to regurgitate the best solutions of commercial tools.
gabegobblegoldi··on Jeff Dean responds to EDA industry about AlphaChip
In this case there were credible claims of fraud from Google insiders. See my comment above.
gabegobblegoldi··on Jeff Dean responds to EDA industry about AlphaChip
As Markov claims Nature did not follow their own policy. Since Google’s results are only on their designs, no one can replicate them. Nature is single blind, so they probably didn’t want to turn down Jeff Dean so that they wouldn’t lose future business from Google.
gabegobblegoldi··on Jeff Dean responds to EDA industry about AlphaChip
Peer review is not designed to combat fraud.
gabegobblegoldi··on Jeff Dean responds to EDA industry about AlphaChip
Additional context: Jeff Dean has been accused of fraud and misconduct in AlphaChip.

https://regmedia.co.uk/2023/03/26/satrajit_vs_google.pdf

gabegobblegoldi··on How AlphaChip transformed computer chip design
Good question. I thought the tpus were a way for Google to apply pricing pressure to nvidia by having an alternative. They are not particularly better (it’s hard to get utilization), and I believe Google continues to be a big buyer of nvidia chips.
gabegobblegoldi··on How AlphaChip transformed computer chip design
Thanks.
gabegobblegoldi··on How AlphaChip transformed computer chip design
Interesting == Suspicious? I think this is a big red flag to those in the know.
gabegobblegoldi··on How AlphaChip transformed computer chip design
Sorry. I meant obscure relative to the large space of combinatorial optimization problems not just chip design.

Most design houses don’t write their own macro placers but customize commercial flows for their designs.

The problem with macro placement as an RL technology demonstrator is that to evaluate quality you need to go through large parts of the design flow which involves using other commercial tools. This makes it incredibly hard to evaluate superiority since all those steps and tools add noise.

Easier problems would have been to use RL to minimize the number of gates in a logic circuit or just focus on placement with half perimeter wirelength (I think this is what you mean with your grad student example). Essentially solving point problems in the design flow and evaluating quality improvements locally.

They evaluated quality globally and only globally and that destroys credibility in this business due to the noise involved unless you have lots of examples, can show statistical significance, and (unfortunately for the authors) also local improvements.

That’s what the follow on studies did and that’s why the community has lost faith in this particular algorithm.

gabegobblegoldi··on How AlphaChip transformed computer chip design
Doesn’t look like it. In fact the original paper claimed that their RL method could be used for all sorts of combinatorial optimization problems. Yet they chose an obscure problem in chip design and showed their results on proprietary data instead of standard public benchmarks.

Instead they could have demonstrated their amazing method on any number of standard NP hard optimization problems e.g. traveling salesman, bin packing, ILP, etc. where we can generate tons of examples and verify easily whether it produces better results than other solvers or not.

This is why many in the chip design and optimization community felt that the paper was suspicious. Even with this addendum they adamantly refuse to share any results that can be independently verified.

gabegobblegoldi··on How AlphaChip transformed computer chip design
Vindicated indeed. The senior researcher and others on the project were bullied for raising concerns of fraud by the two researchers [1]. They filed a lawsuit against Google that has a lot of detailed allegations of fraud [2].

[1] https://www.theregister.com/AMP/2023/03/27/google_ai_chip_pa...

[2] https://regmedia.co.uk/2023/03/26/satrajit_vs_google.pdf