Hacker News Reader

mapleshamrockon DeepSeek OCR

Couldn't you do something like add a bidirectional encoder after your embedding look up table to compress your text into some smaller token-count semantic space before feeding your transformer blocks to get a similar effect, then?

mapleshamrockon Modern action films fetishize the body even as they desexualize it

Funny, Normal People comes out of Ireland, historically a very sexually repressed nation under the thumb of the Catholic Church. Times are changing rapidly in Ireland though.

mapleshamrockon Modeling a Wealth Tax

Exactly. Capital gains tax is equivalent to a wealth tax on appreciating assets only, which is the only kind of assets you should be targeting with a wealth tax. So just implement a sensible capital gains tax, and you're done.

mapleshamrockon Apple has €13bn Irish tax bill overturned

I'd largely disagree. There's a huge amount of R&D and Engineering work being done in Ireland.

On the hardware side Intel, Qualcomm, Huawei, HP, Analog Devices, Xilinx, Nokia Bell Labs and many more all have extensive R&D departments in Ireland.

On the software side, Amazon, Microsoft, Facebook, Google etc. all have engineering roles advertised currently on Linkedin.

mapleshamrockon TSMC officially begins 5 nm production

This is it - you can't just compare FP32 TFLOPS. The newer cards have a ton of extra precisions, custom cores for certain workloads, and on chip memory, all of which use silicon area and transistors, but none of which boost the FP32 TFLOPS metric.

I could design you a chip that is nothing but FP32 multipliers and adders that has, theoretically, a ridiculous TFLOPS per mm^2, but it would be next to useless in any real workload.

mapleshamrockon Ask HN: Ways to generate income when you're at home without pay?

What keywords should I search for on Fiverr to see examples/how this service is marketed?

mapleshamrockon ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations

On CPU, assuming inference is compute bound rather than bandwidth bound, the compute time will scale quadratically with the size of the FC layers (which account for almost all compute time in these networks). So if the hidden size was 768 in BERT-Base, and 4096 in ALBERT, inference will approximately be 28.4x slower... yikes.

mapleshamrockon The More Gender Equality, the Fewer Women in STEM (2018)

Woah there, the person you're replying to didn't once use the word "weird" or any synonyms thereof.

They said that men and women tend to have different broad interests. But that doesn't preclude women from having an interest in tech. He's making a statement on statistics, not making a value judgement about anybody.