HNHacker News
TopNewBestAskShowJobs

bitforger

274 karma · joined February 28, 2015

mitchgordon.me
submissionscomments
bitforger··on BLEU Score: Bilingual Evaluation Understudy
A recent trend has been to use a language model to do the scoring: https://arxiv.org/abs/1904.09675
bitforger··on Facebook to shift permanently toward more remote work after coronavirus
my hands are cold
bitforger··on A commit history of BERT and its forks
I totally agree, but I think the state of a research field is too malleable / moves too quickly to be a Wikipedia article (where people expect things to be "true").

A few weeks ago I spun up wikisurvey.org to try and make a place for Wikipedia-like collaboration on research. There's nothing on there yet, but I'm hoping it will enable low-latency collaboration once we get the ball rolling.

bitforger··on Physicists Criticize Stephen Wolfram’s ‘Theory of Everything’
I don't think he claimed to find the theory of everything.

I think he's excited because he thinks that in this framework we can just "throw compute" at the problem to enumerate the possible theories of everything, and automatically rule out the ones that don't align with reality.

bitforger··on Introduction to Support Vector Machines in Machine Learning
ITT: Whether SVMs are still relevant in the deep learning era. Some junior researchers will say neural networks are all you need. Industry folks will talk about how they still use decision trees.

Personally, I'm quite bullish on the resurgence of SVMs as SOTA. What did it for me was Mikhail Belkin's talk at IAS.[1]

[1] https://m.youtube.com/watch?index=15&list=PLdDZb3TwJPZ5dqqg_...

bitforger··on Math Symbols Explained with Python
I see many comments criticizing the post for only implementing simple mathematics. This is true.

However, the approach of understanding math through code is still very helpful, I think. Personally, implementing things that are fuzzy mathematically provides immense clarity once I write them down.

For example, a simple monty hall simulator[1]. Or implementing matrix multiplication multiple ways to understand why each is equivalent[2], and why multiplying A(BC) can sometimes be faster than (AB)C[3].

I am not sure why this helps me. It may be because I was "raised" as a coder, and so that is how my brain works. But I also think that implementing something in code is very close to constructivist mathematics, in spirit. You cannot prove anything if you cannot construct (/implement) it.

[1] https://github.com/mitchellgordon95/implementing-paradoxes/b... [2] https://github.com/mitchellgordon95/implementing-paradoxes/b... [3] https://github.com/mitchellgordon95/implementing-paradoxes/b...

bitforger··on Layoffs Are Coming
Anyone in academia have takes on the potential effects on graduate students (PhDs / post-docs)? What happens if a lab loses funding?
bitforger··on Working from home – things no one talks about
> Parents come to mind for the latter, but most of the people I've known who have 4+ children work remotely, so this doesn't add up.

It's multifaceted. It might be fine if you own a large enough home that you can have a dedicated working space, with a door.

Even without kids, I find it extremely difficult to work from home without a dedicated space. If I try to work from the living room, I end up doing living room things (like playing video games).

For some people, though, the idea of engineering your environment to change your behavior is either impractical or unheard of, which is what I think gives these people the general impression that "working effectively from home is impossible."

bitforger··on Show HN: Slower News
>Articles are hand selected. Everything that calls my attention and passes the «trivia filter»

I was a little disappointed when I read this. When I read the title, I was hoping for something based on natural language processing summarization, which would aggregate many stories into cohesive chunks.

bitforger··on MIT moves all classes online for the rest of the semester
Similar action was taken by Johns Hopkins University a couple hours ago. https://hub.jhu.edu/assets/uploads/sites/2/2020/03/jhu_covid...
bitforger··on Machine Learning, Kolmogorov Complexity, and Squishy Bunnies (2019)
Even then, it might not really be an issue.

https://youtu.be/5-Kqb80h9rk

bitforger··on Microsoft Zero and DeepSpeed: Memory Efficient Large Neural Network Training
I wrote a blog post on the difficulties of memory-efficient training, which seems relevant: http://mitchgordon.me/machine/learning/2020/01/13/do-we-real...

The methods discussed there take a different angle at the problem.

bitforger··on My Emacs Productivity Tricks/Hacks
I'm extremely surprised to not see Spacemacs mentioned in the article or the comments. Spacemacs is, IMHO, the most sane and useful default configuration of Emacs. It is friendly to people switching from vim and includes all the packages listed in the article by default (as well as many more).

It has been my go-to editor for many years now; I highly recommend it.

bitforger··on Let People Move to Jobs
If you have a better definition, I'd like to hear it. I don't have many friends, so my definition encompasses all of them. Maybe if I had a better definition, I'd be able to make more friends.
bitforger··on Let People Move to Jobs
It's not really the money, it's the level of education and ambition. I worked remotely from Mount Pleasant, Michigan for a year and had a difficult time finding anyone to talk with about things that were interesting to me. The only group on Meetups.com was "Housewives of Mount Pleasant."

Friends are peers that have similar life experiences and values (and humor). Sometimes people like that are hard to find.

bitforger··on A Sober Look at Bayesian Neural Networks
Although I believe this specific blog post is criticizing BNNs rather than defending them.
bitforger··on Using Spotify data to predict what songs will be hits
Step 2: Train a GAN to try to fool the classifier: instant hit generator?
bitforger··on MT-DNN Achieves Human Performance in General Language Understanding Benchmark
The memory constraint is certainly an issue, but I think they can be overcome with some software hacks (for a speed penalty, of course.) For example, gradient checkpointing and gradient accumulation might help:

https://medium.com/tensorflow/fitting-larger-networks-into-m... https://medium.com/huggingface/training-larger-batches-pract...

bitforger··on Jezen/is-thirteen: Check if a number is equal to 13
This is a dependency for isnt-thirteen.

https://github.com/Innectic/isnt-thirteen

Incredible.

bitforger··on App Undresses a Photo of Any Woman with a Single Click
> DeepNude also dispenses with the idea that this technology can be used for anything other than claiming ownership over women’s bodies.

That's not true! We can also use it for undermining democracy, making everything look like a Van Gough painting, and...

> This algorithm is similar to [...] what self-driving cars use to "imagine" road scenarios.

I understand the fear here, but I don't appreciate rage-bait sub-headlines that contradict the rest of the story. Obviously GANs can be used for many things.

Also, I'm sure there are a few bad actors who will use this for things like revenge porn (which is Not Good), but I suspect the driving demand behind this application is horny teenagers who think Daenerys from GoT is hot, rather than malicious people who want to "oppress women." Although to be fair, this is the effect the technology has, whether intended or not.

bitforger··on Self-distancing can help you make better decisions
As I read this article, I thought to myself, "oh, this must be why we must make such good decisions, huh?"
bitforger··on Google’s AI can now translate your speech while keeping your voice
Anyone seen technical papers on this? Interested in the training regimen and data used...
bitforger··on The Man Who Built the Bauhaus
I totally thought we were talking about Eddie Huang https://ny.eater.com/2017/7/27/16051922/baohaus-nyc-chinatow...
bitforger··on Neural nets typically contain smaller “subnetworks” that can often learn faster
Follow up from ICLR really elucidates some of the questions raised by this: https://eng.uber.com/deconstructing-lottery-tickets/ https://arxiv.org/abs/1905.01067
bitforger··on There is free will: we make choices even if our atoms don’t
I wrote a koan about free will not too long ago...

http://mitchgordon.me/zen/2019/04/02/koan-of-will.html

bitforger··on Ask HN: Which books teach mental models?
I wrote a blog post today about how I don't believe in the abstract plane, if you're into it: http://mitchgordon.me/philosophy/2019/05/12/non-existence-of...
bitforger··on Smarter Training of Neural Networks
Recent follow-up work from Uber at ICLR: https://eng.uber.com/deconstructing-lottery-tickets/
bitforger··on Manim – 3Blue1Brown's animation engine for explanatory math videos
Honestly, "useless and entitled" kind of hurt my feelings. The title says it's 3Blue1Brown's "animation engine." I'm just relaying my experience with the thing to let people know that working with it won't be all sunshine and roses, if they want to use it, and that it might be nice to put some effort into it if we really want it to be a community tool.

I think we have similar opinions about what the tool is, and what it's not. I just must have not expressed myself in a very clear way. I did spend about two days hacking on this, just to get a basic POC working. But in the end, I couldn't figure out how to put right angle markers on my vectors. I also submitted an issue about vectors getting smaller when the norm was less than 1.

I'm just saying, the title makes it seem like it's a general purpose tool, but it's not.

bitforger··on Manim – 3Blue1Brown's animation engine for explanatory math videos
Don't get me wrong, I love his videos, and I think it's really nice of him to open-source the stuff.

But like some of the other comments have mentioned, it's not a general purpose tool... it's more like he open-sourced his dot files.

You can certainly make a few things work, but it would be nice to see a community of interested individuals come together to flesh out the abstractions, make sure everything is documented and works as advertised. As it is now, the class hierarchy is a little... misshapen. It's not clear what classes are responsible for what functionality, and how everything fits together in a nice, orthogonal way.

bitforger··on Manim – 3Blue1Brown's animation engine for explanatory math videos
I tried using this once... it wasn't super great.

1. The documentation is sorely lacking.

2. Which makes the inheritance hierarchy (which is already a little unintuitive) really hard to grok.

3. There's this weird home-rolled way of doing default property inheritance that took me a long time to wrap my head around.

In the end, I ended up coding a short interactive thing[1] for my blog using Paper.js. It's a great idea, but could really use some love and maybe a stronger philosophy to guide development. Right now it feels more like a few hacks thrown together.

[1] http://mitchgordon.me/math/2019/03/18/multiplying-complex-nu...

← PreviousPage 2 of 3Next →