HNHacker News
TopNewBestAskShowJobs

brianchu

2,341 karma · joined July 15, 2012

Looking for the next thing.

Worked on machine learning for medicine at Cardiogram. Studied CS at UC Berkeley. Former undergrad researcher and teaching assistant for Berkeley's ML class. Former intern at Twitter on Ads Analytics Infrastructure.

Email: bc@brianchu.com

github.com/bchu

twitter.com/brrrianchu

submissionscomments
brianchu··on Income and Poverty in the United States: 2019
I have the opposite assumption: the raw data is usually more reliable than an editorial. And I confirmed it: the raw table is more reliable since it is the same survey across different years. The article is inconsistently comparing numbers from 2 different surveys. The 2018 figure (2.63) is from the "American Community Survey" and the 2010 figure (2.58) is from "Census SF1 data".

But the 2010 "American Community Survey" says the average houshold size is 2.63 (https://data.census.gov/cedsci/table?q=b25010&tid=ACSDT1Y201...), so for this survey the trend is flat.

brianchu··on A Swedish doctor's perspective on Covid
Also the domain was registered 3 days ago (August 6th). An earlier version, doctorseb.com (which redirects to the website) was registered July 20th.
brianchu··on Boeing cutting more than 12,000 U.S. jobs with thousands more planned
Your example is hogswash. Absolutely, the perceived long term value dropped 30% as people feared a million deaths (with lockdown) and dead bodies piling up outside hospitals across the country (with lockdown, and not just New York City). The stock market is rising now that people realize the pandemic, while still bad, isn't going to be as bad as those predictions. Our perception/understanding of the pandemic has rapidly changed.
brianchu··on Why is the stock market rallying when the economy is so bad?
Some models were predicting multiple hundreds of thousands of deaths, with lockdown. The Imperial College model was predicting 1 million deaths, with lockdown. I completely agree cases will rise as places begin reopening. But whatever the outcome it will be with reopening - still better than what the market expected in March.

Yes, NYC was the only place in America where the system was close to overrun and some hospitals actually were overrun, I'm not disputing that.

brianchu··on Why is the stock market rallying when the economy is so bad?
The explanation is very simple. The pandemic is not nearly as bad as people thought it would be in March.

Models were predicting hundreds of thousands of deaths in the USA over the next few months, with lockdown. Many people were predicting hospitals would be widely overrun in New York City, parts of California, etc (again, with lockdown). These models and predictions, of course, were wrong.

Printing money and stimulus should have been expected (given the government's response in 2008) and therefore priced in, at least in theory. If we actually had massive numbers of bodies piling up outside hospitals in all major US cities, no amount of money printing would have propped up the markets.

brianchu··on For $39, Frontier Air Will Let Passengers Keep Their Distance
The WHO is no longer a trustworthy source. But this is still (mostly) correct, and it's not that hard to dive into the studies directly instead of appealing to authorities. All indications are that it is possible for SARS-Cov-2 to be airborne but it is rare.

The main study from Wuhan that people cite for airborne SARS-Cov-2 only found high levels of airborne SARS-Cov-2 in poorly ventilated areas of a hospital setting (where certain medical procedures like intubation are known to generate aerosols): https://www.nature.com/articles/s41586-020-2271-3. Well-ventilated areas had very low levels. A separate study in Singapore found no airborne samples in a hospital setting (https://jamanetwork.com/journals/jama/fullarticle/2762692). Documented spreading events are consistent with the disease not being aerosolized (one example: https://twitter.com/zeynep/status/1251556084424347649).

brianchu··on Sweden Says Controversial Covid-19 Strategy Is Proving Effective
With the disclaimer that I'm only using Google Translate, it appears this document is from one hospital and is not a requirement, merely a guideline / informational document.
brianchu··on Sweden Says Controversial Covid-19 Strategy Is Proving Effective
You can view Swedish ICU admissions data yourself here: https://www.icuregswe.org/en/data--results/covid-19-in-swedi.... New admissions to the ICU due to Covid-19 appear to be flat or possibly even declining.
brianchu··on Uber Is Biggest Loser as SoftBank Counts IPO Returns
Yep. Obviously this is anecdotal and limited to my own social circles, but I live in the Bay Area, and almost everyone (90%+) I know in San Francisco does not own a car. The ones that do own cars only use them if they need to get out of the city (within the city they bike/scooter/walk/Uber/Lyft/transit).

When I did the math, if I lived in the city it would be cheaper to use rideshare everywhere and rent cars when needed, than to own a car.

brianchu··on Robinhood raises $323M at a $7.6B valuation
Shorting a stock is not a basic feature, it's an advanced feature for power users.

You can buy put options on Robinhood already.

brianchu··on Calgary student has been studying decibel levels in hand dryers since age nine
They are not sealed from the ambient air (not usually), which is what this study is saying is where the bacteria comes from.

Regardless of what common sense might say, the point is that the study didn't actually do a direct comparison.

brianchu··on Calgary student has been studying decibel levels in hand dryers since age nine
An interesting study, but I wouldn't read too much into it. Who's to say that paper towels don't collect and deposit just as much bacteria onto your hands?
brianchu··on California is cracking down on the gig economy
I'm coming to the view that gig workers are neither employees nor independent contractors. Employees don't get to unilaterally set their own hours, and contractors don't get prices unilaterally dictated to them or barred from their profession if their rating falls too low.

All this regulatory squabbling is arguing over whether a square peg fits a round hole or fits a triangular hole.

We need a third classification for gig workers that affords them some protections while preserving the economic viability of ridesharing companies. Disregarding any problems we might have with specific companies, I think ridesharing companies are a benefit to consumers.

brianchu··on The Empty Promise of Data Moats
This is really interesting and thought-provoking, but I'm skeptical.

1. In my experience, each data source and each data format requires a lot of custom work. Each kind of prediction task requires additional custom work. I don't see this going away. Even if a company develops a solid core of reusable engineering infrastructure, it will always need to be adapted to the problem at hand. At this point, this company would seem more like a consultancy, with non-trivial marginal/variable costs. This reminds me of Palantir, which operates this way - core set of tools and infrastructure, consultants implement and apply these tools/infra at each client company with a lot of custom integration work.

2. Assuming this is not a problem and the shared infrastructure is able to generalize enough of the custom work to be feasible, this thesis actually seems like an argument for the big tech companies dominating all data companies. Google, Microsoft, and Amazon have the engineering talent and resouces to develop this hypothetical infrastructure. They also have the internal political will because they can then expose this as cloud APIs. Indeed, it appears they are already attempting this in certain domains.

3. Superior engineering infrastructure is indeed a competitive advantage, but isn't enough of a moat for a single company to dominate this space. Yes, great engineers are hard to find, but there are enough of them for more than one company to feasibly develop this infrastructure, with a lot of money. You can't say the same about trying to buy the social network of Facebook or Instagram.

brianchu··on Tesla is building its own AI chips for self-driving cars
The interesting thing about the $3000 "upgrade" is that if you actually want to get it, I think you're better off taking the $3000 and investing it in Tesla.

Assuming autonomy is make or break for Tesla in the long term: if Tesla fails at it your stock will still be worth something (versus a useless upgrade). If Tesla succeeds you'll make more than enough to cover a retrofit.

brianchu··on Benchmarking Modern GPUs for Maximum Cloud Cost Efficiency in Deep Learning
Right, but after 3-4 months of full time use (and it's not hard to use these full-time, since models can take days to train), you've spent more than if you just bought one outright.
brianchu··on Benchmarking Modern GPUs for Maximum Cloud Cost Efficiency in Deep Learning
1. I wouldn't take much away from the LSTM benchmark. It's more a benchmark of Keras since Keras only supports CuDNN's LSTM via Tensorflow right now. AFAIK CNTK does supports CuDNN LSTM but not through Keras. Keras actually implements its own LSTM in terms of the base math operations (it doesn't call the Tensorflow or CNTK LSTM operations which are in some cases optimized in C++ etc.), so on the CPU you probably could get better performance if you were using the Tensorflow or CNTK functions directly.

2. Compiling Tensorflow from source on CPUs is a bit of a hassle but I have seen nice performance gains (10-20%) for LSTM tasks. I bet you would get even higher gains for CNNs since they're more parallelizable. (Note: I've never gotten the latest TF to work with Intel MKL).

3. I haven't fully tested this myself, but with the P100s you also have full support for half precision floats, which supposedly offer a huge speedup.

4. Also would have liked to see benchmarks of other frameworks like PyTorch, etc. I haven't used them myself but everything I've heard indicates that Tensorflow is often slower.

brianchu··on Neural Networks in JavaScript with Deeplearn.js
When possible, most DL frameworks take advantage of Nvidia's specialized CuDNN libraries, which often provide a 10x+ speedup (and are obviously not available via WebGL). So at least on the latest Nvidia cards, you will likely see a 10x slowdown, and probably even more.
brianchu··on Ask HN: Who is hiring? (November 2017)
Cardiogram | San Francisco, CA | ONSITE: FULLTIME

Our mission is to reinvent preventive medicine using consumer wearables. Our goal is for Cardiogram to be a “doctor” on your wrist that continuously screens your health based on your exercise and wearable data.

We have an Apple Watch app and an Android Wear app that help users track their heart rate and exercise, both built using React. We’re a small team funded by a16z and we’ve scientifically validated our algorithms with UCSF (https://techcrunch.com/2017/05/11/apples-watch-can-detect-an...).

We’re looking for engineers wth 2-4+ years of frontend, mobile, UI, product design, and/or product development experience to help us design and build out our mobile apps. Our stack is React, Node.js, and Postgres. You’d be working directly with our two founders and another engineer-designer. There is a ton of exciting design and frontend work we need to do around helping our users stay healthy, screening them for medical conditions, and providing them with options for diagnosis and treatment. We have hundreds of thousands of daily active users and our Apple Watch app has been featured by Apple in the past. All the time we hear anecdotes from our users about how their cardiologist recommended they use our app to track their heart rate.

Email me at brian@cardiogr.am.

brianchu··on The Corrosion of High School Debate
I believe the pressure requirements were increased to combat the prevalence of this move. Watching Olympic fencing you don't see that many flicks anymore.
brianchu··on Tensorflow sucks
This article is not that detailed, but it's a sentiment I agree with, so I'll add one major shortcoming of Tensorflow: its memory usage is really bad.

The default behavior of TF is to allocate as much GPU memory as possible for itself from the outset. There is an option (allow_growth) to only incrementally allocate memory but when I tried it recently it was broken. This means there aren't easy ways to figure out exactly how much memory TF is using (e.g. if you want to increase the batch size). I believe you can use their undocumented profiler, but I ended up just tweaking batch sizes until TF stopped crashing (yikes).

TF does not have in-place operation support for some common operations that could use it, like dropout (other operations do have this support, I believe). Even Caffe, which I used for my research in college, had this. This can double your GPU RAM usage depending on your model, and GPU RAM is absolutely a precious resource.

Finally, I've had issues where TF runs out of GPU RAM halfway through training, which should never happen - if there's enough memory for the first epoch, there should be enough memory for every epoch. The last thing I want to do is debug a memory leak / bad memory allocation ordering in TF.

brianchu··on DeepTraffic is a gamified simulation of typical highway traffic
400 units is very small. Today's image classification neural nets have hundreds of thousands of units (units is my preferred non-biological synonym for "neuron")
brianchu··on Braess’ paradox
Sure, but dropout actually increases training error (makes you less likely to find the globally optimal training error), with (sometimes) a decrease in generalization error (test error). So any connection is very thin.
brianchu··on Braess’ paradox
I'm not sure dropout has anything to do with local optima or removing greedily optimal paths, since it is random.

The original dropout paper's handwavy justification for dropout is that it prevents co-adaptation. It prevents individual units (nodes/neurons) in the network from relying on specific units in the previous layer firing as well. This is a bad thing because it's fragile (if one unit is off). I say handwavy because this is just intuition; there is not really any proof that this is actually what is happening.

Another commonly cited motivation is that dropout is like learning an ensemble of multiple networks.

The only paper I've seen that theoretically analyzes dropout is: https://arxiv.org/pdf/1506.02142v6.pdf, which proves it's equivalent to approximating gaussian processes (this is beyond me).

brianchu··on AI’s Language Problem
That is very, very weak evidence.
brianchu··on AI’s Language Problem
The very method of using a word embedding space assumes the manifold is smooth, so the fact that vectors extracted from a method that assumes a smooth manifold, are in fact on a smooth manifold, is just circular and not evidence of anything.
brianchu··on AI’s Language Problem
All those sentences sound (mentally) a lot differently. Some of those sentences give you the impression the speaker is an idiot, for example.
brianchu··on AI’s Language Problem
I specifically and mindfully added those words because everything is really an open research question. Would you rather I dissembled a false sense of confidence? If anything, you're stating your vague case way over-confidently. Turing-completeness is broad and nonspecific. Doing "some computation" is an obvious statement that doesn't add any information. The human brain does not seem to have time limits when it comes to thinking about what to say, and further we don't understand enough about neuroscience to make statements like that. Like I said, these are all active areas of research; the jury is still out on whether any specific approach will be the breakthrough.

EDIT (reply to below): in general these statements are either vague and nonspecific, or perfectly correct and non-informative, comments that don't have much to do with my original point.

brianchu··on AI’s Language Problem
Sorry, I've edited my original comment to be clearer. What I really meant is that there is wide tolerance of noise in those domains. "How long does stars last" has a completely different meaning than "How long do stars last" - not tolerant of noise.
brianchu··on AI’s Language Problem
I don't think there will be a winter. There are enough successes in computer vision.
Page 1 of 10Next →