HNHacker News
TopNewBestAskShowJobs

slashcom

367 karma · joined October 18, 2007

submissionscomments
slashcom··on Facebook denies 'listening' to conversations
They can’t say that though, because recording a video involves accessing the microphone. Otherwise Facebook Live and Stories couldn’t exist.
slashcom··on Deep Learning Research and the Future of AI [video]
It's like, fine. If you're an engineer curious about the basic notions of deep learning, have at it. It's not very technical; very big picture.

If you're well experienced with deep learning already, maybe only the last 2-3 minutes on the future is worth watching.

slashcom··on An Adversarial Review of “Adversarial Generation of Natural Language”
It's worth noting this post caused a very intense twitter debate among the NLP and DL communities, especially after Yann Lecun replied to Yoav's comments. https://www.facebook.com/yann.lecun/posts/10154498539442143
slashcom··on China has become a major player in AI
The *ACL conferences (major NLP venues) decided to allow presentations to be in Mandarin now; the rationale being that a lot of presentations were in such poor English already, might as well let half the audience be engaged.

It will take at least a few more years before submissions are allowed in Chinese: reviewers can't be assumed to know Chinese. The momentum is there though.

slashcom··on Cyberattacks in 12 Nations Said to Use Leaked N.S.A. Hacking Tool
I worry that they might sell it as a reason backdoors are necessary: if only we had backdoors, we could've saved those patients! The flaw of this logic would be lost on most lawmakers.
slashcom··on Why I published in a predatory journal
Real publishers make a good chunk of their profits from selling subscriptions of their journals to libraries. These allow anyone at a university to read the journal, but the fee can be many thousands per year (per university). These are legitimate businesses, problems aside.

Fake ones like this make it off the $800 publishing fee. Since it's "open access" they just put the PDF online and call it a day. $800 isn't bad for a few hours of proofreading and updating one web page.

slashcom··on Prophet: forecasting at scale
df is a dataframe, which is like a spreadsheet. This line takes the logarithm of the column named 'y' and updates it in place.
slashcom··on $30 Toll to Use Express Lanes
It wasn't due to demand though. It was due to price being calculated by sensors that detect lane speed. The lane was ridiculously slowed by two snow trucks, so it computed a high price.

That said, it's probably reasonable snow trucks get extremely high priority.

slashcom··on Practical Deep Learning for Coders
Your mediocre graphics card may or may not have CUDA support. If it doesn't, or it only supports an old version, then it's the same as not having a graphics card at all. And of course, Nvidia only.

If it supported, then the major difference is GPU memory, which limits the size of the network you can train. The newest models are faster than some 1-2 year old ones, but older hardware does the job fine.

slashcom··on Bill seeks to put porn block on computers sold in SC
Probably not for a lot of the state, but the Charlotte metro area contains a significant number of people who live across the border in Rock Hill for property tax reasons. These people make that commute almost daily. (It's actually enough that the Charlotte Transit Authority has a bus that runs to Rock Hill).
slashcom··on Bill seeks to put porn block on computers sold in SC
Interestingly, the difference in SC sales tax (6%) and NC sales tax (4.75%, but county/city taxes make it ~6.75%), effectively come out to nearly $20 on a $2000 laptop.
slashcom··on Thomas Piketty’s Capital in the 21st Century, in 20 minutes (2014) [video]
But if you have it tied into an investment vehicle, then you're taking some risk and putting that wealth to use.
slashcom··on A parallel implementation of gzip for modern multi-processor multi-core machines
http://lbzip2.org/ also exists for bzip2. It works really well, especially since bz2 files are split into discreet blocks which can be un/compressed independently.
slashcom··on Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
Forgive me, but I'm less impressed by the paper. As far as I can tell, they've only really shown that (1) language is recursive, which we know already; (2) markov models cannot capture recursive languages, which we've known; and (3) RNNs can, which we've known. But so can PCFGs and many other formalisms from the past 25 years, which they ignore.

I did not read it very closely though.

slashcom··on Italy’s teetering banks will be Europe’s next crisis
According to https://en.wikipedia.org/wiki/Demography_of_the_United_State... 27.1% of the US is under 21 and 14.5% is over 65. I know 16 should be working but a good chunk should be getting education. That leaves only 58.4% even eligible for labor participation.
slashcom··on Quebec passes law to regulate Uber
Will be interesting to see if they pull out like they've done in Austin. It's definitely been less convenient to go to a bar since they left.
slashcom··on Duffy and Cruz Introduce the Protecting Internet Freedom Act
Yeah, it's written like if this law doesn't pass, China will be have full access to the NSA.
slashcom··on NVIDIA Announces the GeForce GTX 1000 Series
Pretty good; 8gb memory and impressive transfer speeds. The 980 Ti is pretty common in the Deep Learning community. Only the Titan X is more popular, and that thing is far outside any average person's budget. I'm definitely looking to pick up one of these soon.
slashcom··on This Is Your Brain on Podcasts
http://www.nature.com/nature/journal/v532/n7600/full/nature1...
slashcom··on Jupyter Notebook Analysis of Salary Data Spreadsheet
Most interesting to me was that the gender gap was so much more pronounced in SV than outside

non-SV male median: 97000

non-SV female median: 90000 (92% of male)

SV male median: 137120

SV female median: 99187 (72% of male!)

Unless there's some external factor here, things look pretty damning in SV...

slashcom··on South Korea announces $860M AI fund after AlphaGo 'shock'
Just left a DARPA grant for an AI project. They've been one of the biggest AI funders for some time.
slashcom··on Facebook Reactions
My guess as to what FB will do: treat them all as a "like" with respect to engagement statistics (i.e. do we show this post to more people?)

And simultaneously, use all the emotions to train a ridiculously good sentiment analysis system.

slashcom··on Ask HN: How does Weiqi AI work?
I can't speak as to how to individual particular programs work, but at least as of a year ago, most of the good AIs used something called Monte Carlo Upper Confidence Trees.

They're, unfortunately, not based on intuition. Just statistics.

Basically, the machine plays many, many random games. The more winning games which play a particular stone, the more valuable that particular position is. Then the position with the highest value is chosen.

This alleviates the need of brute force search (which is just too large for Go).

As far as I understand, most of the more successful AIs use UCT for the general game, but then fall back to heuristics and brute search for small, local conflicts (like if forced some stones to be played until death) and counting stones.

Sensei's library has some nice high level information written about the topic: http://senseis.xmp.net/?UCT

More recently, DeepMind (and someone else independently at Edinburgh, I believe) has published a couple papers about training a neural network to play by teaching it to predict the next move of pros given the board state. These use modern computer vision techniques and data. Last paper I saw, this did much better than GNU Go (which doesn't use UCT, and is very weak), but still not as good as monte carlo based methods. There has yet to be a combination of the Neural Network and Monte Carlo methods, but they're quite complimentary.

I believe we'll see that combination in the next year or so, and this will nearly close the AI-human gap.

Edit: Monte Carlo. :P Hooray for autocorrect.

slashcom··on How do machines learn meaning?
So this is my research area.

Distributional vectors are a proxy to word meaning. Words with similar vectors have similar meaning or are semantically related in some way. But usually, you just measure similarity by a single number: the cosine similarity between the two words' vectors.

This number can tell you words are related or not, but it can't tell you how they're related [1]. There's been a good deal of work in automatically identifying that "ship is-a boat" (which is called hypernymy) or cats and dogs are unrelated animals (cohyponomy), but it's still being perfected.

But it is useful. Words that are similar in meaning can be treated similarly. As a bad example: maybe I know that "anger" has negative sentiment, but I don't know what sentiment "furious" has, but I can infer it probably has negative sentiment since it's so similar to "anger".

[1] There's a good deal of evidence that words that have high cosine similarity are more likely to be cohyponyms.

slashcom··on Ask HN: What newsletters do you read every day or week?
http://www.datascienceweekly.org/

The editor picks are usually extremely good, and if I didn't read them already, I know that I should.

slashcom··on Moss Graffiti
Bleach it?
slashcom··on NIPS 2014 papers
Karpathy constantly shows the gap between "Anyone could've done that" and "Yeah, but he _did_."
slashcom··on GloVe: Global Vectors for Word Representation
The original version of the paper was what Yoav was criticizing. It's worth noting that the authors made nontrivial changes to address most of Yoav's comments (and as a result, ended up with a much higher quality paper).

I specialize in word representations and using them for various tasks. Word Similarity prediction has been used as a basic first evaluation for many years now, with analogies becoming an additional standard task in the past couple of years. But it's worth noting that word representations have a LOT of open parameters (which model? how many dimensions? do I remove stopwords and low frequency words prior? do I use a bag-of-words context or a syntactic context?).

The optimal parameter choices for one task are very frequently not the optimal parameters for another. While there are usually "reasonable defaults" for when you don't want to optimize everything, a solid standardized approach risks vastly overfitting to one task, possibly at the expense of more useful tasks.

slashcom··on How Nations Fare in PhDs by Sex
The source of the data also contains many interesting comparisons and conclusions, particularly with respect to time.

http://www.nsf.gov/statistics/seind14/index.cfm/chapter-5/c5...

slashcom··on Check your Google history
Same; though it looks like it might be because my account is a Google Apps account.
← PreviousPage 2 of 4Next →