1,599 karma · joined December 22, 2008
I think this can and may be true. See Pinker's arguments in The Better Angels of our Nature. It seems obvious to me that people's perceptions of crime are influenced to a huge extent by media reporting. People have irrational, unfounded beliefs all the time, so I don't see why they should be indicative of anything.
I'm confused, why not? "English grammar visualization" is inherently an NLP problem. Both handwritten and statistically learned grammars are very large and therefore hard to visualize. I think it would be better to focus on a manageable language fragment. Some kind of interactive second language learning environment--but that probably already exists. What is it exactly that you want to do?
BTW: I wonder for how many people "graphing sentences" is an effective approach to language learning.
I didn't expect hard data, but a list of traits specific to female autism would have been useful.
That sounds precise... Is that based on the size of her vocabulary?
That doesn't follow. It could simply mean that she had really bad psychiatrists who just threw around diagnoses. Maybe it reflects that mental illness in general is poorly understood, because they didn't discover that the other diagnoses were false positives. I am afraid that unless a diagnosis is followed by a successful treatment, it's not worth much.
The latter two have nothing to do with psychiatric or psychological diagnoses. A diagnoses is made on the basis of symptoms, it doesn't get more exact than that. There are symptoms which frequently go together, and this is how disorders get a name. Although science attempts to find biological markers for mental illness, this has not been very successful. Psychoanalysis is just pseudoscience.
Theoretical physics is also very much a thing.
> and should therefore be testable by definition.
That sounds nice but the definition of testable is hard to pin down and changes over time.
People always proclaim that you can just use multiple processes for parallelism. It's nice when it suits your (embarrassingly parallel) problem but when you need to share a large amount of data between processes it's a major hassle.
No it isn't. It's loosely inspired, but the goal is to make something that works, not to simulate what we know of the human brain. There's a different field, computational neuroscience, which does try to make faithful models of the human brain.
If it's not about innateness but about the claims of "internal grammar" from the press release then it because less clear that there would be many people who would reject such a position. I think this is a misleading on the part of the press release. Whether something was innate or learned, I think most people would agree that knowledge of language is internalized. So then the question remains whether you call it grammar or something else, and whether statistics plays a part should have no bearing on that if you ask me.
No not really. Barring concrete physiological evidence, innateness is simply an unfalsifiable position. I do think you can say that consensus among scientists might have shifted against innateness, but that is definitely not because of some computational model such as RNN with some passing resemblance to observed behavior of human neurons. The way these networks are configured and trained has nothing to do with real brains, nor does the abstraction in neural nets leave room for any electrochemical effects.
> The interesting question is why RNNs are able to produce things that resemble formal languages at first pass.
Is it? A neural network can achieve that by simulating a Turing machine or simpler automaton. I don't see what that brings to the table? That's just doing something we could already do, but less efficiently. I think the interesting thing is the opposite: if the RNN can do something which couldn't be done before with other models.
The opportunity for massive-parallelness is in disambiguating a huge number of possible interpretations. Before you can construct the possible candidates, you first need to have processed enough of the sentence. But since you can process new sensory input at the same time as disambiguating previous input, you can get the garden path effect. What I find interesting about the garden path effect though is that it's so artificial, so the way language is used normally seems to purposely avoid ambiguities that will trip up listeners/readers.
They do not.
> I think we all knew that the brain has some mechanism to detect grammar.
The press release is spinning the paper to make it sound much more controversial than it is.
Think of a single-core processor executing instructions one at a time. Now think of ten billion neurons in your brain out of which a large proportion is active at any time. That is definitely massively parallel.