Confession of a so-called AI expert
huyenchip.com
huyenchip.com
Like other commenters have mentioned, largely due to misbranding and sensational media hype. Fearmongering from people like Elon Musk hasn't helped. But the key impact of machine learning for me is to make better and more efficient decisions that are informed by data - and that is not going to go away.
This is an odd point of view to have. While op may see this as pressure because of imposter syndrome, I would have DREAMED of an opportunity like this in college.
These entrepreneur may not quite understand what they're getting into, but make no mistake, they are very good at recognizing experts, both established and rising [although they do cast a wide net] and this kind of behavior drives life changing opportunities and make it substantially easier, in a difficult world, for the cream of the crop to be unlocked to exceptional success at an early age. And the rising tide helps all of us.
The smartest people in college are usually the ones who ate able to learn what they need to know outside of college on their own, once they have an income, and entrepreneurs unlock that potential.
However call me idealistic, naive, whatever - I don't like the motivations of these solicitors, even though in a pragmatic sense their actions will have positive side-effects for us (the "rising tide" you mention).
Possible that she has severe imposter syndrome and she sounds above average. But maybe she really isn't as great as everyone thinks she is and she wants people to know that. And maybe people shouldn't pat her on the back and say "no dude you're great don't say that"
*disclaimer: basing this on blog comments and some comments here
Stanford undergrads and grads alike can teach a course as long as they have (1) the necessary background, (2) passion and proficiency in the tech, and (3) motivation to teach and manage course overhead.
Being a "super genius" doesn't correlate with being informative and having intrinsic instructional value.
Edit: Commenter above clarified to me that the student is not teaching a full blown 3 unit course.
At work, I started a study club, and started teaching a programming course, all on company time. No pre-approval. Nobody objected.
And the universities I've been to tend to be even more liberal than companies in such matters.
So an undergrad teaching a course doesn't seem questionable to me.
It doesn't really matter if the OP (or anybody else really) is a super genius or not. People from outside the field can't tell, and so they approach those with a high media profile, and who match some of the preconceived ideas, like the buzzword bingo mentioned in the blog post.
The same is true even inside our field. When I'm interested in some architectural design pattern, I often read an article by Martin Fowler. Why? Because what he writes sounds plausible, and because I've heard his name a hundred times before. I've never seen production code he wrote, or been on a project he worked on. Maybe he feels like an impostor too, sometimes?
I'm not calling Fowler an impostor; I just want to draw the parallels how second-hand knowledge influences our perception of expertise.
I don't think it will. Level off - maybe.
I've started my work in Computer Vision with classical algorithms (SIFT features, geometry, correlation filters and things alike people were researching for decades). These really worked like garbage, it was a nightmare.
Then we jumped on DL bandwagon - and CV just clicked for me. Now I see it working, not perfectly, not at human level yet, but it works, it's better than everything else and it certainly brings value - not just in CV! Maybe there will be some expectations delayed or even ruined (AGI, fully self-driving cars, dunno), but the tech isn't going anywhere.
At it requires at least some experience and a specific mindset, slightly unusual for a generic programmer. So I don't see a problem with experts, courses, degrees and the like.
I'll choose refrigeration, combustion engine, concrete, and probably hundreds of other things before computer vision.
Not even at insect level yet. There's no doubt things will improve, and there's already great value, but I hate calling ML "AI". It's been over 70 years of ML research (specifically neural networks) and I don't know how long it's going to take to reach insect-level behavior (which is still far from basic intelligence) let alone so-called AGI (which, BTW, people in the '50s were certain is just around the corner), even though I think we'll get there eventually. We'd better stop using the term "AI" to mean anything other than a field of research or an aspiration, and definitely stop using it to describe existing software.
I'm sure you're familiar with the line of reasoning that if you asked someone 50 years ago to describe tasks that require intelligence, they'd for sure say recognizing objects in images is one of them. Now that computers can do that, it's no longer 'intelligence' and the goalposts get moved.
In what sense is no software 'as adept in "general problem solving" as insects'?
Chimpanzees have better short term memory on certain tasks than humans [1] - humans not being better at _everything_ than chimpanzees doesn't make chimpanzees more intelligent.
[1] https://www.livescience.com/27199-chimps-smarter-memory-huma...
Playing go or chess or matching patterns are all things intelligent begins can do but that does not imply that doing those thing means you are intelligent.
Various products and services have shown that DL and other ML techniques are useful and profitable to implement. And corporations can see the benefits of incremental improvements. That alone will continue the momentum, even without amazing breakthroughs.
Very few organisations are seeing ROI on these projects. I've seen figures showing average for every million spent the return is less than half, for the quarter of them that actually get into production...
Deep learning is a subset of machine learning that utilizes more than one layer of neural networks. So these terminologies just refer to different parts of the same process. The 'process' is just tweaking a program to progressively make more accurate yes or no assumptions about a set of statistics that you give it. That's my best shot at it, hope it makes sense.
If you are into CV, first start with very simple static image recognition with AlexNet/VGG/Inception etc. in Keras, try to understand CNNs a bit (it's inspired by biological neurons, they can do simple things like direction detection, edge detection etc. and overlap each other's field of vision; if you look at computational photography, convolutions do something similar, so the idea is why not use a layer of multiple convolutions, then make a hierarchy of those convolutional layers, and let the optimization/learning part of Deep Learning during training figure out what exact convolutions does it need instead of force-feeding them by hand). Play with the ways to improve training (batch normalization, image augmentation etc.) Once you understand this, your mind would probably explode and then it's time to understand RNNs/LSTMs/GANs and have fun applying it on voice, natural language, generating art etc.
You'll have a blast for sure when you realize what you can now easily do! Have fun! ;-)
Play with http://playground.tensorflow.org/ . Read today's https://news.ycombinator.com/item?id=14992865 about https://pair-code.github.io/deeplearnjs/ .
I mean, the dotcom bubble popped but websites are still here and more profitable than ever. The bubble popping doesn't mean that DL is going to go away. People will just have more reasonable expectations about what it can do.
1. Something works past all expectations.
2. There is craze, overhype, bubble and bust.
The markets have the ability to overvalue things that are great successes. In fact overinvestment and bubbles are often the result of real success.
If something generates 100X return, its completely feasible that markets value it in level that would require 200X return to be profitable investment.
Large amount of data has helped, so AI systems are better than before (with lots of training data), but that's pretty much it. It is not going to replace programming jobs, leave aside solving world problems.
Not equating ML to OR, directly. With today's horsepower and data sets, it is a brave new world. But we're in the elevated expectation phase of the hype cycle.
Why would anyone not continually bike for commuting purposes once they are wealthy? Biking is such a joy whether you're 7 or 70, rich, or poor.
E.g. these authors find the health improvement statistically increases your life expectancy by up to 14 months, while traffic accidents statistically reduce it by up to 9 days. That's a ratio of 47 to 1.
Edit regarding your comment: Oh, I see why you're confused. I didn't need to do the math because I was talking about a 1-time bike ride as an example to just get the point across -- it's already scary for 1 ride. But if you want the actual math for a lifetime, there's a ~1/5000 lifetime odds of dying in 1 year of biking. That's still pretty damn high. I don't know about you but I'd rather just give up on the 78th expected year of my life and lose the 0.1% chance of dying in the next 5 years.
But the point of bringing up the statistic is to check "is this risk worth worrying about, to the extent that I'm not gonna do thing X"? That's what a rational person does in all situations - is the risk of flying so high that I shouldn't go on holiday? No. Is the risk of falling if I climb that cellphone tower so high that it's not worth it for the view? Yes.
I'd take a 1/1000000 chance. I wouldn't take a 1/1000 chance. Get the point?
I've been told Berklee College of Music makes it very easy for students to leave and later come back, even years later, exactly to enable students to grab transient professional opportunities without sacrificing their education. I wonder how engineering schools stack up in comparison.
I've had my own calculus / discrete math / math for bio courses before but that was after several years as a doctoral student and TA at Georgia Tech. I can't imagine that there isn't a PhD candidate with more experience under their belt both teaching and using TensorFlow. The author even admits they volunteered to teach the course to stimulate learning the material themselves.
Stanford allows undergrads to propose and teach some of these more "practical" courses for upcoming technologies - a few examples are classes for NodeJS, cryptocurrency, Spark, and this one for Tensorflow. It's student-lead, very hands-on, and intended to give a specific industry experience.
The classes the author mentioned are first year pre-requisites for the AI specialization and doing research at labs, and gives enough background for a student to be instructive when explaining concepts such as perceptrons and svm's, without necessarily the mathematical rigor. This is the level needed to interact with Tensorflow.
https://registrar.stanford.edu/staff/student-initiated-cours...
I think the problem is with higher education system not the hype.
Standford/cmu should make their degree more rigorous.
I am sure if cs231n include fisher vector in their course and some maths derivation in their assigment,the number of student would drop logarithmically :)
Based on what the author is saying, part of me thinks imposter syndrome and bubble are both justifiable ways of thinking about what he's describing, but to me as an outsider the bigger problem it reveals is the way hiring and career development happens.
Without exaggerating anything about me, or without this coming from a place of jealously (although I can't deny I'm a bit jealous), it seems that I could easily teach the course they're teaching, with a deeper understanding of the material, and more justification for teaching it in many ways. I know that if I taught that course it would be fairly easy and not really stressful--fun in fact. I've taught courses on equally complex stats and math, and published in related areas.
And yet, there are no recruiters pounding on my door. If I applied for jobs most places would throw out my application for all sorts of reasons.
This person seems competent enough, so I do think there's impostor syndrome going on. Part of what they're describing is a normal process of teaching higher ed for the first time. And there probably is a bubble--the stuff they're describing is part and parcel of hype that goes along with bubbles, and although extremely useful, I think there's also a lot of problems with AI being swept under the rug.
This post really touches a nerve for me, because it gets at a problem with careers, at least in the US, which is that the bases of hiring decisions (and by hiring I mean broadly, not just as an employee) are so incredibly superficial. My guess is this person would function fine in AI, but I think anyone who knew me would have to bet that, between the two of us, I would be better qualified and better able to work in that area. But because this person taught an AI course at Stanford, they're more sought after than me, who doesn't even have a CS degree (although I do have a PhD) and certainly not a degree from an elite school.
I'm really at a difficult place in my life because I'm at a point in my career where I should be happy, and lots of people would say I'm successful, but to me I feel professionally typecast and trapped, by stereotypes and superficial appraisals. All the time you hear admonishments that degrees don't matter, etc. but then the reality is, they not only matter but matter in the most superficial ways possible, where it's not just having a degree and publishing and doing research in closely related areas, but having a degree covering exactly what is the focus of a hot plasma-magnitude bubble, from an elite university no less.
Most of the time at this point I just want a job that pays enough, and where I can live in a nice, comfortable safe place that I love. I've started to feel like the whole concept of meritocracy is a huge lie, and not because the people benefiting from it are incompetent--not because of false positives--but because of the huge problem of false negatives that lies in the shadows.
The funny thing is, it took me about a year to find this position after a good amount of rejections. About a year after I got my data scientist title, I've been contacted by recruiters from places I would have never expected to be contacted from (Amazon, Microsoft, FB, etc.). Did a few interviews, and realized during those interviews that I still have a lot to learn.
For one of the interviews, they gave me a take home assignment where they literally duplicated a column in the feature matrix... I didn't catch it, and during the phone part of the interview I get asked 'do you know notice something interesting about those two feature distribution plots you have there?'
"Hrmm, no I don't. Oh, wait, they look pretty similar."
"They're exactly the same."
"... shit."
This is called colinearity - you can check for it by comparing the rank of the matrix to its number of columns. In R qr(X)$rank. Good to add this to your EDA workflow.
The answer is yes. Bubbles are investment and financial entities, decoupled from the value the sector is producing, and a bubble burst can indeed destroy real value.
So AI being in a bubble says nothing about whether AI is valuable.
Machine Learning is a feature set inside an application inside a market. It's not an industry of it's own where massive swaths of an industry place their money or livelihoods, like e-commerce or derivatives.
So in that sense there isn't any bubble to burst. The majority of ML applications are happening INSIDE massive technology companies, not as stand alone companies. Even then, the stand alone companies have a product that they are selling that ML functions with. So SaaS with ML, or Image Captioning or Translation service etc...
is this even true?
aren't legacy admissions to Ivy League schools, the government protected status of Wall Street banks, generations of nepotism in Hollywood, Ticketmaster, the red-blue lock on politics, prosecution-protected city police officers, and Time Warner cable all dandy examples of sustainable rigged systems?
That's the problem - these AI companies... believe their own hype a bit too much.
Now policy makers, and all sorts of busy bodies are contemplating solutions to the 'ai problem' which does not exist and will not exist for some time to come, if it comes.
Pattern matching and image recognition are valuable on their own but passing it off as AI makes a complete mockery of the word and scientific communication.
Engineers and scientists are supposed to be precise and even giving leeway for hype and excitement within the realm of what is possible.
Outsiders calling on the expertise of relatively junior people is a seems to be a pretty natural consequence of this distribution, though maybe not to the extent described in this blog post.
> Like my friend Delenn said, [...]
I've wondered if Delenn would ever show up as a girl's name. I guess now is about when you'd expect to hear about the children of people who watched Babylon 5 as teenagers. Cool!
Just believe in yourself. It's the people who have the courage that'll end up as leaders. You've just got a taste of it.
http://huyenchip.com/2017/08/09/sexism-in-silicon-valley.htm...
posted earlier.