852 karma · joined April 27, 2020
Most of what I'm seeing is AI influencers promoting their shovels.
But more important than the writing style, there is no interesting content here. It's all generic statements and platitudes with a bunch of generated links.
TLDR "look we use AI at Stripe too, come work here"
To me, the article says "columnar formats that don't require deserialization are good, oh, and you can use Minio to store data!"
Having barriers of entry is not always a bad thing - it forces people to learn and understand concepts instead of blindly following and copying and pasting code from a Medium article and praying that it works.
But I agree with you that there are many different use cases. Those people who want to do high-level work (I have some images, just give me a classifier) shouldn't need to deal with that complexity. IMO the big mistake was trying to merge all these different use cases into one framework. Let's hope JAX doesn't go down the same route.
PyTorch has already stood the test of time and proven that its development is led by a competent team.
Time to set up my emacs config to manage my life and stop wasting time.
At least for me, this was one of the reasons why working at FAANG where everyone is striving for $$$ made me miserable. It gave me such a warped view of the world.
I regret nothing. I'm so much happier here than I ever was in the Bay Area, and I doing this early in my life allowed me to have a lot of fun and stories to tell. Why would I "waste" my precious 20s and early 30s being miserable and retire at 35? Who even wants to retire? I wouldn't even know what to do with that money? Buy a house and sit in the garden the whole day? :) Not the life I wanted.
This whole "make a lot of $$$ and be miserable in your 20s to optimize for the future" is such a common thing I see in SV and HN as part of the narratives that these VCs are pushing. I think you have it all backwards. You can make money any time. You can never back to your 20s and 30s where you don't have health problems, are full of energy, and have an easy time making friends.
TLDR; For large projects that must make use of the React ecosystem I'd take Next. For smaller SPA projects I prefer svelte.
For a lot of AI researchers, OpenAI has been a huge disappointment. We had hope that OpenAI would be the company to democratize AI with good open source work, transparency, no PR bullshit (aka DeepMind), and evangelism. That they would develop in the open, and perhaps even do research in the open. You know, kind of like the name says.
It all started out okay with their release of OpenAI Gym, tutorials, leaderboards, and competitions around that. That was when Karpathy was still there. Over time, many projects have become abandoned, poorly maintained, or just disappeared [1]. And many projects they promised never happened [2]. OpenAI became just another research lab obsessed with publishing papers in closed (!) journals, indistinguishable from Google AI, DeepMind, FAIR, MSR, and the many others.
There is nothing open or different about them. Most paper code is not published, and even when it is, it's just the typical poorly written and unmaintained research code that you see from other labs. None of their infrastructure is open source either, because it's needed to maintain their competitive advantage to train models and publish research papers. GPT-3 being offered as a paid API to a select number of people is latest joke in a long series of other jokes. All of this would be fine, if it was not for the name and branding of being a transparent and good-willed nonprofit company. It is just misleading and that rubs many people the wrong way, as if the whole "open" thing was just a PR stunt.
HuggingFace [0] these days is pretty much what OpenAI should have been, but only time will tell what happens.
[1] https://www.reddit.com/r/MachineLearning/comments/aqwcyx/dis...
For what it's worth, I know several people at competing labs who applied for access and didn't hear back. If you are doing science, aren't other scientists, especially those who are critical, the first ones that should get access?
It's quite suspicious that instead of giving access to AI researchers who have the ability to evaluate the model and may be skeptical, OpenAI has largely been giving access to Silicon Valley startup people and VCs who know very little about AI but say how game-changing it is. Perhaps it's just their network with extra incentives. Gwern being the only exception that comes to mind.
[0] https://twitter.com/arram/status/1281258647566217216
[1] https://twitter.com/mckaywrigley/status/1284110063498522624