HNHacker News
TopNewBestAskShowJobs

jeffshek

550 karma · joined April 17, 2014

I work for startups. My blog is at www.jeffshek.com
submissionscomments
jeffshek··on Chris Lattner to Lead SiFive Platform Engineering Team
A lot of work from researchers are using *conda on Windows. ML research is happening across all fields, not just computer science.
jeffshek··on [dead]
I know this isn’t tech related, but Kobe was an idol growing up. I never played basketball, but looked up to his work ethic in so many different areas.

His willingness to push against determination, setbacks and overcome obstacles largely shaped who I am today. I’m not close to having his work ethic and tenacity, but it is something I aim for.

RIP 24.

jeffshek··on A Kaggle Grandmaster cheated in $25k AI contest with hidden code
Adoption speed is probably the only proxy that could be used. Measuring quality of pet life in suitable homes is rarely collected.

I'm not even certain of how that could be objectively measured for children, let alone pets.

jeffshek··on A Kaggle Grandmaster cheated in $25k AI contest with hidden code
Not if the underlying model was bad, no tweaking of hyperparameters can change that. It's safe to say, he probably did consider this (and it probably didn't work well enough).
jeffshek··on Front (YC S14) raises $59M round led by other tech CEOs
https://firstround.com/review/the-founders-guide-to-discipli...

A really good podcast about how her strategy on efficient fundraising.

jeffshek··on She was a star of New York real estate, but her life story was a lie
More likely than not, its easier for a liar to get by in densely populated areas. Get caught in a lie, or marked as a liar in a small town can hurt social standing.

However, I wonder if this changes now with social media - for better or worse, accusations (true and false) are quite quickly thrown.

jeffshek··on AlphaFold: Using AI for Scientific Discovery
Alpha is also a reference to the "learning rate" in machine learning models.
jeffshek··on Ask HN: What has your work taught you that other people don't realize?
If you can prevent being cynical and take that effort into doing actual work, your skillsets quickly compound. If the job sucks, take your improved skillset elsewhere. But do not sit idly and complain - it does nothing, hurts your career, your colleagues and your life.
jeffshek··on The “No Code” Delusion
I don’t have enough experience with no-code tools either, but I don’t agree it’s motivation that prevents it from taking off.

No-code is used mostly by non-technical founders who do seem quite motivated (enough to do it themselves).

Engineers are more likely to build it themselves (realistically, over-engineer).

jeffshek··on How to Invest in Startups
But fool you ten times, and you get Dropbox.
jeffshek··on Microsoft Is Winning the ‘Cloud War’ Against Amazon
It would be a bad thing to have only one clear winner - you now have to deal with antitrust laws.

It’s in ones best interest to look like they have a close competitor, but in reality so distant it won’t catch up.

jeffshek··on How anti-cheats catch cheaters using memory heuristics
Sense of social status, cheating artificially increases your rank. No one knows your cheating, so you get all the respect.

Leaderboards are dopamine clickbait for trying to improve.

Why do billionaires want to richer?

jeffshek··on Ask HN: Joining Big Tech in One’s 40s
Not quite, the term IC also comes with connotation you don’t want to be a manager track.

Many software engineers (including myself) much prefer the IC route.

jeffshek··on Sonos Sues Google: It wanted to sue Amazon but could only risk suing one
It’s hard to make rational long term decisions if the CEO is trying to boost short-term profits for public markets.
jeffshek··on The End of the Beginning
This captures my sentiment.

It’s hard to see how the incumbents could be beaten — precisely because how effective they are around data, buying potential competitors (Instagram, YouTube) .... but this is precisely because we don’t know what/if the next market shift is.

What happens if AI takes off? What happens if 3D printing magically becomes 100x more efficient and you can print anything you want from home?

We don’t know. It doesn’t seem like the big incumbents could be defeated, but history repeats itself.

jeffshek··on Training GPT-2 to Play Chess
It would not be close to similarly efficient. They have completely different loss functions.
jeffshek··on How to be successful (at your career, Twitter edition)
Blog Post (Last Year) : https://blog.samaltman.com/how-to-be-successful
jeffshek··on Amazon has long ruled the cloud – now it must fend off rivals
I’m biased toward my use case - but if I have to move a bunch of terabytes for a ML data pipeline - I arguably am having stuff on GCP.

To your point though, yes there is business risk of having it on one cloud.

jeffshek··on Show HN: Self-taught neural network learns to shoot a target
This is the light that shines through cynicism - the light that makes people brave enough to post new stuff.
jeffshek··on Donald Knuth: Algorithms, Complexity, Life, and the Art of Programming [video]
You need to watch three of them. He has a style and once it “clicks”, it’s rather interesting.

I had a similar impression months ago, and after listening to a few - I was so happy I gave it a fair chance.

jeffshek··on Amazon has long ruled the cloud – now it must fend off rivals
I may be wrong, but I recall reading Azure grew quickly because they already had MS contracts in place with many enterprise companies. They simply said, we’ll also hold your hand in the entire cloud process.

This was critical because by then if you weren’t on AWS, you probably didn’t have the DevOps team to do so - MS was now willing to lend you enough consultants to do it for you.

The number of spend shouldn’t be astronomically high. Most workflows in cloud computing are commoditized low-margin. It also explains why Google wants to do high-margin AI stuff, and why AWS is happy with low-margin areas.

jeffshek··on Amazon has long ruled the cloud – now it must fend off rivals
GCP has a really strong ecosystem around AI. If you end up dealing with some type of ML problem with absurd memory requirements, TPUs can be useful there. A lot of recent Transformer architectures have these requirements.

Also, a huge amount of cloud costs are based on egress, so having it on one cloud saves you resources.

jeffshek··on One-quarter of the world’s pigs died in a year due to swine fever in China
One caveat though is global macro is notoriously difficult.

Even when you think all signs point to a conclusion - think “peak oil hypothesis” something can come out of the moon that changes all your hypothesis, ruining your funds return easily.

jeffshek··on Predicting where AI is going in 2020
I agree with so many points here. Generative AI is one of those things that are immediately applicable. Instead of problems that require 100% accuracy, generative models don’t require that. As long as the avatar looks close enough, it works. And no one really needs explainability there.
jeffshek··on Predicting where AI is going in 2020
I love PyTorch, but I’m not confident the claim that it is the most popular is close to true. The cited link, which brings up a lot of new research is in PyTorch simply doesn’t account for the amount of TensorFlow in production.

Sure, a lot of academics may be embracing PyTorch, but almost all production models have been in TensorFlow. Tesla is a huge notable example that’s using PyTorch at scale.

I do suspect that the split of TensorFlow 1 and 2 is perhaps one of the worst times for TF 2, many teams will likely try out PyTorch instead.

I think both are amazing frameworks, however TF was designed for Google Scale .... which leads to a lot of difficulties since 99.9 are not at Google scale.

jeffshek··on Ask HN: Best book to gift someone for getting into software engineering?
Another vote for Code Complete. But coming from someone who's bought and gifted a few books, I'm thinking instead of the quote ...

"If you want to build a ship, don't drum up people to collect wood and don't assign them tasks and work, but rather teach them to long for the endless immensity of the sea." Antoine de Saint-Exupery

jeffshek··on Ask HN: Partial Bootstrap for a SaaS Startup
https://www.indiehackers.com/ is a great resource around this.

The Mom Test (Book) is a way to verify the thing you're building people will actually want. Providing market-fit can be hard.

Startup School by YC is another good resource to keep you accountable and make progress with your ideas.

jeffshek··on Tensorflow User Experience
That's a little unfair no? Supporting TF's API is much easier than building TF for Google (and then releasing it to the public).
jeffshek··on AI is the new co-writer
Self-plug, but I made https://writeup.ai (open-sourced) for a similar reason. It writes with you, not just at you :)
jeffshek··on Amazon caught using indepdent artist's work without license
Some neural nets could be useful here, just indexing would take a while.

VGG19 measure of perceptual loss has been useful for me.

← PreviousPage 2 of 6Next →