HNHacker News
TopNewBestAskShowJobs

fractionalhare

2,196 karma · joined June 28, 2020

submissionscomments
fractionalhare··on What Data Can’t Do
I know what they're saying, I even reiterate it in my second sentence. My point is that doesn't protect you from the distribution changing, which is a problem that applies to machine learning and classical statistics.

This is in support of the GP comment: while you can loosen your assumptions about what the underlying distribution is and don't literally need to know it, you can't get away from the fundamental limitations of statistics. Which is the original topic we're talking about.

fractionalhare··on What Data Can’t Do
> In ML (or more specifically deep learning), we make no distribution-based assumptions, other than the fundamental assumption that our training data is "distributed like" our test data.

Okay, so that's about the same as classical statistics. You're just waiving the requirement to know what the distribution is. You are still assuming there exists a distribution and that it holds in the future when you apply the model. Sure you may not be trying to estimate parameters of a distribution, but it is still there and all standard statistical caveats still apply.

> Indeed, with the use of autoencoders, we don't assume a single distribution, but rather a stochastic process.

Classical statistics frequently makes use of multiple distrutions and stochastic processes.

fractionalhare··on Deliveroo shares drop 30% on UK IPO listing
You could actually say IPO pops (and drops) are a temporarily more extreme price discovery process when a company transitions from relatively inefficiently traded private entity to a more efficiently traded public one.
fractionalhare··on Money and Investing (1996)
They're actually hard capped at $10B, up from ~$5B a decade or so ago. But you're right, they are thoroughly capacity constrained. Pretty typical for quant strategies in general.

Based on what I see from quant prop trader friends of mine in the Chicago area, if Medallion was an order of magnitude smaller they could probably juice their returns up to 150-300% pretty reliably.

fractionalhare··on Money and Investing (1996)
It's true Buffett had an average annual return of 20.5% between 1965 and 2018. Soros had an average annual return of 32% over about the same time period.

Both of them have been underperforming in the last decade or so. Medallion is still radically outperforming, however.

fractionalhare··on Money and Investing (1996)
Medallion is far beyond 15%/year. Between 1988 and 2018 they had an average annualized return of 39.1%. And the variance is remarkably low: since 1990 there has never been a year with less than a 20% return.

These figures are net. And for what it's worth, I am in the industry and I don't know any professional who thinks there's obvious fraud going on. It's possible, but you make it seem like there's a consensus that it's illegitimate when you say "most sane people." Frankly it's the other way around.

People who think the returns are fraudulent tend to be outside the industry and thoroughly unacquainted with what quantiles of returns are rare versus implausible. They usually hand wave a misinterpretation of Buffett's famous bet against hedge funds and Fama's (strong) Efficient Market Hypothesis.

fractionalhare··on AI skills are worth less than you think (2019)
The author's thesis is that the "hard stuff" decreases over time, and gets commoditized as the field matures. My experience aligns with this view.

For example: you can theoretically do better than a seasonal ARIMA model for time series analysis. But in practice it's very difficult, and you probably don't have the amount of data you need or even an economic justification. The improvements will usually be marginal, expensive and not worth it.

Most teams developing a new product or doing research - even within large and ostensibly sophisticated tech companies - won't usefully or economically outperform something like Box-Jenkins.

fractionalhare··on How can you tell if someone is lying?
> Like foam rolling, or running on your toes instead of your heels.

These things have been studied numerous times. Head over to r/AdvancedFitness or r/AdvancedRunning and you'll find people seriously disseminating acacemic, peer-reviewed research on precisely these topics.

It can take a while for certain things to go from practitioner consensus to academic consensus. But that doesn't mean academics aren't rigorously studying it. I also have doubts about your mask and parachute examples.

fractionalhare··on Go+: Go designed for data science
Love awswrangler. I use that over boto whenever I have the opportunity.
fractionalhare··on Go+: Go designed for data science
I can see a lot of potential in Go for data engineering specifically, yeah. Those would probably be some very stable and performant ETLs. And the concurrency and network primitives would make it easy to develop libraries like Prefect/Airflow.
fractionalhare··on Go+: Go designed for data science
DataFrames? It doesn't even seem to have specialized array primitives like Series or NumPy. What the heck?
fractionalhare··on Go+: Go designed for data science
Yeah I'm confused. The only "data science" I can see here is the the title.

How is list comprehension a data science primitive? How did this get over 4,000 stars on GitHub with a glaring lack of basic data science functionality? Is this used by actual practitioners?

fractionalhare··on Technical interview methods pale in comparison to playing Factorio with someone
> people that seem to base their identity and life around work, and the ones that actually are well rounded people that don't care about which coffee grind size you use on your morning crap of joe.

These don't seem related. I happily base my identity around my work. I don't care about my coworkers personalities or inclinations at all, as long as they're not assholes and they're competent.

Maybe I'm misunderstanding what you mean by identity? I don't hire people because I want them to be friends.

fractionalhare··on The Drivers Cooperative
If you're competing in a winner-take-all market, it is very difficult to compete without shooting for domination. I don't know if digital ride hailing is a winner-take-all market, but there's pretty compelling evidence it could be.

But I also don't think that commenter is disagreeing with you - when they say huge value, they're probably gesturing towards the fact that consumers will generally use whatever the most convenient and recognizable brand is. It will be hard for the coop to achieve a core customer base which allows them to survive if everyone gets off the plane and uses Uber instead of looking for the local coop.

fractionalhare··on The Drivers Cooperative
The commenter is not saying literal taxi dispatch is complicated. But that's an extremely reductive view of what Uber is.

Their actual point is 1) that it's a complex problem to make it a programmatic market which functions nationally (even internationally) and 2) that such a product will naturally have a feature and convenience advantage over regional-specific, capital-constrained alternatives.

fractionalhare··on The Drivers Cooperative
Did we read the same comment? They all look like useful features which deal with the complexity of things external to Uber (like regional payment regulations).
fractionalhare··on Combating Misinformation
I guess, but even if it's imperfect it still seems better than the status quo.
fractionalhare··on Combating Misinformation
I don't agree. It is trivial to spread bullshit and nontrivial to show that it's bullshit. Your philosophy allows misinformation to spread because of how much harder it is to refute than create.
fractionalhare··on Combating Misinformation
I think focusing on the literal semantics of the first sentence rather than taking the blog post holistically is too harsh. Obviously it's still a problem; they are communicating that they're working on it.
fractionalhare··on Combating Misinformation
A principled commitment to fact-checking is more important than whether or not any particular fact-check is ultimately correct. Mistakes happen. If the effort results in more good calls than bad calls, it is a good initiative overall.

What would you have Facebook do, fact check using Twitter because the CDC made this one bad call? Do you think the modal CDC consensus is worse than that of Twitter?

fractionalhare··on Combating Misinformation
But Facebook can at least work towards it, even if you're pessimistic they'll solve it. That's what this blog post is about.
fractionalhare··on Combating Misinformation
Online discourse would be vastly improved if everyone meticulously cited peer reviewed papers and used no other substantiation. It still wouldn't be perfect, but at least there'd be a commitment to rigor. The current status quo is telling people they're wrong, citing nothing, and telling them they "just haven't done enough research."
fractionalhare··on Factoring 2048 RSA integers in 177 days with 13436 qubits and a multimode memory
The research in this field proceeds under the umbrella and framework of physics, yes. But it's not clear that it's possible to scale up to the number qubits required do anything nontrivial. It's plausible there are hard engineering limits on error correction which make it asymptotically more difficult with each order of magnitude more qubits involved.

It might not look that way because there's a lot of (relatively) mainstream investment in quantum computing. However it's pretty common for speculative physics research to be pursued for years without ever coming to fruition. Especially when there are promising early results before it's shown that scaling the work reduces to an intractable problem.

fractionalhare··on We are far from a better Heroku for production apps in a hyper cloud
Sure. I wouldn't be surprised if they have better features along specific dimensions. I'm talking about monetizable market share and revenue.
fractionalhare··on We are far from a better Heroku for production apps in a hyper cloud
> Everything? I thought it was supposed to be Git hosting, but I'm not even sure anymore.

They're losing to GitHub. While they advertise that they have 2/3 of the self-hosted git server market share, they just barely have a double digit share of the total VCS market, which is where the real enterprise money and value is. I don't have figures on hand, but I'd guess they have a single digit percentage of actual enterprise market share. GitHub has the same domination over its space that Google has over search, and Microsoft is excellent at competing on enterprise partnerships.

Tech companies usually scale out their products eventually anyway, but in GitLab's case it's probably existential if they want to maintain status as a high growth, VC-backed company. They need to find another of their competitors' moats which is easier to chip away at, or they need to change the game and introduce something original.

fractionalhare··on A Brief History of the Hedge Fund
RenTech finished the year up over 70% in Medallion, however.
fractionalhare··on Major employers scrap plans to cut back on offices – KPMG
Your cited source also shows 10.9% more hours worked and only 0.8% more hourly compensation (and -1.6% real compensation) comparing Q4 2019 to Q4 2020. Does the data show whether people are more productive because they are happier living more flexible lives at home, or because they simply have worse work life balance? Does it show whether these changes are roughly homogenous, or if there are pockets swinging up (down) the mean hours worked (compensation)? What's the variance?

You can levy a dozen counterfactuals at the use of BLS data like this to support permanent WFH. The analysis needs to be way more holistic and BLS figures aren't nuanced enough.

fractionalhare··on In 2020, two thirds of Google searches ended without a click
The author speculates that this is a direct side effect of Google searches being monetized by ads, and therefore targeting multiple searches.

I don't think that's the case. I think this has more to do with the fact that Google now deliberately surfaces as much information - including summaries, answers, tools and widgets - in the search results page itself, which incentivizes searching without a subsequent click. Google very much wants you to end your search journey on google.com, but I think that's because they believe it will keep people coming back. I do not think Google directly tries to keep people searching for the same thing.

This may still raise interesting antitrust concerns though.

fractionalhare··on Security.txt
I can see and read the JavaScript source code if I intercept the requests! Please pay me $100.
fractionalhare··on What Ended Indie
I don't know...what of it? I still like people, I still like things. Thumb and heart icons on social media haven't changed how or what I like.

Semantically, I generally understand a person who says they "liked" a thing to mean the social media verb. Context also makes it pretty clear.

← PreviousPage 3 of 17Next →