So much of academia is about connections and reputation laundering
statmodeling.stat.columbia.edu
statmodeling.stat.columbia.edu
The real currency in my experience is one thing - relationships. Do I think this person likes, respects, and would vouch for me? Everything else aside, that’s what people optimize for when they choose who to promote, respond to reference requests, and generally in who they engage with at work.
Oftentimes It seems like it may not even be a conscious behavior, they just know that’s who they have a gut feeling about.
I definitely wish this wasn’t the way of the world, as someone who isn’t a natural when it comes to building relationships in a professional setting. But I also don’t let it get me down. It’s an element of human nature that’s hidden many layers deep in the workplace.
When I finally faced this fact and started devoting some of the time I previously spent on hard skills, I realized it was far and away the more impactful way to allocate my resources.
I think one advantage of computers is that what you produce at the end has to work - and if the code doesn't work or you don't know what you're doing, you're quickly exposed as a fraud. This is not the case in other fields like law, academia, politics, and even the corporate world where the results and methods are more abstract and given to opinion.
Unfortunately much of the world is run by people who excel in the abstract fields rather than the technical ones.
Is this actually true? You can bullshit coding...
Same with the guestbook. It may even work. But on the inside it’s a pile of unmaintainable crap.
How do you go about proving this? In the real world people are going to dismiss it. If you are playing against a politician you will be told that you simply have a bad memory thinking that some things exist that really don’t.
This is very naive point of view. Think of how car repair shops bullshit customers (especially what was before some mitigating laws) and then multiply it by Pi or more
There are industries where lying is simply a stable equilibrium.
You need law to keep those businesses going and fair. Otherwise the lemons spoil it for everyone.
Looking at the code can tell you whether it was “implemented properly” - or at least, if it was done reasonably competently.
Relationships, though, can help you know if that properly implemented code was likely a fluke or not. Does the person ask questions? How do they ask questions? How do they communicate? How do they capture requirements? How do they push back when something seems unclear or unwise? etc.
Now, I've seen plenty of "demo-ware" software that has been presented as something that was much more than it actually was, but again, stuff like that always falls over, riddled with bugs and crumbling under load, when it gets substantial use.
Some things you really can't fake, and software engineering is one of them.
Input lag on devices has doubled or tripled from the 1980s while clock speeds have increased drastically. Reddit and Hackernews do essentially the same task, yet Hackernews' load times are almost instant while Reddit takes more than a second to load at times.
It's true that you can't fake a minimum viable product, but it seems to me there is a long way from that to actually making something good.
Noone wants to write low level code because learning it costs money, so instead we just throw more hardware at the problem until it goes away...
Human time is expensive, so it makes sense to throw anything cheaper at the problem first.
You'd think people who got that far would be confident enough to rely on their own skills/study to get ahead BUT even at that level, there is a lot of butt kissing to get ahead.
I've learned that most problems are easily dismissed by people as being "easy", "simple", just do this, just do that. I've found software forces you to really think through, "just do this" is easier said then done, how to do it?
Real problem solving is hard, and I do think computer science humbles you in that sense.
Here's an example, my friend always tells me he thinks we shouldn't take anymore refugees. Alright, I'm not even going to debate the the morals or anything like that. He just think, whoever is letting the refugees in is dumb and shouldn't do that. That's surface level thinking to me. How do you do that? There's a boat arriving to the shore, full of refugees, it's not turning around? What do you do?
This is a hard problem, no matter what you think you want the features or use case to be, how do you do it? The logistics are difficult, how do you scale it? What about all the edge cases? What about the cost?
In that sense I think CS can help you learn how to really think through a problem from understanding the full implications and complexities and the challenges. We learn this by trying to model problems and their solutions very formally.
It’s funny you take this example because your point of view is precisely surface thinking too. I bet you don’t have any concrete plan to fund housing, education, healthcare for those people, nor you have one for them to become productive members of the host society. They are dozens of factors that makes irrational to allow any of them, and a lot of countries (Australia, Japan for instance) have in fact a successful policy of allowing only a bunch of them.
But they're not...? GP didn't say he want to take refugees in, they merely said their friend want refuse refugees without specifying how exactly they want to accomplish that.
>I bet you don’t have any concrete plan to fund housing, education...
I don't think this assumption is fair.
I don't know about Japan, but Australia allows in large numbers of immigrants.
When people are coming to your border in large trove, not letting them in is easier said then done. You can't just "not let them in". To keep my analogy going, this requires an algorithm of some sort. First you need to find something that works, and then you need to take into account cost consideration, scaling, etc.
Your example would work as well. Someone who were to say, whoever is stopping them from coming in is stupid. This would also be surface level. What do you do with them once they're in? Housing, education, integration? Does our system have the capacity to handle such load or will it collapse? Just letting them in may not be enough, it could cause problems down the line, what are we doing to prevent those.
The right conclusion to take from my comment is that problem solving is hard, there's a lot of variable at play, a lot of considerations to take in, and it is never as easy as you assume at first. Recognizing this is part of being humble, and I think computer science teaches you that.
Thinking you have the answers because you thought about it for 5 minutes and not realizing you skimmed and hand waved over all the direct and indirect complexities and considerations and are skipping multiple steps of the solution. Thinking that there is an easy solution and then advocating for it strongly when you haven't begone to recognize and understand the complexity of the problem itself. This to me is an indication of a lack of some form of critical thinking. I think computer science can to some extent teach people better about this, by having them practice concrete problem solving exercise on a computer which can assess to the solution working or not. And learning formal problem modeling techniques and validation strategies. It's a useful skill.
Most people I know would happily sign a document that states 'We hold these truths to be self evident that all men are created equal', even though the world shows us every single day that it isn't true.
In technical fields, getting that document approved would be a nightmare.
Maxwell's equations on the other hand are easy to get approval for. They are 'self evident'. Because they describe what we see, not what we want to see.
So thank god for Jefferson penning that line down and effecting how everyone thinks, because it shows us for some problems, the ambiguous kind, were truth is what we want it to be, technical fields will struggle to provide answers.
Its very fortunate, esp to make progress on all the ambiguous problems, that society props up a Jefferson now and then.
How did Jefferson get into that position and not some jackass, is the most important question. And the answer to that, with a modern developing understanding of networks and graph theory, has only recently started moving from the abstract and ambiguous to the more technical - https://www.youtube.com/watch?v=07KKYostAJ0
No that's not true, that something works is beginner level stuff in many cases. In some cases you're right though, because what has been asked is a super tough problem to crack.
I'll showcase the moments in which the "it has to work" requirement is not enough.
To show this example, I already have to break 2 conventions that are a no no, in my opinion. To other devs: I'm commenting everything (I can't assume someone who works in law to know code, he/she might, he/she might not) and I'm using globals for easier variable reassignment, to ease the example for readability.
Let's get started. The requirement: print 5 to the console of your browser [1].
Open up Chrome Dev Tools (view -> developer -> developer tools -> console)
Type in the following:
five = 1 + 1 + 1 + 1 + 1 //compute 1 + 1 + 1 + 1 + 1 and save it in the computer with the name five
console.log(five) //outputs 5
five = 0 //reset
// loop 5 times, and every time the pc adds 1 to the saved part of the computer named five
for (loopCount = 0; loopCount < 5; loopCount = loopCount + 1) {
five = five + 1
}
console.log(five)
five = 5 //save the number 5 in the computer with the name five
console.log(five) //outputs 5
console.log(5) //also outputs 5
FIVE = 5 //all-caps is a convention for that something is a constant, like a constant number such as 5
console.log(FIVE) //outputs 5 as well, and also probably the way programmers want to see it.
Some of these methods have been really silly and if you catch that during an interview, you won't pass. People can point out that most of these methods happen one way or another, but not when you have a simple requirement such as "output 5". In fact, if that truly is the requirement, then I would go for: console.log(5)
And I'd consider the first 2 entries totally nonsensical (unless I asked it with a funny voice or asked them to do whatever / be creative), the 4th entry slightly questionable but fine and the 5th entry fine.[1] Read the following link to have some context about what the JavaScript console is. Don't worry about not understanding the code or the technical terms. You're not missing anything, as far as context is concerned, I checked. Read it until the first paragraph of "Running JavaScript".
https://developers.google.com/web/tools/chrome-devtools/cons...
You can always screw around with code, redefining code blocks in C would be fun to do.
But I did have situations where FIVE = 5 changed to FIVE = "five" or FIVE = "5" or FIVE = "vijf" (Dutch) or FIVE = "....." (ok, the last one is hypothetical, but maybe you want five points because you tick them off in a for-loop? I've seen something clever-ish like that in a particular fun Fizz Buzz example).
The layer indirection is indeed a classical trade-off that you do or do not want to make.
Regardless of that, your question proves the point I want to make to kbos87.
I don't know how to raise this issue at work without being insensitive.
It's just any sort of scorekeeping added on top screws things up.
A talented jerk is a scourge of a project (especially in open-source): the engineering might attract others in the short term, but being a jerk makes long-term interactions painful and not very fruitful.
Brilliant jerks are bad, but engineers also tend to resent politicians.
Those networks that you form to support your own rise are used by your boss to support their rise. You get promoted because you will make your own boss look better in the future. The second this ceases to be the case, you get discarded like a used tissue. Competence is very far down this equation.
I suspect this is almost universal. The only forcing function is what features the ultimate power selects for. A great CEO forces the subtribes to compete on the basis of value added.
We pretty much act the same way as those chimps in nature shows.
If you sell a product, there is a different calculus for ascension.
The worst part is when performance review time comes around. It's obvious to anyone looking at the situation objectively that competence doesn't matter much when choosing who to reward and who to fire, but seeing the tribe members pretend otherwise and target hard workers who aren't part of the clique is absolutely devastating to morale.
The validity of any cached data can be a hard problem; in the case of reputation, a problem there is. Still, however imprecise this tool is, its usefulness is so high it's not going to go away from human interactions.
It's only FAANG, I've also seen this everywhere in The Netherlands. I've been looking for a job for 18 months -- I've been picky as I was very ambitious during my uni (yep, my mistake, ambition can be very detrimental to one's career as it can make someone quite picky, aka only big corporations). The irony is that a couple of months ago, I walked into my old university, met an old colleague that had a startup and wanted to hire me straight away after the most relaxed interview I've ever seen. They wanted me to read some code and explain what was happening, it was about some caching system.
So yea, it's all about people.
From my perspective, there is little meritocracy to be found in the tech world [1]. Maybe past the resume screening? Definitely not before it.
[0] Next to my own gratefulness, what I always find amazing to see is how some people in really dire situations get completely picked up by HN and sorted out, in some cases. I really feel for the homeless people in the tech industry, because it's a relatively rare issue, but it does exist! And those people tend to be able to find help here.
[1] Maybe there's a lot of it by comparison to other industries, but if a house has been burned to the ground and other houses are starting to catch fire, while in other cases entire city blocks are on fire, then I wouldn't call it a good situation in both cases.
My CS master grade was an A [1, EU grading system explained]. I'm sorry for writing all of this, the GPA 3.0 got me triggered.
I think it's because I'm from Amsterdam and not from the US. I've also noticed by watching YouTube that US people had an easier time applying to Google as a grad, a way easier time in fact. I have found no videos of Europeans doing something similar. Not that I have looked, I simply come across them.
It feels that my predicted future was a complete lie. I failed in my goal, spectacularly. Everything I gave up for it was in vain. Getting to FAANG later won't be the same, it's not the career trajectory/velocity I want. I should've partied a lot more. That would've been fun. I do appreciate the education though.
Perhaps I should find a career coach.
[1] European GPA: 8.1 out of 10, European grades are much harsher, a 10 means a god-like level in many cases, I don't think anyone has gotten a 10 as a GPA, 9.1 or 9.2 means you're the best or one of the best in the country/
More importantly: fuck them. Don't judge your self worth based on the latest shiny megacorp's inscrutable interview process.
The following comment might be too candid and too unpopular. I'm sorry about that. I need to write it down somewhere with the potential for some interaction (it helps me learn). I know I'm not alone in this feeling though. Though, I'm pretty sure the majority of people won't share my opinion. So either there is something I should correct in myself, or I'm a bit odd regarding what I'm about to say. I guess some financially independent people feel similar about this
---
It's not about self-worth. My financial worth depends on it and with it the freedom and possibilities I have. Now, I maybe be biased in how I view my options.
Which is why I said, maybe I should find a career coach.
The way I see it: no job at FAANG means less secure freedom. There is a lot of freedom to be had as an entrepreneur, or as an artist. It's also a lot less secure. There are indeed drawbacks for being in golden handcuffs and not having a lot of free time when working at FAANG. But as far as I can tell: while the freedom is skewed towards money and not time, if you don't have lifestyle inflation and save up the money, you can retire quite a bit earlier.
I want freedom. I want to retire earlier.
And now that I know that I have to work at least until I'm 67, because I can't get an amazing career start, that hurts. I know it's a spoiled statement to make compared to the rest of the population and perhaps even an insult to the world to consider this normal. Nevertheless, I've worked for this goal in particular and I'm seeing nothing of it back. My family has worked at this as well, they did their best into letting me succeed. Yet, I spectacurlarly failed.
I'm not worth less because of it, but financially I am worth less because of it. And because I'm worth less financially, I am able to do less with the life that I want to do.
Of the waking hours:
- 50% of my life is spent working
- 25% of my life is spent doing mundane tasks
- 25% of my life is spent doing what I want
If I could increase from 25% to 100%, then in a sense I live 4 times as long.
Note: I like programming, but I don't love it. For me programming is similar to physically moving around, except now I'm physically moving around in the digital world. I like to do it when it's needed, but not much more than that. I'm not an athlete (a person who only loves physical movement).
There are so many things that I love (that don't make any money or are very risky). I want to do those things instead, but I've seen with a lot of family members how that turns out (bad). Startup failures are real. Life changing successes don't come around often, if at all. This is even the case when you're a person who does everything right.
Now I know that I have to be happy with living a life like the rest of us: mostly doing things that I don't want to do but have to.
I know I have to grow up in this sense (despite my age), but it's a gloomy future and one I don't get excited by. It feels too boring. I don't really see the point of it other than raising children and doing your best they can live a life that feels fulfilling to them, if you have them already. If you don't, then one should reflect deeply on whether they want to burden their children with a father who feels that life is too boring (because they are mostly doing things they don't want to do) and couldn't care less.
But do you know who else does this for you? A dog.
I've never promoted anyone who likes me or respects me or vouched for me, I promote those who are reliable and have have skills to achieve the task at hand, one who will not betray themselves or their company for some kickback.
Of course, one might interpret what you said in a slightly different way, in that two groups of people would fight each other and only vote for people within their group, which would be sorta counterproductive for the whole organization. However, the behavior still actually makes sense for the particular group that those people are in and creates the maximum benefits for everybody in that group. For the organization, it would then be a problem of reconciliating the interests of different groups of people.
Was that sentence necessary? There are so many conspiracy theories about Epstein that its not clear what you are expressing here and I'm not sure I care to know.
I note with some cynicism that there has been no apparent push by economists to promote workers as primary owners of companies, for example. I suspect pervasive co-op style businesses combined with a reasonably permissive lending environment would be absolute economic powerhouses.
That sort of research no doubt happens, but it gets no airplay compared to people pushing branches of Keynesianism or Modern Monetary Theory.
I think you have this the wrong way around. Mainstream economic theory (the neo-liberal kind) actually leads to the control of government by private capital. What you will see coming out of the top schools (especially Chicago) but many others too is theory that pushes for de-regulation, privatization, free flow of capital, laissez-faire etc. The exact opposite of government control over industry.
> no apparent push by economists to promote workers as primary owners of companies for example
This is (probably) true, but the reasons are again quite simple and don't involve the state very much. Great concentrations of wealth are built and maintained by keeping capital ownership in as few hands as possible. Since academic economists are often beholden to big capital owners (in one way or another), they will of course promote theories that justify and encourage concentration of ownership, not its dispersal among the workers.
> it gets no airplay compared to people pushing branches of Keynesianism or Modern Monetary Theory
MMT especially is not at all a mainstream theory. I would say most economists consider it at best "heterodox" and often either don't know much about it or strongly disagree with it.
AFAICT, the descriptive aspects of MMT are widely accepted, if deemphasized in prescriptive contexts, aspects of mainstream economic theory (not just [neo-]Keynesian, but across essentially the whole spectrum of descriptive economics.) The prescriptions that MMT adherents make based on those descriptive aspects are out of line with mainstream prescriptions, which tend to honor what MMT loudly points out (and mainstream economics more quietly acknowledges) is the fiction of the finite public purse.
Take the very basic thing that you mention at the end, which should be absolutely non-controversial: the US government cannot be forced into default.
If your prescriptions are just going to ignore that fact, then have you truly accepted it? I'd argue that no, you really haven't.
(That doesn't mean you'd have to follow the prescriptions of MMTers necessarily, e.g. the Job Guarantee is certainly not a logically necessary conclusion of the fact that a sovereign government cannot go bankrupt. But your whole framing around government spending and revenue really does need to be centered around this observation, or you're simply bound to fall into fuzzy and incorrect thinking all the time.)
The US government 'can't default' but that is basically word games for a complicated tax where nobody is quite certain who is paying. The government is definitely consuming real resources and unlike a tax it isn't at all obvious who would have gotten those resources had the government not redirected them. I'd rather governments were straightforward and levied taxes to pay for things so we know who is supporting state spending.
The conversation really hinges on the semantics of 'default' - in real terms the Government absolutely can default. At some point the country has collapsed, there is nothing left to give (see classic hyperinflation cases) and the government will not make good on its debts. In nominal terms the government can't default but anyone who treats that as useful in their decision making is going to lose out sooner or later when it comes back to real goods and services. I don't want to be one of those people, and I don't want there to be any people like that because it seems dishonest at some level to pretend they aren't losing out.
People call US bonds 'risk free' - that is only in nominal terms. In real terms they are actually quite risky. Take on a 30 year treasury bond today and there isn't any certainty how much it will be worth in 2020 dollars as it matures. Is it a likely net win on the sandwich scale? Signs point to no, but it might be. There are risks.
The next steps are to recognize and integrate into the conversation that:
* Whether and to what extent the government consumes resources that would otherwise have been consumed by somebody else cannot be determined purely by looking at the deficit as a single number. A government deficit, when done right, stimulates the economy which means that it causes the creation of resources that otherwise simply wouldn't have been created.
* Inflation, which is what you're really getting at, is complicated and has many potential drivers. A government deficit can be one of them, but isn't necessarily. There are many other potential drivers: overly lax monetary policy, excessive bank lending, entirely internal mechanism such as genuine supply shocks, businesses' price hikes in an attempt to increase profits, strong unions helping drive up wages broadly across the economy, and so on. Note that some of these effects, especially the last one, are actually desirable for most people, meaning that inflation can actually be a good thing for society overall! Admittedly that happens rarely in practice, but that's really a function of workers having too little power. It all depends on the details.
In fact, on that last point there's reason to suspect that we'd have had quite a bit lower "effective" inflation (meaning higher purchasing power of wages / salary) for the majority of the population today if governments had decided to address the Global Financial Crisis by direct job creation and handing out money to the population at large, rather than leaning on monetary policy which really only caused asset prices to balloon.
This alternative policy wasn't even discussed seriously, because people largely do not understand that the government cannot default. Discussion was shut down with slogans like "making sure that the US is not going to be the next Greece", which are complete nonsense given that the US and Greek governments operate under very different currency arrangements (sovereign currency like Japan, vs. the effectively foreign currency of the Euro in Greece's case).
So anyway, the point is that the framing in real resources matters significantly, precisely because there is no ironclad correlation between government deficits and real resources. People need to learn to go into the real resources framing and then stay there.
That's a tautological and zero-sum way to look at it
Regarding the 0-sum aspect, I don't know how else you can look at it. Ownership of capital has to follow a certain distribution, which can in turn be more or less egalitarian, depending on how we decide to set the system up. it's however not possible to have both concentrated ownership and co-op style ownership at the same time (for the same company).
Only in the sense of "industry control over government". Which doesn't strike me as any improvement.
The true opposite would be "industry has to fend for itself without being able to co-opt government to tilt the playing field in its favor".
Sure, good point. However I don't think it's possible or desirable to let industry be completely independent of the state. It seems to me that would lead us right back to our current predicament - power would concentrate and it would start putting pressure on the state.
The state itself is a concentration of power. Industry wants to co-opt it for that very reason.
Ideally though, all concentrations of power should be dismantled.
Whatever power you use to reduce concentrations of power would undoubtedly become quite powerful.
I think that it's probably better to attempt to reduce the size of any one concentration of power, and set them all up watching each other.
Agreed. It would be great if power was as decentralised as possible and if individuals would take an active part in their (self-)government.
If this were the case, the United States would have adopted full-on UBI socialism decades ago. Or at least, the net taker states would have prioritized advocating for that sort of thing. What we've actually seen is the complete opposite to your theory.
The actual incentives that politicians have are not to their constituents, but to their sponsors.
Based on what? The data seems to point in the opposite direction: successful, innovative businesses are driven by singular leadership. Apple since Steve Jobs died has not only lost much of its innovative spark, but quality has plummeted. See also Tesla, Amazon, etc.
I don't like the implications of that, but I see little evidence pointing in the other direction.
Hrm, I think it depends on what they meant by co-op style (as in the previous sentence they say "primarily worker owned"). I agree singular leadership and direction is important, but that's not necessarily at odds with primarily worker owned, even if it's at odds with some versions of worker owned.
An example of a company that has multiple CEOs that have driven it to success in different times and in slightly different contexts would by Microsoft. Originally helmed by Gates in a manner somewhat similar to Jobs and Musk, it's now helmed by Nadella to great success. I would count that due to Nadella having a singular vision, and buy in from the company so he can achieve that. I'm not sure being worker owned (other than it being kind of hard to keep it that way once you get large enough...) would change that as long as he still had the confidence of the board (which in that case would be a council of workers I guess?).
Another way to think of this might be the (traditional) American auto industry. While not worker owned, as I understand it the unions have quite a lot of power (including board seats), and that might be seen as somewhat of a proxy for large successful (significantly) worker owned companies, and those have gone through periods of great success at times as well.
Your evidence doesn't quite say what you think it does; you are talking about day-to-day management, I'm talking about ownership structure and how day-to-day management gets appointed/fired.
But no specific evidence, just first principles reasoning. It is hard to see why it would do badly.
[0] https://www.businessinsider.com.au/steve-jobs-original-apple...
There are concrete examples of worker-dominated organizations: schools, public transit entities, etc., where powerful worker unions dominate policy. They are almost universally unsuccessful, as worker interests take precedence over delivering a product to the consumer.
I suppose we have trailed things like worker ownership in early stage startups with high equity compensation. That might be evidence that it works well. Letting workers capture most of the value they create would be at least as interesting experiment for me than Universal Basic Income; but I think UBI has much more coverage as a political idea.
As someone else pointed out, MIT is one of the top 5 departments, while Yale is generally not considered to be in that group. The list of departments with Nobel Prize winners shows that there are plenty of good departments: Harvard, MIT, NYU, Yale, Chicago, Princeton, UCLA, Stanford, Northwestern, Berkeley, Minnesota, Columbia, Arizona State, Carnegie Mellon, San Diego, Arizona...that's just in recent years.
The problem they are ridiculing is mainly that an observed time series that is going up and down with no clear trend is "modeled" with a polynomial that necessarily goes down, and that the tweet claims there is some value in the fitted polynomial.
Secondarily, the fact that the polynomial is described as cubic, when it appears to be quadratic.
Added together it makes it extremely explicitly clear that at the highest levels of American government, even in situations with the involvement of elite academic advisors, the actual technical content is utterly incompetent; childish; totally illiterate from a statistical point of view; bad even at high school.
I don't know what that says about any of us.
If an analysis is making a reasonable effort to use the best or even some sort of relevant methodology in the field maybe. There is an entire field built around the learnings and failures of previous work that informs how we do things now.
In this circumstance the economist came in with no understanding or desire to understand any of that and through some random excel function at the problem to get the answer out they wanted for political expediency.
Not to mention the prediction was ridiculously stupid and anyone with common sense let alone an epidemiology degree could see it was going to be wildly incorrect within days.
THAT is the model being talked about at the highest levels of government when you have the entire field of the world class epidemiologists at your fingertips.
Trying to “both sides” this one because scientists who have spent their whole lives trying working on this got a little snarky is just missing the boat.
There are plenty of other places where epi Twitter is having productive cordial discussions.
wut. a quadratic only has one inflection point. that plotted curve clearly has 2.
The problem of today is not most of America have never fitted a curve and not understand the difference between training accuracy and prediction accuracy. But that they choose to not believe or even hear out those who did.
Who are they supposed to believe here?
There's a right-wing academic stroke political appointee, and a left-wing academic stroke political appointee. Both have genuine academic credentials. Both are saying something that supports their political masters. One appears to have been ousted by the other so is probably bitter about that.
If you don't know about statistics, which as you say is most people, this is two equivalent people having an unseemly fight on Twitter.
Did you notice neither presented an actual argument? Just abuse.
Like climate change, but people chose to not to listen to the scientific consensus anyways.
p.s. The fact being that comparing training accuracy to prediction accuracy is something that is simply unsound. You can have hundreds of ways to spin a statistic that is backed by academic research, and comparing those two are not. It also happen to be the first thing you're taught to avoid.
But you said people don't know the facts themselves! So how do you want them to know which of these two people has the facts?
I mean they literally say the same thing about each other - 'new low...'. There's no information to action here if you don't know about statistics! Even if you decide to check their authority and motivation there's still nothing to divide them on!
Science doesn't work by consensus. Science works by having a track record of accurate predictions. So when you see people talking about "scientific consensus", that should immediately be a red flag. Valid science doesn't talk about "consensus" at all; it just points at the predictive track record--which requires not just "facts" but a series of accurate predictions, made before you knew the facts, that match with the facts--and lets you draw your own conclusions.
Human beings are at the very best arrogant and fallible by nature, incapable of truth. When you want to improve your model of the world by including some heretofore unknown to you concept,fact, or set of facts you can opt to learn everything from the ground up in order to develop a deep understanding of the topic or accept or slot in some preexisting truths and models as described by others that you presume to be true.
This presumption of correctness is typically based on their standing with yours or preferably with their own peers combined with your assessment of them based on how well their statements comport with things you know or at least believe to be true. This is typical because the world is incredibly complex and our time here is finite.
Even smart skilled people have to lean on option two a lot outside of their particular area of expertise. When intelligent people do this they ask themselves whose views do people skilled in a particular area think are worth listening to or what on average do people skilled in this area say about something. This is what is meant by scientific consensus. Unintelligent people ask themselves what do my fellow unskilled peers think about this or what do I already think is true and are their any experts who confirm what I already want/believe to be true.
When people say that the scientific consensus is that cigarettes cause cancer they mean I haven't fully examined the complexity of the human lung and the effects of carcinogens on same but I accept the fact that many experts have done so and are telling me that If I keep smoking I'm more likely to die of cancer. This is converse to the person who also doesn't have time to understand how lungs work who eagerly looks for someone with credentials who says its OK if I keep smoking.
People talk about scientific consensus precisely because in a broad population of users you can find at least one party with any given credential willing to espouse any given stupid thing for money or for kicks. It's especially useful if you can get someone who actually IS smart and therefore respected in one area to believe he knows something about a field totally outside his area of expertise and lend existing cred to a stupid idea that an actual expert would dismiss. This strategy is very commonly on display in the discussion about climate change for example.
No, I am talking about how groups of people discover increasingly true pictures of the world. They don't do that by consensus; they do it by finding models that make more and more accurate predictions, as shown by the actual track record of accurate predictions.
> When you want to improve your model of the world by including some heretofore unknown to you concept,fact, or set of facts you can opt to learn everything from the ground up in order to develop a deep understanding of the topic or accept or slot in some preexisting truths and models as described by others that you presume to be true.
Or, instead of making any assumptions, you can look at the actual predictive track record to see which "preexisting truths or models" actually work and which don't.
The reason this isn't obvious to most people is that most people don't stop to think about how much of their everyday experience, particularly in this age of computers and GPS and other technological marvels, actually gives them a huge track record of accurate predictions for our fundamental scientific theories. If our predictions based on models using General Relativity were not accurate, GPS wouldn't work. If our predictions based on models using quantum mechanics were not accurate, computers wouldn't work. There are countless other examples. Most people don't stop to think about this so they don't realize how high the bar actually is for having a track record of accurate predictions. They think of GR and QM as esoteric physics, not as everyday realities. They don't realize how huge a volume of evidence from their direct experience they already have for these theories being correct, so they think they have to take physicists' word for it, when they actually don't. Which means they also don't realize how much other people, who seem to be just as sure of themselves and their predictions as physicists (if not more so), actually are just overstating their case, often by many, many orders of magnitude.
So I reject your model of how people should actually assess claims in areas where they don't have expertise.
> When people say that the scientific consensus is that cigarettes cause cancer they mean I haven't fully examined the complexity of the human lung and the effects of carcinogens on same but I accept the fact that many experts have done so and are telling me that If I keep smoking I'm more likely to die of cancer.
When people assess the probability that if they smoke they will increase their risk of dying of cancer, they have no need to rely on any "consensus". They can just look at the data.
- furman believes (or claims to believe) the original tweet was being deceitful by presenting a curve fit as a curve fit but leaving enough ambiguity that casual viewers might interpret it as a prediction of future deaths dropping to 0 by mid may
- philipson believes (or claims to believe) furman thinks that curve fitting and forecasting are the same thing, does not address whether the original tweet was attempting to be coy or deceitful
- article believes (or claims to believe) that philipson believes that a curve fit actually is a good prediction of the future, then goes super wide with it to make some vaguely related point about academia
I believe no one is lying or stupid, but everyone is finding the worst possible interpretation of events so they can dunk on each other.
"Rashomon (羅生門, Rashōmon) is a 1950 Jidaigeki psychological thriller/crime film directed by Akira Kurosawa...
The film is known for a plot device that involves various characters providing subjective, alternative, self-serving, and contradictory versions of the same incident."
Now that is an esoteric reference!
my only regret is that now that I understand it, i realize it's not interesting (to me personally)
The original graph showing the "cubic" curve is just - pathetic and sad. It's the equivalent of using a sharpie to change hurricane trajectories. And then Philipson defending this nonsense by calling someone else an "economist turned political hack"????
How the hell can so many of these people have no shame? I totally agree with a follow-up tweet - doesn't matter what Philipson did in his whole career, he will be remembered for completely abdicating any decent sense of professional ethics.
At that point I run out of guesses about exactly what's being said by anybody.
Then there's the reason to actually even talk about this specific instance, which is that there is a complete lack of operating on the assumption of good faith and clarifying intent before making assertions as to other peoples intentions which is rampant currently. Whether it's rampant on twitter and between political parties or has spilled into other areas such that it's harder to have coherent discussions in general now than it was in years past I'm not sure.
There are a lot of assumptions in that reply to the tweet in question that's shown. It's not even a novel set of assumptions, it's the standard twitter fare of "I assume he means X and this thing doesn't explicitly show X therefore he must not understand what he's talking about." Any nuance such as using a secondary aspect of something to outline a potion of what you mean is immediately ignored, and if pointed out later assumed to be covering up after the fact.
It's crazy, and twitter's where it's easiest to see, but you can also use a news aggregator like news.google.com and get a good dose of it just from the headlines about what is ostensibly the same story from different news agencies. Wild times.
This is basically what all politics is. People projecting thoughts (or lack thereof) in bad faith on each other. Though it does seem that the fraction of society sucked into this toxic discourse has grown to cover practically everything lately (in the US anyway).
But also the outrage machine of Twitter etc is obviously biased toward the extreme views and outliers. Where 99/100 people might say 'meh, another failure to predict the future like most', the remaining 1/100 blows his top and gets the attention.
To which I'd say that just begs the question of if there's a difference to begin with, and what criteria you would use to distinguish them if they are.
But I can't figure out what anyone in the original discussion is really saying, if anything.
The statistical community has not been doing well with the coronavirus epidemic. Nobody's models seem to be predicting well. Nor is the source data for anything but deaths very good.
This matters, because the current plan US plan seems to be "open things up and wait for herd immunity". How much time, and how many deaths, lie between now and that point? I dunno.
I'm curious how you concluded this. Can you (or anyone) recommend a reasoned evaluation of the existing models? We've got a few months of hindsight now and I'm curious hear what any reputable data scientist might have to say.
I see criticism of the models online (in op-eds and social media), but the criticisms are usually agenda driven and opaque on technical details, which isn't particularly helpful.
Here's the Financial Times graph of actuals, country by country.[1] No predictions. The pattern that shows up in some of the actuals is "huge spike, tight lockdown, big drop". See Italy, Belgium and the Isle of Man. The Isle of Man puts people in jail for weeks for violating quarantine rules. The US didn't have a huge spike, but isn't seeing a big drop, either. US deaths are at about 2/3 of peak.
[1] https://ig.ft.com/coronavirus-chart/?areas=usa&areas=gbr&are...
This seems pretty straightforward, no? You re-open cautiously, wait a few weeks, make sure your hospital resources aren't being overwhelmed, then open up a bit more, rinse and repeat. I wasn't aware there was another way.
The "herd immunity" plan can only work with more than 50% of the population infected, of which about 1% will die and some slightly higher percentage suffer lingering ill health, which in the US means at least a million people.
That's current US policy. That's what the "Get and Keep America Open" plan does.[1] Current death rate for the US is around 1,400 per day.
[1] https://www.cdc.gov/coronavirus/2019-ncov/php/open-america/i...
If that is true, doesn't the strategy taken by SK and NZ put them at continued risk for a another outbreak if the virus sneaks back in? Without a vaccine, and then significant uptake by the population yearly, doesn't the risk of covid-19, and its mutations, come back every year?
SK and NZ can "end" the outbreak. The "herd immunity" strategy will simply continue it straight through the whole year, with a lot more deaths.
Argonne National Lab has simulations where they simulate every person Chicago and where they might go and who they might run into, which, given the correct set of behaviors would probably work very well. But... how do you predict how people will act in a week? That will depend on the weather, court decisions, number of deaths in random countries, how rousing a speech a politician might give, etc. If we could control how people acted, I bet the models would work very well.
Even that's iffy when compared to "excess deaths" (in lots of places, excluding all covid deaths still results in more people dying this year compared to previous years).
Indeed. The post is a big exercise in strawmanning (and of course ad hominem but I am willing to forgive it because it adds entertainment value). Andrew Gelman (a well-known statistics expert) dunks on some guy because he dared to defend a shitty graphic and "made a statistical error". Which is kind of unfair, because he didn't do any statistics. Of course when our brains see some curves they can't resist the temptation to do some statistics on their own, but bad dataviz is a different sin than bad statistics and should be treated as such.
What? The chart's creator said it was a cubic polynomial. Mr. Hassett said he had employed ‘just a canned function in Excel, a cubic polynomial.’”
https://www.vox.com/2020/5/8/21250641/kevin-hassett-cubic-mo...
There are available epidemiological models that are actually grounded in a scientific understanding of the problem. "Why not a cubic polynomial?" is a stupid question.
Somebody persists after hearing the answer (which you gave), that might be stupid.
I feel like I can dismiss it now.
You don't need any flippancy to betray your ignorance, it's already clearly on display.
Plot a cubic polynomial in time, at^3 + bt^2 + c*t + d. Use Excel. The curve either diverges to + or - infinity at each end, or it's a constant. That's not the behavior of the dashed red curve in the OP.
What it could be is some kind of cubic spline. But it is not a cubic polynomial in time.
There are few metrics with which academia can judge how effective a researcher is. If you're not interested in getting as many papers/citations/awards in whatever way you can then you may be in the wrong game.
Or rather it could be that the game itself is whats wrong, leading to a reproducibility crisis, fraud, group think, walled gardens and ivory towers.
A long while ago, I worked in IT in the admissions department of a top-5 ivy league school. While there I became good friends with many of the admissions officers for the undergraduate and MBA programs.
It's an open secret that admissions are highly influenced by who you know, but what I was stunned by was the overwhelming percentage of each incoming class owes its entry to the connections of their parents.
I had always assumed it was some small single digit percentage, but the first time I saw "the list", I was dumbfounded. There is a list of students each year that is sent from the Dean of admissions to admissions department containing the students that must be admitted. The process for rejecting one of those students required the admissions officer to submit a report outlining why - an incredibly rare occurrence.
The admissions officers rationalize this as a necessary evil, and cover themselves by pointing to the special attention they pay to diversity candidates. "If I see one more white, indian or asian kid from the upper-east side with a perfect GPA, I'm just going to throw the app out the window" was a quote that stuck in my mind.
The list was a collection of applicants who were the children of staff, professors, administrators, and financial or political benefactors. Surprisingly, children of alumni (even those who donated regularly) were not in the group unless they really made an effort over the years and had someone at the school who could call the Dean personally.
It sort of bothered me because it made me realize that someone like myself - a good student, non-diversity, with good EC activities was competing for a tiny tiny portion of the admissions slots for any top school.
Is it really so much to ask to have a transparent and level playing field in college admissions?
You have a table full of top-tier poker players and you have a rookie who won a contest to be in a game alongside them. The rookie is playing absolutely terrible, the commentators are cringing at the moves the rookie is making. The other players are clearly doing things to take advantage of the rookies playing style. Yet at the same time, the rookie comes out in 3rd place, up 50k from their buy in at the start of the night. 3 seasoned award winning professionals are all net-negative for the night, some of which are -150k from where they started after 150 hands played.
Is this rookie an impostor or not? Does it matter that the rookie is an impostor if he is still beating people who verifiably are not impostors over the average of 150 separate hands?
I guess all this is to say that I don't get what value using the impostor's syndrome framing gives us.
Edit: sibling is making much the same point. The concept is only useful if actual imposters can be identified.
Likewise if you believe - probably correctly - that your failures don't matter because you can bullshit and bluster your way through them. And if that doesn't work, a quick word with your sponsors will sort out your problems.
Impostor syndrome is the opposite - caring about quality, feeling you fall short (because quality is hard), and relying on substance not superficiality to get ahead.
I'm still quite skeptical, but even this simple conversation is far deeper than any discussion I've seen on the subject. I would never have bothered to think about the caring dimension if you hadn't mentioned it.
The point is that at the very highest levels of US government, when they have brought in an academic advisors from elite universities, they have ended up presenting absurdly wrong child-like nonsense as their best attempt at analyzing Covid-19 data.
Rather few people in this thread have managed to get beyond the title and the slightly opaque columbia.edu blog post to see this. An exception is ahdeanz.
It is an extremely depressing and valid point. Yes, human connections will always be important, but we MUST as sensible democracies, ensure that when science needs to be done, it is not left to the those who have been so involved in the world of human politics and dinner-party-approved conversational topics that they can't even vaguely think about something technical.
I expect he has many flaws, but Dominic Cummings in the UK Conservative party is on the right side of history here, in wishing for a new era in which politics is not dominated by those with law and humanities degrees.
In many situations, it's not that the person doesn't know what they're talking about or is "bluffing", but that they are deliberately presenting a position that fits their current role and benefits them in some way. I totally agree that the former does happen, but those two things are really distinct, and if the author conflates those two and throws out a blanket claim that "stats is hard", it's not really helpful.
One, the blue line, is a model from 3/27. It matches the data okay.
The second, the yellow line, is a model from 4/5. The agreement of this line is much worse, and the fact that the model did worse with more data is not promising.
The third, the teal line, is a model from 5/4. The data (black) ends at 5/4. So the agreement of the teal line with the black line is not a prediction at all.
The red line, a cubic fit, is totally irrelevant. By "cubic fit" I infer that they mean some kind of low-pass signal filter. Fitting a simple model like that to a complex time series without some motivation for why that model was chosen is the mathematical equivalent of treating tuberculosis with mercury.
My point is: it sure doesn't look like the models are doing a good job of predicting death rates. And that's just from the graph used to advertise them.
It's literally just ax^3 + bx^2 + cx + d, optimize a, b, c, and d to minimize some loss function (probably L2).
So in addition to log-exp to prevent projections going negative, they clipped the end date at 4 Aug to prevent it from going back up to +inf
Does this make sense to anybody? The author is "struck" that somebody is "willing" to talk about something they believe they understand? The only annoying thing about academia is that it seems to attract smug, selfish people like this.
On the other hand, I've recently worked in "machine learning" teams led by academic snake oil salesmen who publish lots of papers in ML journals and have fancy PhDs. They often regard coding and technical delivery as "grunt work" and do nothing but play corrupt politics, delivering little value. I have a hard time believing the fact that they came from academia has nothing to do with that, although I guess it may be similarly bad under other non-technical leadership and impostors.
[...]
>"2. Academia, like any other working environment, is full of prominent, successful, well-connected bluffers."
It's a fair point. But what should have a discussion turned into playground name calling.
What is the /g in this context?
Is this the regular expression flag for global search?
Sorry, not a programmer just a dumb tradie.
s/regular expression/replacement/flags – Substitute the replacement string for the first instance of the regular expression in the pattern space. ...
g – Make the substitution for all non-overlapping matches of the regular expression, not just the first one.
No models, forecasts, fittings, or prophecies mean anything with heavily biased data. I'm unaware of a solid method to counteract this problem.
If my understanding is correct, we need population-wide testing to get a good basis for predictions of the future. Something which, unless I crawled under a rock again, we simply haven't come close to achieving (at least in my neck of the woods).
> Academia, like any other working environment, is full of prominent, successful, well-connected bluffers. The striking thing is not that a decorated professor and A/Chairman @WhiteHouseCEA made a statistical error, nor should we be surprised that a prominent academic in economics (or any other field) doesn’t understand statistics. What’s striking is that the professor and A/Chairman doesn’t know that he doesn’t know. I’m struck by his ignorance of his ignorance, his willingness to think that he knows what he’s talking about when he doesn’t.
The first sentence sounds like it's going to lead to something about bluffers, but the remainder looks like a re-iteration of the Dunning-Kruger effect. A little surprising to not see it mentioned in the article or comments.
> In the field of psychology, the Dunning–Kruger effect is a cognitive bias in which people with low ability at a task overestimate their ability. It is related to the cognitive bias of illusory superiority and comes from the inability of people to recognize their lack of ability. Without the self-awareness of metacognition, people cannot objectively evaluate their competence or incompetence.
This is not unique to academia. Our entire society has gradually degenerated over the last few decades for a number of constructively interfering reasons:
1. We told two+ generations of children that everyone was capable of anything, gave them all awards after every "competition", and that kind of upbringing makes it difficult to recognize merit.
2. We've lowered the bar for standards across education, in an attempt to bring our lowest up, failing to realize that the primary result was bringing our best down. That hurts merit at professional levels especially, where the pipeline effectively shrinks.
3. Our media has regressed to the lowest common denominator. The most popular sources of influence in our society are uncredentialed hacks who spread misinformation ("Dr." Phil, "Dr." Oz, Oprah, etc). Even our official "news" sources are primarily entertainment venues and are fully editorialized. This makes it extremely difficult for the average person to recognize merit.
It's like our entire culture has been consumed by charisma, such that incompetence permeates every sector of our economy and society. Things were too easy for too long, and now we face a reckoning - either we fix things or our nation collapses. There's no room for popularity contests, crony capitalism, or diversity initiatives during times of crisis.
Edit: what about this comment is deserving of being flagged?
Getting a stupid ribbon in third grade is not going to radically inform your approach to life.
In response to your question, about the stupid ribbon, it probably won't but that's the point. Everyone got a freaking ribbon, everyone got a ribbon in third grade, and fourth grade, and so when someone is actually exceptional how do you then distinguish them, you can't. It's not that the ribbon changed anything because you got it, it's because everyone got it that made it worthless.
Suddenly everyone can prove to everyone how smart they are, meanwhile those that are actually exceptional in an area without an easily defined winners and loser bracket can never be recognized. This leads quickly to a situation where my ignorance is as good as your facts because we are all can be "right in our own way."
The result leads to a distortion of facts a society that can agree on basic reality and everything being run by conmen and manipulators because they realized early on that was the only way to get ahead. Starting to sound familiar?
It's not a single stupid ribbon. It's growing up in a society where literally every competition results in everyone winning. Predicting performance (i.e. evaluating merit) is a skill that requires development, yet when you reward everyone equally regardless of success or failure you train that skill on noise. How do you expect children to learn to recognize when people are or are not skilled when you imply that skills don't matter because everyone wins anyway? Instead you raise them to believe that skills don't matter.
What happens when these children become adults after a lifetime of being taught that everyone is a winner, regardless of performance? Cognitive dissonance and a sense of entitlement, because there will always be true winners and losers in a world of scarce resources.
Children need to experience failure. Just like they need to experience pain and a multitude of other negative emotions that our modern society increasingly attempts to shield them from. Otherwise you raise a generation of childminded adults who fail to differentiate between charisma and merit, and all of society suffers.
But drawing a line from your pet peeve about the world to one occasional event out of thousands in a kid's life is disproportionate and reductive.
Children fail and children fail to get their way all the time, in hundreds of daily struggles. A few school contests they don't even necessarily find important shouldn't be assumed to move the needle. If a kid grows up rich, that's something that colors their every experience and is more likely to shape a lifelong attitude about what they're entitled to. But that still doesn't mean you have to stereotype them.