HNHacker News
TopNewBestAskShowJobs

dan_mctree

358 karma · joined July 3, 2017

submissionscomments
dan_mctree··on How I use LLMs to learn complex topics
Imo the podcast and the video are better served as background material for some other task. The low bandwidth becomes an advantage because it's often ok if you miss out on some parts due to lack of attention.

Indeed it's often a waste of time to just focus on talking people fully if you want to learn fast, reading and especially deliberate practice are better for that. But if you don't have the time, energy or focus, then listening to interviews in the background can be useful supplementally

dan_mctree··on The Singularity will occur on a Tuesday
>So obviously, error correction with inputs/outputs is not the way we get to intelligence.

This doesn't seem to follow at all let alone obviously? Humans are able to reason through code without having to become a completely discrete computer, but probably can't reason through any length of assembly code, so why is that requirement necessary and how have you shown LLMs can't achieve human levels of competence on this kind of task?

dan_mctree··on The US is flirting with its first-ever population decline
Yes, this absolutely appears to be the main reason. Both in practical terms through birth control, but also through cultural terms in that it's now seen as a choice rather than as an obvious thing you do. To change this course, we probably need to change the culture first so that a birth control ban will be supported. That's currently not looking likely, so population collapse it is
dan_mctree··on Over 36,500 killed in Iran's deadliest massacre, documents reveal
Well you see that take over and over because that's what people actually believe in and feel and it's almost weird it has to be repeated over and over. Most protestors are not solidarity protestors. Most protestors show up when they're angry, when they feel like there's something obvious that can be changed and when people around you refuse to do the obvious thing. If you don't have these factors, you don't really get big protests.

For example I don't believe the US saw particularly large scale anti Germany protests surrounding WW2. Before the US joined the war people didn't really know what to do, while after they joined the war there was little disagreement. The Vietnam protests were much larger, because you have the internal conflict and something obvious to do: stop fighting.

People showed up for Gaza protests because they were angry and because they felt people around them, and particularly their governments were complicit in events. People do not show up for Iran because everyone agrees it's terrible but no one really knows what to do, so who are you going to be yelling at on the streets and what would you yell? Additionally events in Iran, relatively speaking probably triggers more hopelessness/confusion than anger, these are not exactly the best emotions to inspire protest

dan_mctree··on Intelligence Evolved at Least Twice in Vertebrate Animals
Advanced intelligence may have evolve multiple times, but wouldn't the origins of simpler intelligence lie much deeper in the evolutionary tree? If Octopi use neurons too, it seems obvious to me that rudimentary intelligence must have originated in or before the common ancestor of vertebrates, octopi and squids: flatworms. Or going back even further, perhaps even all the way to single cellular life which often seems to be able to react in complex ways to stimuli. Even our brains seem to still make use of forms of processing within the cell, isn't there intelligence in those cells? Or do we have some agreed on definition of intelligence that excludes these simpler forms?
dan_mctree··on Larry Ellison's half-billion-dollar quest to change farming
If all the wealthy would band together to spend their money on convincing every farmer to write software instead, then we'd all starve
dan_mctree··on Does X cause Y? An in-depth evidence review (2021)
You probably also need at least: - Y does not appear when X does not - We need an overwhelming sample size containing examples of both X and not X - The experiment and data collection and trivially repeatable (so that we don't need to rely on trust) - The experiment, data collection and analysis must be easy to understand and sensible in every way without leaving room for error

And as another commenter already pointed out: You can't really eradicate the existence of an unknown Z

dan_mctree··on Does X cause Y? An in-depth evidence review (2021)
And even if you do know there's causality (eg: the input variable X is part of software that provides some output Y), the exact nature of the causality can be too complex to analyze due to emergent and chaotic effects. It's seldom as simple as: an increase in X will result in an increase in Y
dan_mctree··on Markov chains are funnier than LLMs
Why are bananas the funniest food? Even Claude seems to have caught on
dan_mctree··on AI solves International Math Olympiad problems at silver medal level
I'm curious if we'll see a world where computers could solve math problems so easily, that we'll be overwhelmed by all the results and stop caring. The role of humans might change to asking the computer interesting questions that we care about.
dan_mctree··on What if they gave an Industrial Revolution and nobody came? (2023)
I'd like to recommend the author mentioned briefly in the article on this topic: Joel Mokyr. Unlike how this article paints him, Joel doesn't really point to a sole cause for the industrial revolution, but highlights a broad range of contributing factors, I thought it was very insightful.

While it's certainly not the only cause, high wages as a contributing factor to innovation in productivity does still seem like a plausible factor behind the industrial revolution. I suspect that these days in the west, labor is relatively so cheap compared to how much capital is around, that capital ends up being rather inefficiently used. Or at least, capital doesn't primarily go to production increases anymore. Perhaps there's avenues for gains here today

dan_mctree··on A 1.3B-light-year-across ring of galaxies has confounded astronomers
Pretty sure you wouldn't find many circles containing galaxies all at a similar approximate distance

There might be some, so it could be lucky and just random chance, but the stats seem to say that it's very unlikely

dan_mctree··on Grothendieck’s use of equality
There's so much ambiguous context that goes into your average '=', even when just talking about your standard functions on real numbers. You'll see it being used for anything from:

- We've found these to be equal

- We're hypothesizing this to be equal

- These are approximately equal

- These are defined to be equal

- This is a way to calculate something else, whether it's equal is up to your philosophy (a^2+b^2=c^2)

- I'm transforming my function into something else that looks different but is exactly the same

- I'm transforming my function into something else that is the same for some of the stuff I care about (but for example does not work anymore for negative numbers, complex nrs, etc.)

- I'm transforming my function into something else, but it's actually a trapdoor, and you can't convert it back.

- This is kind of on average true within an extremely simplified context or we know it's not true at all, but we'll pretend for simplification (looking at you physics)

- We are trying to check if these two are equal

- This is equal, but only within a context where these variables follow some constraints mentioned somewhere else entirely

- This is equal, but, we're not going to say whether you can or can't replace the variables with functions or whether it supports complex nrs, negative nrs, non-integers, etc.

A lot of this is usually kind of clear from context, but some of these differences are a nightmare if you want to code it out

dan_mctree··on New findings point to an Earth-like environment on ancient Mars
I wonder if there'd be any good way to confirm or rule out an ancient Martian civilization. Would Martian surface structures be able to last a few billion years? Or would Martian processes be able to make all of them disappear? And how about underground structures?
dan_mctree··on What we know about the xz Utils backdoor that almost infected the world
Possibly if language use fingerprinting ever becomes reliable enough to be able to connect multiple online pseudonyms together. That'd be a fun time
dan_mctree··on Why does an extraneous build step make my Zig app 10x faster?
It's just a preference thing, I loathe the small program chaining style and cannot work with it at all. Give me a python script and I'm good though. I can't for the life of me imagine why people would want to do pseudo programming through piping magic when chaining is so limited compared to actual programming
dan_mctree··on Scientists put Jared Diamond's continental axis hypothesis to the test
To my untrained eye, the eastern United States and Uruguay + surroundings also seem like great places for civilizations to thrive. But for some reason those areas did not seem to have particularly large civilizations before the colonization period. Does anyone know of a good reason why these areas were relatively unpopulated compared to the areas you mention but also compared to say Mexico?
dan_mctree··on Shave and a Haircut
The Pledge of Allegiance?
dan_mctree··on Vesuvius Challenge 2023 Grand Prize awarded: we can read the first scroll
The scans used for the grand prize look like this : https://scrollprize.org/img/grandprize/scroll1.mp4

It's a cut through the scroll, with the time dimension in this video representing the location of the cut along the scroll lengthwise.

As you can see from the mess it's far from trivial to find the surface of any of the sheets in the scroll, often they layers are blended together messes.

You may be thinking of the scans they used of an unwrapped sheet, those were as you describe and were used to help figure out methods for the real challenge.

dan_mctree··on Plastic bag bans work
We need supermarkets to provide places where people can donate or sell their excess reusable shopping so other people can pick them up and use. That should put a big dent in the necessity for people to make use of new bags if they didn't bring their own reusable bags
dan_mctree··on More product, fewer product managers
>but the catastrophist discourse that there's a deep slowdown in productivity compared to the previous decades and that today we're mostly relying on things we already did in the past maps pretty well with my perception.

Mine too. Any ideas why productivity has slowed down so much? Is this a software online observation, or more of a wider pattern

With software I guess part of the problem is that there's a lot of diminishing returns, with it being much easier to just crank out some initial prototype that does a lot, then it is to adjust some spaghetti mess that users deeply rely on. But that should only really affect individual projects, not necessarily the industry as a whole

dan_mctree··on 55% of workers say their pay isn't keeping up with inflation
There are various things that go into inflation, and wages are only a small part of it. Wage price spirals are very unlikely and have not been demonstrated. Wages are not 100% of the cost of products, so even if companies directly increase product prices exactly by labor cost increases, the product prices would not increase by as much as wages did.

More likely causes for system wide inflation generally lie in limited substitution options for people. If they have to buy from limited options, either because of a lack or supply or because of monopolistic behavior, prices can be jacked up as undercutting is of no concern. This can happen both at the finished products level, or somewhere in the chain. E.g. the cost of gasoline goes up due to lack of alternatives and since it is used by companies making and transporting many types of products, prices go up everywhere.

dan_mctree··on 55% of workers say their pay isn't keeping up with inflation
Or not at all. If the 45% are exactly on the mark with inflation, then the average would be significantly below inflation. The 45% would have to significantly exceed inflation for it to be spot on. And of course even then it's little solace for the 55% that someone else is keeping up
dan_mctree··on Joint Statement on AI Safety and Openness
Nor do I get what the plan is to stop good but overoptimistic actors developing AI that spirals out of their control

I feel these kind of statements by Mozilla reflect exactly that lack of caution that may end us

dan_mctree··on Ivan Illich’s radical critique of modern certitudes (2021)
Why do you assume a tabula rasa person would assume that consciousness ceases to continue on death? I don't think there's anything obvious that would suggest this goes one way or the other and that different people could end up settling for different conclusions. An obvious natural guess would be that it'd be similar to sleeping, as in, you would see dreams
dan_mctree··on Fractional Factorial Experiment Design: There Are Too Many Experiments to Do
Is it just me or does this require background knowledge that isn't widely available? I couldn't get through it as it never seemed to really explain what Aliases or Alias structures are, how determining those aliasing structures works (why multiply by C?), how this primary effect thing works and how any of this actually relates to the experiments in any way. As in, like, ok I do tests 1-4, now how do I turn that into insight with this algebra?

If someone could elaborate how this all fits together that would be great, because it does seem like there's some nuggets of insight to be found here

dan_mctree··on The Quiet Revolution of the Sabbath
The beatitudes are much more difficult, with some of them unlikely to be prescriptive (blessed are those who are persecuted), some of them being unclear (blessed be the meek) and others that are difficult to translate to actions (blessed be the pure of heart). In contrast, the simple rules of the ten commandments, most of which just tell you not to do a basic thing you probably weren't doing anyway (thou shalt not steal) are much easier to follow and much easier to confirm you are doing well in. People resonate more with simple yardsticks like the ten commandments than with the vaguer "be a good person and it's ok if things are bad for you now" beatitudes.
dan_mctree··on Nomnoml
Those who log issues are the hardcore users crowd that are bothered by something small, whereas new potential users that bounce because of something important generally don't bother making issues. You may be missing out on a lot of critical issues such as limited documentation and confusing API aspects by ignoring other channels of communication.
dan_mctree··on JAX – NumPy on the CPU, GPU, and TPU
It's so awkward that these truly fantastic tools for fast numerical computation (NumPy and JAX) have to be accessed through Python, which is a truly terrible language for fast numerical computation.

Is anyone making any serious progress in fast GPU based computational tools for other faster languages? I'm looking for something that also works on the GPU on windows (unlike JAX)

dan_mctree··on Observation of the effect of gravity on the motion of antimatter
That's right, it's usually been theorized that gravity would affect antimatter the same way as regular matter, but it's been hard to confirm as it's a serious challenge to obtain a significant mass of antimatter
Page 1 of 6Next →