Hacker News Reader

fsg7sdfg789on A Web Crawler with Asyncio Coroutines

I just reached out to you via email to see if I can help.

fsg7sdfg789on What's So Special About Low-Earth Orbit?

Beyond the information presented, this is really neat to see interactive visualizations with code that can be edited inline.

It reduces the apparent distance between "wow cool visualization" and the code that generated it.

The more people see code regularly, and can connect it with something they understand, the more likely they are to be code fluent.

fsg7sdfg789on A Web Crawler with Asyncio Coroutines

It's not a significant number of pages per day, honestly. For me, the limiting factor is almost always how many concurrent requests I feel comfortable making to the remote server. For big sites, the proxy I use generally caps it at 5 req / domain (concurrently).

I generally use distributed crawlers, which means I can scale to millions of pages per day (assuming different domains). The biggest limiting factor is the database layer, how many writes can I do in a day.

If I need to go faster, I just spin up another crawler worker, which connects to the queue and starts pulling jobs.

I believe anything under a million pages / day should be do-able by a homebuilt, single-server system.

fsg7sdfg789on NASA Struggles Over Deep-Space Plutonium Power

Personally, I believe the political system is structured in such a way as to make changes impossible. This is a feature, not a bug. The inertia of the system protects us against mob rule. It also means that as much as change is inevitable, it is also completely outside the control of one person, party, or special interest group.

Instead, I choose to optimize for my own happiness. Politics, especially because you're just shouting against the rain, makes me incredibly unhappy, so I avoid it.

Others are free to spend their time as they wish, but I am simultaneously cynical about the system and as removed and detached from it as I can be in order to focus on my own happiness.

fsg7sdfg789on The Danger of Managing Drug Prices

If my understanding is correct, other nations with single payer systems have lower health care costs and frequently better outcomes than in the US.

Econ101 is good for teaching concepts about how to think about economic interactions, but when the data doesn't match the theory, you can't stick with the theory.