HNHacker News
TopNewBestAskShowJobs

spectre256

675 karma · joined June 25, 2012

I like free (open) software, the open web, computer graphics, flying planes, riding bikes, and cats.

San Francisco -> Berlin -> NYC

Core Maintainer, Pelias Geocoder (http://github.com/pelias/pelias/) Founder of geocode.earth (https://geocode.earth): open source geocoding hosted services and consulting Formerly of Mapzen

https://juliansimioni.com

submissionscomments
spectre256··on My own brain’s refusal to integrate the seriousness of climate change
Either: definitely yes, as the conclusion of the article is very different than what I expected from the title

or: no, because the content was substantial and many people probably would not read yet another article with a title like "even more evidence for how sure scientists are of climate change". we all already know and have mostly made up our mind

spectre256··on Ask HN: What should an ideal developer interview process look like?
My favorite coding interview ever is still from many years ago when I interviewed at Pivotal labs.

It was an in person pair programming session, with the interviewer driving.

Most importantly, it was collaborative, whereas many interviews often feel adversarial.

It also tested how you communicate, since you weren't the one typing.

However, it still tested your coding skills, but because the interviewer was "on your side" with respect to the desired output code, it wasn't a dealbreaker or stressful situation if you forgot the signature of an important method or function.

But it also touched on actual coding skills, while not requiring you

spectre256··on What's in a Docker image?
Definitely, storage is still hard. I don't have a ton of experience doing anything fancy with storage and K8S yet.

Like I said, our primary service with storage is Elasticserach which we still manage with good old Terraform and bash scripts.

spectre256··on What's in a Docker image?
I've been using Docker with very positive results in consulting contracts for several companies on very different hardware. The same codebase is used for hosted services that we run ourselves on Kubernetes running on AWS.

I'll consider writing this up as said blog post, but here's the gist.

In my view, the advantages of Docker containers are roughly as follows:

- At a high level, Docker allows thinking our services as opaque units in a way I haven't really seen in practice anywhere else. Our containers have CPU and memory requirements, but other than that, when thinking about infrastructure, nothing else matters.

- Docker allows all knowledge of how to run software and its dependencies to live with the corresponding code. While I understand your reasons, I don't agree with the idea that "regular programmers" should not be trusted with devops code. The advantage here is that we can write our application code and its requirements once, and run it in lots of places. In all my years of trying systems like Puppet, Chef, etc, I've never seen this work quite as well.

- With Kubernetes (or ECS, or Docker Swarm, etc), all our infrastructure instances are identical. They are agnostic to the workload they will eventually run, and likewise the containers don't "know" anything about the machines on which they run, except that they are guaranteed to have the resources that container needs. If we really need to do something special for performance, like run a CPU intensive container on a C5 AWS instance, and another on an R5 instance to optimize for memory, Kubernetes or ECS would let us do that without much trouble. This makes managing our fleets of servers super easy.

- As consultants on a codebase we run with many clients, the level of abstraction with Docker lets us avoid most of the hard work of adapting to a client's infrastructure. We have clients using Kubernetes on AWS and bare metal, using just Docker Compose (no Swarm) on virtualized and bare metal machines, and using ECS. Basically, we tell them: "give us something that can run Docker containers, and integration will be a breeze".

Conversely, here are some times I _wouldn't_ recommend Docker:

- You really have hard performance requirements beyond "make sure it runs on the right EC2 instance type". If you are in HFT, sure, avoid Docker.

- You have an existing, working, relatively stable infrastructure running on a sane modern-ish setup like Packer/Terraform, and everyone on the team knows how it works. This is especially true if you mostly have a monolithic codebase, with few other services.

- This is more for Kubernetes, but Databases with their own clustering/coordination are a bit scary to run on Kubernetes, at least to me. It's getting better, but I feel like the probability of two "auto-healing" clustering mechanisms fighting each other is too high. We currently run Elasticsearch on bare EC2 instances in our most critical setups for that reason. Someday I hope this is no longer required.

Finally I'll say that Docker itself is nothing special, and I actually don't expect we're still using Docker in 10 years time. The implementation itself has a lot of quirks, the idea of a Docker service running as root on all machines is very scary (but is already going away), and the limitations of Docker requiring root to build images is also concerning (and is also going away). But the idea of containers or something similar as the "unit" of managing workloads is really great.

spectre256··on Impostor syndrome strikes men just as hard as women in technical interviews
The fact that people still parrot the top 1% idea after it was pretty thoroughly debunked by Joel almost 15 years ago is...interesting.
spectre256··on Migrating away from Google Maps and cutting costs
Thanks Andrew! (one of our first customers)

geocode.earth founder here, happy to answer questions.

We have great reverse geocoding with OSM and OpenAddresses data.

Feel free to shoot me an email for an invite: julian@geocode.earth

spectre256··on Facebook exodus: Nearly half of young users have deleted the app
Twitter is really useful for sharing content at conferences or other events with a clear hashtag.

Other than that, and perhaps sharing more substantive articles/blog posts/etc to a wider audience, it's at best silly, and at worse, well...much worse.

spectre256··on Our Solar System Is Even Stranger Than We Thought
I'm not sure why you were downvoted, that's a beautiful analogy.
spectre256··on Air India Express 737 Hits ILS, Damages Wall on Departure, Flies for 4 Hours
It totally depends. A weakened structure can hold pressurization for a while, and then suddenly (and possibly catastrophically) fail.

A famous example of this is American Airlines flight 96 (1972): https://en.wikipedia.org/wiki/American_Airlines_Flight_96

spectre256··on Ask HN: How do you decide when you've done enough work for the day?
Starting with a plan has been absolutely essential for me.

This year I started a business which means I work full time from home (or a nearby coffee shop), because my co-founder is in a different city and timezone.

While I've worked part-time remote and on distributed teams before, the lack of structure from being your own boss has been a huge change. A blessing and a curse to be sure.

When I start the day without a plan, even if I "get lots of things done", I feel stressed all day and am almost certainly not effective.

spectre256··on Lenovo: Companies working in China may have to install local backdoors
I concur that it's unlikely that time ever really existed, at least in the US.

After all, the internet came directly from the Department of Defense funded ARPANET. Before that, computers were so expensive and large that realistically only governments or large companies could fund even routine work with them.

I suppose all that's changed is now the average human is on the internet. I mean that literally, since it seems that we are about to cross the threshold of 50% of humanity using the internet (https://en.wikipedia.org/wiki/Global_Internet_usage).

So the things governments wish to do on the internet are more and in line with things that involve the population at large. For better or worse (mostly the latter, IMO) that involves lots of intelligence gathering, copyright enforcement, and national security work.

spectre256··on Mapbox CEO says the map calling New York City ‘Jewtropolis’ has been 100% fixed
It sounds like building a system on top of OpenStreetMap that is similar to Wikipedia's "protected pages" could be worthwhile.

There are legitimate reasons to edit even the information for major world cities (most of them, for example, don't have translations into all major languages yet), but there's little reason to need those changes to be applied immediately.

spectre256··on GitLab 11.1 released with security dashboards and enhanced code search
I would have to admit that's useful as I've accidentally printed a secret key or two to publicly accessible jobs on TravisCI, and then had to scramble to rotate them :)
spectre256··on GitLab 11.1 released with security dashboards and enhanced code search
Wouldn't this be an unwinnable battle? If you can't print out the whole secret, you can print out each half of it, or one character at a time, each on a different line.

There's probably no way around the reality that users who have the ability to run arbitrary code on the CI server have access to the secrets.

spectre256··on Farewell, Google Maps
The upside of this change is it should help raise awareness and investment in mapping products that are open source and use open data.

Off the top of my head, there are a number of companies/services that can serve as alternatives to Google Maps, and one way or another they all contribute to the collective quality of open source and open data map tools:

* geocode.earth (https://geocode.earth) has geocoding including autocomplete based on Pelias(https://github.com/pelias/pelias)

* Interline can help with routing, OSM extracts, and transit data(https://interline.io)

* Stadia Maps also offers map tiles and routing (https://stadiamaps.com/)

* GraphHopper (https://www.graphhopper.com/) offers routing and geocoding

* OpenCage (https://opencagedata.com/) offers geocoding based mainly on Nominatim but also a bunch of other geocoders

* Jawg.io (https://www.jawg.io/en/) offers maps, routing, and geocoding

Roughly speaking, open data allows for lower prices because investing directly in gathering proprietary data is super expensive. Open data coverage is getting pretty good in lots of areas, and is better than proprietary data in a lot of developing cities (like Jakarta). It can often be updated much more quickly. Google is notorious for taking a long time to fix errors.

Likewise open source map tools are definitely behind Google in many respects, but there's the advantage of transparency and ease of migration if one particular provider happens to go away, or customization is needed.

I'm sure I'm missing some services, and am happy to talk more about any of the challenges/features as much as I know.

Disclosures: I am a co-founder of geocode.earth, and a former employee of Mapzen, along with the founders of Interline

spectre256··on Riot Games Approach to Anti-Cheat
Blizzard is famous for a variation of this.

They will spend a few weeks/months detecting cheaters, but do nothing.

Then, they will ban many users of a given cheat at the same time. This creates press, which helps the message of "you will be banned if you cheat" spread further than if they had immediately banned each offender.

spectre256··on Why Use OpenStreetMap Instead of Google Maps?
There is http://opentraffic.io which was developed together with Mapzen(RIP), Conveyal, and the World Bank, which shows a lot of promise
spectre256··on Google Maps Platform
sure, shoot an email to hello@geocode.earth and we'll set you up
spectre256··on Google Maps Platform
Hey 2dvisio,

I'm an ex-Mapzen alum who runs https://geocode.earth. We don't have a permanent free tier at the moment (our geocoder is solid but the service is new!), but we want to find ways to contribute to the community where we can. I would be happy to set up a temporary free tier on our service for one of your classes.

Shoot me an email, julian at geocode dot earth and we can figure something out

spectre256··on Google Maps Platform
I'll tag on to Nelson's post to plug a new geocoding service two of us ex-Mapzen folks started called https://geocode.earth.

We offer geocoding, especially autocomplete, with much more liberal usage restrictions than either Mapquest or Google, and some pretty powerful features like address interpolation.

As we're still really getting the platform around the geocoder off the ground, we don't have a permanent free tier, but I'd be happy to set anyone up with a demo key if they are looking for something new.

spectre256··on Google Maps Platform
Hey kinard,

I'm an ex-Mapzen teammember, and we've set up a new, paid, geocoding service called https://geocode.earth. I suspect we can give you what you need around geocoding, especially autocomplete, for much less than Google. Feel free to request an invite or reach out to me personally.

spectre256··on Mailchimp Is Shutting Down ICO and Blockchain-Related Emails
This is exactly what I assumed caused them to make this decision.

Who knows, a lot of Mailchimp employees might even really like blockchain tech, or be intererested in ICOs, but at the end of the day, if serving ICO/blockchain mail results in lots of emails marked as spam, it puts their whole business at risk.

spectre256··on The duties of John von Neumann's assistant (1993)
I have a similar story for a college course also titled "Software Engineering". Essentially, it was a course on how to properly execute the waterfall model of design.

We were assigned teams of four, wrote hundreds of pages of requirement papers, design papers, everything papers. Then we wrote the code in PHP in one night.

For the final section of the class, 3 teams of 4 were merged into teams of 12. It's obvious that no college students have the desire or ability to manage a team of 12, as it's a huge task even for an experienced manager. The overhead of having 12 people involved was incredible. Fortunately, more than half the students in the group were happy to be "fired": we didn't talk to them at all, did the work in a smaller, more nimble group, and everyone got a good grade.

spectre256··on OpenStreetMap Is in Trouble
Agreed. While the quote has a certain elegance to it, and certainly some truth, I suspect many people who have statues were on committees of some sort.

For all their flaws committees are a primary way in which people pool their collective experience and effort which is ultimately how anything significant is built.

spectre256··on OpenStreetMap Is in Trouble
As soon as I started reading your article I actually started thinking of Jimmy and how he's been a part of a real government entity (the national park service) sending data directly into OSM.
spectre256··on OpenStreetMap Is in Trouble
In that sense, perhaps the linux distro model actually makes more sense than centralizing power into one entity?

Ubuntu, Redhat, and many others produce their own polished, supported products, sell it, and then give back to the central parts of the community in the process.

Mapbox and others certainly seem like they essentially play the part of "OSM Distro" in that regard. And maybe its okay for multiple entities to be able to contribute in different ways.

spectre256··on OpenStreetMap Is in Trouble
True, at least for the moment, although that doesn't mean we shouldn't try.

One nice thing about open data is it can outlast. What do you think will survive and be readily accessible on the internet longer, Wikipedia or Quora? My money's on Wikipedia 100%.

With OSM things are similar. Obviously geo data has additional ways it can grow stale, but still. Google is big today but there's no guarantee for the future.

spectre256··on OpenStreetMap Is in Trouble
Ultimately it comes down to the resources to create such a thing, right? There have been some successes with crowdsourced validations such as Facebook's translation efforts (although I think in that case it was merely a component of the process). And it would rely on a volume of edits that OSM may not have. There may be 1000 people ready to verify the location of the Statue of Liberty, but probably not the location of every building in a remote area being mapped for HOT.

Mapbox has built the start of a validation framework, and they have done very cool stuff. Of course then they get criticized for "forking" OSM. There are definitely valid criticisms there, but it seems like there's no way to win.

spectre256··on Online shopping in Africa doesn’t work because of shipping and billing forms
Alternatively, it might show something about people (mainly Europeans) who have driven huge numbers of Africans into terrible poverty for generations where they have no option but to perform jobs poorly, steal, etc.

Likewise, assuming all problems in Africa are due to innate differences in "blacks" rather than considering other possibilities certainly says something about the person making that assumption.

(edited for minor typos/grammar)

spectre256··on A Glimpse into the Apollo Guidance Computer
Absolutely they considered programming to be not as serious. There's a great book called Digital Apollo by David Mindell[1] that talks about the creation of the Apollo Guidance Computer.

One of the stories is of a male manager who, after being put in charge of a team of software developers, asks his wife not to tell any of their friends he was managing a software team.

[1] https://www.amazon.com/Digital-Apollo-Human-Machine-Spacefli...

← PreviousPage 2 of 5Next →