HNHacker News
TopNewBestAskShowJobs

manish_gill

1,516 karma · joined October 18, 2011

Software

https://parallelthoughts.xyz

https://twitter.com/mgill25

submissionscomments
manish_gill··on Amsterdam bans cruise ships
Amsterdam cultivated a reputation for its drug tourism. Why was that ever allowed to happen? It seems like you're angry about all the tourism - a problem a lot of other cities would love to have.

The sad answer is that everyone _left_ Amsterdam by choice - and allowed these tourism centric industries to grow. The money that it brought in was too good and eventually lead to the so called decline you seem to be complaining about.

As for property price rise - people have the same complaint against tech workers. So I guess I can no longer be a tourist and I can't work in tech because someone somewhere is definitely going to be angry that I make more money and the world isn't fair.

manish_gill··on Fly.io Postgres cluster down for 3 days, no word from them about it
Why is this company always on HN frontpage - ironically for their bad services? Normally, poor service from a provider isn't grounds for such attention - but seems like Fly.io has not done anything great.

They still continue to get love from the developer community who "wants them to succeed". I'm puzzled as to why? Because of some blog posts?

manish_gill··on Ask HN: Could you share your personal blog here?
Some old posts (including one that made it top of HN once upon a time!) here: https://parallelthoughts.xyz/
manish_gill··on FoundationDB: A Distributed Key-Value Store
Seems like a very similar use-case like Zookeeper - use it for distributed coordination / consistency etc and build your actual database on top of it.
manish_gill··on I moved to Germany and regret it
You assume that I haven't traveled the entire country. I have. I've been to many places that you describe and have friends in those cities. Student towns are sort of a bubble, they don't count.

The rest of Germany as you put it isn't any better. I've had people tell me Berlin is _shockingly better_ compared to $insert_name_here.

manish_gill··on I moved to Germany and regret it
Not really. Everything she described - the feeling of being unwelcome, comments about your language skills (even when you're learning and trying), being stared at, the utterly ridiculous bureaucracy - all of these experiences are true. Even in a big, supposed modern city like Berlin. Even when interacting with young people.

Source: Been living in Berlin since '19

manish_gill··on Garum Masala
On the question of roasted vs not: I believe they simply need to be _dry_.

Typically this can be achieved by either soaking the individual spices out in the heat, or a partial roast.

manish_gill··on Show HN: Time-tracker that helps me with context switches and documentation
Great idea! I would use it without a second thought if this could take my notes and push them into the my Daily Obsidian note, along with timestamps. :D
manish_gill··on Ask HN: Laid off folks, are you getting hired?
I'm also based in Berlin. Do you mind if I ask what companies are you talking to?
manish_gill··on Health Services as Credence Goods: a Field Experiment (2020)
I love HN. Getting a dentist recommendation in the city I live in from a fellow hacker is something that can only happen here.

PS: sent you a message. Would love to get more info :D

manish_gill··on Health Services as Credence Goods: a Field Experiment (2020)
This is timely. I've been to a Dentist in India who's suggested that I get a complicated procedure done, and I figured that since I'm living in Berlin right now, I might as well do it here - I've yet to make a Dental appointment. But your post makes me question things now.

I don't trust Dentists in Delhi, but thought the situation would be much better here in Berlin. Guess not.

manish_gill··on Ask HN: What Is Going on with Neo4j?
It was more of an observation by looking at most production systems, reading tons of docs, talking to a LOT of people who built the legacy - the stuff that's on your phone and in your car right now - and building a few modern systems over the course of ~2 years.

So a bit more than `kubectl get pods -A` :)

manish_gill··on Ask HN: What Is Going on with Neo4j?
I have worked in a Maps company - with the core business model being literally - building maps and adding traffic services. The sort of thing that's provided as the Graph 101 example.

I can assure you, nobody used any Graph database to achieve any of it.

manish_gill··on Ask HN: How's the job hunt going? (For those laid off)
Thanks. Her German is A2 already. The problem is that companies here expect professional C1-C2 level, which will take some time.

And yeah, great idea re: jobs for Dutch companies. Will definitely check that out!

manish_gill··on Ask HN: How's the job hunt going? (For those laid off)
Since this thread is the most relevant - my partner has been struggling for a long time to get going into the field as a Data Analyst/BI analyst doing SQL, Tableau, Excel and (beginner) Python/Pandas. She has been hunting for junior positions or even internships with no luck so far.

Here in the EU, either her career gap (due to covid + country change + taking time to upskill herself) gets in the way, or C-level German language does, and if nothing else, they're hiring Seniors.

If anyone is willing to hire a bright and hard-working beginner with an MBA in Finance, drop me an email at me [at] manishgill [dot] com

manish_gill··on Spain will introduce free train travel
Living here for 3 years, I think I can “appreciate” that.
manish_gill··on Spain will introduce free train travel
I’m writing this from a German train (Regional Bahn, not even the ICE), and it does have air conditioning. Not too crowded, smooth journey for the past 2 hours.

I’ve travelled all across Europe, and German trains aren’t what I would call “lousy”.

manish_gill··on Things to know about databases
What tool was used to create the visuals?
manish_gill··on Apache Hop 2.0
Something I've been asking for a long time as well. Java/JVM are great, but it would be great to see _some_ diversity in the Big Data ecosystem when it comes to implementations. :)
manish_gill··on The end of big data
Delta metadata based min/max statistics, Parquet row groups and min/max in-file, combined with the right combination of bucketing and sorting, allowed us to actually ignore all partitioning and drastically improve performance on PB scale. The metadata can be a very useful way to do indexing/allows you to skip a lot of things.

It's not magic, and you can understand what the _delta_log is doing fairly easily, but I can testify that the performance improvement over partitioning can be achieved.

manish_gill··on Preventing Burnout: A Manager's Toolkit
I actually recently suffered (am still suffering from?) a burning caused by the combination - super high stress combined with absolutely no progress, "busywork" and literally a feeling like a plumber whose job is to "support" the people doing the cool stuff (which I thought I would get to work on when I was hired).

I was given most advice that this article mentions - I took vacations, we had internal rotations to reduce stress, we tried hiring. Ultimately, none of these efforts came to fruition. I think there really is no counter to bad decisions from management. You can try to be as nice as possible at an individual level, but the "lack of progress" burnout will bite you if the pressure doesn't.

manish_gill··on Ask HN: Have you used SQLite as a primary database?
Unfortunately I don't have numbers on hand. We approximated our Postgres would ingest around 1 TB over the course of a year, later I think? I could be wildly wrong.

It's been more than 5 years but from what I remember, it definitely was _not_ the partitioning logic (the sharding just meant we had a huge amount of files that were hard to organise). But a single consumer doing heavy writes on a single SQLite file would see enough traffic that pretty soon you would start to see errors and your writes would start to break.

manish_gill··on Ask HN: Have you used SQLite as a primary database?
One of my previous employers was using SQLite as a large distributed database - they had their own custom sharding strategy, but essentially the idea was to shard A accounts * B tables * C num_of_days with a .db file for every shard.

When I first came and saw it, it...did not sound right. But I didn't want to be the guy who comes in and says "you are doing it wrong" month 1. So I went along with it.

Of course, eventually problems started to pop up. I distinctly remember that the ingestion (happening via a lot of Kafka consumers) throughput was high enough that SQLite started to crumble and even saw WAL overruns, data loss etc. Fortunately, it wasn't "real" production yet.

I suggested we move to Postgres and was eventually able to convince everyone from engineers to leadership. We moved to a custom sharded Postgres (9.6 at the time). This was in 2016. I spoke to people at the place last month, and it's still humming along nicely.

This isn't to illustrate anything bad about SQLite, to be clear! I like it for what it does. Just to show at least 1 use case where it was a bad fit.

SQLite was a tempting first answer, but what solved it was Postgres, and we eventually offloaded a lot of aggregation tables to Clickhouse and turned the whole thing into a warehouse where the events got logged.

manish_gill··on Why isn't there a Swagger/OpenAPI for binary formats?
http://www.jemarch.net/poke
manish_gill··on Tell HN: Did you know you can negotiate price on many things?
Being a bad haggler, I typically just always say Yes to the first price I'm asked to pay.

I wonder how this changes across different countries. I know in India, there's a lot of flexibility in negotiation/haggling prices.

But living in Germany, I always get the impression that things are fixed price and I typically don't bother negotiating. Unless it's the rare street market/Weihnachtsmarkt where they're willing to negotiate (and even there they usually don't).

I'm curious to know other countries experience if people can chime in.

manish_gill··on How does database indexing work? (2008)
Relevant Book: https://www.databass.dev/
manish_gill··on Trapped in Silicon Valley’s hidden caste system
Care to elaborate?
manish_gill··on Trapped in Silicon Valley’s hidden caste system
https://www.livemint.com/Leisure/3u2QUPuXBEFPaBQXU2R8mJ/When...

I'll edit this with more links later, it's 3am in my TZ atm.

manish_gill··on Trapped in Silicon Valley’s hidden caste system
Yeah, as a Sikh from Delhi, I can confirm that you've read the fairy tale version. Caste is ever present in Sikhism.
manish_gill··on Trapped in Silicon Valley’s hidden caste system
As someone born and raised in India, things like this were a bit "distant" from me when I was in school (it came up but I was never a victim).

But the more I got to know Indians who were more privileged than I have been, the pattern started to clearly emerge. I distinctly remember thinking - "people who are better educated than I am tend to be richer or from an upper caste background, usually both".

I try to not let it get to me - I'm in a more "esoteric" position as I'm neither one of the privileged castes nor the downtrodden. My last name is still a dead giveaway to people who know. And I wonder how many opportunities I've missed because I've never been part of these subgroups (any subgroups really). I'm lucky enough that I have friends and a partner who recognise their historical privilege very well.

It's why diversity is important. I love working with my Dutch, Indian, German, Turkish, Chinese, American, Brazilian etc... colleagues. When I'm in a diverse group, those feelings tend to fade away - because I know there isn't a large group that I might need to be closely aligned with.

Of course, living in another country (not USA), the higher up I look at management, the less diversity I see. Same problem in a different form, I suppose. :)

All of the above is just an individual experience. But data seems to confirm it.

← PreviousPage 2 of 15Next →