HNHacker News
TopNewBestAskShowJobs

meritt

6,947 karma · joined February 24, 2011

submissionscomments
meritt··on We reduced the AWS costs of our streaming data pipeline
I find it highly entertaining a two-year old company who was founded on the basis of helping slash cloud spending found so much waste in their own AWS spend. This is not an example of dogfooding, but an example of sheer incompetency and massive technical debt.

I'd really like to start seeing a series of blog posts from companies who are running extremely lean and efficient tech environments by utilizing cloud in an intelligent manner and avoiding the expensive and unnecessary bullshit that's so prevalent today. The ones that can brag "How we run a $4M/yr SaaS on $40k/yr of AWS spend!" are far more interesting than "How we stopped incinerating millions of VC money by simply turning off shit we didn't need"

meritt··on Bash IRC Quote Database
hunter2 is one of the best: http://bash.org/?244321
meritt··on Beyond Remote
> I'd expect them to pay a stipend on top of my wage, equivalent to the amount of money they save by not having office space

Holy sense of entitlement. No, that's not going to happen. That's not how any of this works. You don't see companies paying outsourced workers $150k/yr due to the "amount of money they save by not hiring expensive talent in SF"

meritt··on What a typical serverless architecture looks like in AWS
This article is a blueprint for not only creating a massive amount of technical debt, but ensuring your startup's entire opex is spent on AWS.
meritt··on Self-hosting a blog for cheap and lazy devs
That makes no sense. You containerize both, or you containerize neither. I wager most people from both camps (for and against containers) would agree.
meritt··on Apache Drill's Future
Nice! Does that work alongside reading in via chunks and writing via row_groups? If I have a 500GB CSV will it work?
meritt··on Three bugs in the Go MySQL driver
The general approach I've used in other languages is if the mysql client API is implemented correctly [1], when it encounters a closed connection, will return a CR_SERVER_GONE_ERROR error to the calling code. You catch when this type of error occurs, re-initialize the connection, and replay the last query/transaction.

[1] https://dev.mysql.com/doc/refman/8.0/en/gone-away.html

meritt··on Apache Drill's Future
pandas + fastparquet fairly lightweight. but yes I would love to see a simple c++/golang binary that's just a simple csv2parq call.
meritt··on Python performance: it’s not just the interpreter
It's about 3-4x faster with the initial implementation:

    foreach(range(1,20) as $j)
        foreach(range(1,1000000) as $i)
            strval($i);
Running on my low-end EC2 box:

    php7.3 py.php == 1.258s
    python2 py.py == 3.714s
    python3 py.py == 4.530s
meritt··on Linux Productivity Tools (2019) [pdf]
> How much of these is really still relevant

All of it? A very small chunk of these slides are even about bash scripts. Most of it is about standard unix commands and pipe and redirection operators.

meritt··on Ask HN: Is there still a place for native desktop apps?
Try opening a moderately large (even 2MB) .json file in VSCode, and then do the same in sublime.

VSCode very quickly freezes because it cannot handle a file that size. Sublime not only opens it but syntax highlights immediately.

meritt··on US video game sales have record quarter as consumers stay at home
https://steamspy.com/year/

8,243 games were released on Steam in 2019 and 3,434 so far in 2020.

Unless you approach indie development like a business and you have a concrete plan for gaining a following, your chances of making a living are near zero. That's not to say you shouldn't do it, but don't expect to make a living doing so.

As an example, David Brevik (of Diablo and Diablo2 fame) spent several years working on It Lurks Below -- a procedurally generated roguelite/dungeon-crawler. According to SteamSpy [1], he's sold 20k-50k copies at around $15-20 per copy, and as of today the game only has about 20 peak daily players.

So probably $500k-$1M in gross sales (and then Steam takes 30%) for someone of his caliber and reputation, after 3+ years in development and a year or so since initial sales. It's just an unbelievably difficult chance of making it financially viable.

[1] https://steamspy.com/app/697550

meritt··on Your mobile data sold, without your knowledge
I was referring to https://mail.edison.tech/, but they compete with unroll.me (rakuten intelligence) in selling people's emails.
meritt··on Your mobile data sold, without your knowledge
Yeah, it's not just emails of course. You can do it with web traffic data. You can do it with credit card data. You can do it with geolocation data. You can do it with TV viewing data.
meritt··on Your mobile data sold, without your knowledge
> Ultimately, free is the culprit.

No, it isn't. Consumer data being sold in a completely unregulated manner is the culprit.

Paying for the product or service has nothing to do with whether or not your data is being sold.

meritt··on Your mobile data sold, without your knowledge
Correct. This "if the product is free, then you're the product!" thinking needs to go away. The reality is numerous companies sell your data today, regardless if you're paying for the service or not.
meritt··on Your mobile data sold, without your knowledge
Anonymization in the data reselling industry is often some form of md5(lower($email)). It's a joke. They even do that for extremely small search spaces like phone numbers. It's still provided at the individual user-level and even if the anonymization is done in a way that's irreversible, you only need to know a single event for a given person and you now have their entire history.

For example, there's a popular email client that scrapes people's inboxes and sells their purchase history to anyone willing to pay. That purchase history is provided on an individual email level and is "anonymized". But if you know your target has this email client installed and you know a single purchase (e.g. a coworker saying "Oh, I bought this awesome coffee maker on Amazon last night!") you can now access their entire individual purchase history backward and forward.

meritt··on Uber loses $2.9B, offloads bike and scooter business
> Why is it amusing?

Because Uber's market cap is indeed egregious, but not nearly as inflated as Tesla. So it's amusing when people like yourself rationally find issue with Uber, but cannot find any flaw in the valuation of Tesla.

meritt··on Uber loses $2.9B, offloads bike and scooter business
> I've been staying away from Uber stock because they have a market cap of 50B

Not defending Uber here in the slightest, but given your post history on Tesla, I find it amusing you think Uber's market cap is egregious

meritt··on Ask HN: What are your favorite developer-efficiency tips?
Avoid being an early adopter of new technology despite everyone on HN raving about it. Instead focus on solving actual business needs that grow revenue or profit margins.
meritt··on Facebook uses 1.5B Reddit posts to create chatbot
It's already happening across social media, just with software a whole lot more advanced than this.
meritt··on Medium-hard SQL interview questions
Most people have no idea what an optimization fence is and opt for CTEs because they yield "cleaner" queries, despite nearly always killing performance.

I've always found explicit temporary tables, where I can add indexes, are often a great solution for performance and readability.

meritt··on Medium-hard SQL interview questions
> It's better to use windowing functions, I believe it should be faster than self-join.

Your statement is making the assumption you have completely dense data and you can simply offset a number of rows to get the desired denominator. Sparse data is a very common occurrence, and now your MoM/YoY/XoX queries are completely incorrect.

meritt··on Show HN: Host your own minimal file sharing site (now with expiring files)
> `is_uploaded_file` and `move_uploaded_file` are the band-aid

It's not a band-aid. When a file is uploaded (see RFC 1867) via HTTP POST, PHP internally allocates a hash table that tracks which files on the filesystem have been uploaded. When the process terminates, it uses that hashtable to remove any remaining uploaded files in the tmp space.

move_uploaded_file() confirms that the filename was indeed created as a result of an upload, and additionally removes that entry from the hash table.

meritt··on Shirt Without Stripes
The point of this isn't asking how to apply boolean search operators, it's showing that the largest AI-focused companies in the world absolutely suck at NLP.
meritt··on California Covid-19 traffic report finds silver lining
Really? Maybe my local experience is an outlier but I've seen significantly more people cooking meals at home and exercising. The number of daily runners in my neighborhood has easily increased 10x. Are gluttony and sedentary lifestyles not the major contributors for type-2 diabetes and heart disease?
meritt··on Maryland restaurant owner: 'Delete all the delivery apps'
Uhh, wouldn't it be a lot easier for the restaurant owner to simply not partner with Grub/UberEats/Caviar/etc. Delivery cos can't charge a commission to the restaurant if you don't have an agreement with them.

Do they want the free advertising on networks but then disintermediate those same platforms in an effort to work directly with the customers who may have never found them in the first place? I'm all about supporting local businesses but me deleting GrubHub isn't going to stop other people from ordering on it from their restaurant.

meritt··on SQL is a better API language than GraphQL – Convince me otherwise
> So swagger is bad

No, because in Swagger the first step is carefully designing exactly what the inputs and outputs are of each and every API call. Most GraphQL servers you simply point it at a database and it automatically makes your entire schema, including tables and fields that shouldn't be exposed to end users, readily available.

> doesn't remotely mean the queries "run on the client side".

Sorry, that was poorly written. Obviously the queries are not running on the client side. My point was that the client can provide any query they want and the system will process it.

meritt··on SQL is a better API language than GraphQL – Convince me otherwise
I feel like this thread is tongue-in-cheek to make people realize that "run any query on the client side" is a terrible idea, and that's exactly what most GraphQL installations offer.

As a penetration tester though I like GraphQL, it's a very handy data exfiltration engine. By default, there's no authorization, no authentication, and it even comes with introspection. One query and I get your entire schema! This trendy movement will be far worse for data security than SQL injection, unsecured S3 buckets, or misconfigured NoSQL instances.

meritt··on GitHub is now free for teams
Microsoft owns Github. Microsoft owns VS Code. VS Code is superior to Atom. Do you need an official comment? It seems abundantly obvious to me.

Nat is the CEO of GitHub, not Microsoft, and despite any promises made on a Reddit AMA a year ago, why would they devote resources to two competing editors?

← PreviousPage 3 of 34Next →