LaserToy

Metrics are a must to understand complex systems, as you can’t just comprehend them. Like economy or complex business.

Without understanding, you will be making decisions based on gut feeling, which is ok if you are Jobs, and not ok if you don’t have a magical vision for the product that will be a success.

I think of it as evolution. If you want to rely on luck - don’t track anything, let the natural selection work. If you want to control your destiny, think very hard about what you track and what you do when numbers change.

I saw both negligence of metrics and mindless obsession with useless ones, with the same results - frustration

Can it be used for large and fast changing datasets?

Example: 100 TB, write us every 10 mins.

Or, 1tb, parquet, 40% is rewritten daily.

ASS - acronym’s seriously suck

I don't see it :(

Yes, we do

If you really want to experience early hyper growth, let me know.

I work for CloudKitchens, new startup of Travis Kalanick.

What do you do?

100%

I’m curious whether it can be modified to find global maximum, but avoid McNamara fallacy

I guess the main issue will be the quality of input data

This looks like a good way to pick something everyone will feel good about, but not necessarily the best strategy. Pretty much quantitate way to design by committee

Honestly, ability to build more. Can’t say I’m a big fan of people issues.

I looks like a weird attempt to build a consulting business around a simple idea.

Treat data assets like micro services and pipelines like network. Period.

Prescribing everything else rubs me wrong way.

So, data mesh is: architecture in which data in the company organized in loosely coupled data assets.

Ha, the same happens to managers.

Unless you have a power to remove cheaters, you will have to throw rules at them. At expense of everyone else.

I still hold the line, but do suffer sometimes.

There is a new book about it called: Burn: New Research Blows the Lid Off How We Really Burn Calories, Lose Weight, and Stay Healthy

The only way is to eat less.and to eat less we need to eat less manufactured food designed to be addictive

I needed to sort incoming stream of events by time and after some benchmarking ended up using modified version of a count sort, which had same runtime complexity as radix but was 2 times faster for my use case.

I’m not sure reverse etl is a great name. ETL is direction agnosti

Just curious, does Roblox push engineers to learn internals of critical software they operate or they lean on vendors.

If vendors, it is reckless.

OMG, +1000000

The Hungry Brain: Outsmarting the Instincts That Make Us Overeat by Stephan Guyenet

Gives a good base to understand how we are tricked into consuming much more food that we need

It is due to shortcuts. It is very hard to keep things modular under the pressure when violating is easy.

Micro services make it hard.

And I know the dude. I guess, You never know.

Mmm, I worked at google in 2012 and F1 was in active development.

I’ve never heard of Spanner internally. Maybe it was in development, but it was not in use.

Edit: went and read more. Looks like Spanner existed but didn’t have sql, so it wasn’t what it is today. And looks like I don’t remember things any more.

Spanner didn’t exist in 2012.

Yes, the cycle goes on as we go from one pain to a solution we forgot about, just to learn the old new pain again.

Argo is not good. Heavily relying on k8s, tons of yaml

Given it is hard to understand SQL once jt reaches 100-200 lines, anything that bloats it just pure evil :)

Writing Argo workflows in yaml is a special kind of hell.

I thought Pinot and Druid are direct competitors

We discussed writing a plugin for Trino to support Kubernetes operations. Was more like a fun thought experiment. Looks like someone built it...

I manage data infrastructure. Recently, I found I don’t know how to name What we do as many the names are marketing and embarrassing BuzzWords.

All we need is a database that can do analytical queries (and ideally OLTP) and can scale. We don’t need lakes, ponds, swamps, lake houses, sparks, …

Big Query got it right.

I’m surprised anyone is surprised…

For some reason I don’t relive in the sincerity of those apologies. You have an adult who acted as a*le for a whole life. They were told it multiple times. They saw other people cried.

And now they finally apologizing when s*t hit thr fan. Sure. I’m also wondering whether sociopathy has something to do with this.

The blog post claims multiple incidents, not a single one.